*Job Title: AWS Data Engineer*
Location: Hyderabad
Position Overview:
As an AWS Data Engineer, you will be responsible for designing, implementing, and maintaining scalable data pipelines and integration solutions utilizing various AWS services. The ideal candidate will have extensive experience with AWS Spark, Redshift, S3, and other related technologies, along with a strong understanding of data engineering principles and best practices.
Key Responsibilities:
– Design, develop, and deploy data pipelines using AWS Spark and Spark Streaming for both batch and near-real-time processing.
– Build and optimize data warehouse solutions on AWS Redshift, ensuring high performance and scalability.
– Implement data storage and retrieval mechanisms using AWS S3, ensuring data integrity and security.
– Utilize AWS DMS (Data Migration Service) for data replication tasks, where applicable.
– Leverage AWS Step Functions, Airflow, or similar tools for orchestrating complex data workflows.
– Develop and maintain ETL processes using AWS Glue or similar frameworks.
– Collaborate with stakeholders to understand project requirements and translate them into scalable and efficient data integration solutions.
– Monitor and optimize data pipelines for performance, reliability, and cost-effectiveness.
– Stay current with AWS data and analytics offerings and recommend new technologies and approaches to enhance data engineering capabilities.
Qualifications:
– Bachelor’s degree in Computer Science, Engineering, or related field.
– 5+ years of experience in data engineering roles, with a focus on AWS technologies.
– Proficiency in AWS Spark, Redshift, S3, and other relevant AWS services.
– Experience with AWS DMS for data replication is a plus.
– Familiarity with workflow orchestration tools such as AWS Step Functions or Airflow.
– Strong understanding of data warehousing concepts and best practices.
– Experience with AWS Glue or similar ETL frameworks is preferred.
– Excellent problem-solving skills and attention to detail.
– Ability to effectively communicate technical concepts to non-technical stakeholders.
– Proven track record of delivering high-quality solutions in a fast-paced environment.
Benefits:
– Competitive salary and benefits package
– Opportunity to work with cutting-edge technologies and industry experts
– Flexible work environment with remote work options
– Career growth and development opportunities
Job opening in IT Company for Calling Profile. Fixed Salary and Attractive Incentive. yearly Increment and surprises Scheme for extra...
Apply For This JobJob Profile- Network Administrator Required Experience- 1 Year to 3 Year JOB BRIEF: We are looking for a Network Administrator...
Apply For This JobInterpret software license agreements and identify rules, obligations, and product metrics to ensure compliance with software license Understand general software...
Apply For This JobLooking for New opportunities in Large Drives Applications business of Siemens Ltd.? We have got you covered. We are looking...
Apply For This JobDepartment: Technical Support Location: Hyderabad, Andhra Pradesh Position Summary This position provides responsive Technical Support to customers in solving product...
Apply For This JobJob Title: RA – AIC – IT & SA – Assistant Manager – ITGC Non FS Job requisition ID ::...
Apply For This Job