Location: Pune, Bangalore

Job Description

We are looking for a skilled AWS Data Engineer to join our team and contribute to the design, development, and management of data solutions on the AWS platform. As an AWS Data Engineer, you will play a vital role in architecting and implementing data pipelines, data transformation processes, and data visualization solutions.

Your expertise in AWS services, data processing, and visualization tools will be crucial in supporting our data analytics, AI, and machine learning initiatives. This role offers the opportunity to work on diverse projects and collaborate with cross-functional teams.

Responsibilities

  • Design and implement data pipelines using AWS Glue, Apache Spark, and PySpark.
  • Set up and manage data lakes and data storage solutions on AWS.
  • Develop ETL processes for data ingestion, transformation, and loading.
  • Implement and optimize data transformation logic using PySpark.
  • Design and manage databases using AWS Redshift, Aurora, or other relevant services.
  • Collaborate with data scientists, analysts, and stakeholders to define data requirements.
  • Create and maintain data visualization solutions using tools such as Tableau, Power BI, or similar.
  • Optimize data pipelines for performance, scalability, and reliability.
  • Implement data security measures and ensure compliance with data governance standards.
  • Monitor and troubleshoot data pipeline and processing issues.
  • Stay updated with AWS services, data engineering best practices, and emerging technologies.

Qualifications

  • Bachelor’s degree in Computer Science, Information Technology, or a related field. Master’s degree is a plus.
  • 2 to 5 years of experience as a Data Engineer or in a similar role.
  • Strong expertise in AWS services, including Glue, Redshift, S3, Lambda, etc.
  • Proficiency in PySpark for data processing and transformation.
  • Experience with ETL processes and data integration using AWS Glue or similar tools.
  • Knowledge of SQL and database design principles.
  • Familiarity with data visualization tools such as Tableau, Power BI, etc.
  • Strong problem-solving and troubleshooting skills.
  • Excellent communication and collaboration abilities.
  • AWS certifications (e.g., AWS Certified Data Analytics) are a plus.
  • Experience working in BFSI domain is a plus.

Perks and Benefits

  • Competitive salary and performance-based incentives.
  • Opportunity to work with cutting-edge data technologies and projects.
  • Exposure to diverse industries and cross-functional teams.
  • Professional development opportunities and training.
  • Collaborative and inclusive work environment.
  • Health and wellness programs.
  • Hybrid working model, offering flexibility between remote and in-office work.