Location: Pune, Bangalore
Job Description
We are seeking a skilled and experienced Data Engineer to join our dynamic team. As a Data Engineer, you will play a crucial role in designing, implementing, and maintaining the data architecture that supports our data analytics, AI, and machine learning initiatives.
We are seeking a skilled and experienced Data Engineer to join our dynamic team. As a Data Engineer, you will play a crucial role in designing, implementing, and maintaining the data architecture that supports our data analytics, AI, and machine learning initiatives. Your expertise in PySpark and SQL will be essential in ensuring the efficient flow of data from various sources to our data warehouses, enabling seamless data transformation and analysis. This is an excellent opportunity to work in a cutting-edge environment, contributing to both consulting projects and product development.
Responsibilities
- Collaborate with cross-functional teams to understand data requirements and design data pipelines that support business objectives.
- Develop and maintain ETL processes using PySpark to extract, transform, and load data from diverse sources into data warehouses.
- Optimize data pipelines for performance, scalability, and reliability.
- Write complex SQL queries for data transformation, aggregation, and analysis.
- Work closely with Data Scientists and Analysts to ensure data availability and quality for advanced analytics and machine learning purposes.
- Monitor and troubleshoot data pipeline issues, identifying and resolving bottlenecks or inconsistencies.
- Contribute to data governance and data management practices, ensuring compliance with relevant regulations and standards.
- Stay updated with industry trends and emerging technologies in data engineering and analytics.
Qualifications
- Bachelor’s degree in Computer Science, Engineering, or a related field. Master’s degree is a plus.
- 2 to 5 years of hands-on experience in data engineering roles.
- Strong proficiency in PySpark and SQL is essential.
- Solid understanding of ETL processes and data integration techniques.
- Experience with data warehousing concepts and technologies.
- Familiarity with cloud platforms (e.g., AWS, Azure, GCP) and data storage solutions.
- Knowledge of data governance principles and practices.
- Excellent problem-solving skills and attention to detail.
- Strong communication and collaboration abilities.
- Ability to adapt to a fast-paced, collaborative, and innovative work environment.
- Experience working in BFSI domain is a plus.
Perks and Benefits
- Competitive salary and performance-based incentives.
- Hybrid working model, allowing a flexible balance between remote and in-office work.
- Exposure to a wide range of projects across various industries.
- Opportunities for continuous learning and professional growth.
- Collaborative and inclusive work culture.
- Health and wellness programs.
- Support for refining technical skills and staying updated with emerging trends.