Location: Pune, Bangalore
Job Description
We are seeking a skilled Azure Data Engineer to join our team and contribute to the development, implementation, and management of data solutions on the Azure platform. As an Azure Data Engineer, you will play a pivotal role in designing and building data pipelines, data transformation processes, and data visualization solutions.
Your expertise in Azure services, data processing, and visualization tools will be essential in supporting our data analytics, AI, and machine learning projects. This role offers the opportunity to collaborate on diverse projects and work with cross-functional teams.
Responsibilities
- Design and implement data pipelines using Azure Data Factory (ADF), Databricks, and PySpark.
- Develop ETL processes for data ingestion, transformation, and loading.
- Set up and manage data lakes and storage solutions on Azure.
- Design and manage databases using Azure Synapse Analytics, SQL Database, or other relevant services.
- Collaborate with data scientists, analysts, and stakeholders to understand data requirements.
- Create and maintain data visualization solutions using Power BI or similar tools.
- Optimize data pipelines for performance, scalability, and reliability.
- Implement data security measures and adhere to data governance standards.
- Monitor and troubleshoot data pipeline and processing issues.
- Stay updated with Azure services, data engineering best practices, and emerging technologies.
Qualifications
- Bachelor’s degree in Computer Science, Information Technology, or a related field. Master’s degree is a plus.
- 2 to 5 years of experience as a Data Engineer or similar role.
- Strong expertise in Azure services, including ADF, Databricks, Synapse Analytics, etc.
- Proficiency in PySpark for data processing and transformation.
- Experience with ETL processes and data integration using Azure Data Factory.
- Knowledge of SQL and database design principles.
- Familiarity with data visualization tools such as Power BI.
- Strong problem-solving and troubleshooting skills.
- Excellent communication and collaboration abilities.
- Azure certifications (e.g., Azure Data Engineer Associate) are a plus.
- Experience working in BFSI domain is a plus.
Perks and Benefits
- Competitive salary and performance-based incentives.
- Opportunity to work with cutting-edge data technologies and projects.
- Exposure to diverse industries and cross-functional teams.
- Professional development opportunities and training.
- Collaborative and inclusive work environment.
- Health and wellness programs.
- Hybrid working model, offering flexibility between remote and in-office work.
