Job Summary:
We are seeking a highly skilled and experienced Azure Data Engineer to join our growing data team. In this senior role, you will be responsible for designing, developing, and implementing data solutions on the Microsoft Azure platform. You will play a critical role in building and maintaining robust, scalable, and high-performance data pipelines and data warehouses.
Key Responsibilities:
- Design, develop, and deploy data pipelines using Azure Data Factory, Azure Databricks, and other Azure data services.
- Develop and maintain data warehouses and data lakes on Azure.
- Perform data analysis, data integration, and data transformation tasks.
- Implement data quality checks and data governance policies.
- Optimize data pipelines for performance, scalability, and cost-effectiveness.
- Troubleshoot and resolve data-related issues.
- Mentor junior data engineers and provide technical guidance.
- Stay abreast of the latest advancements in Azure data technologies.
- Collaborate effectively with data scientists, data analysts, and business stakeholders.
Required Skills and Experience:
- Bachelor’s degree in Computer Science, Computer Engineering, or a related field.
- 5+ years of professional experience as a Data Engineer or in a related role.
- Strong proficiency in Azure data services, including Azure Data Factory, Azure Databricks, Azure Synapse Analytics, Azure Cosmos DB.
- Experience with data processing frameworks like Spark, PySpark.
- Experience with data warehousing and data lake architectures.
- Strong SQL and scripting skills (Python, Scala).
- Experience with cloud computing concepts and best practices.
- Excellent problem-solving and analytical skills.
- Strong communication and interpersonal skills.
- Ability to lead and mentor junior team members.
Desired Skills and Experience:
- Experience with Azure DevOps and CI/CD pipelines.
- Experience with data security and privacy best practices.
- Experience with data visualization tools (e.g., Power BI).
- Certifications in Azure data technologies.
- Contributions to open-source projects.
Benefits:
- Competitive salary and benefits package.
- Opportunities for professional growth and development.
- Work in a challenging and rewarding environment.
- Collaborative and supportive team culture.
To Apply:
Please submit your resume and cover letter to ekta@digitalxnode.com