Job Description
Our team is in need of a Snowflake Data Engineer who is highly competent and can contribute significantly to the design, development, and maintenance of our data infrastructure. You will be accountable for the ingesting, transformation, and distribution of data using AWS and Snowflake technologies in your capacity as a Snowflake Data Engineer.
Key Responsibilities:
- Design, develop, and implement efficient data pipelines using Snowflake and AWS technologies.
- Utilize SnowSQL, Snowpipe, and other relevant tools to ingest and transform data.
- Implement role-based access controls to ensure data security and privacy.
- Leverage ETL/ELT tools like NiFi, Matillion, or DBT to automate data integration and transformation processes.
- Configure and manage AWS resources such as EC2, Lambda, ECS/EKS, DynamoDB, and VPCs to support Snowflake operations.
- Develop and maintain data quality checks and monitoring processes.
- Gain a comprehensive understanding of data requirements and provide actionable insights by collaborating with data analysts, data scientists, and other stakeholders.
- Optimize Snowflake queries and data models for performance and scalability.
- Troubleshoot and resolve data-related issues.
- Stay up-to-date with the latest advancements in Snowflake and AWS technologies.
Required Skills and Experience:
- Strong proficiency in SQL and Python.
- Hands-on experience with Snowflake, including SnowSQL, Snowpipe, and data sharing.
- Experience with AWS services (EC2, Lambda, ECS/EKS, DynamoDB, VPCs).
- Knowledge of ETL/ELT tools (NiFi, Matillion, DBT).
- Understanding the concepts of data warehousing and data lakes.
- Experience with data quality and data profiling techniques.
- Excellent analytical and problem-solving abilities.
- I have excellent communication and collaboration skills.
- Ability to work independently and as part of a team.
Preferred Skills:
- Experience with data virtualization and data federation.
- Knowledge of machine learning and AI concepts.
- Experience with data governance and data security best practices.
If you are a passionate and experienced Snowflake Data Engineer, we encourage you to apply and join our team.