Data Engineer
✨ AI Summary
Join Growe as a Data Engineer, where you'll play a crucial role in designing, developing, and maintaining efficient data pipelines. Your responsibilities will include utilizing Airflow to create scalable data workflows, optimizing tables in Athena for enhanced query performance, and managing SQL transformations in DBT to build reusable models. You will also focus on automating infrastructure with Terraform and ensuring data integrity through effective monitoring and validation.
Main Responsibilities:
- Design and maintain data pipelines using Airflow.
- Optimize table structures in Athena for performance and cost.
- Write and manage SQL transformations in DBT.
- Streamline data workflows for reliability and efficiency.
- Automate provisioning of data processing infrastructure with Terraform.
- Monitor data integrity and handle errors effectively.
- Collaborate with analytics and engineering teams to meet data needs.
- Troubleshoot and resolve data pipeline issues promptly.
Requirements:
- Minimum of 1 year experience in data engineering, particularly with ELT processes.
- Proficient in Python, SQL, and data modeling.
- Experience in workflow orchestration using Airflow.
- Familiarity with DBT for data transformations.
- Understanding of AWS S3, Athena, and data lake architectures.
- Knowledge of Terraform is a plus.
Personal Attributes:
- Strong analytical and problem-solving skills.
- Detail-oriented with a focus on accuracy.
If you resonate with our values of teamwork, results-driven approach, and adaptability, we encourage you to apply!
