FREE ACCESS
5,000–10,000 jobs/day
See all jobs on Scoutfield
Search thousands of fresh jobs every day.
Discover
- Fresh listings
- Fast filters
- No subscription required
Create a free account and start exploring right away.
Data Engineer
iClassPro - Class Management Software. Design, build, and maintain ETL/ELT data pipelines in Python, orchestrated with Apache Airflow .
Tech Stack
Tools & technologiesAirflowAmazon RedshiftApacheAWSCloudETLPandasPythonSQLTerraform
About the role
Key responsibilities & impact- Design, build, and maintain ETL/ELT data pipelines in Python, orchestrated with Apache Airflow
- Write and maintain dbt transformation models for clean, documented reporting and analytics datasets
- Author and maintain dbt tests to validate data quality
- Build and manage ingestion and processing jobs in AWS Glue
- Query data through Amazon Athena
- Help manage and optimize the Amazon Redshift warehouse for query performance and cost efficiency
- Deploy and manage cloud resources with Terraform
- Monitor pipeline health, troubleshoot data issues, and build alerting
- Participate in code reviews
- Write documentation and contribute to data governance standards
Requirements
What you’ll need- Strong Python skills, including data manipulation libraries like pandas
- Advanced SQL, including window functions and CTEs
- Hands-on experience with core AWS services: Redshift, MWAA, Athena, Glue, and Lambda
- Bachelor's degree in computer science, engineering, or a related quantitative field, or equivalent practical experience
- AWS certification preferred
- Must be authorized to work for any employer in the U.S.
- Will not participate in STEM OPT programs or sponsor or take over sponsorship of an employment visa
- Must complete the Culture Index Survey during the application process
Benefits
Comp & perks- Highly competitive compensation package
- Robust PTO - 27 total paid days off in the first year!
- Comprehensive health benefits including employee fully paid medical premiums
- Generous 401(k) contribution - Better than a match! We contribute even if you are not able.
- Fun company events that connect our team
- Career growth opportunities in a thriving, purpose-driven company