FREE ACCESS
5,000–10,000 jobs/day
See all jobs on Scoutfield
Search thousands of fresh jobs every day.
Discover
- Fresh listings
- Fast filters
- No subscription required
Create a free account and start exploring right away.
Core Competencies
Role fitCore Competencies
Use this summary to align your resume positioning with the role.
Demonstrates expertise in designing and implementing scalable data architectures, optimizing data pipelines, and ensuring data quality and governance. Proficient in leading technical initiatives, mentoring engineers, and collaborating with stakeholders to translate business needs into effective data solutions.
Highest-signal resume keywords
Data ArchitectureETL ProcessesPython ProgrammingBig Data TechnologiesData Governance
ATS Keywords
Tailor your resumeApplicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard Skills
Data EngineeringDatabase ManagementSQLData Pipeline DevelopmentData Integration SolutionsNoSQL TechnologiesAI ToolsData Quality StandardsMonitoring PracticesCloud Data Services
Soft Skills
Problem-SolvingDecision-MakingCommunicationMentoringCollaboration
Tools & Technologies
AirflowDatabricksJenkinsSparkKafkaHadoopAWSAzureGCPAWS Redshift
Certifications & Qualifications
Databricks Certification
Industry Keywords
AgileScrumLeanKanbanData QualityObservability Frameworks
Tech Stack
Tools & technologiesAirflowAmazon RedshiftAWSAzureCloudETLGoogle Cloud PlatformHadoopJavaJenkinsKafkaNoSQLPySparkPythonScalaSparkSQL
About the role
Key responsibilities & impact- Design and implement scalable, efficient, and reliable data architectures
- Build and maintain data pipelines, ETL processes, and integration solutions for large volumes of structured and unstructured data
- Optimize data pipelines, databases, data warehouses, and data lakes for performance, reliability, scalability, and security
- Partner with stakeholders to understand data requirements and translate business needs into data models and solutions
- Establish and improve data quality standards, validation rules, documentation, and governance practices
- Implement monitoring and observability practices
- Provide technical leadership on architecture, scalability, reliability, monitoring, integration, and extensibility
- Lead and contribute to code reviews
- Mentor junior engineers
- Own production issues, including troubleshooting, root-cause analysis, escalation, and long-term resolution
- Independently lead multiple features and projects, coordinate work across engineers, and keep stakeholders informed
- Evolve engineering tools, platforms, and practices
- Use AI tools to improve engineering productivity, analysis, documentation, and problem-solving
Requirements
What you’ll need- 8+ years of experience in data engineering, with strong experience in data architecture, ETL, and database management
- Strong programming skills in Python or PySpark, plus experience with Java or Scala
- Experience building complex end-to-end data pipelines and data integration solutions
- Strong knowledge of SQL and experience with relational and NoSQL database technologies
- Experience with big data technologies such as Spark, Kafka, Hadoop, or similar platforms
- Experience with orchestration and scheduling tools such as Airflow, Databricks, Jenkins, or similar technologies
- Experience designing and operating scalable, reliable, and secure data systems
- Familiarity with cloud platforms such as AWS, Azure, or GCP and associated data services
- Experience working in Agile environments such as Scrum, Lean, or Kanban
- Strong problem-solving and decision-making skills
- Experience mentoring junior engineers and contributing to technical leadership within a team
- Strong written and verbal communication skills with the ability to work effectively across technical and non-technical teams
- Openness to experimenting with AI tools and willingness to learn
- Bachelor's or Master's degree in Computer Science, Data Science, or a related field (nice to have)
- Databricks experience or certification (nice to have)
- Experience with AWS Redshift, S3, Azure SQL Data Warehouse, or comparable cloud data services (nice to have)
- Experience implementing data governance, data quality, or observability frameworks (nice to have)
- Experience leading cross-functional or multi-month engineering initiatives (nice to have)
- Experience using AI-assisted engineering tools (nice to have)
Benefits
Comp & perks- Competitive compensation and benefits package designed to support physical, financial, and professional well-being
- Medical Insurance
- Savings Fund
- Life Insurance
- Internet and Electricity Allowance
- Paid time off such as vacation and parental leave