FREE ACCESS
5,000–10,000 jobs/day
See all jobs on Scoutfield
Search thousands of fresh jobs every day.
Discover
- Fresh listings
- Fast filters
- No subscription required
Create a free account and start exploring right away.
Core Competencies
Role fitCore Competencies
Use this summary to align your resume positioning with the role.
Demonstrates expertise in designing and optimizing lakehouse architectures on Databricks, with a strong focus on data governance, scalable data pipelines, and cloud infrastructure management. Proficient in mentoring engineers and communicating complex design trade-offs to diverse stakeholders.
Highest-signal resume keywords
Databricks Architecture DesignPySpark DevelopmentData Governance with Unity CatalogInfrastructure as Code with TerraformCloud Migration Experience
ATS Keywords
Tailor your resumeApplicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard Skills
PythonPySparkSpark SQLScalaSQLCI/CDData ModelingBatch and Streaming PipelinesAutomated TestingData Lake Design
Soft Skills
MentoringCommunicationStakeholder Engagement
Tools & Technologies
DatabricksTerraformAWSAzureGCPGitMLflowOpenAI APIsLangChainVector Databases
Certifications & Qualifications
Databricks CertificationsAWS Solutions Architect
Industry Keywords
Data EngineeringData GovernanceCloud ArchitectureFinanceTelecomPaymentsSaaS
Tech Stack
Tools & technologiesAWSAzureCloudGoogle Cloud PlatformHadoopIoTNoSQLPySparkPythonScalaSparkSQLTerraformUnity
About the role
Key responsibilities & impact- Design and own the end-to-end lakehouse architecture on Databricks using Medallion (bronze/silver/gold) patterns
- Build and optimize scalable batch and streaming pipelines in PySpark, Spark SQL and Python
- Lead platform migrations, such as legacy data warehouse or Hadoop/EMR to Databricks, with measurable cost and runtime gains
- Define data governance including Unity Catalog, fine-grained access control, auditing, lineage and compliance
- Model data for analytics and operations across OLTP/OLAP, dimensional, SQL and NoSQL models
- Set engineering standards for CI/CD, unit and integration tests, code review, reusable Python packages and Databricks Asset Bundles
- Manage infrastructure as code with Terraform and drive FinOps practices to control cloud spend
- Evaluate and prototype AI use cases including LLMs, vector databases, agents and MLflow
- Advise other teams on architecture and mentor junior and mid-level engineers
- Explain design trade-offs to engineers and non-technical stakeholders
Requirements
What you’ll need- Based in Latin America and available to work remotely
- English-fluent; English at C1 level or higher
- 10+ years in data engineering, including 5+ years hands-on with Databricks and Spark in production
- Strong Python and PySpark; working knowledge of Scala and advanced SQL
- Proven record designing data lakes, data warehouses and lakehouses, including at least one large migration led
- Production experience on at least one major cloud: AWS, Azure or GCP
- Hands-on data governance with Unity Catalog, access controls, lineage and auditing
- Solid software engineering practice: Git workflows, automated testing, CI/CD (Azure DevOps, GitHub Actions or similar)
- Infrastructure as code with Terraform
- Ability to explain design trade-offs clearly to engineers and non-technical stakeholders
- Experience mentoring engineers
- Spanish or Portuguese is a plus
- Databricks certifications are a plus
- AWS Solutions Architect or equivalent cloud architecture certification is a plus
- Multi-cloud experience across AWS, Azure and GCP is a plus
- Experience building agentic or RAG solutions with LangChain, LangGraph, MLflow, OpenAI APIs and vector databases is a plus
- Real-time and IoT data processing at high volume is a plus
- Background in finance, telecom, payments or SaaS data domains is a plus
Benefits
Comp & perks- Full-time contract through a payroll platform
- Remote work allocated at the client
- Salary of USD $7,000–$8,800 per month, depending on seniority and skillset
