FREE ACCESS
5,000–10,000 jobs/day
See all jobs on Scoutfield
Search thousands of fresh jobs every day.
Discover
- Fresh listings
- Fast filters
- No subscription required
Create a free account and start exploring right away.
Senior Data Architect – Databricks, Azure, FinOps, Operations
Stefanini Brasil. Support the Technical Directorate and the team responsible for operating and maintaining the Databricks environment .
Core Competencies
Role fitCore Competencies
Use this summary to align your resume positioning with the role.
Demonstrates expertise in managing and optimizing Databricks environments, including infrastructure-as-code implementation, cost management, and compliance with security standards. Proficient in Azure services integration and observability practices to ensure platform stability and efficiency.
Highest-signal resume keywords
Databricks Environment ManagementAzure Infrastructure KnowledgeCI/CD ImplementationTerraform ExperienceMonitoring and Observability
ATS Keywords
Tailor your resumeApplicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard Skills
DatabricksAzureTerraformCI/CDVNetPrivate LinkSQL WarehousesDelta LakeMLOpsData Governance
Soft Skills
Strong Communication SkillsTechnical Decision-Making
Tools & Technologies
Azure DevOpsGitHub ActionsAzure MonitorLog AnalyticsGrafanaDatadog
Certifications & Qualifications
Databricks CertificationAzure Certification
Industry Keywords
FinOpsRegulated IndustriesBrazil’s LGPDProduction ML/AI WorkloadsPlatform Engineering
Tech Stack
Tools & technologiesAzureDNSGrafanaITSMSQLTerraformUnityVault
About the role
Key responsibilities & impact- Support the Technical Directorate and the team responsible for operating and maintaining the Databricks environment
- Keep the platform stable, monitored, integrated with internal systems, and financially efficient
- Review and evolve the architecture of workspaces, metastores, Unity Catalog, accounts, and environments
- Define and implement infrastructure-as-code standards
- Design and review networking, including VNet injection, subnets, NSGs, Private Link, DNS, routes, firewalls/NVAs, ExpressRoute, and VPNs
- Define storage, resource groups, subscriptions, tags, and Azure Policy
- Manage identity and access using Entra ID, SCIM, groups, service principals, and RBAC
- Implement platform and workload observability, including metrics, logs, alerts, and dashboards
- Integrate Databricks with ITSM, SIEM, enterprise monitoring, catalogs, and identity systems
- Establish runbooks, SLAs/SLOs, incident management, and root cause analysis processes
- Prepare backup, disaster recovery, and business continuity plans
- Define and implement CI/CD for notebooks, jobs, pipelines, and infrastructure
- Create templates and golden paths for data teams
- Build visibility into costs, budgets, chargeback/showback, and present efficiency insights to managers
- Right-size clusters, SQL Warehouses, and jobs, and identify waste and savings opportunities
- Apply security, audit, compliance, and data governance best practices using Unity Catalog
- Interact frequently with leadership and work closely with the Databricks Solutions Architect responsible for the account
Requirements
What you’ll need- Proven experience in large-scale projects, including the design, implementation, and operation of enterprise-scale Databricks environments in production
- In-depth knowledge of Databricks, including workspaces, Unity Catalog, compute, clusters, pools, SQL Warehouses, serverless, Jobs/Lakeflow, Delta Lake, system tables, and account administration
- Advanced knowledge of Azure applied to Databricks, including VNet, Private Link, DNS, firewalls, ADLS Gen2, resource groups, Entra ID, Azure Policy, and Key Vault
- Hands-on experience with Terraform, Databricks and Azure providers, and CI/CD using Azure DevOps, GitHub Actions, or an equivalent platform
- Experience with monitoring and observability using Azure Monitor, Log Analytics, Grafana, Datadog, or similar tools
- Experience with FinOps and cloud and Databricks cost optimization
- Strong communication skills with technical teams and leadership, including the ability to explain technical decisions and trade-offs to executive audiences
- Fluency in Portuguese and technical English for reading documentation
- Availability to work onsite at the client approximately once a week; negotiable
- Databricks and/or Azure certifications are a plus
- Experience in regulated industries is a plus
- Experience migrating legacy platforms to Databricks is a plus
- Knowledge of advanced security and compliance, including Brazil’s LGPD, is a plus
- Experience with production ML/AI workloads, MLOps, and Model Serving is a plus
- Experience in Platform Engineering and Centers of Excellence is a plus
Benefits
Comp & perks- Meal voucher or food allowance
- Discounts on courses, universities, and language schools
- Stefanini Academy — a platform offering free, up-to-date online courses with certificates
- Mentoring
- Discount club for medical consultations and examinations
- Health insurance
- Dental insurance
- Benefits and discounts at leading establishments
- Travel club
- Pet care partnership
- Hybrid work model
- Employment under Stefanini’s CLT contract