Lead Data Engineer, CICD, AI

Enable Data

. Modify source code for architectural considerations, including authentication changes and Databricks X-forwarded headers while using Apps.

Posted 9/18/2026full-timeRemote • IndiaSeniorWebsite

Core Competencies

Role fit

Core Competencies

Use this summary to align your resume positioning with the role.

Demonstrates expertise in designing and building data ingestion pipelines using Databricks, PySpark, and PySQL, while ensuring security and compliance through proper configuration and documentation. Proficient in CI/CD pipeline automation and full-stack troubleshooting, with a focus on collaboration and agile delivery.

Highest-signal resume keywords

Databricks Data-Ingestion Pipeline DevelopmentPySpark and PySQL ProficiencyCI/CD Pipeline AutomationAzure Resource ConfigurationFull-Stack Troubleshooting

ATS Keywords

Tailor your resume

Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills

DatabricksPySparkPySQLCI/CDFastAPIReactVisual Studio CodeTDDFDDAPI Development

Soft Skills

CollaborationCommunicationProblem-SolvingStakeholder EngagementAgile Delivery

Tools & Technologies

AzureDatabricks Unity CatalogADOSnykGenieClaude ModelsMachine LearningFoundation ModelsTeamsWebhooks

Industry Keywords

Cloud ArchitectureSecurity ComplianceData EngineeringApplication DeploymentTechnical Documentation

Tech Stack

Tools & technologies

AzureCloudPySparkReactUnity

About the role

Key responsibilities & impact

Modify source code for architectural considerations, including authentication changes and Databricks X-forwarded headers while using Apps.
Participate in technical reviews for configuring Azure resources for application deployment.
Prepare technical and network architecture documentation for cloud and security team reviews and approvals.
Design and build Databricks data-ingestion pipelines from sources such as SAP and website scraping using PySpark and PySQL.
Perform scenario-based and edge-case testing; collaborate with stakeholders to finalize code changes and acceptance criteria.
Configure and use Databricks Unity Catalog permissions, OBO tokens, and service principals for Databricks Agents, Genie Spaces, Machine Learning, and Foundation Models.
Build and deploy Databricks Apps using Visual Studio Code.
Send custom Databricks notifications through APIs to custom Teams channel webhooks.
Build minimal SPA chat interfaces using FastAPI, React, and Claude models/APIs.
Apply system prompts, user prompts, prompt engineering, token economics, rule enforcement, Claude Vision API, NLP, RAG, AI safety guardrails, and caching mechanisms.
Work with Claude Code and Genie.
Troubleshoot full-stack frontend, backend, middleware, data-layer, and routing issues.
Correct and rewrite code related to security findings.
Document code using TDD, FDD, DFD, and SD techniques.
Create and automate CI/CD deployment pipelines for Teams bots, web applications, and Databricks bundles/notebooks through ADO.
Add validation steps such as Snyk scans and linting.
Configure environments through CI/CD pipelines.
Collaborate with toxicologists and client project managers from short requirement descriptions.
Deliver work as an individual contributor in short sprint cycles.

Requirements

What you’ll need

Please share your resume to Careers.Apply@enabledata.com for a quick response.
Share total years of experience.
Share relevant years of experience.
Share current CTC.
Share expected CTC.
Only immediate joiners.