Senior Software Engineer – Azure Databricks

YASH Technologies

. Design, develop, and maintain scalable data pipelines using Azure services .

Posted 10/8/2026full-timeHyderabad • IndiaSeniorWebsite

Core Competencies

Role fit

Core Competencies

Use this summary to align your resume positioning with the role.

Demonstrates expertise in designing and maintaining scalable data pipelines using Azure services, with a strong focus on ETL/ELT workflows, data governance, and performance optimization. Proficient in integrating AI/ML solutions and managing data lakes and warehouses on Azure.

Highest-signal resume keywords

Azure Data FactoryAzure DatabricksAzure Synapse AnalyticsPythonSQL

ATS Keywords

Tailor your resume

Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills

Data EngineeringETL WorkflowsData Ingestion SolutionsData Lake ManagementData Warehouse SolutionsData GovernanceData QualityCloud ArchitecturePerformance OptimizationAgile Development

Soft Skills

CollaborationTroubleshootingProduction Support

Tools & Technologies

Azure AI ServicesAzure OpenAIAzure Machine LearningCognitive ServicesAzure DevOpsInfrastructure as Code

Certifications & Qualifications

Microsoft Azure DP-203Microsoft Azure AI-102Microsoft Azure AZ-305

Industry Keywords

Generative AIRetrieval-Augmented GenerationVector DatabasesSemantic Search

Tech Stack

Tools & technologies

AzureCloudETLPythonSparkSQL

About the role

Key responsibilities & impact

Design, develop, and maintain scalable data pipelines using Azure services
Build and optimize ETL/ELT workflows for structured and unstructured data
Implement data ingestion solutions using Azure Data Factory, Azure Databricks, and Azure Synapse Analytics
Develop and manage data lakes and data warehouse solutions on Azure
Integrate Azure AI Services, Azure OpenAI, Azure Machine Learning, and Cognitive Services into enterprise applications
Create and maintain data models, transformations, and processing frameworks
Implement data governance, data quality, security, and compliance controls
Monitor and optimize data platform performance, scalability, and cost
Collaborate with Data Scientists, AI Engineers, Business Analysts, and Application Development teams
Develop reusable frameworks and automation for data orchestration and deployment
Support CI/CD implementation using Azure DevOps and Infrastructure as Code
Troubleshoot data-related issues and provide production support

Requirements

What you’ll need

3 to 6 years of experience in Data Engineering and Azure Cloud technologies
Bachelor's or Master's degree in Computer Science, Information Technology, Data Science, or related field
Strong experience with Azure Data Factory, Databricks, Synapse Analytics, and Data Lake
Experience working with large-scale structured and semi-structured datasets
Knowledge of AI/ML integration and Generative AI solutions on Azure
Hands-on experience with Python, SQL, and Spark
Strong understanding of cloud architecture, security, and performance optimization
Experience with Agile development methodologies
Preferred: Microsoft Azure certifications DP-203, AI-102, or AZ-305
Preferred: Experience with Microsoft Fabric
Preferred: Experience in Retrieval-Augmented Generation (RAG) architectures
Preferred: Knowledge of Vector Databases and Semantic Search
Preferred: Experience integrating Azure OpenAI with enterprise applications

Benefits

Comp & perks

Flexible work arrangements
Inclusive team environment
Career-oriented skilling models
Continuous learning, unlearning, and relearning
Stable employment
Great atmosphere and ethical corporate culture
All support needed for realization of business goals
Agile self-determination, trust, transparency, and open collaboration
Free spirit and emotional positivity