Software Engineer – Azure Databricks

YASH Technologies

. Design, develop, and maintain scalable data pipelines using Azure services .

Posted 10/9/2026full-timeHyderabad • IndiaMid-LevelSeniorWebsite

Core Competencies

Role fit

Core Competencies

Use this summary to align your resume positioning with the role.

Demonstrates expertise in designing and maintaining scalable data pipelines using Azure services, with a strong focus on ETL/ELT workflows, data governance, and AI/ML integration. Proficient in optimizing data platform performance and implementing CI/CD practices in cloud environments.

Highest-signal resume keywords

Azure Data FactoryAzure DatabricksAzure Synapse AnalyticsPythonSQL

ATS Keywords

Tailor your resume

Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills

Data EngineeringETL/ELT WorkflowsData LakeData Warehouse SolutionsData GovernanceData QualityCloud ArchitecturePerformance OptimizationAgile DevelopmentAutomation

Soft Skills

CollaborationTroubleshooting

Tools & Technologies

Azure AI ServicesAzure OpenAIAzure Machine LearningCognitive ServicesAzure DevOpsInfrastructure as Code (IaC)

Certifications & Qualifications

Microsoft Azure DP-203Microsoft Azure AI-102Microsoft Azure AZ-305

Industry Keywords

Data PipelinesData ModelsLarge-Scale DatasetsGenerative AI SolutionsRetrieval-Augmented Generation (RAG)Vector DatabasesSemantic Search

Tech Stack

Tools & technologies

AzureCloudETLPythonSparkSQL

About the role

Key responsibilities & impact

Design, develop, and maintain scalable data pipelines using Azure services
Build and optimize ETL/ELT workflows for structured and unstructured data
Implement data ingestion solutions using Azure Data Factory, Azure Databricks, and Azure Synapse Analytics
Develop and manage data lakes and data warehouse solutions on Azure
Integrate Azure AI Services, Azure OpenAI, Azure Machine Learning, and Cognitive Services into enterprise applications
Create and maintain data models, transformations, and processing frameworks
Implement data governance, data quality, security, and compliance controls
Monitor and optimize data platform performance, scalability, and cost
Collaborate with Data Scientists, AI Engineers, Business Analysts, and Application Development teams
Develop reusable frameworks and automation for data orchestration and deployment
Support CI/CD implementation using Azure DevOps and Infrastructure as Code (IaC)
Troubleshoot data-related issues and provide production support

Requirements

What you’ll need

Bachelor's or Master's degree in Computer Science, Information Technology, Data Science, or related field
3 to 6 years of experience in Data Engineering and Azure Cloud technologies
Strong experience with Azure Data Factory, Databricks, Synapse Analytics, and Data Lake
Experience working with large-scale structured and semi-structured datasets
Knowledge of AI/ML integration and Generative AI solutions on Azure
Hands-on experience with Python, SQL, and Spark
Strong understanding of cloud architecture, security, and performance optimization
Experience with Agile development methodologies
Preferred: Microsoft Azure certifications DP-203, AI-102, or AZ-305
Preferred: Experience with Microsoft Fabric
Preferred: Experience in Retrieval-Augmented Generation (RAG) architectures
Preferred: Knowledge of Vector Databases and Semantic Search
Preferred: Experience integrating Azure OpenAI with enterprise applications

Benefits

Comp & perks

Flexible work arrangements
Inclusive team environment
Career-oriented skilling models
Continuous learning, unlearning, and relearning opportunities
Stable employment
Great atmosphere and ethical corporate culture
Support needed for realization of business goals