Senior Software Engineer, Python

YASH Technologies

. Design, develop, and maintain scalable data pipelines using PySpark and SQL within Microsoft Fabric .

Posted 9/30/2026full-timePune • IndiaSeniorWebsite

Core Competencies

Role fit

Core Competencies

Use this summary to align your resume positioning with the role.

Demonstrates expertise in designing and maintaining scalable data pipelines using PySpark and SQL within Microsoft Fabric, with a strong focus on data migration, ETL/ELT processes, and ensuring data quality and integrity. Proficient in collaborating with stakeholders to define data models and optimize workflows for performance and cost efficiency.

Highest-signal resume keywords

Data EngineeringPySparkSQLMicrosoft FabricETL/ELT Frameworks

ATS Keywords

Tailor your resume

Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills

Data Pipeline DesignData MigrationData WarehousingBig Data ArchitectureCI/CD PracticesAutomation FrameworksAI/ML IntegrationRoot Cause AnalysisPerformance OptimizationVersion Control (Git)

Soft Skills

Strong Communication Skills

Tools & Technologies

Microsoft FabricAzure Data LakeAzure MonitorLog AnalyticsPython NotebookData FactoryData WarehouseSynapse

Tech Stack

Tools & technologies

AzureETLPySparkPythonSQL

About the role

Key responsibilities & impact

Design, develop, and maintain scalable data pipelines using PySpark and SQL within Microsoft Fabric
Migrate data from legacy systems, including Azure Data Lake and on-premises sources, into Fabric Lakehouse
Build ingestion and transformation frameworks for structured and unstructured datasets
Collaborate with data analysts and business stakeholders to define data models supporting reporting and analytics
Ensure data quality, integrity, and consistency across datasets
Optimize workflows for performance, scalability, and cost efficiency in Fabric and Azure environments
Establish monitoring and alerting frameworks for production data-pipeline reliability
Automate ETL/ELT processes, testing, and operational tasks
Explore and integrate AI capabilities within Fabric for intelligent data processing and advanced analytics
Monitor and troubleshoot production data issues and perform root cause analysis
Document technical processes, system designs, and operational procedures

Requirements

What you’ll need

4–7 years of experience
4+ years of experience as a Data Engineer or similar role
Hands-on experience with Python Notebook, PySpark, and SQL for large-scale data processing
Strong knowledge of Microsoft Fabric components: Lakehouse, Data Factory, and Warehouse
Strong knowledge of Azure and Synapse ecosystem
Experience in data migration projects and building ETL/ELT frameworks
Solid understanding of data warehousing concepts and big data architecture
Knowledge of CI/CD practices
Familiarity with monitoring tools such as Azure Monitor and Log Analytics
Familiarity with automation frameworks
Exposure to AI/ML concepts and ability to integrate them into data workflows
Experience with version control systems such as Git
Strong communication skills for cross-functional collaboration

Benefits

Comp & perks

Flexible work arrangements
Inclusive team environment
Career-oriented skilling models
Continuous learning, unlearning, and relearning
Stable employment
Great atmosphere and ethical corporate culture
Support needed for realization of business goals
Open collaboration and transparent workplace culture