Senior Software Engineer – AWS, Databricks, GenAI

YASH Technologies

. Design, develop, and optimize scalable data pipelines using AWS and Databricks .

Posted 9/21/2026full-timePune • IndiaSeniorWebsite

Core Competencies

Role fit

Core Competencies

Use this summary to align your resume positioning with the role.

Demonstrates expertise in designing and optimizing scalable data pipelines using AWS and Databricks, with a strong focus on data governance, ETL/ELT solutions, and modern Lakehouse architectures. Proficient in implementing AI solutions and collaborating with cross-functional teams to deliver high-performance data solutions.

Highest-signal resume keywords

AWS Data Analytics ServicesDatabricks Delta LakePython ProgrammingETL/ELT SolutionsData Governance

ATS Keywords

Tailor your resume

Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills

PythonPySparkSQLETLELTData ModelingData WarehousingLakehouse ArchitectureData QualityData Lineage

Tools & Technologies

AWSDatabricksDelta LakeIcebergUnity CatalogMLflowSemantic SearchGenAI SolutionsRAG-based ChatbotsAI Agents

Industry Keywords

Data GovernanceMetadata ManagementData SecurityData ObservabilityLake FormationDynamoDBDataZoneRedshiftGlueAthena

Tech Stack

Tools & technologies

Amazon RedshiftAWSDynamoDBETLPySparkPythonSQLUnity

About the role

Key responsibilities & impact

Design, develop, and optimize scalable data pipelines using AWS and Databricks
Build and manage modern Lakehouse architectures leveraging Delta Lake, Iceberg, and Unity Catalog
Implement data governance capabilities including data quality, data lineage, metadata management, and data security
Develop ETL/ELT solutions using Python, PySpark, and SQL
Design and deploy GenAI solutions, including RAG-based chatbots and AI agents
Implement Context Engineering and semantic search frameworks to improve AI outcomes
Collaborate with architects, data scientists, and business stakeholders to deliver enterprise data solutions
Ensure platform scalability, performance, reliability, and cost optimization

Requirements

What you’ll need

5+ years of experience
Experience with AWS data analytics services: S3, Glue, Athena, Redshift, Lake Formation, Lambda, DataZone, DynamoDB
Experience with Databricks: Delta Lake, Iceberg, Unity Catalog, Delta Live Tables (DLT), MLflow, Mosaic AI, Vector Search, Genie Agent, Genie One
Proficiency in Python, PySpark, and SQL
Knowledge of ETL/ELT, data modeling, data warehousing, Lakehouse architecture, and Medallion architecture
Knowledge of data quality, data lineage, metadata management, data cataloging, data observability, and data security
Knowledge of AWS Bedrock, SageMaker, RAG, Context Engineering, Semantic Search, AI Agents, and LLM Orchestration

Benefits

Comp & perks

Flexible work arrangements
Career-oriented skilling models
Continuous learning, unlearning, and relearning
All support needed for realization of business goals
Stable employment
Inclusive team environment
Great atmosphere and ethical corporate culture