FREE ACCESS
5,000–10,000 jobs/day
See all jobs on Scoutfield
Search thousands of fresh jobs every day.
Discover
- Fresh listings
- Fast filters
- No subscription required
Create a free account and start exploring right away.
Senior Software Engineer – AWS, Databricks, GenAI
YASH Technologies. Design, develop, and optimize scalable data pipelines using AWS and Databricks .
Core Competencies
Role fitCore Competencies
Use this summary to align your resume positioning with the role.
Demonstrates expertise in designing and optimizing scalable data pipelines using AWS and Databricks, with a strong focus on data governance, ETL/ELT solutions, and modern Lakehouse architectures. Proficient in implementing advanced AI solutions and collaborating with cross-functional teams to deliver enterprise data solutions.
Highest-signal resume keywords
AWS Data Pipeline DevelopmentDatabricks Lakehouse ArchitecturePython ProgrammingData Governance ImplementationETL/ELT Solutions
ATS Keywords
Tailor your resumeApplicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard Skills
Data Pipeline OptimizationETL/ELT DevelopmentData ModelingData WarehousingPythonPySparkSQLData Quality ManagementMetadata ManagementData Security
Tools & Technologies
AWS S3AWS GlueAWS RedshiftAWS LambdaDatabricks Delta LakeDelta Live TablesMLflowMosaic AIVector SearchGenie Agent
Industry Keywords
Lakehouse ArchitectureMedallion ArchitectureData GovernanceContext EngineeringSemantic SearchAI AgentsRAGLLM Orchestration
Tech Stack
Tools & technologiesAmazon RedshiftAWSDynamoDBETLPySparkPythonSQLUnity
About the role
Key responsibilities & impact- Design, develop, and optimize scalable data pipelines using AWS and Databricks
- Build and manage modern Lakehouse architectures using Delta Lake, Iceberg, and Unity Catalog
- Implement data governance capabilities including data quality, data lineage, metadata management, and data security
- Develop ETL/ELT solutions using Python, PySpark, and SQL
- Design and deploy GenAI solutions, including RAG-based chatbots and AI agents
- Implement Context Engineering and semantic search frameworks to improve AI outcomes
- Collaborate with architects, data scientists, and business stakeholders to deliver enterprise data solutions
- Ensure platform scalability, performance, reliability, and cost optimization
Requirements
What you’ll need- 5+ years of experience
- Experience designing, developing, and optimizing scalable data pipelines using AWS and Databricks
- Experience with Lakehouse architectures leveraging Delta Lake, Iceberg, and Unity Catalog
- Knowledge of data quality, data lineage, metadata management, data security, and data governance
- Proficiency in Python, PySpark, and SQL
- Experience with ETL/ELT, data modeling, data warehousing, Lakehouse Architecture, and Medallion Architecture
- Experience with AWS services including S3, Glue, Athena, Redshift, Lake Formation, Lambda, DataZone, and DynamoDB
- Experience with Databricks technologies including Delta Lake, Iceberg, Unity Catalog, Delta Live Tables, MLflow, Mosaic AI, Vector Search, Genie Agent, and Genie One
- Experience with AWS Bedrock, SageMaker, RAG, Context Engineering, Semantic Search, AI Agents, and LLM Orchestration
Benefits
Comp & perks- Flexible work arrangements
- Inclusive team environment
- Career-oriented skilling models
- Continuous learning, unlearning, and relearning opportunities
- Agile self-determination, trust, transparency, and open collaboration
- Support needed for realization of business goals
- Stable employment
- Great atmosphere and ethical corporate culture