FREE ACCESS
5,000–10,000 jobs/day
See all jobs on Scoutfield
Search thousands of fresh jobs every day.
Discover
- Fresh listings
- Fast filters
- No subscription required
Create a free account and start exploring right away.

Senior Data Engineer
Sequoia Connect. Design, develop, and maintain scalable ETL/ELT pipelines for batch and real-time data processing .
Core Competencies
Role fitCore Competencies
Use this summary to align your resume positioning with the role.
Demonstrates expertise in designing and developing scalable ETL/ELT pipelines, optimizing data models, and implementing cloud-native data solutions using Azure technologies. Proficient in API development and real-time data ingestion frameworks, ensuring data quality and compliance across platforms.
Highest-signal resume keywords
SQL ProficiencyPython ProgrammingAzure Data FactoryDatabricks Lakehouse ArchitectureAPI Development
ATS Keywords
Tailor your resumeApplicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard Skills
SQLPythonPySparkPL/SQLJavaScalaDatabricks SparkDelta TablesKafkaHadoop
Soft Skills
ResilienceEmotional IntelligenceAgile Delivery
Tools & Technologies
Azure DatabricksAzure Synapse AnalyticsAzure Event HubsAzure FunctionsDockerKubernetesApache AirflowEvent-Driven Architectures
Certifications & Qualifications
Azure Data Engineer (DP-203)Databricks Certifications
Industry Keywords
ETLELTData GovernanceData SecurityDataOpsCI/CDInfrastructure as CodeReal-Time Analytics
Tech Stack
Tools & technologiesAirflowApacheAzureCloudDockerETLHadoopJavaKafkaKubernetesMicroservicesMySQLOpenShiftOraclePySparkPythonScalaSparkSQL
About the role
Key responsibilities & impact- Design, develop, and maintain scalable ETL/ELT pipelines for batch and real-time data processing
- Build and optimize data models, Delta Tables, and Lakehouse architectures for analytics and reporting
- Develop and integrate RESTful APIs and data services for data exchange across enterprise systems
- Implement real-time and high-frequency data ingestion frameworks using streaming technologies and event-driven architectures
- Design and manage cloud-native data solutions using Azure Data Factory, Azure Databricks, ADLS, Event Hubs, and Synapse Analytics
- Develop and optimize Databricks Spark applications for large-scale data transformation and processing
- Ensure data quality, governance, security, and compliance across data platforms
- Collaborate with data scientists, analysts, application teams, and business stakeholders
- Troubleshoot, monitor, and optimize pipeline performance and data platform reliability
- Support DataOps and CI/CD practices for data pipeline deployment and automation
Requirements
What you’ll need- Strong proficiency in SQL and relational databases such as Oracle, SQL Server, and MySQL
- Strong programming skills in Python, PySpark, PL/SQL, Java, or Scala
- Hands-on experience with Azure Cloud technologies including Azure Data Factory, Azure Databricks, ADLS, Azure Synapse Analytics, Azure Event Hubs, Azure Functions, Azure API Management, and Azure DevOps
- Experience with Databricks Lakehouse architecture, Delta Lake, and Delta Tables
- Expertise in API development, API integration, RESTful services, and microservices architecture
- Experience processing high-volume and high-frequency data with low-latency requirements
- Strong knowledge of real-time data ingestion and streaming technologies such as Kafka, Azure Event Hubs, or Kinesis
- Experience with Spark, Hadoop, and distributed data processing frameworks
- Hands-on experience with OpenShift, Kubernetes, Docker, and containerized deployments
- Experience with workflow orchestration tools such as Apache Airflow and Azure Data Factory
- Understanding of data governance, data security, and compliance best practices
- Resilience, emotional intelligence, and focus on agile delivery
- Deep understanding of the difference between coding and engineering
- Experience with Delta Live Tables (DLT), Auto Loader, and Change Data Capture (CDC) preferred
- Knowledge of DataOps, CI/CD, and Infrastructure as Code (IaC) preferred
- Familiarity with event-driven architectures and real-time analytics platforms preferred
- Azure Data Engineer (DP-203) and Databricks certifications preferred
- Familiarity with cloud-native foundations or AI coding assistants preferred
- Advanced oral English required for seamless collaboration with global teams
- Advanced Spanish required
Benefits
Comp & perks- Flexible work arrangement supporting lifestyle
- Remote work option depending on specific project needs
- Global career opportunities
- Exposure to high-impact digital transformation projects
- Collaboration with global teams
- Professional growth through world-class, high-impact projects