FREE ACCESS
5,000–10,000 jobs/day
See all jobs on Scoutfield
Search thousands of fresh jobs every day.
Discover
- Fresh listings
- Fast filters
- No subscription required
Create a free account and start exploring right away.
Senior Data Platform Engineer
SS&C Technologies. Build, scale, and operate the enterprise data platform .
Core Competencies
Role fitCore Competencies
Use this summary to align your resume positioning with the role.
Demonstrates extensive experience in building and operating large-scale data platforms, with a strong focus on Apache Airflow, Spark, Flink, and Kafka. Capable of designing resilient systems with observability and mentoring others in agentic software development practices.
Highest-signal resume keywords
Apache AirflowApache SparkApache FlinkApache KafkaAPI Design
ATS Keywords
Tailor your resumeApplicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard Skills
Data Platform InfrastructureLakehouse ArchitecturePerformance TuningCapacity PlanningFault ToleranceObservabilityData CleansingStreaming ProcessingBatch ProcessingAI Coding Agents
Soft Skills
MentoringCollaborationProblem-Solving
Tools & Technologies
IcebergNessieTrinoStarRocksMCP Servers
Industry Keywords
Financial ServicesRegulated IndustryOpen-Source Contributions
Tech Stack
Tools & technologiesAirflowApacheDistributed SystemsKafkaSpark
About the role
Key responsibilities & impact- Build, scale, and operate the enterprise data platform
- Design and operate reusable batch and streaming processing frameworks on Airflow, Spark, and Flink
- Own the Iceberg/Nessie/Trino/StarRocks data lakehouse layer, including governance, query performance, and storage lifecycle
- Build and maintain Kafka streaming infrastructure, including topics, schemas, and connectors
- Develop reusable ingestion, cleansing, and harmonization frameworks
- Build platform UI components for platform state, catalogs, job status, and data quality visibility
- Design APIs exposing ingestion, querying, catalog metadata, and job orchestration capabilities
- Build MCP servers and interfaces for AI-agent access to platform data, catalogs, and lineage
- Develop tooling and guardrails enabling AI agents to operate platform functions with human-in-the-loop controls
- Partner with platform consumers, including the Ontology Platform team, on API and agentic access needs
- Ensure scalability through capacity planning, performance tuning, and architectural evolution
- Design resilience through fault tolerance, disaster recovery, data consistency, and graceful degradation
- Build observability with metrics, logging, tracing, and alerting
- Drive on-call and production support practices, runbooks, and incident response
- Champion agentic software development using AI coding agents
- Establish testing, CI/CD, infrastructure-as-code, and code and architecture review practices
- Mentor engineers on platform internals and agentic development tooling
Requirements
What you’ll need- 8-12 years of software/data engineering experience
- Significant hands-on experience building or operating large-scale data platform infrastructure
- Deep, hands-on experience with several of Apache Airflow, Apache Iceberg, Apache Spark, Apache Flink, Apache Kafka, Nessie, Trino, and StarRocks
- Strong understanding of lakehouse architecture, table formats, catalog management, query engines, and batch/streaming trade-offs
- Experience designing and building APIs with API governance, versioning, and security knowledge
- Direct experience with, or strong interest and rapid aptitude for, building MCP servers or similar agent-facing interfaces
- Practical, hands-on experience using AI coding agents such as Claude Code or GitHub Copilot as a core development workflow
- Strong distributed systems, performance tuning, capacity planning, fault tolerance, and resilience fundamentals
- Experience building and maintaining production observability with metrics, logging, and tracing
- Ability to operate as an individual contributor with deep technical ownership and mentor others
- Familiarity with UI/front-end development is a plus
- Experience in financial services or another regulated, data-intensive industry is preferred
- Contributions to open-source projects in the Airflow/Iceberg/Spark/Flink/Trino ecosystem are preferred
Benefits
Comp & perks- Medical, dental, and vision coverage
- 401(k) plan with company match
- Paid time off
- Holidays
- Parental leave
- Professional development reimbursement opportunity