FREE ACCESS
5,000–10,000 jobs/day
See all jobs on Scoutfield
Search thousands of fresh jobs every day.
Discover
- Fresh listings
- Fast filters
- No subscription required
Create a free account and start exploring right away.
Manager, Data Engineering – Modeling and Architecture
Capital One. Collaborate across Agile teams to design, develop, test, implement, and support technical solutions .
Tech Stack
Tools & technologiesAirflowAmazon RedshiftCassandraCloudDynamoDBJavaMicroservicesMongoDBNoSQLPythonScalaSparkSplunkSQL
About the role
Key responsibilities & impact- Collaborate across Agile teams to design, develop, test, implement, and support technical solutions
- Influence developers, data analysts, and data scientists across machine learning, distributed microservices, lakehouse architecture, and full-stack systems
- Use Python and Spark, relational and NoSQL databases, and cloud data warehousing platforms including Databricks and Snowflake
- Stay current with data trends, experiment with new technologies, participate in technology communities, and mentor data-community members
- Collaborate with product managers and software engineers to deliver cloud-first data solutions
- Independently design, build, and deliver cloud data solutions and applications
- Architect and enforce common data engineering design patterns across data platforms and pipelines
- Communicate technical concepts and data outcomes to internal and external stakeholders
- Design and build scalable, resilient, and operationally efficient data pipelines and platforms
- Implement data security standards including encryption and fine-grained access control
Requirements
What you’ll need- Bachelor's Degree or higher in Computer Science or a related quantitative field (Statistics, Economics, Operations Research, Analytics, Mathematics, Engineering)
- At least 4 years of experience in application development; internship experience does not apply
- At least 2 years of experience in distributed data
- At least 2 years of experience with SQL
- At least 2 years of experience with Python, Java, or Scala
- At least 2 years of experience in data pipeline design and development
- At least 1 year of experience in data modeling and designing end-to-end data solutions using relational and non-relational database systems
- No employer sponsorship or immigration-related support for employment authorization
- Preferred: 4+ years of experience in Data Architecture/Data Modeling
- Preferred: 7+ years of experience in application development with Python, SQL, Scala, or Java
- Preferred: 4+ years designing, deploying, and operating data workloads in a public cloud environment
- Preferred: 4+ years building or supporting distributed data or compute workloads using EMR, Spark, Glue, or Databricks
- Preferred: 4+ years designing, implementing, and operating real-time or streaming data pipelines
- Preferred: 2+ years with data observability or orchestration tools such as Monte Carlo, Splunk, Airflow, or Dagster
- Preferred: 4+ years with unstructured or semistructured data using NoSQL databases such as MongoDB, Cassandra, or DynamoDB
- Preferred: 4+ years designing and supporting data warehousing solutions such as Snowflake or Redshift
- Preferred: 2+ years in an Agile development environment
- Preferred: 2+ years developing user-centric reusable data products
Benefits
Comp & perks- Performance-based incentive compensation, which may include cash bonuses and/or long-term incentives (LTI)
- Comprehensive, competitive health, financial, and other benefits supporting total well-being
- Reasonable accommodation support