FREE ACCESS
5,000–10,000 jobs/day
See all jobs on Scoutfield
Search thousands of fresh jobs every day.
Discover
- Fresh listings
- Fast filters
- No subscription required
Create a free account and start exploring right away.

Data Engineer
Capital One. Collaborate across Agile teams to design, develop, test, implement, and support technical solutions .
Core Competencies
Role fitCore Competencies
Use this summary to align your resume positioning with the role.
Demonstrates expertise in designing and implementing cloud data solutions using Python, Spark, and SQL, while ensuring data security and compliance. Proven ability to collaborate across Agile teams and communicate complex technical concepts effectively to stakeholders.
Highest-signal resume keywords
Python DevelopmentData Pipeline DesignCloud Data SolutionsSQL ProficiencyAgile Development
ATS Keywords
Tailor your resumeApplicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard Skills
Application DevelopmentData ModelingDistributed DataData WarehousingData Security StandardsMachine LearningMicroservices ArchitectureReal-Time Data PipelinesNoSQL DatabasesData Engineering Design Patterns
Soft Skills
CollaborationMentoringCommunication
Tools & Technologies
DatabricksSnowflakeEMRGlueAirflowMonte CarloSplunkDagster
Industry Keywords
Cloud Data WarehousingLakehouse ArchitectureData TrendsData CommunityCross-Cloud Migration
Tech Stack
Tools & technologiesAirflowCloudJavaMicroservicesNoSQLPythonScalaSparkSplunkSQL
About the role
Key responsibilities & impact- Collaborate across Agile teams to design, develop, test, implement, and support technical solutions
- Influence developers, data analysts, and data scientists across machine learning, distributed microservices, lakehouse architecture, and full-stack systems
- Use Python and Spark with relational and NoSQL databases and cloud data warehousing platforms including Databricks and Snowflake
- Stay current with data trends, experiment with new technologies, participate in technology communities, and mentor data community members
- Collaborate with product managers and software engineers to deliver cloud-first data solutions
- Independently design, build, and deliver cloud data solutions and applications
- Architect and enforce data engineering design patterns for code quality, maintainability, and reusability
- Communicate technical concepts and data outcomes to internal and external stakeholders
- Design and build scalable, resilient, and operationally efficient data pipelines and platforms
- Implement data security standards including encryption and fine-grained access control
- Lead key aspects of a large-scale cross-cloud migration for the Travel Data team
- Unify multi-cloud datasets into a central data lake using Python, Spark, and Databricks
- Enable real-time personalized recommendations, tailored travel offers, and intelligent user benefits
Requirements
What you’ll need- Bachelor's Degree or higher in Computer Science or a related quantitative field
- At least 4 years of experience in application development (internship experience does not apply)
- At least 2 years of experience in distributed data
- At least 2 years of experience with SQL
- At least 2 years of experience with Python, Java, or Scala
- At least 2 years of experience in data pipeline design and development
- At least 1 year of experience in data modeling and designing end-to-end data solutions using relational and non-relational database systems
- No employer-sponsored immigration or work authorization support available for new applicants
- Preferred: 7+ years of application development experience
- Preferred: 4+ years designing, deploying, and operating data workloads in a public cloud environment
- Preferred: 4+ years building or supporting distributed data or compute workloads using EMR, Spark, Glue, or Databricks
- Preferred: 4+ years designing, implementing, and operating real-time or streaming data pipelines
- Preferred: 2+ years with data observability or orchestration tools such as Monte Carlo, Splunk, Airflow, or Dagster
- Preferred: 4+ years with unstructured or semistructured data using NoSQL databases
- Preferred: 4+ years designing and supporting data warehousing solutions
- Preferred: 2+ years in an Agile development environment
- Preferred: 2+ years developing user-centric reusable data products
Benefits
Comp & perks- Performance based incentive compensation, which may include cash bonus(es) and/or long term incentives (LTI)
- Comprehensive, competitive, and inclusive health, financial and other benefits supporting total well-being
- Reasonable accommodations for applicants with disabilities