Senior Software Engineer, Data Acquisition
People Data Labs
Posted: 10/20/2026AirflowAmazon RedshiftApacheAWSBigQueryCloudDistributed SystemsDNSETL+8 more
IT Architect, Data Scientist
DLH Corporation
Posted: 10/20/2026CloudCyber SecurityPython
Staff Software Engineer – Data Engineer
Walmart
Posted: 10/20/2026BigQueryCloudJavaKafkaKubernetesMavenMicroservicesNoSQLPython+4 more
Data Engineering Intern
American Family Insurance
Posted: 10/20/2026Amazon RedshiftAWSBigQueryCloudDockerETLGoogle Cloud PlatformPythonSQL+1 more
Senior Staff Data Migration Engineer
Alkami Technology
Posted: 10/20/2026ETLSQL
Senior Consultant – Data Platforms, Architecture
3Cloud
Posted: 10/20/2026AzureETLSQLSSIS
Senior Data Platform Engineer
Sola
Posted: 10/20/2026Amazon RedshiftAWSDynamoDBJavaScriptMS SQL ServerMySQLNoSQLPostgresPython+3 more
Data Architect – Microsoft Fabric
NBCUniversal
Posted: 10/20/2026AzureCloudITSMKafkaPySparkPythonSQLTerraform
Senior Data Engineer
Qventus, Inc
Posted: 10/20/2026CloudTableau
Manager, Cloud and Data Platform Engineer
CVS Health
Posted: 10/20/2026AirflowBigQueryCloudDockerETLGoogle Cloud PlatformKubernetesPythonRedis+1 more
Senior Data Engineer
Vericast
Posted: 10/20/2026AirflowApacheAWSAzureCloudDistributed SystemsETLGoogle Cloud PlatformHadoop+4 more
Director, Data Engineering
Healogics, LLC.
Posted: 10/20/2026Cyber SecurityETLSQL
Data Engineer I
Pekin Insurance
Posted: 10/20/2026AirflowETLPythonSQL
Data Engineer
General Dynamics Information Technology
Posted: 10/20/2026ApacheCloudETLPySparkPythonSparkSQL
Data Engineer
RTX
Posted: 10/20/2026CloudETLMatillionPythonSQL
Senior Business Data Engineer
Nex
Posted: 10/20/2026AWSPythonSQL
Senior QA Data Engineer
Gradient AI
Posted: 10/20/2026AirflowCypressPythonSparkSQL
Data Engineer, Consultant
Thought Logic Consulting
Posted: 10/20/2026Cloud
Consultant, Data Engineer
Thought Logic Consulting
Posted: 10/20/2026Cloud
Lead Data Engineer
Astrana Health
Posted: 10/20/2026ApacheAWSAzureCloudETLGraphQLPostgresPySparkPython+4 more
Senior Software Engineer, Data Acquisition
People Data LabsCore Competencies
Role fitCore Competencies
Use this summary to align your resume positioning with the role.
Demonstrates expertise in building and operating large-scale distributed systems, with a strong focus on data ingestion, processing, and backend service development. Proficient in Python and familiar with web crawling technologies, ensuring high-quality data management and system reliability.
Highest-signal resume keywords
Python ProgrammingDistributed Systems DesignData Ingestion SystemsBackend Service DevelopmentConcurrency Frameworks
Tech Stack
Tools & technologiesAbout the role
Key responsibilities & impact- Contribute to the architecture and improvement of the data acquisition and processing platform, increasing reliability, throughput, and observability
- Use and develop web crawling technologies to capture and catalog data on the internet
- Build, operate, and evolve large-scale distributed systems that collect, process, and deliver data from across the web
- Design and develop backend services for distributed job orchestration, data pipelines, and large-scale asynchronous workloads
- Structure and model captured data, ensuring high quality and consistency across datasets
- Improve the speed, scalability, and fault tolerance of ingestion systems
- Partner with data product and engineering teams to design and implement new data products and improve existing products
- Learn and apply domain-specific knowledge in web crawling and data acquisition with mentorship from experienced teammates
Requirements
What you’ll need- 7+ years of professional experience building or operating backend or infrastructure systems at scale
- Solid programming experience in Python, Go, Rust, or similar, including async / await, coroutines, or concurrency frameworks
- Strong grasp of software architecture and backend fundamentals, including concurrency, scalability, and fault tolerance
- Solid understanding of browser rendering pipeline and web application architecture, including authentication, cookies, and HTTP request/response
- Familiarity with network architecture and debugging, including HTTP, DNS, proxies, and packet capture and analysis
- Solid understanding of distributed systems concepts: parallelism, asynchronous programming, backpressure, and message-driven design
- Experience designing or maintaining resilient data ingestion, API integration, or ETL systems
- Proficiency with Linux / Unix command-line tools and system resource management
- Familiarity with message queues, orchestration, and distributed task systems such as Kafka, SQS, and Airflow
- Experience evaluating and monitoring data quality, ensuring consistency, completeness, and reliability across releases
- Ability to work independently in a fast-paced, remote-first environment and collaborate asynchronously
- Ability to communicate clearly and thoughtfully in writing
- Ability to write and maintain technical design documents, including pipeline design, schema design, and data flow diagrams
- Ability to scope and break down complex projects into deliverable milestones and communicate progress, risks, and blockers
- Degree in a quantitative field such as computer science, mathematics, or engineering (nice to have)
- Experience as a Red Teamer (nice to have)
- Experience with large-scale data ingestion, crawling, or indexing systems (nice to have)
- Experience with Apache Spark, Databricks, or other distributed data platforms (nice to have)
- Experience with streaming data systems such as Kafka, Pub/Sub, and Spark Streaming (nice to have)
- Proficiency with SQL and data warehousing such as Snowflake, Redshift, or BigQuery (nice to have)
- Experience with cloud platforms, preferably AWS (nice to have)
- Understanding of modern data storage and design patterns such as Parquet, Delta Lake, partitioning, and incremental updates (nice to have)
- Experience building and maintaining data pipelines on modern big-data or cloud platforms (nice to have)
Benefits
Comp & perks- Stock
- Competitive Salaries
- Unlimited paid time off
- Medical, dental, & vision insurance
- Health, fitness, and office stipends
- The permanent ability to work wherever and however you want
ATS Keywords
✓ Tailor your resumeApplicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard Skills
PythonGoRustSQLETL SystemsAsynchronous ProgrammingData Pipeline DesignData Quality EvaluationWeb Crawling TechnologiesDistributed Task Systems
Soft Skills
Clear CommunicationIndependent WorkProject ScopingCollaborationTechnical Documentation
Tools & Technologies
Linux/UnixKafkaSQSAirflowApache SparkDatabricksAWSSnowflakeRedshiftBigQuery
Industry Keywords
Data AcquisitionData ProcessingScalabilityFault ToleranceWeb Application ArchitectureNetwork ArchitectureMessage-Driven DesignData WarehousingCloud PlatformsModern Data Storage