FREE ACCESS
5,000–10,000 jobs/day
See all jobs on Scoutfield
Search thousands of fresh jobs every day.
Discover
- Fresh listings
- Fast filters
- No subscription required
Create a free account and start exploring right away.

Software Engineer, Big Data
ZipRecruiter. Build data processing and exploration pipelines along with ML infrastructure to power ZipRecruiter’s intelligence .
Core Competencies
Role fitCore Competencies
Use this summary to align your resume positioning with the role.
Demonstrates expertise in building data processing pipelines and ML infrastructure using Python and big data technologies. Proficient in deploying applications in Kubernetes environments and utilizing cloud-based technologies for scalable solutions.
Highest-signal resume keywords
Python ProgrammingBig Data TechnologiesKubernetes DeploymentData Processing PipelinesContainerization Technologies
ATS Keywords
Tailor your resumeApplicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard Skills
PythonSparkKafkaHadoopHiveDockerData StructuresAlgorithmsObject-Oriented ProgrammingData Integration Tools
Tools & Technologies
KubernetesApache KafkaFlumeNiFiDelta LakeHBaseCassandraMongoDBApache HudiGoogle Cloud Dataflow
Certifications & Qualifications
BS/MS/PhD in MathematicsComputer SciencePhysics
Industry Keywords
Data ProcessingML InfrastructureCloud-Based TechnologiesScalable ApplicationsStreaming Data
Tech Stack
Tools & technologiesApacheAzureCassandraCloudDockerHadoopHBaseKafkaKubernetesMongoDBPythonSpark
About the role
Key responsibilities & impact- Build data processing and exploration pipelines along with ML infrastructure to power ZipRecruiter’s intelligence
- Deploy a range of cloud-based technologies for critical projects
- Write, test, instrument, and deploy code to a Kubernetes environment
- Help drive the innovation and evolution of ZipRecruiter
- Build fast, scalable, and effective applications, stream and batch data processing, ML infrastructure, and other systems serving millions of jobseekers and tens of thousands of customers
Requirements
What you’ll need- 2+ years of professional software development experience with a focus on Python and big data technologies
- Experience with Spark, Kafka, Hadoop, Hive, and/or other big data technologies
- Comprehensive computer science fundamentals in coding, object-oriented programming, data structures, and algorithms
- Experience with containerization technologies like Docker and/or Kubernetes
- Preferred: 4+ years of professional software development experience with a focus on Python and big data technologies
- Preferred: Experience with data integration tools like Apache Kafka, Flume, and NiFi
- Preferred: Familiarity with data storage technologies such as Delta Lake, HBase, Cassandra, and MongoDB
- Preferred: Familiarity with Apache Hudi, Apache Beam, Apache Flink, Google Cloud Dataflow, Amazon Kinesis Data Analytics, and/or Azure Databricks
- Preferred: BS/MS/PhD in Mathematics, Computer Science, Physics, related technical field, or equivalent practical experience
Benefits
Comp & perks- Competitive compensation
- Exceptional benefits package
- Flexible Vacation & Paid Time Off
- Employer-matched 401(k) plan
- Potential equity, bonuses, commission, or other forms of compensation as part of total compensation package
- Medical, financial, and other benefits