Senior Collections Data Engineer

iCOUNTER

. Design and scale high-volume data collection systems ingesting threat data from open-web, deep-web, and dark-web sources, including Tor, I2P, and other anonymity networks .

Posted 10/30/2026full-timeRemote • California • United StatesSenior💰 $140,000 - $180,000 per yearWebsite

Core Competencies

Role fit

Core Competencies

Use this summary to align your resume positioning with the role.

Demonstrates expertise in designing and scaling high-volume data collection systems, with a strong focus on building robust data pipelines and integrating advanced parsing techniques. Proficient in Python programming and familiar with cybersecurity concepts and threat intelligence data types.

Highest-signal resume keywords

Python ProficiencyData Pipeline DevelopmentThreat Intelligence ExpertiseAgentic Workflow ImplementationCloud Platform Experience

ATS Keywords

Tailor your resume

Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills

Data CollectionData ProcessingData ParsingAPI DevelopmentScraping TechniquesConcurrencyPerformance OptimizationBatch ProcessingStreaming Data PipelinesCybersecurity Concepts

Soft Skills

CollaborationProblem-SolvingAdaptability

Tools & Technologies

AirflowSparkKafkaDockerKubernetesLangChainFastAPIFlaskSnowflakeClickHouse

Industry Keywords

Threat IntelligenceDark WebOpen WebIOCsTTPsMalware SamplesPhishing KitsUnderground ForumsData QualityBackground Check

Tech Stack

Tools & technologies

AirflowCloudCyber SecurityDockerFlaskKafkaKubernetesPythonSnowflakeSpark

About the role

Key responsibilities & impact

Design and scale high-volume data collection systems ingesting threat data from open-web, deep-web, and dark-web sources, including Tor, I2P, and other anonymity networks
Build and maintain robust, fault-tolerant batch and streaming data pipelines for ingestion, transformation, enrichment, and storage
Develop advanced parsing and normalization logic for unstructured, semi-structured, and rapidly evolving threat data formats
Design, build, and maintain agentic workflows using autonomous, LLM-powered agents for multi-step collection and enrichment tasks
Architect and operate high-scale media pipelines for ingesting, processing, storing, and enriching images, videos, screenshots, documents, and other media
Design and build internal and external APIs exposing collected intelligence to downstream security teams and platforms
Write clean, production-grade Python code for data engineering and automation
Collaborate with threat intelligence analysts, detection engineers, and security researchers to translate intelligence requirements into reliable, scalable data systems
Monitor, troubleshoot, and continuously optimize collection performance, data quality, and latency at scale
Stay current with emerging threat actor TTPs, data sources, and evasion techniques to improve collection coverage

Requirements

What you’ll need

5+ years of experience as a Software Engineer or Data Engineer, with a strong focus on large-scale data collection and processing
Deep experience collecting data at scale from open and dark web sources, including scraping, crawling, API integration, Tor-based collection, and anti-detection/anti-bot techniques
Strong expertise in building and operating data pipelines using Airflow, Dagster, Prefect, Spark, Kafka, Flink, or equivalent
Advanced data parsing skills for turning messy, unstructured web data into clean, structured intelligence
Expert-level Python proficiency, including async, concurrency, and performance optimization
Hands-on experience designing and implementing agentic workflows using LangChain, CrewAI, AutoGen, LlamaIndex, or similar frameworks, and integrating LLMs into production data systems
Track record of building and maintaining production APIs using FastAPI, Flask, or similar
Strong understanding of cybersecurity concepts and threat intelligence data types, including IOCs, TTPs, malware samples, phishing kits, and underground forums
Comfortable working in a fast-paced, ambiguous environment with high-stakes data quality requirements
Experience with cloud platforms
Knowledge of modern data stack tools such as dbt, Snowflake, ClickHouse, and DuckDB
Familiarity with containerization, Docker, Kubernetes, and infrastructure-as-code
Prior work in cybersecurity, threat intelligence, or intelligence collection organizations
Contributions to open-source tools or public research in the threat intelligence or data collection space
Completion of a Background Check is required for employment at iCOUNTER
Legally authorized to work in the United States

Benefits

Comp & perks

Full Health, Dental, & Vision Coverage, with 100% employee premiums covered and 90% dependent premiums covered on base plans
401(k), HSA, & FSA Plans
Flexible PTO
Meaningful equity ownership
Company Holidays & Paid Sick Days
Monthly home-office stipend for internet, equipment, or other technology needs