FREE ACCESS
5,000–10,000 jobs/day
See all jobs on Scoutfield
Search thousands of fresh jobs every day.
Discover
- Fresh listings
- Fast filters
- No subscription required
Create a free account and start exploring right away.
Core Competencies
Role fitCore Competencies
Use this summary to align your resume positioning with the role.
Demonstrates expertise in building and maintaining distributed crawlers, with a strong focus on Python or Node.js frameworks. Proficient in reverse engineering private APIs and implementing proactive monitoring and updates for data scraping processes.
Highest-signal resume keywords
Distributed Crawler DevelopmentPython (Scrapy / Playwright)Node.js (Puppeteer / Crawlee)Reverse Engineering Private APIsProxy Infrastructure Experience
ATS Keywords
Tailor your resumeApplicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard Skills
Distributed Crawler DevelopmentPython (Scrapy / Playwright)Node.js (Puppeteer / Crawlee)Reverse Engineering Private APIsProxy InfrastructureBehavioral SimulationScaling Crawlers on Distributed QueuesMonitoring Target Sites for ChangesUsing LLMsData Flow Restoration
Soft Skills
ProactivityProblem-Solving Mindset
Tools & Technologies
MitmproxyCharlesBurpRedisKafkaSQS
Industry Keywords
Data ScrapingChange DetectionAnti-Bot LogicMarketplace MonitoringInternational Team Collaboration
Tech Stack
Tools & technologiesJavaScriptKafkaNode.jsPuppeteerPythonRedis
About the role
Key responsibilities & impact- Own and develop the scraping of Mercado Livre, the main data source behind JoomPulse, and extend it to new marketplaces such as Shopee
- Build and maintain distributed crawlers running in production
- Monitor target marketplaces for changes, detect them early and update bypass logic proactively
- Reverse engineer private APIs to get data faster and more reliably than through HTML
- Keep crawlers scalable and observable using distributed queues, success-rate monitoring, and alerting on anti-bot regressions
- Investigate pipeline failures caused by new anti-bot checks and restore the data flow
- Use LLMs and other tooling to research and solve problems without ready-made answers
- Identify useful product data and bring these insights to the team
Requirements
What you’ll need- 3+ years of building distributed crawlers running in production
- Strong Python (Scrapy / Playwright) or Node.js (Puppeteer / Crawlee)
- Behavioral simulation: human-like mouse trajectories, realistic timing, scroll and click patterns, bypassing behavioral biometrics
- Security research mindset: monitoring target sites for changes, change detection, proactive updates of bypass logic
- Experience with proxy infrastructure: residential, mobile, ISP, and rotating proxies
- Reverse engineering of private APIs via mitmproxy, Charles, or Burp
- Scaling crawlers on distributed queues: Redis, Kafka or SQS
- Active use of LLMs and an experimental mindset
- Proactivity: noticing useful data and bringing it without a detailed specification
- English sufficient for daily work in an international team
Benefits
Comp & perks- Compensation package: base salary and performance-based bonuses
- Office-first: flexible hours with the possibility to work remotely 52 days per year
- 22 days of paid annual leave
- Health insurance (including dental care) for employees and their children
- Daily meal allowance
- 100% paid sick leave
- Licenses and access to a wide range of AI tools
- Opportunities for promotions
- Professional training
- English courses
- Annual team-building activities
- Knowledge-sharing workshops
- Strong sense of teamwork