Apply

Ready to go for it?

AI Apply speeds things up—apply directly if you prefer.

FREE ACCESS
5,000–10,000 jobs/day
Scoutfield Logo

See all jobs on Scoutfield

Search thousands of fresh jobs every day.

Discover
  • Fresh listings
  • Fast filters
  • No subscription required
Create a free account and start exploring right away.
Mindrift

Senior Python Data Scraping Engineer

Mindrift

. Own end-to-end data extraction workflows across complex websites, ensuring complete coverage, accuracy, and reliable delivery of structured datasets .

Posted 9/26/2026part-timeRemote • New York • United StatesSenior💰 $45 per hourWebsite

Tech Stack

Tools & technologies
AWSCloudDockerJavaScriptPythonSelenium

About the role

Key responsibilities & impact
  • Own end-to-end data extraction workflows across complex websites, ensuring complete coverage, accuracy, and reliable delivery of structured datasets
  • Leverage tools and custom workflows to accelerate data collection, validation, and task execution while meeting defined requirements
  • Ensure reliable extraction from dynamic and interactive web sources, adapting approaches for JavaScript-rendered content and changing site behavior
  • Enforce data quality standards through validation checks, cross-source consistency controls, formatting specifications, and systematic verification before delivery
  • Scale scraping operations for large datasets using efficient batching or parallelization
  • Monitor failures and maintain stability against minor site structure changes
  • Apply web scraping, data extraction, and data processing expertise to specialized Tendem project workflows

Requirements

What you’ll need
  • At least 5+ years of relevant experience in data engineering, web scraping, automation, or software development
  • Strong experience in Python web scraping, including BeautifulSoup, Selenium or similar, dynamic content, and APIs via proxies
  • Proven ability to extract data from complex structures, including hierarchies, archived pages, and inconsistent HTML
  • Solid background in data cleaning, normalization, and validation, delivering structured datasets in CSV, JSON, or Google Sheets
  • Demonstrated experience handling anti-bot mechanisms and dynamic site structures at scale
  • Experience with cloud infrastructure such as AWS or equivalent and containerization with Docker
  • Hands-on experience with LLM frameworks such as LangChain, OpenRouter, or similar applied to automation tasks
  • Strong attention to detail and commitment to data accuracy
  • Self-directed work ethic with ability to troubleshoot independently
  • English proficiency: Upper-intermediate (B2) or above
  • Bachelor’s or Master’s Degree in Engineering, Applied Mathematics, Computer Science, or related technical fields is a plus
  • GitHub link is a plus

Benefits

Comp & perks
  • Freelance opportunity
  • Part-time remote work
  • Estimated 10–20 hours per week during active project phases
  • Flexible workload based on project requirements