Apply

Ready to go for it?

AI Apply speeds things up—apply directly if you prefer.

FREE ACCESS
5,000–10,000 jobs/day
Scoutfield Logo

See all jobs on Scoutfield

Search thousands of fresh jobs every day.

Discover
  • Fresh listings
  • Fast filters
  • No subscription required
Create a free account and start exploring right away.
Mindrift

Senior Python Data Scraping Engineer, Freelance

Mindrift

. Own end-to-end data extraction workflows across complex websites .

Posted 10/4/2026part-timeRemote • New York • United StatesSenior💰 $45 per hourWebsite

Core Competencies

Role fit
Core Competencies

Use this summary to align your resume positioning with the role.

Demonstrates expertise in end-to-end data extraction workflows, utilizing Python for web scraping and data validation. Proficient in managing complex datasets and ensuring data quality through systematic verification and cloud infrastructure.

Highest-signal resume keywords
Python Web ScrapingData Cleaning and NormalizationCloud Infrastructure (AWS)Dynamic Content ExtractionAnti-Bot Mechanisms Handling

ATS Keywords

Tailor your resume
Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills
Web ScrapingData ExtractionData ValidationBeautifulSoupSeleniumAPIs via ProxiesCSV FormattingJSON FormattingGoogle SheetsContainerization (Docker)
Soft Skills
Attention to DetailSelf-Directed Work EthicTroubleshooting
Tools & Technologies
ApifyOpenRouterLangChainCloud InfrastructureGitHub
Industry Keywords
Data EngineeringAutomationSoftware DevelopmentDynamic Site StructuresComplex Data Structures

Tech Stack

Tools & technologies
AWSCloudDockerJavaScriptPythonSelenium

About the role

Key responsibilities & impact
  • Own end-to-end data extraction workflows across complex websites
  • Deliver complete, accurate, and reliable structured datasets
  • Use tools such as Apify, OpenRouter, and custom workflows to accelerate data collection, validation, and task execution
  • Extract data from dynamic and interactive web sources, including JavaScript-rendered content
  • Adapt scraping approaches to changing site behavior and minor site structure changes
  • Enforce data quality through validation checks, cross-source consistency controls, formatting compliance, and systematic verification
  • Scale scraping operations for large datasets using efficient batching or parallelization
  • Monitor failures and maintain scraping stability

Requirements

What you’ll need
  • At least 5+ years of relevant experience in data engineering, web scraping, automation, or software development
  • Strong experience in Python web scraping, including BeautifulSoup, Selenium or similar, dynamic content (JS, AJAX, infinite scroll), and APIs via proxies
  • Proven ability to extract data from complex structures, including hierarchies, archived pages, and inconsistent HTML
  • Solid background in data cleaning, normalization, and validation, delivering structured datasets in CSV, JSON, or Google Sheets
  • Demonstrated experience handling anti-bot mechanisms and dynamic site structures at scale
  • Experience with cloud infrastructure (AWS or equivalent) and containerization (Docker) in real workflows
  • Hands-on experience with LLM frameworks such as LangChain or OpenRouter applied to automation tasks
  • Strong attention to detail and commitment to data accuracy
  • Self-directed work ethic and ability to troubleshoot independently
  • English proficiency at Upper-intermediate (B2) or above
  • Bachelor's or Master's Degree in Engineering, Applied Mathematics, Computer Science, or related technical fields is a plus
  • GitHub link is a plus

Benefits

Comp & perks
  • Freelance opportunity
  • Part-time remote work
  • Estimated 10–20 hours per week during active project phases
  • Up to $45 per hour equivalent, depending on level and pace of contribution