Apply

Ready to go for it?

AI Apply speeds things up—apply directly if you prefer.

FREE ACCESS
5,000–10,000 jobs/day
Scoutfield Logo

See all jobs on Scoutfield

Search thousands of fresh jobs every day.

Discover
  • Fresh listings
  • Fast filters
  • No subscription required
Create a free account and start exploring right away.
Mindrift

Senior Python Data Scraping Engineer

Mindrift

. Handle end-to-end data extraction workflows across complex websites .

Posted 10/4/2026part-timeRemote • AustraliaSenior💰 $45 per hourWebsite

Core Competencies

Role fit
Core Competencies

Use this summary to align your resume positioning with the role.

Expertise in end-to-end data extraction workflows, including web scraping from dynamic sources and ensuring data quality through validation and normalization. Proficient in using Python and relevant tools to deliver structured datasets while adapting to changing site behaviors.

Highest-signal resume keywords
Python Web ScrapingBeautifulSoupSeleniumData ValidationAWS

ATS Keywords

Tailor your resume
Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills
Data ExtractionData CleaningData NormalizationDynamic Content HandlingAPI IntegrationAnti-Bot MechanismsBatch ProcessingParallelizationData StructuringTroubleshooting
Soft Skills
Attention to DetailSelf-Directed Work Ethic
Tools & Technologies
ApifyOpenRouterDockerLLM FrameworksGoogle Sheets
Industry Keywords
Data EngineeringWeb ScrapingAutomationSoftware DevelopmentCloud Infrastructure

Tech Stack

Tools & technologies
AWSCloudDockerJavaScriptPythonSelenium

About the role

Key responsibilities & impact
  • Handle end-to-end data extraction workflows across complex websites
  • Ensure complete coverage, accuracy, and reliable delivery of structured datasets
  • Use available tools and custom workflows to accelerate data collection, validation, and task execution
  • Extract data from dynamic and interactive web sources, including JavaScript-rendered content
  • Adapt scraping approaches to changing site behavior and minor site structure changes
  • Enforce data quality through validation checks, cross-source consistency controls, formatting specifications, and systematic verification
  • Scale scraping operations for large datasets using efficient batching or parallelization
  • Monitor failures and maintain scraping stability
  • Use tools such as Apify, OpenRouter, and other technologies

Requirements

What you’ll need
  • At least 5+ years of relevant experience in data engineering, web scraping, automation, or software development (required)
  • Bachelor’s or Master’s Degree in Engineering, Applied Mathematics, Computer Science, or related technical fields is a plus
  • Strong experience in Python web scraping, including BeautifulSoup, Selenium or similar, dynamic content (JS, AJAX, infinite scroll), and APIs via proxies
  • Proven ability to extract data from complex structures, including hierarchies, archived pages, and inconsistent HTML
  • Solid background in data cleaning, normalization, and validation, delivering structured datasets in CSV, JSON, or Google Sheets
  • Demonstrated experience handling anti-bot mechanisms and dynamic site structures at scale
  • Experience with cloud infrastructure such as AWS or equivalent and containerization with Docker
  • Hands-on experience with LLM frameworks such as LangChain, OpenRouter, or similar applied to automation tasks
  • Strong attention to detail and commitment to data accuracy
  • Self-directed work ethic with ability to troubleshoot independently
  • English proficiency: Upper-intermediate (B2) or above (required)

Benefits

Comp & perks
  • Freelance opportunity
  • Part-time schedule estimated at 10–20 hours per week during active project phases
  • Up to $45 per hour equivalent, depending on level and pace of contribution