Apply

Ready to go for it?

AI Apply speeds things up—apply directly if you prefer.

FREE ACCESS
5,000–10,000 jobs/day
Scoutfield Logo

See all jobs on Scoutfield

Search thousands of fresh jobs every day.

Discover
  • Fresh listings
  • Fast filters
  • No subscription required
Create a free account and start exploring right away.
Mindrift

Senior Python Data Scraping Engineer

Mindrift

. Own end-to-end data extraction workflows across complex websites, ensuring complete coverage, accuracy, and reliable delivery of structured datasets .

Posted 10/4/2026part-timeRemote • IndiaSenior💰 $30 per hourWebsite

Core Competencies

Role fit
Core Competencies

Use this summary to align your resume positioning with the role.

Expertise in data extraction and web scraping, with a strong focus on Python and tools like BeautifulSoup and Selenium. Proven ability to ensure data quality and accuracy while managing complex datasets and dynamic web structures.

Highest-signal resume keywords
Python Web ScrapingData Extraction ExpertiseCloud Infrastructure (AWS)Containerization (Docker)Data Cleaning and Validation

ATS Keywords

Tailor your resume
Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills
Web ScrapingData EngineeringAutomationData ProcessingDynamic Content HandlingData NormalizationData ValidationAnti-Bot MechanismsLLM FrameworksAPIs via Proxies
Soft Skills
Attention to DetailSelf-Directed Work EthicTroubleshooting Ability
Tools & Technologies
BeautifulSoupSeleniumAWSDockerLangChainOpenRouter
Industry Keywords
Data Quality StandardsStructured DatasetsDynamic Web SourcesComplex StructuresCSVJSONGoogle Sheets

Tech Stack

Tools & technologies
AWSCloudDockerJavaScriptPythonSelenium

About the role

Key responsibilities & impact
  • Own end-to-end data extraction workflows across complex websites, ensuring complete coverage, accuracy, and reliable delivery of structured datasets
  • Leverage available tools and custom workflows to accelerate data collection, validation, and task execution while meeting defined requirements
  • Ensure reliable extraction from dynamic and interactive web sources, adapting approaches for JavaScript-rendered content and changing site behavior
  • Enforce data quality standards through validation checks, cross-source consistency controls, formatting specifications, and systematic verification before delivery
  • Scale scraping operations for large datasets using efficient batching or parallelization
  • Monitor failures and maintain stability against minor site structure changes
  • Apply web scraping, data extraction, and data processing expertise to the Tendem project for real-world applications

Requirements

What you’ll need
  • At least 5+ years of relevant experience in data engineering, web scraping, automation, or software development (required)
  • Strong experience in Python web scraping (BeautifulSoup, Selenium or similar), including dynamic content (JS, AJAX, infinite scroll) and APIs via proxies
  • Proven ability to extract data from complex structures (hierarchies, archived pages, inconsistent HTML)
  • Solid background in data cleaning, normalization, and validation, delivering structured datasets (CSV, JSON, Google Sheets)
  • Demonstrated experience handling anti-bot mechanisms and dynamic site structures at scale
  • Experience with cloud infrastructure (AWS or equivalent) and containerization (Docker) as part of real workflows
  • Hands-on experience with LLM frameworks (LangChain, OpenRouter, or similar) applied to automation tasks
  • Strong attention to detail and commitment to data accuracy
  • Self-directed work ethic with ability to troubleshoot independently
  • English proficiency: Upper-intermediate (B2) or above (required)

Benefits

Comp & perks
  • Freelance opportunity
  • Part-time remote work
  • Estimated workload of 10–20 hours per week during active project phases