FREE ACCESS
5,000–10,000 jobs/day
See all jobs on Scoutfield
Search thousands of fresh jobs every day.
Discover
- Fresh listings
- Fast filters
- No subscription required
Create a free account and start exploring right away.
Core Competencies
Role fitCore Competencies
Use this summary to align your resume positioning with the role.
Demonstrates expertise in end-to-end data extraction workflows, ensuring data accuracy and reliability while utilizing advanced web scraping techniques and tools. Proficient in handling complex data structures and maintaining data quality across large datasets.
Highest-signal resume keywords
Python Web ScrapingBeautifulSoupSeleniumData ValidationAWS
ATS Keywords
Tailor your resumeApplicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard Skills
Data EngineeringWeb ScrapingAutomationData CleaningData NormalizationData ExtractionDynamic Content HandlingAPIs via ProxiesContainerization with DockerLLM Frameworks
Soft Skills
Attention to DetailSelf-Directed Work EthicTroubleshooting
Tools & Technologies
Google SheetsCSVJSONGitHub
Industry Keywords
Data QualityAnti-Bot MechanismsDynamic Site StructuresComplex StructuresHierarchies
Tech Stack
Tools & technologiesAWSCloudDockerJavaScriptPythonSelenium
About the role
Key responsibilities & impact- Own end-to-end data extraction workflows across complex websites
- Ensure complete coverage, accuracy, and reliable delivery of structured datasets
- Use tools and custom workflows to accelerate data collection, validation, and task execution
- Extract data reliably from dynamic and interactive web sources, including JavaScript-rendered content
- Adapt scraping approaches to changing site behavior
- Enforce data quality through validation checks, cross-source consistency controls, formatting specifications, and systematic verification
- Scale scraping operations for large datasets using efficient batching or parallelization
- Monitor failures and maintain stability against minor site structure changes
Requirements
What you’ll need- At least 5+ years of relevant experience in data engineering, web scraping, automation, or software development
- Strong experience in Python web scraping, including BeautifulSoup, Selenium or similar, dynamic content, and APIs via proxies
- Proven ability to extract data from complex structures such as hierarchies, archived pages, and inconsistent HTML
- Solid background in data cleaning, normalization, and validation, delivering structured datasets in CSV, JSON, and Google Sheets
- Demonstrated experience handling anti-bot mechanisms and dynamic site structures at scale
- Experience with cloud infrastructure such as AWS or equivalent and containerization with Docker
- Hands-on experience with LLM frameworks such as LangChain, OpenRouter, or similar applied to automation tasks
- Strong attention to detail and commitment to data accuracy
- Self-directed work ethic and ability to troubleshoot independently
- English proficiency at Upper-intermediate (B2) or above
- Bachelor's or Master's Degree in Engineering, Applied Mathematics, Computer Science, or related technical fields is a plus
- GitHub link is a plus
Benefits
Comp & perks- Remote work
- Part-time project schedule estimated at 10–20 hours per week during active phases
- Freelance opportunity
- Access to innovative technology projects through the Mindrift platform
