FREE ACCESS
5,000–10,000 jobs/day
See all jobs on Scoutfield
Search thousands of fresh jobs every day.
Discover
- Fresh listings
- Fast filters
- No subscription required
Create a free account and start exploring right away.
Core Competencies
Role fitCore Competencies
Use this summary to align your resume positioning with the role.
Demonstrates strong expertise in software engineering with a focus on reviewing code quality, assessing test coverage, and managing dependencies. Proficient in providing technical feedback and evaluating complex software engineering tasks within large codebases.
Highest-signal resume keywords
Software Engineering ExperiencePull Request ReviewUnit TestingDependency ManagementGit and GitHub Workflows
ATS Keywords
Tailor your resumeApplicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard Skills
Software EngineeringCode ReviewDebuggingUnit TestingTest CoverageEnvironment ConfigurationTechnical Assessment DesignAI/ML EvaluationData CurationBenchmark Development
Soft Skills
Analytical Problem SolvingClear Written Communication
Tools & Technologies
DockerCI/CDPipCondaSWE-BenchDjangoFlaskScikit-learnPytestMatplotlib
Industry Keywords
Open-Source ProjectsTest FixturesTest IsolationProperty-Based Testing
Tech Stack
Tools & technologiesDjangoDockerFlaskPythonScikit-Learn
About the role
Key responsibilities & impact- Review software engineering tasks derived from real GitHub issues and pull requests
- Assess real-world bug fixes and feature implementations
- Evaluate open-source repositories, pull requests, unit tests, and test coverage
- Review repository setup and dependency management
- Assess reproducibility and environment configuration
- Evaluate task difficulty, complexity, and multi-file or cross-module code changes
- Determine whether tasks are clearly specified, technically solvable, appropriately tested, and representative of professional software engineering problems
- Identify flaky tests, missing dependencies, ambiguous requirements, version conflicts, and environment-specific behavior
- Provide clear recommendations on whether tasks should be accepted, improved, or excluded
- Provide technical feedback and quality assessments
Requirements
What you’ll need- 3+ years of professional software engineering experience
- Strong experience working with large, multi-file codebases
- Experience reviewing pull requests, debugging issues, and maintaining production code
- Strong understanding of unit testing and test coverage
- Ability to evaluate whether tests correctly validate a solution without unnecessarily restricting implementation approaches
- Experience with dependency management, environment setup, and reproducibility
- Strong understanding of Git and GitHub-based development workflows
- Ability to analyze complex technical problems and provide clear written feedback
- Contributions to or maintenance of open-source projects (nice to have)
- Experience with SWE-Bench, SWE-Bench Verified, or similar coding benchmarks (nice to have)
- Experience with major Python open-source projects such as Django, Flask, scikit-learn, SymPy, matplotlib, requests, or pytest (nice to have)
- Experience with Docker, CI/CD, pip, conda, or dependency pinning (nice to have)
- Knowledge of test fixtures, test isolation, or property-based testing (nice to have)
- Experience designing technical assessments or reviewing coding challenges (nice to have)
- Experience with AI/ML evaluation, data curation, RLHF, or benchmark development (nice to have)
Benefits
Comp & perks- $65 per hour compensation
- Remote work
- Part-time, project-based consulting engagement