FREE ACCESS
5,000–10,000 jobs/day
See all jobs on Scoutfield
Search thousands of fresh jobs every day.
Discover
- Fresh listings
- Fast filters
- No subscription required
Create a free account and start exploring right away.
Core Competencies
Role fitCore Competencies
Use this summary to align your resume positioning with the role.
Demonstrates expertise in legal evaluation and analysis, with a focus on assessing AI-generated legal answers for accuracy and clarity. Proficient in providing evaluations that inform product development while adhering to legal standards and guidelines.
Highest-signal resume keywords
Qualified LawyerItalian Bar AdmissionActive Italian VAT NumberExperience in Legal EvaluationExcellent Command of Italian
ATS Keywords
Tailor your resumeApplicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard Skills
Legal EvaluationCriteria DefinitionAnswer ComparisonLegal Accuracy AssessmentService Quality Measurement
Tools & Technologies
Legal Tech ToolsGenerative AI Tools
Certifications & Qualifications
Italian Bar AdmissionActive Italian VAT Number
Industry Keywords
Legal QuestionsAI Systems EvaluationIndependent ContractorService Agreement
About the role
Key responsibilities & impact- Evaluate AI-generated answers to legal questions
- Define positive and negative criteria for judging answer correctness
- Build and review evaluation sets measuring Lexroom's service quality
- Compare alternative answers from different AI models to the same legal question
- Select the preferred answer and explain the choice based on legal accuracy, completeness, use of sources, and clarity
- Provide evaluations that guide product development
- Work independently on dedicated platforms following Lexroom's guidelines
- Maintain direct contact with the People team
Requirements
What you’ll need- Must be a qualified lawyer already admitted to the Italian Bar (iscrizione all'Albo)
- Must have an active Italian VAT number (Partita IVA)
- Solid experience in at least one area of law, to be specified in the CV
- Excellent command of Italian
- Familiarity with legal tech or generative AI tools in legal work is a plus, but not required
- Experience evaluating AI systems, such as benchmarks, A/B tests, or model comparisons, is a plus, but not required
- Service agreement as an independent contractor with a VAT number
Benefits
Comp & perks- Fully remote work setup
- One in-person meeting per month for alignment and goal-setting