Analyst

• Design scientific coding tasks with one main problem and at least 3 logically connected sub-problems
• Implement verified Python solutions with complete unit test coverage
• Create discriminative test cases that distinguish correct from incorrect AI-generated outputs
• Perform quality control checks using the Central Task Platform (CTP), including Tier 1 structure checks and Tier 2 quality rubrics
• Revise tasks and solutions based on QC feedback
• Optimize tasks against Pass@K evaluation criteria across multiple LLM judges, including GPT, Gemini, and Nemotron
• Validate scientific correctness, determinism, well-posedness, and expected outputs
• Maintain a low rework rate and high first-submission quality
• Participate in project reviews, feedback sessions, and standups during required overlap hours

Analyst jobs in Pakistan

Materials Science Analyst