Gramian Consulting

Backend Engineer

• Design scientific coding tasks consisting of one main chemistry problem and at least 3 logically connected, progressively structured sub-problems
• Develop verified golden solutions in Python with complete unit test coverage
• Create discriminative test cases that distinguish correct from incorrect AI-generated outputs
• Execute quality control validation through the Central Task Platform (CTP), including Tier 1 structural checks and Tier 2 quality rubrics
• Iterate on task specifications, implementations, and test cases based on QC feedback
• Optimize tasks to meet Pass@K evaluation criteria across multiple LLM judges, including GPT, Gemini, and Nemotron
• Ensure scientific correctness, determinism, well-posedness, and adherence to project quality standards
• Maintain high first-submission quality and minimize rework, targeting consistent L1 approval
• Participate in review meetings, feedback sessions, and project standups during required overlap hours

Scientific Chemistry, Python, AI Evaluation

• Design and refine evaluation rubrics and criteria for preference data
• Review and label data while identifying subtle quality issues and inconsistencies
• Build and maintain Python or TypeScript pipelines and infrastructure supporting data generation, collection, and evaluation
• Develop processes that translate qualitative assessments into scalable evaluation workflows
• Synthesize findings from data reviews into clear technical write-ups, updates, and recommendations
• Collaborate with researchers and engineers to improve evaluation methodologies and data quality
• Iterate on evaluation processes based on observed issues and project requirements
• Communicate technical findings in a structured, concise, and actionable format

Python Engineer – AI Data & Evaluation

Editor

• Source authentic photographs of real-world places, products, and media relevant to the target locale.
• Verify image licensing, copyright status, and provenance.
• Conduct multi-step visual research using Google Search, Google Lens, and reverse image search.
• Create cropped, masked, occluded, or degraded image versions that hide key identifiers while preserving realistic clues.
• Write clear, time-bounded prompts in English without revealing the answer.
• Create concise, objective grading criteria for each evaluation instance.
• Document the correct identity, research path, supporting evidence, and expected answer.
• Work with structured file-naming, shared Google Drive folders, and submission guidelines.
• Maintain consistency and quality across multiple evaluation tasks.

Photographer, Photo Editor

• Author mathematical coding tasks containing one main problem and at least 3 logically connected sub-problems that progressively build toward the main solution
• Implement verified golden solutions in Python with complete unit test coverage
• Design discriminative test cases that distinguish correct from incorrect AI-generated outputs
• Perform quality control validation using the Central Task Platform (CTP), including Tier 1 structure checks and Tier 2 quality rubrics
• Refine problem specifications, solutions, and test cases based on QC feedback
• Optimize tasks to meet Pass@K evaluation criteria across multiple LLM judges, including GPT, Gemini, and Nemotron
• Ensure mathematical correctness, well-posedness, determinism, and compliance with project quality standards
• Maintain high first-submission quality and minimize rework, targeting consistent L1 approval
• Participate in review sessions, feedback meetings, and project standups during required overlap hours

Mathematics Expert, Python, AI

Psychologist

• Review AI-generated psychological and mental-health content for accuracy and relevance.
• Evaluate clinical scenarios, case studies, assessments, and therapeutic dialogues.
• Identify factual, clinical, ethical, or cultural issues in model outputs.
• Provide clear written feedback and expert recommendations.
• Review and help develop datasets used for AI training and evaluation.
• Assess potential bias, harmful assumptions, or inappropriate psychological guidance.
• Apply evidence-based psychological or psychiatric frameworks.
• Ensure content is appropriate across different cultural and linguistic contexts.
• Collaborate with multidisciplinary teams on AI evaluation tasks.
• Contribute to documentation and quality guidelines.

Psychologist, PhD or completed residency

Photographer / Photo Editor

• Design scientific coding tasks consisting of one main physics problem and at least 3 logically connected sub-problems
• Implement verified golden solutions in Python with complete unit test coverage
• Develop discriminative test cases that distinguish correct from incorrect AI-generated outputs
• Perform quality control checks using the Turing Central Task Platform (CTP), including Tier 1 structure checks and Tier 2 quality rubrics
• Revise scientific tasks and solutions based on QC feedback
• Optimize tasks to meet Pass@K evaluation criteria across multiple LLM judges, including GPT, Gemini, and Nemotron
• Validate scientific correctness, well-posedness, determinism, and expected outputs
• Maintain high first-submission quality and minimize rework
• Participate in reviews, feedback sessions, and project standups during required overlap hours

Physics, Python Specialist

Analyst

• Design scientific coding tasks with one main problem and at least 3 logically connected sub-problems
• Implement verified Python solutions with complete unit test coverage
• Create discriminative test cases that distinguish correct from incorrect AI-generated outputs
• Perform quality control checks using the Central Task Platform (CTP), including Tier 1 structure checks and Tier 2 quality rubrics
• Revise tasks and solutions based on QC feedback
• Optimize tasks against Pass@K evaluation criteria across multiple LLM judges, including GPT, Gemini, and Nemotron
• Validate scientific correctness, determinism, well-posedness, and expected outputs
• Maintain a low rework rate and high first-submission quality
• Participate in project reviews, feedback sessions, and standups during required overlap hours

Materials Science Analyst

Photographer – Photo Editor

Attorney

• Analyze complex family law cases, statutes, and precedents
• Conduct legal research and prepare concise summaries and case notes
• Draft, review, and annotate family law documents such as custody agreements, divorce decrees, and prenuptial agreements
• Identify key legal issues, arguments, reasoning, and risk areas in case files
• Evaluate AI-generated legal content for accuracy, clarity, and legal soundness
• Provide structured feedback and corrections where needed
• Explain nuanced family law concepts in clear, precise written language
• Collaborate with remote project teams using digital tools
• Maintain a high standard of legal accuracy, consistency, and attention to detail

Family Law Attorney, AI Evaluation

Artificial Intelligence

• Review, label, classify, and validate data according to detailed project guidelines
• Ensure accuracy, consistency, and quality across assigned tasks
• Apply instructions objectively when evaluating or categorizing content
• Identify edge cases, discrepancies, and annotation issues
• Escalate unclear or inconsistent cases when needed
• Perform quality checks and provide clear feedback where required
• Meet productivity and quality expectations in a remote work environment
• Work independently while following project standards and timelines
• Support AI model improvement through structured data tasks used to train and evaluate the Gemini model

Scientific Chemistry, Python, AI Evaluation

Python Engineer – AI Data & Evaluation

Photographer, Photo Editor

Mathematics Expert, Python, AI

Psychologist, PhD or completed residency

Photographer / Photo Editor

Photographer, Photo Editor

Physics, Python Specialist

Photographer, Photo Editor

Materials Science Analyst

Physics, Python Specialist

Photographer – Photo Editor

Photographer, Photo Editor

Family Law Attorney, AI Evaluation

AI Evaluator, Gemini