AI Rubric Writer - remote job

micro1 is hiring a AI Rubric Writer. The role sits in IT and programming and is fully remote. The company places no restriction on where the candidate lives, so you can apply from anywhere.

The employer published the pay: $95 - $185 an hour. The advert sets no condition on working hours.

This vacancy passed an automated check: the list excludes any advert requiring a foreign work permit, visa sponsorship, a particular citizenship, or residence in a specific country.

Role Title: AI Rubric Writer Role Type: Contractor Location: Remote We are seeking an experienced AI Rubric Writer to develop high-quality evaluation rubrics and scoring frameworks for AI and Large Language Model (LLM) assessments. The ideal candidate will create clear, objective evaluation criteria to assess AI-generated responses and help improve model performance across a variety of subject areas. Responsibilities

* Design and develop evaluation rubrics and scoring guidelines for AI-generated content.

* Create objective, consistent, and well-structured assessment criteria.

* Evaluate AI responses for accuracy, reasoning, completeness, and quality.

* Provide detailed feedback to improve AI model performance.

* Collaborate with cross-functional teams to refine evaluation standards.

* Ensure rubrics are clear, unbiased, and easy to apply.

Required Qualifications

* Bachelor's degree or higher in a relevant field.

* Strong analytical, critical thinking, and written communication skills.

* Experience creating evaluation criteria, scoring frameworks, assessment guidelines, or rubrics.

* Subject matter expertise in Software Engineering, Finance, Law, Consulting, or other quantitative/STEM disciplines.

Preferred Qualifications

* Experience as an AI Evaluator, Prompt Evaluator, or similar AI quality assessment role.

* Experience evaluating Large Language Models (LLMs) or Generative AI systems.

* Familiarity with rubric development, AI quality assurance, or data annotation.

* Experience reviewing and assessing technical or domain-specific content.

Originally posted on Himalayas