Research Evaluation Specialist (PhD / Researcher / Professor) - remote job

micro1 is hiring a Research Evaluation Specialist (PhD / Researcher / Professor). The role sits in Other jobs and is fully remote. The company places no restriction on where the candidate lives, so you can apply from anywhere.

The employer published the pay: $40 - $90 an hour. The advert sets no condition on working hours.

This vacancy passed an automated check: the list excludes any advert requiring a foreign work permit, visa sponsorship, a particular citizenship, or residence in a specific country.

Role Title: Research Evaluation Consultant (PhD / Academic / Scholar) Role Type: Freelance Location: Flexible

micro1 is seeking Research Evaluation Consultants (PhD / Academic / Scholar) to contribute specialized knowledge in crafting cutting-edge test material for evaluating advanced AI models. This opportunity allows you to apply your expertise in training next-generation AI systems. Your insights will guide how models learn, reason, and perform through the development of high-quality, practical inputs. No prior AI experience is necessary; what we value most is your deep domain knowledge.

Responsibilities

- Develop original, complex question-and-answer pairs at the forefront of your field to thoroughly assess AI model performance. - Research, verify, and meticulously document answers using primary sources and authoritative references, including detailed citations and reasoning. - Design questions that require advanced reasoning, methodological precision, or synthesis from multiple sources, ensuring they resist simple or expedient solutions. - Test questions against AI systems, identify areas needing enhancement, and iteratively refine complexity while ensuring accuracy. - Craft each question and answer with precision and clarity, removing ambiguity and ensuring defensible responses. - Incorporate reviewer feedback and consistently adhere to all project guidelines and quality standards in your work.

Desired Qualifications

- PhD degree, current PhD candidacy, or equivalent extensive research experience as a specialist, researcher, or professor in your field. - A proven history of scholarly research, comprehensive subject matter expertise, and familiarity with primary literature. - Strong analytical thinking, meticulous attention to detail, and outstanding written communication skills in English. - Proficiency in sourcing and verifying information from authoritative references. - Demonstrated self-motivation and reliability in delivering expert-level work independently in a remote setting. - Ability to create challenging, original, and methodologically robust questions. - Background in AI training or evaluation is beneficial but not required.

Compensation

Compensation is based on output; experts are paid for tasks that meet project criteria. The timeframe to complete work can vary according to your experience and workflow. Minimum submission requirements apply.

Start Timeline & Availability

We usually fill roles within 48 hours and are looking for consultants ready to begin immediately. If selected, we expect you to start your first tasks within 24-48 hours of completing onboarding.

Originally posted on Himalayas