Mercor is launching the Rubric Academy, a specialized course designed to teach subject-matter experts how to rigorously evaluate Artificial Intelligence. To build models that can act as true professionals, we need humans who can not only ask the right questions but also define exactly what a perfect answer looks like.
We are looking for professionals with unique domain knowledge to participate in a paid, 3–5 hour instructional course. You will be paid to learn the methodology of "Prompt-Rubric Pairing"—the gold standard for training and benchmarking advanced AI models. Upon successful completion, you will become eligible for our high-paying expert projects.
What You Will Learn
This is a paid upskilling opportunity. You will complete a seven-lesson interactive course followed by a practical capstone task designed to translate your standards of quality into machine-readable data:
* The Art of the Prompt: Learn to write inputs that set clear context, clarity, and constraints to elicit specific expert behaviors from an AI.
* The "Golden Response": Learn how to define the ideal output. You will move beyond simple fact-checking to articulate the nuance, tone, and logic required for a top-tier professional response.
* Rubric Architecture: Learn to build objective grading systems. You will master writing "Criterion Descriptions," assigning weights, and citing sources to create a mathematical framework for judging AI performance.
Who We Are Looking For
We are looking for deep domain experts in any field. Whether you are a legal scholar, a structural engineer, a clinical psychologist, or a financial analyst—if you have standards for quality that are hard to quantify, we want you.
* Deep Expertise: You possess unique knowledge that is difficult to find on the open web. You can cite specific sources (PDFs, data sets) that support your professional judgments.
* Analytical Rigor: You are detail-oriented. You can break down a complex professional task into specific, measurable steps (criteria) that an AI must follow.
* Integrity: You are committed to original work. You understand that using AI to grade AI defeats the purpose, and you rely on your own knowledge and external verification.
Project Details & Compensation
* Stipend: Flat $50 to $150 payment upon successful completion of the Academy lessons and the Practice Task.
* Time Commitment: Approximately 3–5 hours (self-paced).
* Future Opportunities: Successful Graduates will be prioritized for our ongoing Expert Contributor roles (long-term projects creating training data for frontier models).
* Requirements: No paid subscriptions are required. You must be able to upload valid sources (PDF/CSV) to support your work.
Why Apply?
* Get Paid to Upskill: Learn a highly technical skill set (Rubric Design and RLHF methodologies) that is essential for the next phase of AI development.
* Set the Standard: Your rubrics will serve as the "ground truth" for AI models, teaching them the difference between a mediocre answer and an expert one.
* Unlock High-Value Work: This Academy is the required entry point for Mercor’s specialized, high-hourly-rate expert projects.
Apply today to join the Rubric Academy and teach AI how to meet your professional standards.