Assessment Design

How to Grade Take-Home Assignments Fairly

ClarityHire Team(Editorial)2 min read

The grading bottleneck

Most teams kill take-home tests not because candidates dislike them, but because interviewers dislike them. A 90-minute submission takes 30 minutes of focused review per reviewer. By submission ten, attention drops, and the candidate who arrives on a Friday afternoon gets a different evaluation than one who arrives on Monday morning.

The fix is not "stop using take-homes." The fix is structured grading.

Step 1: Write the rubric before you write the test

A rubric is a contract with yourself. Write it before you see any submissions, and break the score into 4–6 dimensions:

  • Correctness — does it solve the stated problem?
  • Code quality — is it readable by someone who did not write it?
  • Test coverage — are the obvious edge cases covered?
  • Architecture — would this be easy to extend?
  • Communication — is the README clear about tradeoffs?

Each dimension gets 0–4 points with explicit anchors. "3 = handles all stated requirements plus the two most obvious edge cases."

Step 2: Calibrate before you grade

Pick three submissions blind. Have two reviewers score them independently. Compare. If you disagree by more than one point on any dimension, the rubric is the problem, not the reviewers — fix the anchors and try again.

Step 3: Use AI as a first-pass reviewer, not a judge

LLM grading is excellent at the boring parts: did they include tests, did the README answer the prompt, are there obvious bugs. It is bad at "is this elegant." Use it to produce a draft score and a list of observations. The human reviewer confirms or overrides.

ClarityHire ships this pattern out of the box: an AI grader populates rubric scores and notes, the interviewer reviews and adjusts. Average review time drops from 30 minutes to about 8.

Step 4: Anonymize what you can

Hide the candidate's name and resume from the grader during the rubric pass. You will reduce the gap between how submissions from candidates with "elite" backgrounds and "non-traditional" backgrounds get scored.

Step 5: Cap the test at what you would do for free

If your take-home would take you four hours, do not pretend it will take a candidate two. Respect their time and your funnel will widen.

take homegradingrubricasync hiring

Related Articles