How to Grade Take-Home Assignments Fairly
The grading bottleneck
Most teams kill take-home tests not because candidates dislike them, but because interviewers dislike them. A 90-minute submission takes 30 minutes of focused review per reviewer. By submission ten, attention drops, and the candidate who arrives on a Friday afternoon gets a different evaluation than one who arrives on Monday morning.
The fix is not "stop using take-homes." The fix is structured grading.
Step 1: Write the rubric before you write the test
A rubric is a contract with yourself. Write it before you see any submissions, and break the score into 4–6 dimensions:
- Correctness — does it solve the stated problem?
- Code quality — is it readable by someone who did not write it?
- Test coverage — are the obvious edge cases covered?
- Architecture — would this be easy to extend?
- Communication — is the README clear about tradeoffs?
Each dimension gets 0–4 points with explicit anchors. "3 = handles all stated requirements plus the two most obvious edge cases."
Step 2: Calibrate before you grade
Pick three submissions blind. Have two reviewers score them independently. Compare. If you disagree by more than one point on any dimension, the rubric is the problem, not the reviewers — fix the anchors and try again.
Step 3: Use AI as a first-pass reviewer, not a judge
LLM grading is excellent at the boring parts: did they include tests, did the README answer the prompt, are there obvious bugs. It is bad at "is this elegant." Use it to produce a draft score and a list of observations. The human reviewer confirms or overrides.
ClarityHire ships this pattern out of the box: an AI grader populates rubric scores and notes, the interviewer reviews and adjusts. Average review time drops from 30 minutes to about 8.
Step 4: Anonymize what you can
Hide the candidate's name and resume from the grader during the rubric pass. You will reduce the gap between how submissions from candidates with "elite" backgrounds and "non-traditional" backgrounds get scored.
Step 5: Cap the test at what you would do for free
If your take-home would take you four hours, do not pretend it will take a candidate two. Respect their time and your funnel will widen.