Structured Interview Scoring Guide
A step-by-step system for running fair, consistent, and legally defensible interviews across your hiring pipeline.
Why Structured Interviews?
Unstructured interviews have a correlation of ~0.20 with job performance. Structured interviews reach ~0.51 — more than double the predictive power. This guide helps you get there.
Key principles:
1. Every candidate for the same role answers the same questions
2. Every answer is scored against a pre-defined rubric
3. Interviewers score independently before discussing (prevents anchoring bias)
4. Final decisions use aggregated scores, not gut feelings
The 5-Point Scoring Scale
| Score | Label | Definition |
|---|
| 5 | Exceptional | Demonstrates mastery far beyond role requirements. Could teach this to others. Provides novel insights. |
| 4 | Strong | Clearly meets and occasionally exceeds requirements. Well-articulated, specific examples. |
| 3 | Meets Bar | Adequately demonstrates the competency. Solid but not outstanding. Acceptable for the role level. |
| 2 | Below Bar | Partially demonstrates the competency. Notable gaps or vague examples. Needs development. |
| 1 | Insufficient | Does not demonstrate the competency. Cannot provide relevant examples. Disqualifying for this role. |
Rule of thumb: A "3" should mean "I'd be comfortable hiring this person." Reserve 4-5 for candidates who genuinely impress.
Scoring Dimensions
Technical Skill (weight varies by role: 25-35%)
What you're evaluating:
- Depth of knowledge in required technical areas
- Ability to apply technical skills to real problems
- Understanding of tradeoffs and constraints
- Code quality, system design, or domain expertise (role-dependent)
Sample rubric anchors:
- 5: Identifies edge cases unprompted, proposes multiple solutions with tradeoff analysis, demonstrates expertise beyond the question scope
- 3: Solves the problem correctly with minor hints, explains their reasoning, handles the common cases
- 1: Cannot solve basic problems in their stated area of expertise, or solutions have fundamental flaws
Communication (weight: 15-25%)
What you're evaluating:
- Clarity of explanation (can they teach what they know?)
- Active listening (do they ask clarifying questions?)
- Structured thinking (do answers have a logical flow?)
- Appropriate level of detail for the audience
Sample rubric anchors:
- 5: Explains complex topics simply, adapts communication style to the interviewer, asks insightful clarifying questions before diving in
- 3: Communicates clearly enough to collaborate effectively, answers are organized, asks some clarifying questions
- 1: Rambling answers, cannot explain their own work clearly, misunderstands questions repeatedly without seeking clarification
Problem Solving (weight: 20-30%)
What you're evaluating:
- Approach to ambiguous problems (how do they start?)
- Breaking large problems into manageable pieces
- Adapting when initial approach doesn't work
- Reasoning about constraints and scale
Sample rubric anchors:
- 5: Structures the problem beautifully before solving, identifies hidden assumptions, adapts approach smoothly when constraints change
- 3: Takes a reasonable approach, may need a hint for edge cases, gets to a working solution
- 1: Freezes on ambiguous problems, cannot break down complexity, rigid thinking when approach fails
Culture Add (weight: 10-20%)
What you're evaluating:
- Values alignment with team principles
- Collaboration style and empathy
- Growth mindset and self-awareness
- What new perspectives they bring (not "culture fit" — culture ADD)
Sample rubric anchors:
- 5: Demonstrates strong alignment with team values while bringing a genuinely new perspective, shows high self-awareness about strengths and growth areas
- 3: Aligned with core values, collaborative demeanor, shows willingness to learn and adapt
- 1: Values misalignment on critical dimensions, dismissive of collaboration, lack of self-awareness about impact on others
Leadership (weight: 5-15%)
What you're evaluating:
- Influence without authority (for IC roles)
- Decision-making under uncertainty
- Mentoring and knowledge-sharing history
- Ownership and accountability for outcomes
Sample rubric anchors:
- 5: Clear examples of driving cross-team initiatives, mentoring others to promotion, owning failures publicly and learning from them
- 3: Has influenced outcomes beyond their immediate scope, participates in mentoring, takes ownership of their work
- 1: Waits to be told what to do, blames external factors for failures, no evidence of helping others grow
Interview Workflow
Before the Interview
1. Review the candidate's resume and any prior scorecard notes
2. Confirm which questions you're assigned (avoid overlap between interviewers)
3. Have the scorecard template ready (printed or in a second tab)
4. Set up your environment — quiet room, working video, glass of water
During the Interview (typical 45-60 min)
- [0-5 min] Warm-up: introduce yourself, explain the interview format, put candidate at ease
- [5-45 min] Core questions: ask 3-4 questions from your assigned dimension(s)
- [45-55 min] Candidate questions: leave genuine time for their questions (this also tells you about their priorities)
- [55-60 min] Close: explain next steps, timeline, thank them
After the Interview (within 30 minutes)
1. Score each dimension immediately while memory is fresh
2. Write 2-3 bullet points for Strengths
3. Write 1-2 bullet points for Concerns
4. Record your overall recommendation: Strong Yes / Yes / No / Strong No
5. Submit your scorecard BEFORE reading other interviewers' feedback
Recommendation Decision Framework
| Recommendation | When to Use | What It Means |
|---|
| Strong Yes | You would fight for this hire | Exceptional on multiple dimensions; you'd be disappointed to lose them |
| Yes | You'd support hiring them | Meets the bar clearly; no significant concerns; would be a good addition |
| No | You have meaningful concerns | Below bar on one or more critical dimensions; concerns outweigh strengths |
| Strong No | Clear misalignment or red flag | Fundamental gap in required competency, values misalignment, or integrity concern |
Debrief Process
After all interviews for a candidate are complete:
1. Scoring review (5 min): Hiring manager reviews aggregate scores silently
2. Round-robin (2 min each): Each interviewer shares their recommendation and top 1-2 observations — no discussion yet
3. Discussion (10-15 min): Open discussion focused on areas of disagreement
4. Decision (5 min): Hiring manager makes final call — advance, reject, or need more information
Anti-bias rules for debrief:
- No one speaks before submitting their written scorecard
- Junior interviewers share first (prevents seniority anchoring)
- Focus on specific observed behaviors, not impressions ("They couldn't explain X" not "They seemed nervous")
- "I have a bad feeling" is not actionable feedback — require specifics
Legal Considerations
- Ask every candidate for the same role the same core questions
- Score against the rubric, not against other candidates
- Document everything — your notes may be reviewed in a discrimination claim
- Never ask about: age, marital status, children/pregnancy, religion, disability, national origin
- If a candidate volunteers protected information, do not record it and do not factor it into scoring