Interview Scorecard Designer

Overview

Transform interviewing from gut-feel conversations into structured evaluation that predicts job success. This skill encodes the frameworks for competency-based questions, scoring rubrics, and interview loop design that improve hiring quality and reduce bias.

When to Use This Skill

• Scorecard creation — Building evaluation criteria
• Question development — Creating competency-based questions
• Interview loop design — Structuring multi-round processes
• Debrief facilitation — Running hiring decisions

Scorecard Framework

Core Components

ROLE: [Title]

COMPETENCIES TO ASSESS:
1. [Competency 1] - Interview: [Stage]
2. [Competency 2] - Interview: [Stage]
3. [Competency 3] - Interview: [Stage]
4. [Competency 4] - Interview: [Stage]

SCORING SCALE:
4 - Strong Hire: Exceeds bar significantly
3 - Hire: Meets bar
2 - Lean No: Below bar but some positives
1 - No Hire: Significant concerns

Competency Categories

Question Design

Behavioral Question Formula

STAR Format:

"Tell me about a time when [situation requiring competency]"

Follow-ups:
- "What was the situation?" (Situation)
- "What did you do?" (Task/Action)
- "What was the result?" (Result)
- "What would you do differently?" (Learning)

Questions by Competency

Problem-Solving

• "Describe a complex problem you solved. Walk me through your approach."
• "Tell me about a time you had to make a decision with incomplete information."
• "Give an example of when you identified a problem before it became critical."

Leadership

• "Tell me about a time you led a team through a difficult situation."
• "Describe how you've developed someone on your team."
• "Give an example of when you had to make an unpopular decision."

Communication

• "Tell me about a time you had to explain something complex to a non-expert."
• "Describe a situation where you had to give difficult feedback."
• "Give an example of how you've built consensus across stakeholders."

Collaboration

• "Tell me about a time you worked with a difficult colleague."
• "Describe a cross-functional project you led or contributed to."
• "Give an example of when you had to compromise to move forward."

Scoring Rubrics

Behavioral Anchors

Example Rubric: Problem-Solving

Interview Loop Design

Standard Loop Structure

Competency Coverage Matrix

● = Primary | ○ = Secondary

Debrief Process

Debrief Structure

1. Individual scoring (before meeting): Each interviewer completes scorecard
2. Round robin (15 min): Each interviewer shares assessment without others' influence
3. Discussion (15 min): Explore disagreements and concerns
4. Decision (5 min): Hiring manager makes call

Debrief Rules

• No peeking at others' scores before the meeting
• Share assessment before hearing others
• Focus on evidence, not impressions
• Hiring manager makes final decision but must address concerns

Red Flag Discussion

If any interviewer sees a red flag:

• Must be discussed regardless of other scores
• Flag-raiser explains specific concern
• Group assesses: Is this disqualifying?
• Document decision either way

Bias Mitigation

Before Interview

• Use structured questions (not free-form chat)
• Score against rubric, not against other candidates
• Review scorecard immediately after interview

During Interview

• Ask all candidates the same questions
• Let candidate finish before probing
• Take notes on specific statements

After Interview

• Complete scorecard before discussing with others
• Focus on evidence, not gut feel
• Identify which competency each concern relates to

Resources

references/

• question-library.md — Questions by competency and role
• rubric-templates.md — Scoring rubrics by competency

assets/

• scorecard-template.xlsx — Interview scorecard
• debrief-template.docx — Debrief meeting format