How to assess coachability before hiring an executive
Give finalists equivalent feedback on a relevant work exercise and observe their revisions. Evaluate the quality of their reasoning, including justified disagreement, rather than rewarding immediate agreement with you.
Executive coachability assessment is a job-related observation of how a candidate interprets feedback and revises work while retaining independent judgment. This is an applied working definition. Its established research anchor is the structured selection interview, reviewed by Campion, Palmer, and Campion in 1997. Their review separates ways to structure interview content from ways to structure evaluation. It does not validate the particular executive exercise proposed here. OPM provides the practical guidance cited below; Colquitt’s 2001 paper addresses fairness rather than the origin of interview structure.
Recognize the decision behind the pressure
Composite recognition scene: You replay an interview while walking the dog. The candidate agreed with every challenge, yet you cannot tell which parts of the proposal they would defend when you leave the room. This is an invented illustration of a leadership pattern, not a client story or evidence about a particular person. Use the scene to identify the work choice that needs attention, without drawing conclusions about anyone’s psychological condition.
Select a bounded task relevant to the mandate and decide what a useful response to feedback would look like. Keep the original work and the revision available for comparison. The exercise should reveal how a candidate examines information, rather than whether they can infer the interviewer’s preferred answer and adopt it quickly.
Coachability concerns how someone considers and uses feedback. Compliance concerns whether they follow a request. Agreement may accompany sound learning or weak judgment, while disagreement may be justified or poorly supported. Evaluate the reasoning and work changes in context, without inferring a stable personal quality from a single agreeable or defensive-looking response.
What the research supports
Campion, Palmer, and Campion (1997) distinguish ways to structure interview content from ways to structure evaluation. That is the established research anchor retained in the definition. The feedback and revision exercise is a proposed application, not a coachability measure validated by the review. Plan both the information candidates receive and the evidence assessors use, without attributing a new executive test to the authors.
OPM’s September 2008 guide supports job-related questioning and consistent rating standards. The practical application here is comparable feedback and a clear criterion for assessing the response. It does not mean every candidate must make an identical revision. A relevant explanation may include a defensible reason to reject a suggestion, which should be evaluated against the same standards as acceptance.
OPM work-sample guidance describes representative work tasks and trained assessment. Use that guidance to choose an appropriate bounded exercise, rather than request free production work. EEOC guidance highlights selection, discrimination, and accommodation concerns. Have qualified selection specialists and counsel review the design and administration instead of assuming that a realistic-looking exercise is necessarily appropriate or legally compliant.
Colquitt (2001) separates dimensions of organizational justice. As an advisory comparison, fairness in this exercise includes more than courteous feedback: examine the conditions, evidence opportunity, and explanation of the process. Industrial/organizational psychology is the psychology of work and organizations. It supports a careful selection design while keeping the inference proportionate to one observed sample of behavior.
The feedback and revision exercise
Use the feedback and revision exercise only within a properly reviewed hiring process. Preserve the task, initial response, feedback, and revision. Have assessors identify what they observed before discussing a global impression of the candidate, and keep the exercise as one source alongside other relevant evidence.
1. Choose a relevant work sample
Use a bounded problem with no requirement for confidential or unpaid production work.
Choose a hypothetical or otherwise permitted task that samples work the role requires. Bound its scope and time, and avoid asking for confidential material or unpaid usable consulting output. Ask qualified designers whether the task is suitable for the selection purpose. A problem that resembles your current strategy question can still be an inappropriate assessment if the administration or scoring is unclear.
2. Set evaluation criteria first
Define how you will judge understanding, clarification, and the reasoning behind revisions.
Define the evidence for understanding, clarification, and reasoned revision before meeting candidates. Distinguish improvement of the work from agreement with the assessor. Explain what a strong response would demonstrate about the role, without inventing a personality score. If the panel cannot apply the criterion consistently, repair the design with qualified support before relying on the results.
3. Deliver comparable feedback
Give candidates a similar opportunity to ask questions and inspect an alternative view.
Give candidates comparable information and a similar opportunity to inspect the feedback. Use planned prompts and appropriate clarification. Preserve the required accommodation process. Do not make the exercise harder for someone because their style differs from yours, or easier because you already like their initial proposal. The comparison needs a record of what each person was actually asked to consider.
4. Observe the revision
Ask what changed, what remained, and why the candidate accepted or rejected each material suggestion.
Ask the candidate to explain what changed, what remained, and why. Compare the revision with the original response. Look for a reasoned use of the information rather than a performance of gratitude. Where the candidate rejects feedback, ask for the relevant basis within the planned process. A justified challenge may be useful evidence about the work instead of a failure to comply.
5. Compare evidence independently
Treat the exercise as one sample and check consistency with interview and reference evidence.
Have assessors record evidence and ratings independently before discussion. Identify where the exercise is consistent with or different from other permitted evidence. Do not generalize from one response to a permanent trait or clinical conclusion. Where a material gap remains, use an appropriate follow-up or retain the uncertainty rather than convert a polished interaction into a comprehensive assessment.
Put the conversation into usable words
Use this proposed exercise explanation after qualified review of the task and administration. State the real scope and criteria, and avoid implying that agreement is the expected answer.
We will ask you to consider feedback on [job-related task] and revise your response. Explain what you changed, what you retained, and the evidence behind each choice. You may ask clarifying questions and disagree with a suggestion where your reasoning supports it. We will evaluate [defined criteria], not whether you adopt every recommendation. Please use only information you are permitted to discuss.
When the candidate agrees immediately, ask how the revision changes the work. When they disagree, ask which requirement their alternative better serves. Use the same evidential standard rather than score either response through its interpersonal tone alone.
If assessors disagree about a response, compare the feedback given and the work produced before debating the label coachable. Check whether one assessor rewarded agreement that the scoring guidance did not require. Resolve the criterion through the qualified selection owner, preserving uncertainty where the exercise cannot support the broader inference someone wants to make.
Check the method against a live example
In a hypothetical continuation of the dog-walk reflection, the candidate accepts every suggestion but cannot explain why the revised proposal would work. Record the acceptance separately from the reasoning gap. Ask the planned clarification without inventing a favorable rationale for them. Immediate agreement is an observation, while the assessment still needs evidence that the person can use information to improve a relevant decision.
Suppose another candidate rejects a suggestion because it conflicts with a stated task requirement. Ask them to show the conflict and compare the explanation with the same criterion applied to others. Do not treat a disagreement as proof of poor coachability or automatically reward it as independent thought. The useful evidence is whether the reasoning and work address the actual problem.
Imagine the panel realizes that candidates received materially different feedback. Preserve the differences and obtain qualified guidance on whether the comparison remains usable. Do not hide the variation behind a common score label. Where the exercise cannot support a fair inference, retain that limit and use an appropriate, consistently administered route for the remaining evidence.
What to record and what to leave out
Retain the approved task, information provided, original work, feedback, revision, and assessor rationale through the authorized hiring process. Keep the evidence linked to the criterion. Distinguish observed revision behavior from a broader interpretation, so later reviewers can inspect the work without inheriting an unsupported description of the candidate’s personality.
Protect candidate material and restrict access to legitimate assessors. Exclude confidential details the task did not require, and handle accommodation information through the appropriate process. Do not circulate informal labels such as defensive or eager to please when the useful record is the specific question, response, revision, and reason supporting a rating.
Use this completion check before closing the discussion:
- Does the task sample relevant executive work?
- Were feedback and clarification opportunities comparable?
- What changed in the response?
- Why did the candidate accept or reject each material suggestion?
- What inference can this single sample support alongside other evidence?
This exercise samples work behavior. It does not establish a permanent trait, diagnose a candidate, or substitute for qualified selection design.
Judge progress by follow-through
At the evidence review, compare the original and revised work with the candidate’s explanation. Check that ratings reward relevant reasoning and improvement rather than automatic agreement with the interviewer.
Review the exercise with the qualified selection owner before repeating it. Correct ambiguous feedback and inconsistent scoring. Keep the original evidence available if later impressions change. A useful process supports a bounded hiring judgment while acknowledging what one sample cannot establish, rather than turning a favorable conversation into a guarantee about how the executive will respond to every future challenge.
Have qualified selection specialists and employment counsel review relevance, accommodations, and fairness. One exercise cannot establish a stable personality trait or clinical conclusion.
For related preparation, use How to hire executives who fit the work ahead of them, How to spot similarity bias when choosing your next hire, Can this executive execute, or only present a strategy?, How to give a senior executive feedback they can use. Choose the guide that addresses the next concrete decision, and keep responsibility with the person authorized to make it.