Karim Lakhani, a professor at Harvard Business School, put it bluntly: "AI won't replace humans, but humans with AI will replace humans without AI."
That line, or some variation of it, is everywhere now. It also skips a hard question: how do you tell which leaders have actually built AI into the way they think and work? Most organizations still hire and promote on tenure, pedigree, and a highlight reel of past wins. Those things matter. They just don't predict who will guide a team through an AI-driven transformation.
The gap looks more like an assessment problem than a training problem.
Why is leadership hard to assess as a single trait?
Because it isn't one. Leadership is a stack of core capabilities: communication clarity, learning velocity, adaptability under duress, cross-functional systems thinking, and resilience. Most leaders are strong on one or two and average on the rest. In a stable environment that mix works fine. When the ground moves, the gaps show.
Leaders who do well here aren't always the most technical. They're the ones who can break their own job into its component skills, decide which ones matter most, and adapt as those priorities shift. They try new tools before anyone asks them to. They model the iterative thinking their teams need. They already treat leadership as a collection of skills, even if they never named it that way.
How do most companies assess leaders today?
Backward. Years in role. Credentials. Performance reviews. The assumption is that leading a team through yesterday's challenge means being ready for tomorrow's.
Sometimes that holds. More often the director who thrived inside one function freezes when asked to orchestrate across product, sales, and operations.
The deeper questions rarely get asked:
- Which foundational skills powered that success?
- Which of those skills transfer to the next challenge?
- What does the new role really demand?
The pace of change makes that audit urgent. A leader who excelled in a predictable environment may freeze when things get ambiguous. The skills that made them a star before may not be the ones required now.
Which leadership skills actually matter for AI-era work?
Five, and each one is observable in an interview or a working session. Rather than evaluating leaders on past outcomes alone, assess the foundational skills that produced those outcomes and the gaps that sat alongside them.
- Learning velocity. How quickly does someone absorb new information, sort signal from noise, and integrate it into decisions? A leader with high learning velocity doesn't need to know a tool today. They will know it soon.
- Adaptability under ambiguity. AI-era work rarely comes with a clean brief. Leaders who form hypotheses, run small experiments, and adjust are the ones who keep teams moving, the same quality that makes adaptable candidates win in the age of AI.
- Cross-functional systems thinking. AI initiatives sprawl. A leader has to see how decisions ripple across teams, translate between technical and business language, and broker alignment.
- Communication clarity. Ambiguity makes most people hedge. Effective leaders do the opposite. They over-communicate, share what they know and what they don't, and make their thinking visible, which is the behavior that builds the trust teams need to follow through change.
- Modeling new tools. When leaders wait until they feel expert, teams assume mastery is the price of entry. Leaders who learn in public signal that experimentation is expected.
These behaviors are observable, and the research is clear that structured interviewing is the way to surface them reliably. The Sackett 2022 meta-analysis ranks structured interviews as the #1 predictor of job performance, more than twice as predictive as unstructured conversations. Google's own hiring guidance reaches the same conclusion from practice rather than meta-analysis (Google re:Work).
Break a leadership role into its capabilities, write specific questions against each one, and the assessment stops being a conversation about someone's reputation.
What happens when you reassess your current bench?
You find gaps, and that is the point. The executive who scaled a known process might be weak on learning velocity. The functional leader who excelled in a silo might lack cross-functional instincts.
That's uncomfortable. You invested in those leaders. They know the business. Ignoring the gap won't make it disappear. The organizations that move faster are the ones willing to confront it, support leaders with targeted development, and place people where their skills actually fit.
This is about being honest about the work ahead and lining up the right skills to match it, rather than sidelining experienced leaders. A leader who is excellent at running a mature function is still valuable. They may just not be the right person to lead an AI-first transformation.
Why does this matter for AI adoption specifically?
Because leaders who think in skills treat AI as a capabilities question rather than a shiny-object question. They ask:
- What does this tool let us do that we couldn't do last quarter?
- Which skills does that require, and which does it make less relevant?
- Who on my team has the learning velocity to pick this up?
- How do I model its use so everyone sees it is part of the job?
Leaders who avoid that analysis tend to outsource AI to a transformation team, wait for a perfect training program, or hope the technology matures without much involvement. I think that rarely works.
The difference between leaders who integrate AI and those who don't comes down to those foundational muscles. Those skills are measurable. They can be developed. They can be built into hiring, promotion, and succession planning.
Where should you start?
Break your leadership roles into the underlying skills they require, then answer four questions. Do your current leaders have them? Where do you build? Where do you hire? Where do you redeploy?
Then, when you find leaders who already think in skills, give them room to lead the transformation. Don't sideline them while assigning AI to a separate task force. Let them build it into the work.
How Ratio fits
We built Ratio because we saw the same problem in hiring. Job descriptions were vague, interviews were inconsistent, and decisions leaned on credentials instead of capabilities. Ratio takes a role, extracts and weights the skills that matter by must-have, preferred, and nice-to-have, and builds the interview kit from them. The candidate scorecard and the match scores then give a hiring team something it can compare and defend. Interviewers run the conversation and score the answers; Ratio never auto-scores candidates.
The same logic applies to leadership. Break the job into the capabilities you expect leaders to use every week. Assess what is actually there. Coach with intention.
References
- Harvard Business Review. "AI Won't Replace Humans, But Humans With AI Will Replace Humans Without AI." Harvard Business Review, 2023. link
- Sackett, P. R., Zhang, C., Berry, C. M., & Lievens, F. "Revisiting meta-analytic estimates of validity in personnel selection." Journal of Applied Psychology, 107(11), 2040-2068, 2022. https://doi.org/10.1037/apl0000994
- Google re:Work. "Use structured interviewing." link
Frequently asked questions
What skills do leaders need in the AI era?
The capabilities that matter most are learning velocity, adaptability under ambiguity, cross-functional systems thinking, communication clarity, and a willingness to model new tools in public. Leaders who thrive are not always the most technical. They are the ones who can break their own job into component skills, decide which ones matter most, and adapt as those priorities shift.
Why don't tenure and credentials predict AI-era leadership success?
Most leadership evaluations look backward at years in role, credentials, and performance reviews, assuming past success predicts readiness for tomorrow's challenge. A leader who excelled in a predictable environment may freeze when things get ambiguous, and the skills that made someone a star before may not be the ones the next phase of work demands.
What is the most reliable way to assess leadership skills?
Structured interviewing. The Sackett 2022 meta-analysis ranks structured interviews as the #1 predictor of job performance, more than twice as predictive as unstructured conversations (0.42 against 0.19). Breaking a leadership role into its underlying capabilities and asking specific questions against each one surfaces observable behaviors that tenure and pedigree hide.
What is learning velocity and why does it matter for leaders?
Learning velocity is how quickly someone absorbs new information, sorts signal from noise, and integrates it into decisions. A leader with high learning velocity doesn't need to know a tool today; they will know it soon. That makes it one of the clearest indicators of who can carry an organization through an AI-driven transformation.
Was this useful?