People: Roles, Skills and the Junior Pipeline

15 min read

16
Part III · The Migration

People: Roles, Skills and the Junior Pipeline

In a randomised trial, mostly junior engineers who learned a new library with an AI assistant scored 50% on a mastery quiz, against 67% for those who coded by hand, and they were not significantly faster. Their biggest gap was in debugging, the skill that supervising an agent depends on. AI raises a junior's output today and can lower the skill they will need later. An AI-driven SDLC therefore has to design the junior track on purpose, and rebuild senior roles around supervising and verifying.

16.1

The work moves to supervising

This book defines a level by what a human reviews, and when (The AI-SDLC Maturity Model). The definition has a consequence for people that is easy to miss: every climb up the ladder changes someone's job. At L2 an engineer reads every diff an agent produces. At L3 the same engineer reads evidence bundles, the items routed to them, and a sample of the rest. The share of the day spent writing new code falls, and the share spent judging code someone else wrote rises.

The most detailed account of that shift comes from a vendor studying its own staff, so it sits in a box and carries no number this chapter relies on.

Vendor-reported. Anthropic surveyed 132 of its engineers and researchers about their use of its own product, Claude, and interviewed 53 of them. Engineers "increasingly see themselves as 'manager[s] of AI agents'", and one estimated that their work had shifted "70%+ to being a code reviewer/reviser rather than a net-new code writer" (Anthropic, December 2025). The same study records the problem this chapter is about. Some staff worried about "the atrophy of deeper skillsets", and the authors put the paradox plainly: "supervising Claude requires the very coding skills that may atrophy from AI overuse". A senior engineer added: "It's been sad that more junior people don't come to me with questions as often", while granting that "they definitely get their questions answered more effectively and learn faster".

Who measured: Anthropic, about its own employees using its own product, through a non-anonymous survey, interviews and Claude Code transcripts (published December 2025). What "success" means here: how staff describe their own work; the "70%+" is one engineer's estimate. What is missing: anonymity (the authors flag social-desirability bias), a comparison group, and any measure of output or quality. Tier: T3.

Two other sources fit the same picture. DORA's 2025 qualitative data suggest that "perceived capacity gains from AI-assisted development tools have invited higher expectations of work output in some organizations" (DORA 2025, p. 40). Danish administrative data, discussed in Economics, Risk and Measurement, found no measurable effect on earnings or hours, and found that "employers absorb AI through task reorganization—including new tasks in content generation, AI oversight, and AI integration" (Humlum & Vestergaard, T1). Pay and hours stay put; the tasks inside the jobs change, and one of the new tasks is oversight.

Oversight is a skill, and skills are learned. That is the hinge of this chapter: the people who will supervise agents at L3 have to come from somewhere, and the evidence says the default way of using AI does not train them.

16.2

Output up, skill down

Two bodies of evidence seem to disagree about juniors. They are measuring different things.

Short-term output: juniors gain most. In three field experiments covering 4,867 developers at Microsoft, Accenture and a Fortune 100 firm, AI code completion raised completed tasks by 26.08% (Cui et al., T1, mixed independence). Less-experienced developers were more likely to adopt the tool and gained more from it. At Microsoft, short-tenure developers adopted at 81.6% against 72.1%, and their output rose 27–39% against 8–13% for long-tenure staff. The authors call the split by seniority noisy and "not statistically significant at conventional levels", so read it as a direction. Economics, Risk and Measurement places this result in the full range, from 19% slower to 56% faster, and shows how task type, familiarity with the code, codebase maturity and tool generation move it. This result is for code completion, an L1 tool.

Long-term skill: juniors learn less. Anthropic randomised 52 mostly junior engineers to learn Trio, a Python library they were unfamiliar with, either with an AI assistant or by hand. Afterwards "the AI group averaged 50% on the quiz, compared to 67% in the hand-coding group", and "the largest gap in scores between the two groups was on debugging questions". The AI group finished about two minutes faster, "although the difference was not statistically significant" (Anthropic, January 2026; paper: Shen & Tamkin).

Measured by Anthropic researchers · randomised controlled trial, chat assistant (not an agent), quiz taken right after the task · n = 52, published January 2026 · T2 (a result against the vendor's commercial interest)

How people used the assistant mattered more than whether they had it. The three patterns whose users averaged under 40% on the quiz were AI delegation, progressive AI reliance and iterative AI debugging. The three that averaged 65% or more were generation-then-comprehension, hybrid code-explanation and conceptual inquiry. The groups are small (two to seven people per pattern) and the authors say their qualitative analysis "does not draw a causal link". The direction is still useful: asking the AI to explain kept the learning, and handing it the work did not. The authors also expect agentic tools, which do more of the work, to have effects on skill that are "likely to be more pronounced", and they tell managers to "think intentionally about how to deploy AI tools at scale".

A larger trial outside software points the same way and shows a fix. Nearly 1,000 Turkish high-school maths students practised with either an unrestricted GPT-4 interface or a tutor version built to guide students with hints rather than give them answers. During practice the unrestricted group did 48% better than the control group and the tutor group 127% better. On a later exam without AI, the unrestricted group did 17% worse than the control group, and in the tutor group those harms were largely mitigated (Bastani et al., PNAS 2025; summary from Wharton).

Measured by university researchers · field experiment in schools · ~1,000 students, published 2025 · T1 (a different population; transfer to professional engineers is an inference)

A survey of 319 knowledge workers points to a mechanism: "higher confidence in GenAI is associated with less critical thinking, while higher self-confidence is associated with more critical thinking" (Lee et al., CHI 2025, self-report survey; six of the seven authors are at Microsoft Research).

Put together, these findings do not contradict each other. Juniors produce more with AI in the short term and form less skill if the AI does the thinking. Practice scores rose in the classroom too, right up to the exam. A pull-request count is a practice score. It cannot tell you whether the engineer behind it could debug the code without help.

16.3

The hiring signal

The labour-market data show the junior problem as a hiring problem, not a layoff problem. Two independent datasets agree on the mechanism.

Stanford's Digital Economy Lab, using ADP payroll records, finds that "employment of young workers (ages 22–25) in AI-exposed occupations now stands 19% below where it would be had it kept pace with that of their less-exposed peers; experienced workers show no comparable gap". The effect "operates primarily through reduced hiring of young workers rather than increased separations", and the authors find "no evidence of widespread, economy-wide job displacement" (Brynjolfsson, Chandar & Chen, August 2026). The declines are concentrated where AI use substitutes for human tasks. Where it complements workers, employment is "flat or rising". The authors attach their own caveats: the patterns "attenuate when controlling for education, show some divergent trends predating generative AI, and are more pronounced in the ADP analysis sample than in national survey benchmarks". The paper gives no reliable figure for software developers alone, so this book quotes none.

Hosseini and Lichtinger, using résumé data on 65 million workers at more than 280,000 firms, find that "junior employment in adopting firms starts to decline steeply relative to controls, declining by about 9 percent after six quarters", while senior employment showed "no sign of a break in trend". The decline is "driven primarily by slower hiring", and "within occupations, GenAI-exposed tasks are increasingly removed from junior job postings" (Hosseini & Lichtinger, May 2026 version).

Measured by independent academics · payroll records (Stanford) and résumés plus job postings (Harvard), observational · ADP data through June 2026; 65M workers, 2015–2025 · T1 (descriptive, not causal; working papers)

The last finding is the one that matters for an engineering organisation. Firms are not only hiring fewer juniors. They are removing from the junior role the very tasks juniors used to learn on.

Counter-signals and reversals. The headcount story is not one-directional, and the loudest claims carry the least evidence. Cloudflare announced "as many as 1,111" interns for 2026, framed as needing fresh approaches "to ramp up the creative and widespread application of AI" (Cloudflare, September 2025). Duolingo's CEO wrote in April 2025 that the company would "gradually stop using contractors to do work that AI can handle", then a few weeks later said "I didn't do that well" and that "we are, in fact, continuing to hire at the same speed as before" (Entrepreneur, May 2025, secondary). Salesforce's CEO claimed "30 percent productivity increase on engineering" and said "we're not going to hire any new engineers this year" (earnings call, as reported by The Register, February 2025). All three are announcements, T4. None measured what happened to delivery.

The pipeline argument follows from the book's own model, not from a forecast. L3 is defined by humans who review evidence instead of every line, and who can tell when the evidence is wrong. Those people need exactly the debugging judgement the trial above found weakest in AI-assisted learners. Every senior engineer was once a junior. An organisation that stops hiring juniors, or hires them and lets the agent do their learning, is drawing down the supply of the people its higher levels depend on.

16.4

Designing the junior track

No company has published a measured evaluation of a junior programme built for AI-driven delivery. What follows is the book's proposal, assembled from the learning evidence above. Each practice names the harm it guards against and the evidence behind it.

Practice
What it guards against
Evidence
Tutor mode by default
Delegation: the junior gets working code and no understanding. Configure juniors' assistants to explain, hint and ask before they generate, and make "explain this back" part of the workflow.
High scorers used conceptual inquiry and generation-then-comprehension (T2, small groups). A hint-only tutor largely removed the exam harm (T1, students).
Say when manual work is expected
Using the agent as a shortcut in exactly the sessions meant to build skill.
Zalando's training rule: "state explicitly when manual coding is expected from attendees", because "using coding agents usually inhibits learning" (T3, programme description).
Review-first apprenticeship
Juniors who never learn to judge code. Pair juniors with a senior on agent pull requests: the junior reviews first, the senior reviews the review.
Review is where the bottleneck lands and where the new senior work sits (Anthropic internal, T3). Mechanism only: no study of this format yet.
AI-off debugging drills
The skill with the largest measured gap. Hold regular sessions where juniors find a bug without an assistant, then compare notes with what the assistant would have said.
Debugging showed the largest gap in the skill trial (T2).
Protected mentorship
Questions that go to the chatbot instead of a person. Put mentoring time on the calendar and count it as delivery work.
"More junior people don't come to me with questions as often" (Anthropic internal, T3, qualitative).
Graduated authority
Juniors running agents at a level they cannot supervise. A junior's agent work stays at L2, with every diff reviewed, until they have shown they can review it.
The level definitions in the maturity model. The same rule applies to people as to task types.

The two strongest items are the cheapest. Tutor mode is a configuration choice, and the wiki's tutoring and learning agents playbook covers how hint-first assistants are built. Review-first apprenticeship reuses work the team already has to do. Code Review sets out the review queue, risk tiers and evidence bundles; a junior reviewing an evidence bundle under supervision learns both the code and the standard it was held to.

The trade-off is real and should be named. Every practice in the grid costs output in the short term. A junior in tutor mode ships less this quarter than one who lets the agent write the code, and a senior reviewing a junior's review is not reviewing something else. You are spending current throughput to keep a future supply of reviewers.

16.5

Measuring ramp-up honestly

The only company-level ramp-up data with numbers come from a vendor.

Vendor-reported. DX, which sells engineering-measurement software, analysed "data from six multinational enterprises" and reported that "engineers using AI daily hit their 10th PR in just 49 days", against 73.5 days for weekly users, 84 for monthly users and "the 91 days it took their peers without AI". It added: "Half of new hires who don't use AI tools still haven't reached 10 PRs after 3 months of work" (DX, last updated September 2025).

Success here means the date of a tenth merged pull request. What is missing: the number of hires, how AI use was measured, and any control for who chose to use AI. Reverse causation is likely, since fast learners may also adopt tools faster. A later DX post concedes that the metric "does not, on its own, tell us about the quality of those changes, the amount of rework they generate" (DX, April 2026). Tier: T3.

Time to tenth pull request is a practice score, in the sense of the classroom trial above. A faster ramp-up is welcome, but only if the engineer can explain and debug what they shipped. If you track ramp-up, pair the speed measure with a comprehension check: a debugging exercise without an assistant at 90 days, or a short walk-through of the engineer's own merged changes with a senior. The pairing follows the rule this book applies to every phase: no speed metric without the quality metric that would tell you it backfired.

16.6

Roles by level

Job titles are a poor guide here. The hard data on new formal roles is thin, and Microsoft's "agent boss", defined as "someone who builds, delegates to and manages agents to amplify their impact", comes from a vendor survey that does not state its sample (Microsoft Work Trend Index, April 2025, T4). A better guide is the ladder itself, because each level defines what a human must do. The grid below is the book's proposal, read off the level definitions in The AI-SDLC Maturity Model.

Level
What the human role becomes
The skill it needs
L1 Assisted
Author. The engineer writes every artefact and takes suggestions.
Coding, plus the habit of checking a suggestion before accepting it.
L2 Delegated
Reviewer of every agent artefact for named task types, and author of the spec and instruction file the agent works from.
Reading code critically at volume; writing specs precise enough to implement (see Requirements, Specs & Design). The wiki's AFK coding workflow keeps humans on exactly these two ends.
L3 Supervised-autonomous
Owner of the verifier, the routing rules and the evidence bundle. Reviews routed items and samples, not every line. Exercises pause and rollback.
Test and verifier design, risk judgement, debugging from evidence. The skills the trial found weakest are the ones this level needs most.
L4 Autonomous (task class)
A named, accountable human who has documented the risk acceptance, reads audit samples and holds the kill switch for one narrow class.
Accountability and incident judgement. It is a named person's job, not a committee's.

Three things follow for how you organise people. First, review and verification work has to be counted as delivery. If a team's targets count only merged changes, the reviewing that L2 and L3 depend on will be skipped, which is what the no-review merge telemetry in When Code Gets Cheap, the Bottleneck Moves shows happening. Second, accountability stays with a person. The Linux kernel's rule that only humans may add a Signed-off-by tag, while the tool is credited with Assisted-by:, is one working model (kernel.org, as of October 2026). Scaling Across Teams turns it into a provenance policy. Third, the person accountable for an L4 task class must have the skill to judge it. A level whose accountable human cannot debug the class it covers is a level that cannot be rolled back with confidence.

16.7

Keep AI metrics out of individual reviews

Once AI use is visible in telemetry, the temptation is to grade people on it. Some companies have done so. Shopify's CEO declared that "Reflexive AI usage is now a baseline expectation", and press summaries say AI use entered performance reviews (Digital Commerce 360, April 2025, secondary). Coinbase's CEO said engineers who had not onboarded to AI coding tools within a week, without a good reason, were let go (Entrepreneur, August 2025, secondary). Neither has published outcomes. Both are T4 policy statements.

The measurement vendor that sells AI-usage dashboards argues against using them this way: "we strongly caution against top-down mandates or using metrics for individual performance evaluation", and "metrics like code generation volume are particularly susceptible to gaming" (DX AI Measurement Framework, vendor guidance, as of October 2026). The learning evidence gives a second reason. A junior graded on AI usage or output volume is being paid to delegate, which is the pattern that produced the lowest skill scores. Grading people on AI use rewards the habit this chapter is trying to train out.

Engineers have noticed the risk themselves. In Stack Overflow's 2026 survey, 17.1% of 13,857 respondents named "Concern over losing job skills or training an AI to replace you" as a reason to avoid AI at work or school (Stack Overflow 2026, survey). There is a legal angle too. Germany's Works Constitution Act gives the works council co-determination over technical equipment "designed" to monitor employees' behaviour or performance (section 87(1)(6)), and the Federal Labour Court reads that test objectively: a system suitable for recording such data qualifies, whatever the employer intends. A per-user AI-usage dashboard fits that description. The wiki's page on worker consultation and co-determination sets out the test.

Measure the system, not the person. Flow and stability metrics belong to teams and phases, and Measuring Success and When to Roll Back sets them out. For individuals, judge what has always mattered: whether the work was right, whether they could explain it, and whether they made the people around them better.

What to do.

  • Keep hiring juniors, and write down which tasks they will learn on now that agents do the routine ones.
  • Set juniors' assistants to tutor mode by default (explain and hint before generating), and state when manual work is expected.
  • Run review-first apprenticeship: juniors review agent pull requests first, and a senior reviews the review.
  • Put mentoring and AI-off debugging sessions on the calendar, and count them as delivery work.
  • Before any task type climbs to L3, name the people who own its verifier and routing rules, and check they can debug what it produces.
  • If you track ramp-up time, pair it with a comprehension check at 90 days.
  • Keep AI-usage and code-volume metrics out of individual performance reviews; measure teams and phases instead.