<?xml version="1.0" encoding="UTF-8"?><rss xmlns:dc="http://purl.org/dc/elements/1.1/" xmlns:content="http://purl.org/rss/1.0/modules/content/" xmlns:atom="http://www.w3.org/2005/Atom" version="2.0" xmlns:itunes="http://www.itunes.com/dtds/podcast-1.0.dtd" xmlns:googleplay="http://www.google.com/schemas/play-podcasts/1.0"><channel><title><![CDATA[Shaping Minds]]></title><description><![CDATA[Shaping Minds is where I reflect on what it means to grow, adapt, and stay human in a technology-driven world and constant change.]]></description><link>https://www.shapingminds.co</link><image><url>https://substackcdn.com/image/fetch/$s_!yYJm!,w_256,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F5eb3e46e-75be-4e4d-a7d8-4d108ce6df8e_1280x1280.png</url><title>Shaping Minds</title><link>https://www.shapingminds.co</link></image><generator>Substack</generator><lastBuildDate>Thu, 05 Nov 2026 13:55:08 GMT</lastBuildDate><atom:link href="https://www.shapingminds.co/feed" rel="self" type="application/rss+xml"/><copyright><![CDATA[Shaping Minds]]></copyright><language><![CDATA[en]]></language><webMaster><![CDATA[shapingminds@substack.com]]></webMaster><itunes:owner><itunes:email><![CDATA[shapingminds@substack.com]]></itunes:email><itunes:name><![CDATA[Maxime Mouton]]></itunes:name></itunes:owner><itunes:author><![CDATA[Maxime Mouton]]></itunes:author><googleplay:owner><![CDATA[shapingminds@substack.com]]></googleplay:owner><googleplay:email><![CDATA[shapingminds@substack.com]]></googleplay:email><googleplay:author><![CDATA[Maxime Mouton]]></googleplay:author><itunes:block><![CDATA[Yes]]></itunes:block><item><title><![CDATA[Who Owns the Agent When It Fails?]]></title><description><![CDATA[Exploring why companies are putting AI agents into production faster than they name anyone to answer for them, and how blame ends up with whoever is closest rather than whoever has control.]]></description><link>https://www.shapingminds.co/p/who-owns-the-agent-when-it-fails</link><guid isPermaLink="false">https://www.shapingminds.co/p/who-owns-the-agent-when-it-fails</guid><dc:creator><![CDATA[Maxime Mouton]]></dc:creator><pubDate>Tue, 03 Nov 2026 23:00:36 GMT</pubDate><enclosure url="https://substackcdn.com/image/fetch/$s_!Q-dj!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F082f5ad1-9c90-40d6-be7c-e030b96d8bed_1254x1254.png" length="0" type="image/jpeg"/><content:encoded><![CDATA[<div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!Q-dj!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F082f5ad1-9c90-40d6-be7c-e030b96d8bed_1254x1254.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!Q-dj!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F082f5ad1-9c90-40d6-be7c-e030b96d8bed_1254x1254.png 424w, https://substackcdn.com/image/fetch/$s_!Q-dj!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F082f5ad1-9c90-40d6-be7c-e030b96d8bed_1254x1254.png 848w, https://substackcdn.com/image/fetch/$s_!Q-dj!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F082f5ad1-9c90-40d6-be7c-e030b96d8bed_1254x1254.png 1272w, https://substackcdn.com/image/fetch/$s_!Q-dj!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F082f5ad1-9c90-40d6-be7c-e030b96d8bed_1254x1254.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!Q-dj!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F082f5ad1-9c90-40d6-be7c-e030b96d8bed_1254x1254.png" width="1254" height="1254" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/082f5ad1-9c90-40d6-be7c-e030b96d8bed_1254x1254.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:1254,&quot;width&quot;:1254,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:766625,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:false,&quot;topImage&quot;:true,&quot;internalRedirect&quot;:&quot;https://www.shapingminds.co/i/222878458?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F082f5ad1-9c90-40d6-be7c-e030b96d8bed_1254x1254.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!Q-dj!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F082f5ad1-9c90-40d6-be7c-e030b96d8bed_1254x1254.png 424w, https://substackcdn.com/image/fetch/$s_!Q-dj!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F082f5ad1-9c90-40d6-be7c-e030b96d8bed_1254x1254.png 848w, https://substackcdn.com/image/fetch/$s_!Q-dj!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F082f5ad1-9c90-40d6-be7c-e030b96d8bed_1254x1254.png 1272w, https://substackcdn.com/image/fetch/$s_!Q-dj!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F082f5ad1-9c90-40d6-be7c-e030b96d8bed_1254x1254.png 1456w" sizes="100vw" fetchpriority="high"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image buttonBase-GK1x3M"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image buttonBase-GK1x3M"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p>On the first Monday after an AI agent goes wrong, there is always a meeting. It is well attended, well intentioned and almost entirely devoted to a single question that should have been settled months earlier. Whose agent was it?</p><p>Operations says it belongs to the product team. The product team says it is a finance workflow. Finance points at legal, because legal signed the contract. Legal points at the vendor, because the vendor wrote the logic. The vendor, when it joins the call, is warm, apologetic and quietly precise: the contract assigns responsibility to the customer&#8217;s designated owner. Somebody opens the register of agents. The designated owner is a name that nobody in the room recognises, because the person left the company in the spring.</p><p>This scene is not a joke, and it is no longer hypothetical. In September, IBM and Censuswide surveyed 3,221 senior executives across eight EMEA markets. 80% said an AI-related incident had reached their board or C-suite in the past year. IBM defined an incident broadly: an agent failure, a data exposure, an AI-driven decision error or an AI security breach. Four in five senior leaders have already sat through some version of that Monday meeting.</p><p>Then the survey asked the question that matters. Who owns the outcome when an AI agent goes wrong? The most popular answer was the CIO or CTO. It attracted 17%. There was no consensus on legal liability either: 20% favoured sharing it between deployer and vendor, 19% said a regulatory framework that does not yet adequately exist should decide, and 14% placed it with the vendor.</p><p>Read those numbers as a single sentence. Most large organisations have had an AI incident, and most cannot say who is responsible for the next one. They have built the machine, switched it on and forgotten to write a name on the door.</p><div><hr></div><h3>The question nobody put on the project plan</h3><p>Every agent deployment has a business case, a vendor, a security review, a pilot and a launch date. Almost none has a person whose job it is to answer for what the agent does once it is live. It is the one line missing from an otherwise meticulous plan, and it is missing for a reason: asking for it slows the launch.</p><p>IBM&#8217;s survey makes the incentive visible. When governance lags behind deployment, 56% of executives keep deploying within agreed risk limits. Only 33% pause until governance catches up. Speed is rewarded and the delay is blamed on whoever caused it. The person who points out that nobody owns the agent becomes the person who is holding up the launch.</p><p>So the box on the org chart stays empty, and the agents multiply. 35% of those executives already run agentic AI in production. 75% expect agents to have some level of autonomy over decisions by 2027. Meanwhile only 37% have a formal, board-reviewed estimate of the financial risk from their governance gaps. A board cannot govern a risk it has never priced.</p><p>This edition is about that empty box. Who ought to be in it, why nobody wants to be, and what happens to the people who end up there by accident.</p><div><hr></div><h3>The long history of someone to blame</h3><p>The idea that an organisation answers for the actions of those working on its behalf is old. Employment law has long held that an employer is responsible for what an employee does in the course of the job. Ships have captains, aircraft have a pilot in command, and hospitals have a named consultant on every patient record. These are not just administrative conventions. They are answers to the question that every complex system eventually has to face: when something breaks, where does the account stop?</p><p>Automation has repeatedly strained that arrangement. When a machine takes over part of the work, responsibility does not move with it. It stays with the human who is nominally in charge, even as their real control shrinks. The pilot is still responsible for an aircraft that spends most of its flight on autopilot. The operator is still responsible for a plant whose control room has been automated. The more capable the system becomes, the less the person responsible can actually do, and the more the arrangement relies on that person being a convenient place to put the blame.</p><p>The researcher Madeleine Clare Elish gave this pattern a name. In a 2019 paper in <em>Engaging Science, Technology, and Society</em>, she described the moral crumple zone: a situation where responsibility for an automated system&#8217;s actions is misattributed to a human actor who had limited control over it. The metaphor comes from car design. A crumple zone is the part of a vehicle engineered to absorb the force of a crash so that the passenger compartment survives. In a moral crumple zone, the human absorbs the impact so that the system, and the institution behind it, keeps its integrity.</p><blockquote><p><strong>The AI debate has moved from adoption to governance and accountability.</strong></p><p>Ana Paula Assis, Chair of IBM EMEA and APAC, on the findings of the company&#8217;s September 2026 executive survey.</p></blockquote><p>Assis is right, and the shift matters more than the sentence suggests. For three years, the argument inside organisations was about whether to adopt. Governance was a compliance exercise, something to be written down and filed. Agents change that, because an agent acts. It sends the email, approves the refund, changes the record, calls the API. A tool you consult leaves the decision with you. An agent takes the decision and tells you afterwards, if it tells you at all.</p><div><hr></div><h3>The mechanism: how an owner becomes a scapegoat</h3><p>Nobody sets out to build a moral crumple zone. They emerge from three ordinary decisions, each reasonable on its own.</p><p>The first is that deployment is decentralised. A marketing team connects an agent to the customer database. A finance analyst gives an assistant access to the invoicing system. A developer gives a coding agent standing credentials. None of these decisions goes through a central approval, because the tools are cheap, the benefits are immediate and nobody wants to wait six weeks for a review.</p><p>Workato and Censuswide surveyed 1,001 US IT decision-makers at VP level or above in May. 62% agreed that most of the AI agents in use at their organisation were not formally approved by IT. 63% said their IT team knows less about AI agents than other employees do. These are the people responsible for the technology estate, telling us that the estate has grown without them.</p><p>The second decision is that accountability follows the org chart, not the architecture. When something breaks, the organisation asks whose function it falls under. The answer is nearly always technology, because technology is the function that is nominally responsible for systems. The same survey found that 74% of those leaders expect IT leadership to be blamed if an agent breaks policy, exposes data or harms a customer. That is more than twice the share who expect the blame to fall on the AI vendor.</p><p>Put the two findings together. IT did not approve most of the agents. IT knows less about them than the people using them. And IT expects to take the blame. That is the moral crumple zone in a single page of survey data: accountability without approval rights, blame without a veto.</p><p>The third decision is that the contract assigns the risk downhill. Vendors, understandably, limit their liability. The customer&#8217;s designated owner carries the operational risk, and the customer carries the legal risk. By the time an incident occurs, the chain of responsibility runs from a model provider through a platform vendor through an integration partner to one nervous person in a company who clicked &#8220;accept&#8221; on the terms.</p><p>The consequences for that person are not abstract. 23% of the same IT leaders expect to be removed or to resign after a major AI-caused incident. 36% expect their organisation to try to handle a major incident quietly, without disclosure. A role with that profile does not attract volunteers. It attracts people who did not see it coming, and people with no choice.</p><div><hr></div><h3>What gets lost when nobody owns the agent</h3><p>An empty owner box does not just create a blame problem after an incident. It quietly damages the organisation before one.</p><p><strong>Early warning disappears.</strong> An owned system has someone who reads its logs, notices the strange behaviour and raises a hand. An unowned system produces the same warnings and delivers them to nobody. The most unsettling detail in many incident reviews is not that the signals were missing. It is that they were there, in an inbox no one was reading.</p><p><strong>Learning does not happen.</strong> OneTrust and Sapio Research surveyed 1,200 senior decision-makers in eight markets in June and July. 86% had experienced at least one AI-related incident in the past year. Yet only 5% said coordination and accountability are clear across the AI lifecycle. An incident that belongs to no one cannot be investigated properly, because there is nobody whose job it is to change the system afterwards. The organisation experiences a crisis, issues a statement and returns to the previous arrangement.</p><p><strong>Authority drifts away from responsibility.</strong> Where an owner exists on paper but cannot approve, change or stop the agent, the arrangement is ceremonial. The name on the register is a name to blame, not a person who can act. This is the gap between a decision-maker and a designated owner, and it is the gap the moral crumple zone lives in.</p><p><strong>Responsibility cannot be outsourced to the machine.</strong> In 2024, a tribunal in British Columbia dealt with a customer who had been given wrong information about a bereavement fare by Air Canada&#8217;s website chatbot. The airline argued that the chatbot was a separate legal entity responsible for its own actions. The tribunal did not accept it, ruling that the airline remained responsible for all the information on its website, whether it came from a static page or a chatbot. The decision concerned a small claim, but the principle is not small. A company cannot create an agent and then disown it when it speaks.</p><div><hr></div><h3>Five archetypes of the empty box</h3><p>Organisations fill the owner role in recognisable ways. Most are wrong, and each fails differently.</p><p><strong>The Named Scapegoat.</strong> A single person, usually in IT or security, whose name is on the register. They did not choose the agent, cannot veto it and cannot always see it. Their title implies authority; their actual power is the ability to be fired. The Named Scapegoat is the human crumple zone in its purest form, and the organisation treats the arrangement as a successful governance structure until the first incident.</p><p><strong>The Committee Ghost.</strong> A governance committee that meets monthly, reviews a slide deck and issues guidance. Everyone is responsible, so no one is. The committee can recommend, but it cannot stop a deployment on a Tuesday afternoon, and it has no one to dismiss when the guidance is ignored. When an incident occurs, the minutes show that it was discussed. They do not show who acted.</p><p><strong>The Vendor Shield.</strong> The organisation assumes the AI supplier carries the risk, and sometimes writes it into the strategy deck. The contract usually says otherwise. The 74% figure from Workato is a useful corrective: IT leaders expect to be blamed at more than twice the rate they expect the vendor to be. Even those who buy from a vendor know the buck does not stop there.</p><p><strong>The Absentee Signatory.</strong> The person who signed off on the agent months ago and has since moved teams, left the company or forgotten. The register still carries their name, and so do the credentials the agent runs under. The agent continues to operate with the authority of someone who is no longer there. It is the most dangerous archetype precisely because it looks fine on paper.</p><p><strong>The Quiet Owner.</strong> The rare good case. A named person with authority over scope, access and shutdown, who reads the logs, holds a review date and has a direct line to the executive who will answer for the loss. The Quiet Owner is boring in the best sense: no one notices them until the agent misbehaves, at which point the incident is contained in hours rather than weeks. They are also the hardest to hire, because the role requires technical judgement, organisational authority and a willingness to say no to a launch date.</p><div><hr></div><h3>The uncomfortable truths</h3><p><strong>1. Ownership without authority is not ownership. It is a liability transfer.</strong> If the person named on the register cannot approve, change or stop the agent, the register is a list of people to blame. The test is simple: ask the owner whether they could switch the agent off today without asking permission. If the answer is no, you have a scapegoat, not an owner.</p><p><strong>2. The pressure to adopt is not neutral.</strong> It is created by executives, repeated by consultants and enforced by peers. Only 37% of EMEA organisations have a board-reviewed estimate of the financial risk, yet 87% of the leaders OneTrust surveyed encourage agent use. A culture that encourages adoption without pricing the risk is not brave. It is borrowing against someone else&#8217;s career.</p><p><strong>3. Regulators are coming for the name on the door.</strong> On 1 October, Senators Josh Hawley and Chris Murphy introduced the AI Agent Accountability Act. As described, it would create criminal and civil liability under the Computer Fraud and Abuse Act for operators who knowingly run an agent that recklessly causes hacking damage or loss, and for developers who fail to put reasonable safeguards in place. It is a proposal, not law, and at the time of writing its text had not been published, so definitions such as &#8220;operator&#8221; may change. But the direction of travel is unmistakable. The people who run agents are about to be treated as the people who answer for them.</p><p><strong>4. &#8220;Nobody told me&#8221; will not be a defence.</strong> The 36% of IT leaders who expect their company to handle a major incident quietly are describing a world in which the first sign of an incident is concealment. Concealment is not a governance model. It is a delay before a larger disclosure, and it exposes the owner twice: once for the incident and once for the silence.</p><p><strong>5. An agent without an owner is not autonomous. It is abandoned.</strong> We use the word autonomy as if it were a feature. Autonomy is what we grant to someone who can be held to account. A system that nobody can be held to account for is not autonomous. It is an orphan with a root password.</p><div><hr></div><h3>What to do about it</h3><p>The fix is not complicated. It is just unglamorous, which is why it has not happened. Here is what it looks like by role.</p><p><strong>If you are early in your career.</strong> You may be offered the agent. A team will need someone to &#8220;look after&#8221; a new workflow, and the junior person with the energy and the technical curiosity is the obvious candidate. Before you accept, ask three questions. What can this agent do, in plain language? What can I do to stop it, today, without asking anyone? And who do I report to if it goes wrong? If you cannot get clear answers, you are being offered a crumple zone with a nice title. Decline politely, or ask for the authority first. The people who can answer these questions clearly will be among the most valuable in any organisation over the next five years, because they are the ones who make agents safe to use.</p><p><strong>If you are a manager building a team.</strong> Treat agent ownership as a real role, not an extra line on an existing job description. It needs time in the week, access to logs, the power to pause a deployment and a route to the executive who will answer to the board. When you hire, look for people who can describe how an agent fails, not only what it can do. Ask candidates for a time they stopped something that was working because they did not trust it. And protect the person who raises the incident. If the first thing that happens to them is a difficult conversation with their line manager, you will not hear about the second incident until it is on the front page.</p><p><strong>If you run a function or a business.</strong> Start with a register of every agent in use. Each entry needs a named owner, a written scope, an access list, a kill switch, a review date and a designated deputy for when the owner is absent or moves on. Review the register against your joiners, movers and leavers list every quarter, because the Absentee Signatory is created by departures, not by decisions. Then give the owner the authority that matches the name. In practice, that means the right to approve, to change and to stop. If they cannot do all three, someone senior has not delegated, they have deflected.</p><p><strong>If you sit on a board.</strong> Ask for a number. IBM found that only 37% of organisations have a board-reviewed quantification of financial risk from AI governance gaps. If your board has never seen a loss estimate for an agent failure, it is not governing the risk, it is hoping. Ask who owns the most consequential agent in the organisation, what they can stop and whether they would tell you about an incident. Then ask the question 98% of the IBM sample say they have answered: who holds board-level responsibility for AI risk? Naming a director is easy. Asking what that director has actually reviewed is the part that tests the arrangement.</p><div><hr></div><h3>The name on the door</h3><p>It would be easy to read this edition as an argument for slowing down. It is not. The Workato leaders were explicit that none of them wanted to slow the business. What they wanted was to know what the agents were doing, to be able to audit and reverse their actions, and to know who is accountable. 29% named that last point as a top priority. They are not asking for permission to stop. They are asking for a name on the door.</p><p>The irony is that ownership is what makes speed possible. A pilot can fly faster in a system with a clear captain, a checklist and a flight recorder. An organisation can deploy more agents, more boldly, once it knows who is watching each one, what that person can do and where they go when things break. Trust in automation has never come from the absence of human responsibility. It has come from the presence of it.</p><p>So the next time someone proposes a new agent, do not begin with the business case. Begin with a short, awkward conversation. Whose name goes beside this? What can they switch off? What will they tell the board when it fails? If the room goes quiet, you have found the work.</p><p>Because the Monday meeting is coming. The only choice you still have is whether, when it starts, someone in the room already knows the answer to the question on the first slide.</p>]]></content:encoded></item><item><title><![CDATA[Banning AI Is Not an AI Policy.]]></title><description><![CDATA[Exploring why blanket AI bans do not stop people using AI, only stop leaders seeing it, and why the cost of that blindness now shows up in breach reports, hidden work and learning that never happens.]]></description><link>https://www.shapingminds.co/p/banning-ai-is-not-an-ai-policy</link><guid isPermaLink="false">https://www.shapingminds.co/p/banning-ai-is-not-an-ai-policy</guid><dc:creator><![CDATA[Maxime Mouton]]></dc:creator><pubDate>Tue, 27 Oct 2026 23:00:54 GMT</pubDate><enclosure url="https://substackcdn.com/image/fetch/$s_!b8xH!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F06874e14-f5ed-4fdd-9f04-580414d35efd_1024x1024.png" length="0" type="image/jpeg"/><content:encoded><![CDATA[<div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!b8xH!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F06874e14-f5ed-4fdd-9f04-580414d35efd_1024x1024.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!b8xH!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F06874e14-f5ed-4fdd-9f04-580414d35efd_1024x1024.png 424w, https://substackcdn.com/image/fetch/$s_!b8xH!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F06874e14-f5ed-4fdd-9f04-580414d35efd_1024x1024.png 848w, https://substackcdn.com/image/fetch/$s_!b8xH!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F06874e14-f5ed-4fdd-9f04-580414d35efd_1024x1024.png 1272w, https://substackcdn.com/image/fetch/$s_!b8xH!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F06874e14-f5ed-4fdd-9f04-580414d35efd_1024x1024.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!b8xH!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F06874e14-f5ed-4fdd-9f04-580414d35efd_1024x1024.png" width="1024" height="1024" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/06874e14-f5ed-4fdd-9f04-580414d35efd_1024x1024.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:1024,&quot;width&quot;:1024,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:657919,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:false,&quot;topImage&quot;:true,&quot;internalRedirect&quot;:&quot;https://www.shapingminds.co/i/222273290?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F06874e14-f5ed-4fdd-9f04-580414d35efd_1024x1024.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!b8xH!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F06874e14-f5ed-4fdd-9f04-580414d35efd_1024x1024.png 424w, https://substackcdn.com/image/fetch/$s_!b8xH!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F06874e14-f5ed-4fdd-9f04-580414d35efd_1024x1024.png 848w, https://substackcdn.com/image/fetch/$s_!b8xH!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F06874e14-f5ed-4fdd-9f04-580414d35efd_1024x1024.png 1272w, https://substackcdn.com/image/fetch/$s_!b8xH!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F06874e14-f5ed-4fdd-9f04-580414d35efd_1024x1024.png 1456w" sizes="100vw" fetchpriority="high"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image buttonBase-GK1x3M"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image buttonBase-GK1x3M"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p>In April 2023, an engineer at Samsung pasted sensitive internal source code into ChatGPT. A few weeks later, staff in one of the company&#8217;s biggest divisions received a memo. Generative AI was now banned on company phones, computers and tablets, and over the internal network. Staff were also asked not to share company information with such tools on their personal devices, and the memo warned that breaking the rule could lead to disciplinary action up to and including dismissal.</p><p>It was, by every corporate standard, a responsible decision. A leak had happened. A risk had been named. A rule had been written. Samsung was not alone: within months, a string of banks and large companies had banned or restricted ChatGPT for similar reasons, and &#8220;we have blocked it&#8221; became a respectable answer in boardrooms everywhere.</p><p>Three years later, we can measure what those memos achieved. The answer is uncomfortable for anyone who signed one. Blanket bans did not stop people using AI. They stopped leaders seeing it. They converted a visible, governable behaviour into an invisible, ungovernable one, and they did it while giving the people at the top a pleasant feeling of control.</p><p>This edition is about that feeling, and about what it costs. My argument is simple: <strong>banning AI is not an AI policy. It is the absence of one, dressed up as decisiveness.</strong></p><div><hr></div><h3>We have run this experiment before</h3><p>On 17 January 1920, the United States made the manufacture, transport and sale of intoxicating liquor illegal. The intention was moral, the law was national and the enforcement was real. Agents raided warehouses, smashed barrels and poured whisky into gutters for the newspapers.</p><p>Americans kept drinking. What changed was where. In New York alone, contemporary estimates of the number of speakeasies ran from 30,000 to 100,000. Drinking moved from licensed saloons, where the owner had a name, an address and something to lose, into back rooms, basements and unmarked doors. The alcohol got worse, because nobody could inspect it. The economics got darker, because the only people willing to supply an illegal market were people already comfortable with illegality. By 1929, the city&#8217;s own police commissioner, Grover Whalen, was warning Mayor Jimmy Walker about who the trade had pulled in.</p><blockquote><p><strong>&#8220;The illegal nature of the business attracts to it the stickup thug, the gangster, the degenerate, the racketeer and the gunman.&#8221;</strong></p><p><strong>Grover Whalen, New York Police Commissioner, report to the mayor, 1929 (via the NYC Municipal Archives)</strong></p></blockquote><p>The point is not that drinking was harmless. The point is that prohibition did not reduce the harm. It removed the supervision. It took a behaviour that society could see, regulate and tax, and moved it somewhere nobody could inspect the bottles.</p><p>The workplace has its own, smaller versions of this history. In the late 2000s, plenty of IT departments refused to let staff connect personal smartphones to company email. Staff forwarded their work mail to personal accounts instead. Eventually the industry gave up and invented a name for the thing it could not stop: bring your own device. The policy that followed was not a ban. It was a set of rules for managing what was already happening.</p><p>Every one of these stories has the same shape. A new tool arrives that makes individual work easier. The institution sees the risk before it sees the value. It bans the tool. The tool survives the ban, and the institution loses the one thing it actually needed, which was the ability to see.</p><div><hr></div><h3>The mechanism: demand does not obey memos</h3><p>To understand why AI bans fail, start with the demand, because the demand is not a fringe phenomenon.</p><p>Microsoft and LinkedIn&#8217;s 2024 Work Trend Index, based on a survey of 31,000 people in 31 countries, found that 75% of knowledge workers were already using AI at work. More importantly, 78% of those AI users were bringing their own tools, rather than waiting for their employer to provide them. Microsoft gave it a name, bring your own AI, and the name is telling. It describes something done to the organisation, not by it.</p><p>Then Software AG asked the question that every banning executive should have asked first. Its survey of 6,000 knowledge workers across the US, UK and Germany found that 46% would keep using their personal AI tools even if their organisation banned them completely. In Germany, the figure was 49%. Those workers cited time savings, easier jobs and higher productivity as their reasons. In other words, they were not rebels. They were people trying to do their jobs well, who had found a tool that helped.</p><p>The largest study of all makes the pattern unmistakable. The University of Melbourne and KPMG surveyed more than 48,000 people across 47 countries for their 2025 global study of trust in AI. 57% of employees said they hide their use of AI and present AI-generated work as their own. Almost half admitted to using AI in ways that contravene company policy, including uploading sensitive company information into free public tools.</p><p>And the trend has not reversed. In June 2026, PagerDuty published a survey by Wakefield Research of 1,250 office professionals at companies with at least $500 million in revenue. Two thirds said they had used AI tools at work despite believing they were not permitted under company policy. At organisations with 1,500 or more employees, the figure rose to 72%.</p><p>Put those findings together and the mechanism is clear. A ban does not change the incentive. The employee still has a report due on Thursday, a backlog of emails and a manager who expects faster turnaround than last year. AI still makes those things easier. The only thing the ban changes is the route the work takes. It goes from the company laptop to the personal phone, from the enterprise account to the free one, from the logged network to the home broadband.</p><p>I call this <strong>the speakeasy effect</strong>: when you prohibit a tool that people find genuinely useful, you do not remove the use, you remove the inspection. The behaviour continues, but every safeguard you could have applied to it disappears.</p><div><hr></div><h3>What the ban actually costs</h3><p>For a while, the speakeasy effect was a theory. It now has a price tag.</p><p>IBM&#8217;s 2025 Cost of a Data Breach report was the first edition to look hard at shadow AI, meaning AI tools used without the knowledge or approval of the organisation. It found that one in five breaches in its study involved shadow AI. Organisations with high levels of shadow AI paid an average of $670,000 more per breach than those with low levels or none. Those breaches were also more likely to expose personal data and intellectual property. And among organisations that reported an AI-related breach, 97% lacked proper AI access controls.</p><p>Read those numbers alongside the Samsung memo. The original fear was that staff would paste sensitive data into a public tool. The ban&#8217;s answer was to forbid the tool. The result, across the economy, is that staff paste sensitive data into public tools on devices the company cannot monitor, and the company finds out during the breach investigation.</p><p>But the financial cost is the easiest one to see. The deeper costs are the ones that never appear in a report, because they are, by definition, invisible. I count three.</p><p><strong>First, you lose the learning.</strong> When AI use is visible, an organisation can discover which uses work. A sales team finds a prompt that halves proposal time. A finance analyst works out which reconciliation tasks the model gets wrong. Those discoveries can be shared, tested and turned into standard practice. When AI use is hidden, every discovery stays private. Every employee runs their own experiment, alone, and the organisation learns nothing from any of them. The KPMG study found that only 47% of employees had received any AI training. In a banning culture, the other half are teaching themselves in secret.</p><p><strong>Second, you lose the error signal.</strong> The same study found that 66% of employees rely on AI output without evaluating its accuracy, and 56% say they have made mistakes in their work because of AI. In an open culture, those mistakes surface. Someone says, &#8220;the model invented that clause&#8221;, and the team adds a check. In a hidden culture, nobody admits the source of the error, because admitting the source means admitting the breach of policy. The mistake gets fixed, perhaps, but the cause stays buried, ready to recur.</p><p><strong>Third, you lose honesty itself.</strong> This is the cost I worry about most. A ban that most people break teaches everyone that the official rules and the real rules are different things. It trains people to present AI-assisted work as unassisted work. It turns ordinary productivity into a small, daily act of concealment. Once a workforce has learned that the safest move is to say nothing, that lesson does not stay neatly confined to AI.</p><div><hr></div><h3>The four ban archetypes</h3><p>Not every ban looks the same. In the conversations I have had with leaders over the past year, I see four recurring patterns. Each one feels like governance. None of them is.</p><ul><li><p><strong>The Panic Ban.</strong> Something goes wrong, usually a leak or an embarrassing output, and the response arrives within days. The Panic Ban is the purest form of the speakeasy effect, because it is written in fear and enforced with threats. It names the tool, not the risk. It is often the right short-term call and the wrong long-term policy, and the trouble is that nobody ever comes back to replace it.</p></li><li><p><strong>The Paper Ban.</strong> The policy exists, somewhere, in a document nobody reads. It says AI tools require approval. There is no approval process. There are no approved tools. Everyone knows the rule exists and everyone knows nobody enforces it. The Paper Ban is the most common archetype and the most corrosive, because it gives legal cover to leaders while giving permission to nobody. The KPMG study found that only 40% of employees said their workplace had a policy or guidance on generative AI use. I suspect many of the rest work under a Paper Ban they have never seen.</p></li><li><p><strong>The Selective Ban.</strong> AI is banned for most staff, but quietly allowed for a favoured few: the leadership team, the innovation lab, the consultants. The Selective Ban teaches the rest of the organisation that AI is a privilege of status rather than a tool of the job. Survey work this year suggests that decision-makers are often more likely to use unsanctioned AI than the staff below them, which makes the Selective Ban not just unfair but faintly comic.</p></li><li><p><strong>The Perpetual Pilot.</strong> This one does not call itself a ban. It calls itself a pilot. A small group gets access to a sanctioned tool &#8220;while we evaluate&#8221;. The evaluation never ends. Eighteen months later, the pilot group is still the only group with access, and everyone else has long since found their own tools. The Perpetual Pilot is a ban with a better press office.</p></li></ul><p>What unites all four is that they answer the wrong question. They ask, &#8220;should our people use AI?&#8221; That question was settled by the people themselves, years ago, without asking permission. The only live question is, &#8220;how should they use it, and how will we know?&#8221;</p><div><hr></div><h3>The uncomfortable truths</h3><p><strong>A ban is the easiest policy a leader can write.</strong> It requires no understanding of the work, no budget for tools and no difficult conversations about which data matters. It produces a clean memo, a clear audit trail and a clear conscience. That comfort is precisely why it is so popular, and precisely why it should be treated with suspicion.</p><p><strong>Your real adoption rate is higher than your licence count.</strong> If you have bought seats for 10% of your workforce and banned everything else, you do not have 10% adoption. You have 10% visible adoption and an unknown amount of invisible adoption. On the evidence above, the invisible part is probably the larger one.</p><p><strong>The people breaking your ban are often your best people.</strong> The workers most likely to route around a ban are the ones under the most pressure to deliver and the most curious about better methods. A ban does not punish your least diligent staff. It punishes the ones trying hardest, or teaches them to hide.</p><p><strong>Fear is not a control.</strong> Security teams know this better than anyone. A control is something you can test, monitor and audit. A threat of dismissal is none of those things. It only works on people who expect to be caught, and the whole point of shadow AI is that nobody expects to be caught.</p><p><strong>The risk you can see is always smaller than the risk you cannot.</strong> A sanctioned tool with data controls, logging and a clear owner carries risk. An unsanctioned tool on a personal phone carries the same risk with none of those things. The choice is never between risk and no risk. It is between risk you can manage and risk you cannot even count.</p><div><hr></div><h3>What to do instead</h3><p>Replacing a ban does not mean replacing it with a free-for-all. It means replacing a single prohibition with a small number of clear answers. A real AI policy answers four questions: which tools are sanctioned and why they beat the free alternative, which data may never leave the building, who owns and checks the output before it reaches a customer, and how people disclose their use without being punished for honesty. Here is what that means depending on where you sit.</p><p><strong>If you are early in your career:</strong></p><ul><li><p>Do not hide your AI use. Hidden use is invisible skill, and invisible skill does not get promoted. The ability to use AI well, check its output and explain how you got to an answer is one of the most valuable things you can demonstrate right now, but only if someone can see it.</p></li><li><p>Learn your organisation&#8217;s data boundaries before you learn its prompts. Know which information is confidential, which is personal and which is regulated. The fastest way to end an early career is to be the person whose upload appears in the breach report.</p></li><li><p>If there is no sanctioned tool, ask for one, in writing, with a specific use case. You become the person who surfaced the problem rather than the person caught causing it. That is a much better reputation to have.</p></li></ul><p><strong>If you are hiring:</strong></p><ul><li><p>Ask candidates how they use AI, and reward honest answers. If your interview treats every mention of AI as cheating, you are selecting for people who conceal, and you will get a workforce of them.</p></li><li><p>Test judgement about data, not just fluency with tools. Give candidates a scenario: a deadline, a confidential document, a public chatbot. What would they do? The answer tells you more than any prompt-writing exercise.</p></li><li><p>Look for people who can describe a time AI got something wrong and how they caught it. That is the skill your policy depends on.</p></li></ul><p><strong>If you are leading:</strong></p><ul><li><p>Count before you rule. Before you write or rewrite any AI policy, find out what is already happening. Run an anonymous survey. Look at network traffic. Ask teams directly, and promise no consequences for the answer. You cannot govern a behaviour you have refused to measure.</p></li><li><p>Make the sanctioned path easier than the shadow one. People route around friction, not principles. If the approved tool requires a three-week access request and the free one requires a phone, you have already lost. Speed of access is a security control.</p></li><li><p>Write rules about data, not about tools. Tools change every quarter. The categories of information you must protect change far more slowly. A policy that says &#8220;never paste customer personal data into any tool that is not on this list&#8221; will outlive any list of banned websites.</p></li><li><p>Create an amnesty. Tell people that disclosing their current AI use will not be punished, and mean it. The information you gain about what your workforce actually needs is worth far more than the satisfaction of enforcing a rule nobody followed.</p></li><li><p>Replace &#8220;never&#8221; with &#8220;here is how&#8221;. Every blanket ban is a training budget you chose not to spend. Every hour you spend teaching people to use AI safely is an hour they do not spend teaching themselves in secret.</p></li></ul><div><hr></div><h3>The memo you should have written</h3><p>Go back to that Samsung memo in 2023. It was a reasonable reaction to a real incident, and I do not think the people who wrote it were foolish. They did what responsible institutions have always done when a new tool arrives faster than their understanding of it. They reached for the lever marked &#8220;stop&#8221;.</p><p>The trouble is that the lever is not connected to anything. Prohibition did not stop New York drinking. Blocking smartphones did not stop people reading work email in bed. Banning AI has not stopped people using AI. Every time, the lever only did one thing: it moved the behaviour to a place where the institution could no longer see it, shape it or learn from it.</p><p>The memo that would actually have reduced the risk would have been longer and harder to write. It would have said: here are the tools you may use, here is the data you must never share, here is who checks the output and here is how to tell us what you are doing without fear. It would have required investment, judgement and honesty about how work really gets done.</p><p>That memo is still available to any leader willing to write it. The alternative is to keep the ban, keep the clean conscience and keep the comfortable silence that comes with it.</p><p>Just remember what that silence means. You did not stop AI. You stopped hearing about it.</p>]]></content:encoded></item><item><title><![CDATA[The Atrophy Dividend.]]></title><description><![CDATA[Exploring how the productivity AI pays out today is funded by a quiet withdrawal of human skill that no dashboard measures, and why the people making the withdrawal are the last to feel poorer.]]></description><link>https://www.shapingminds.co/p/the-atrophy-dividend</link><guid isPermaLink="false">https://www.shapingminds.co/p/the-atrophy-dividend</guid><dc:creator><![CDATA[Maxime Mouton]]></dc:creator><pubDate>Tue, 20 Oct 2026 23:02:03 GMT</pubDate><enclosure url="https://substackcdn.com/image/fetch/$s_!B8Lr!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F3a516e0f-8e4e-4f37-a2ce-56146306c169_1254x1254.png" length="0" type="image/jpeg"/><content:encoded><![CDATA[<div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!B8Lr!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F3a516e0f-8e4e-4f37-a2ce-56146306c169_1254x1254.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!B8Lr!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F3a516e0f-8e4e-4f37-a2ce-56146306c169_1254x1254.png 424w, https://substackcdn.com/image/fetch/$s_!B8Lr!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F3a516e0f-8e4e-4f37-a2ce-56146306c169_1254x1254.png 848w, https://substackcdn.com/image/fetch/$s_!B8Lr!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F3a516e0f-8e4e-4f37-a2ce-56146306c169_1254x1254.png 1272w, https://substackcdn.com/image/fetch/$s_!B8Lr!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F3a516e0f-8e4e-4f37-a2ce-56146306c169_1254x1254.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!B8Lr!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F3a516e0f-8e4e-4f37-a2ce-56146306c169_1254x1254.png" width="1254" height="1254" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/3a516e0f-8e4e-4f37-a2ce-56146306c169_1254x1254.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:1254,&quot;width&quot;:1254,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:465716,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:false,&quot;topImage&quot;:true,&quot;internalRedirect&quot;:&quot;https://www.shapingminds.co/i/220799517?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F3a516e0f-8e4e-4f37-a2ce-56146306c169_1254x1254.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!B8Lr!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F3a516e0f-8e4e-4f37-a2ce-56146306c169_1254x1254.png 424w, https://substackcdn.com/image/fetch/$s_!B8Lr!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F3a516e0f-8e4e-4f37-a2ce-56146306c169_1254x1254.png 848w, https://substackcdn.com/image/fetch/$s_!B8Lr!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F3a516e0f-8e4e-4f37-a2ce-56146306c169_1254x1254.png 1272w, https://substackcdn.com/image/fetch/$s_!B8Lr!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F3a516e0f-8e4e-4f37-a2ce-56146306c169_1254x1254.png 1456w" sizes="100vw" fetchpriority="high"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image buttonBase-GK1x3M"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image buttonBase-GK1x3M"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><h3>The account nobody checks</h3><p>Imagine a bank that publishes a glowing dividend report every quarter. Payouts up. Returns up. Customers delighted. Then imagine that the bank has stopped publishing its balance sheet, and no regulator, board member or journalist has thought to ask why. The dividends are real money, deposited in real accounts. What nobody can tell you is what they are being paid out of.</p><p>That is where most organisations stand with AI today. Every adoption dashboard in every leadership deck shows the same pleasing shape: usage climbing, throughput climbing, time-to-draft collapsing. All of it is true. And all of it measures the yield. Almost none of it measures the principal: the accumulated human capability, built over years of difficult, slightly painful practice, that the yield is quietly being drawn against.</p><p>This edition is about that second number. Call the first one the <strong>Atrophy Dividend</strong>: the short-term performance gain AI pays out today, funded by a long-term skill withdrawal that no instrument in your organisation is built to detect. The unnerving part is not that the withdrawal happens. The unnerving part is that, by design, the people making it feel richer while they do.</p><div><hr></div><h3>A fifth of an edge, gone</h3><p>In August 2025, <em>The Lancet Gastroenterology &amp; Hepatology</em> published a study that deserves to be taught in every business school, although it is about colonoscopies. Researchers observed 19 experienced endoscopists, each with more than 2,000 procedures behind them, working across four centres in Poland. Before AI-assisted detection was introduced, these doctors found adenomas, the precancerous growths they are paid to find, in 28.4% of the colonoscopies they performed unaided. After a period of routine AI use, the researchers looked at the same doctors performing procedures without the AI. Their detection rate had fallen to 22.4%. That is a six-point absolute drop and roughly a 20% relative decline in a life-and-death skill, in people who were already experts.</p><p>Nobody did anything wrong. The AI worked: with the system switched on, detection came in at 25.3%. These were not careless clinicians. They were excellent clinicians who had, without deciding to, started leaning on a very good crutch, and a body of expertise that had taken years to build began to dim in a matter of months. The study&#8217;s lead clinician, Dr Marcin Roma&#324;czyk, described it as the first to suggest a negative impact of regular AI use on health professionals&#8217; ability to complete a patient-relevant task. An accompanying commentary warned of &#8220;the quiet erosion of fundamental skills.&#8221;</p><blockquote><p><strong>&#8220;You are gaining something in the short term that might result in losses in the long term.&#8221;</strong></p><p><strong>Mohammad Hossein Jarrahi, University of North Carolina at Chapel Hill, on the cognitive debt of delegating decisions to AI (as reported by HCA Magazine)</strong></p></blockquote><p>Jarrahi&#8217;s phrase, <em>cognitive debt</em>, is the right one, with one amendment. A debt implies a statement: a number you can look at, a repayment schedule, a creditor who will eventually call. Skill atrophy has none of these. It is a debt with no ledger, which is exactly why it compounds.</p><div><hr></div><h3>We have seen this film before</h3><p>None of this is new. It is simply arriving in a new industry. In 1983, the psychologist Lisanne Bainbridge published a short paper in the journal <em>Automatica</em> titled &#8220;Ironies of Automation.&#8221; Her argument was devastating in its economy. Automate the routine parts of a task, she wrote, and you leave the human with the exceptions: the rare, difficult, unrehearsed cases the machine cannot handle. But the human can no longer practise on the routine cases, because the machine has absorbed them. So the person you most need at the worst moment is also the person who has had the least chance to prepare for it. The better the automation, the crueller the irony.</p><p>Aviation learned this by crashing. After a series of accidents in which crews struggled to fly manually when the automation failed or confused them, the US Federal Aviation Administration issued a safety alert in January 2013 encouraging airlines to promote manual flight operations and to give pilots more hands-on time. Pilots now log deliberate manual flying not because autopilots are bad, but because autopilots are so good that human proficiency decays without being protected on purpose.</p><p>Notice what aviation did that most workplaces have not. It admitted the decay was structural. It did not blame individual pilots for getting rusty, and it did not ask them to &#8220;be more careful.&#8221; It built practice into the system. The industry treated skill the way a bank treats capital: as something that must be actively held in reserve, not assumed to be there.</p><p>Knowledge work has nothing like it. We handed our drafting, analysing, summarising and coding to a tool with extraordinary range, and we did it faster than any profession has ever adopted anything. We have no equivalent of manual flight hours. We barely have the vocabulary.</p><div><hr></div><h3>The mechanism: supervising is not practising</h3><p>Why does the decay happen so reliably? Because expertise is not a possession. It is not a file you saved once and can open again. It is a pattern of connections that is maintained by use, and specifically by <strong>retrieval and production under difficulty</strong>: the moment you stare at the blank page, the awkward dataset, the bug that won&#8217;t yield, and have to generate something from what you know.</p><p>AI removes precisely that moment. And what it leaves behind looks like work, feels like work, and is billed as work, but is a different cognitive activity. The AI produces; the human reviews. Review is <em>recognition</em>, and recognition is the easy half of expertise. You can approve a thousand well-formed analyses and become steadily worse at writing one, because nothing in the approving requires you to reach.</p><p>Three pieces of evidence show how this plays out.</p><p><strong>Evidence one: the learning penalty.</strong> In January 2026, Judy Hanwen Shen and Alex Tamkin at Anthropic published a randomised trial with 52 mostly junior software engineers, each with at least a year of weekly Python experience, asked to learn an unfamiliar library. Half used an AI assistant; half did not. On a comprehension quiz afterwards, the AI group averaged 50%; the hand-coding group averaged 67%, a gap the authors described as nearly two letter grades (Cohen&#8217;s d of 0.738). The speed gain that was supposed to justify the trade was about two minutes and did not reach statistical significance. In other words: a large, measurable loss of understanding, purchased for almost no measurable time.</p><p><strong>Evidence two: the scrutiny penalty.</strong> A team at Microsoft Research and Carnegie Mellon, led by Hao-Ping Lee, surveyed 319 knowledge workers about 936 real examples of using generative AI at work, and published the results at CHI 2025. Their central finding was a confidence paradox: the more confident someone was in the AI, the less critical thinking they reported applying to its output. Confidence in themselves pointed the other way. Trust in the machine and scrutiny of the machine moved in opposite directions, and scrutiny is where a surprising amount of professional skill actually lives.</p><p><strong>Evidence three: the real-world penalty.</strong> The Lancet study, above, shows what these laboratory effects look like once they escape the lab: not a quiz score, but a missed cancer.</p><p>Three different populations. Three different measures. One direction.</p><div><hr></div><h3>What gets lost: the invisible reserve</h3><p>If you take these findings seriously, a new category of organisational asset comes into view. Call it the <strong>reserve</strong>: the portion of your workforce&#8217;s capability that is not being used on any given day, but that you are relying on to exist when something goes wrong.</p><p>The reserve is the senior analyst who can sniff out that a model&#8217;s output is subtly off because she once built forecasts by hand. It is the engineer who knows what the stack trace means because he has read ten thousand of them without help. It is the editor who can tell the draft is hollow because she has written a thousand hollow drafts herself and learned what they feel like from the inside. None of these abilities shows up in a day-to-day output metric, because on a normal day the AI is right and the reserve sits idle. Its entire value is realised in the exception.</p><p>And that is the trap. Reserves look like waste to any optimisation process. A finance team looking at a human who &#8220;isn&#8217;t needed&#8221; for routine cases will see overcapacity. A well-meaning manager will see an opportunity to redeploy. The reserve is liquidated, slowly, by a thousand sensible decisions, and the first sign that it ever existed is the day it is needed and found missing.</p><p>There is a second, subtler loss: <strong>the pipeline</strong>. Today&#8217;s reserve was built by yesterday&#8217;s routine work. The junior who used to write the first draft, run the first reconciliation, debug the first ticket was not merely producing output. She was becoming a senior. Remove the routine cases and you remove the staircase by which novices climb. We explored this in an earlier edition under the name of the apprenticeship problem; the atrophy dividend is its adult cousin. One stops the reserve from forming. The other drains the reserve that already exists.</p><p>And there is a third: <strong>the calibration</strong>. If you no longer do a thing yourself, you lose your sense of how long it should take, what good looks like and where the traps are. You become a poor judge of the very output you are signing off. This is why the Microsoft/CMU finding matters so much. Skill is not only the ability to produce. It is the ability to know when something is wrong. Lose the first and the second goes with it.</p><div><hr></div><h3>A taxonomy of AI users: four ways to hold the tool</h3><p>Not everyone who uses AI is on the same trajectory. The Anthropic trial is particularly valuable here, because it looked not just at whether people used the assistant but at <em>how</em>. Three interaction patterns preserved learning: generating code and then asking follow-up questions to understand it, asking for explanations alongside code, and asking only conceptual questions while debugging independently. What separates these from the low-scoring patterns is that the human stays cognitively in the loop. Drawing on that, and on the broader literature, it is useful to think of four archetypes.</p><p><strong>The Passenger.</strong> The Passenger prompts, receives, pastes. The output arrives complete, and the Passenger&#8217;s role is to forward it. Passengers are the fastest people in the building and, over any horizon longer than a quarter, the most fragile. They accumulate output but not understanding, and their confidence in the tool, per the Microsoft/CMU data, is highest exactly where their scrutiny is lowest. A Passenger is one outage, one hallucination or one unusual client request away from a very visible problem.</p><p><strong>The Proofreader.</strong> The Proofreader reads everything the AI produces and corrects the visible flaws. This feels responsible, and it is better than being a Passenger. But proofreading is recognition, not production, and the Proofreader&#8217;s underlying skill slowly erodes while their sense of diligence stays intact. Of the four archetypes this is the most dangerous, because it is the most self-deceiving. The Proofreader is working hard and getting weaker.</p><p><strong>The Sparring Partner.</strong> The Sparring Partner attempts the problem first, or at least frames it, then uses the AI to challenge, extend and explain. They generate and then interrogate. They ask why, not just what. This maps closely onto the interaction patterns that preserved learning in the Anthropic trial. They are slightly slower on any single task and meaningfully faster at improving over time.</p><p><strong>The Fire Marshal.</strong> The Fire Marshal is a role as much as a type: the person, usually a leader, who treats capability as infrastructure. They ask which skills the team could not perform without the tool, they schedule unassisted work on purpose, and they measure what the team can do with the system switched off. The Fire Marshal is the rarest archetype and the one organisations need most, because individuals cannot solve a structural problem with personal discipline alone.</p><p>It is worth being honest about the incentives. Almost everything in a typical workplace rewards the Passenger: faster output, quicker turnaround, visible adoption. Almost nothing rewards the Sparring Partner, whose benefits are deferred and invisible. If you leave this to individual virtue, the Passengers will win the performance review and the Sparring Partners will quietly outlast them. That is a bet most firms have not knowingly made.</p><div><hr></div><h3>The uncomfortable truths</h3><p><strong>The first uncomfortable truth: the loss feels like a gain.</strong> This is what sets skill atrophy apart from most operational risks. With the tool on, you perform better, and so you feel sharper. The decline only becomes visible when the tool is off, wrong or out of its depth, which is precisely the situation you were hoping never to face. Every individual signal says you are improving. The signal that says otherwise only arrives at the worst possible moment.</p><p><strong>The second: your metrics are structurally blind to it.</strong> Output per head, turnaround time, tickets closed, drafts shipped: every standard measure improves while the reserve declines. You are optimising a number that is positively correlated with the problem. A dashboard that celebrates AI adoption without measuring unassisted capability is not neutral. It actively rewards the drawdown.</p><p><strong>The third: it is irreversible faster than it is visible.</strong> Skills that took years to build can erode in months. Jarrahi is blunt about the end state: in many cases, he says, the skill is gone and he doubts it can be redeveloped. Whether or not that is always true, the asymmetry is real. Building expertise is slow. Losing it is fast. And the loss tends to be noticed after the window to prevent it has closed.</p><p><strong>The fourth: this is not an argument against AI.</strong> The Lancet study found that the AI genuinely helped. Anthropic&#8217;s trial found that some ways of using it protected learning. Nothing here says to stop. It says to stop treating the yield as the whole story. A person who takes a dividend while checking the principal is an investor. A person who takes a dividend and never looks is, eventually, an heir to nothing.</p><div><hr></div><h3>Practical implications: running the reserve like capital</h3><p>The aviation analogy is useful because it points to a solution that is neither Luddite nor naive. The answer is not to take away the autopilot. It is to protect the manual hours deliberately. Here is what that looks like at three levels.</p><p><strong>If you are early in your career.</strong> The struggle you are tempted to skip is the apprenticeship. The practical rule is simple: attempt before you ask. Write the bad first draft, sketch the approach, form a hypothesis, then bring in the AI to challenge it. When you do ask for code or text, ask it to explain its choices, and do not close the window until you could reproduce the logic. This is the Sparring Partner pattern, and the evidence suggests it is not just virtuous but effective. Treat unassisted practice the way an athlete treats training: something you do precisely because the match does not need it today. You are building the reserve that will make you valuable when the easy cases are all automated.</p><p><strong>If you hire and manage.</strong> Stop using speed and visible AI usage as proxies for competence. Add an unassisted component to hiring, promotion and review, sometimes, on the hard cases: a live problem-solving session, an annotated walkthrough of how someone reached a conclusion, a task where the tool is deliberately unavailable. Ask people to explain the AI&#8217;s output, not just ship it. Notice who can say where the output is likely to be wrong. That person has a functioning reserve. The one who cannot is, however fast, a Passenger. And be careful with workload: the single biggest driver of Passenger behaviour is overload, not laziness. People who are drowning do not practise.</p><p><strong>If you lead.</strong> Treat capability as a balance-sheet item. Identify the five or six skills your organisation could not survive losing, then ask honestly how many people could perform them today without the tool. Schedule unassisted work: manual-flight hours, in aviation&#8217;s terms. That might be a monthly &#8220;tools-off&#8221; review of a critical process, rotation of juniors through unassisted work so the pipeline keeps forming, or tabletop exercises in which the AI is declared unavailable and the team must recover. Build a continuity plan that humans can actually execute, written by people who have done the work and reviewed by people who could do it again. Then measure it. Add a capability metric next to the productivity one, and watch the pair rather than either alone. If you only chart the dividend, you will keep paying it until the principal runs out.</p><p>One more practical point, for all three levels: pay attention to which tasks you give away, not just how many. Some tasks are pure friction and should be automated with a clear conscience. Others are the exercise that keeps the muscle alive. The skill is in telling them apart, and that judgement is itself a thing you only retain by continuing to practise.</p><div><hr></div><h3>The statement that never arrives</h3><p>The cruellest feature of the atrophy dividend is its timing. Gains arrive immediately, loudly and with a dashboard. Losses arrive late, quietly and without a name. A financial institution that behaved like this would be shut down. A workforce that behaves like this is called &#8220;AI-forward.&#8221;</p><p>The endoscopists in Poland were not careless. They were excellent, and they were given an excellent tool, and in a matter of months a fifth of their unaided edge was gone. Nobody told them. No alarm sounded. The only reason we know is that someone thought to run the unassisted numbers again.</p><p>That is the whole assignment for the coming year. Not to resist the tool, and not to celebrate it uncritically, but to find out what you still own when it is switched off. Check the principal. Schedule the manual hours. Reward the people who can still do the thing, not only the people who can get it done.</p><p>Because every shortcut is a withdrawal from a skill account you cannot see, and the statement does not come in the post. The overdraft just shows up one day, in a room where the tool does not work and everyone is looking at you.</p>]]></content:encoded></item><item><title><![CDATA[The Workslop Tax.]]></title><description><![CDATA[Exploring how a quietly named workplace phenomenon, AI-generated work that looks finished but isn't, has become an invisible tax employees pay on each other's shortcuts, and what the fix could be.]]></description><link>https://www.shapingminds.co/p/the-workslop-tax</link><guid isPermaLink="false">https://www.shapingminds.co/p/the-workslop-tax</guid><dc:creator><![CDATA[Maxime Mouton]]></dc:creator><pubDate>Tue, 13 Oct 2026 23:02:05 GMT</pubDate><enclosure url="https://substackcdn.com/image/fetch/$s_!gp47!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F7c529643-d767-41e5-bc43-69b4bc78cb4e_1024x1024.png" length="0" type="image/jpeg"/><content:encoded><![CDATA[<div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!gp47!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F7c529643-d767-41e5-bc43-69b4bc78cb4e_1024x1024.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!gp47!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F7c529643-d767-41e5-bc43-69b4bc78cb4e_1024x1024.png 424w, https://substackcdn.com/image/fetch/$s_!gp47!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F7c529643-d767-41e5-bc43-69b4bc78cb4e_1024x1024.png 848w, https://substackcdn.com/image/fetch/$s_!gp47!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F7c529643-d767-41e5-bc43-69b4bc78cb4e_1024x1024.png 1272w, https://substackcdn.com/image/fetch/$s_!gp47!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F7c529643-d767-41e5-bc43-69b4bc78cb4e_1024x1024.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!gp47!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F7c529643-d767-41e5-bc43-69b4bc78cb4e_1024x1024.png" width="1024" height="1024" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/7c529643-d767-41e5-bc43-69b4bc78cb4e_1024x1024.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:1024,&quot;width&quot;:1024,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:379120,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:false,&quot;topImage&quot;:true,&quot;internalRedirect&quot;:&quot;https://www.shapingminds.co/i/220220606?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F7c529643-d767-41e5-bc43-69b4bc78cb4e_1024x1024.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!gp47!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F7c529643-d767-41e5-bc43-69b4bc78cb4e_1024x1024.png 424w, https://substackcdn.com/image/fetch/$s_!gp47!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F7c529643-d767-41e5-bc43-69b4bc78cb4e_1024x1024.png 848w, https://substackcdn.com/image/fetch/$s_!gp47!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F7c529643-d767-41e5-bc43-69b4bc78cb4e_1024x1024.png 1272w, https://substackcdn.com/image/fetch/$s_!gp47!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F7c529643-d767-41e5-bc43-69b4bc78cb4e_1024x1024.png 1456w" sizes="100vw" fetchpriority="high"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image buttonBase-GK1x3M"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image buttonBase-GK1x3M"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p>Denise runs marketing operations at a mid-sized software company, and on a Tuesday morning in late 2025 she got a Slack message from a junior analyst on her team: &#8220;competitive landscape deck attached, ready for the leadership review tomorrow!&#8221; The deck was seventeen slides, cleanly formatted, with a colour-coded matrix comparing eleven competitors across nine dimensions, complete with a five-bullet &#8220;strategic implications&#8221; summary on the final slide. At a glance, in the ninety seconds she had before her next meeting, it looked like exactly what she&#8217;d asked for.</p><p>It took her until nearly midnight to discover it wasn&#8217;t. Three of the eleven competitors had been discontinued or acquired more than a year earlier: information that was publicly available and trivially searchable, but which nobody had bothered to check because the deck itself looked too polished to need checking. Two of the &#8220;differentiators&#8221; listed for her own company&#8217;s product were features that had been deprecated in the last release. The &#8220;strategic implications&#8221; bullets were fluent, confident, and completely disconnected from the actual data in the matrix above them, in the specific way that happens when a document is generated end-to-end rather than built up from verified pieces. She spent that night rebuilding the deck from scratch, because by the time she&#8217;d finished checking it, fixing it would have taken longer than starting over.</p><p>The analyst hadn&#8217;t lied to her, exactly. He&#8217;d fed a prompt into a chatbot, gotten back something that looked like a finished competitive analysis, formatted it nicely, and sent it along in genuine good faith, under real time pressure, believing he&#8217;d done the job. In his mind, the deck was done. In Denise&#8217;s, it had just become a different job entirely: verifying and rebuilding something that presented itself as already trustworthy. Nobody in that exchange thinks of themselves as having produced or received a failure. That&#8217;s precisely what makes it so hard to see, and why it took researchers naming the pattern before most organisations noticed they were drowning in it.</p><div><hr></div><h3>Naming the thing</h3><p>In September 2025, researchers at BetterUp Labs and the Stanford Social Media Lab surveyed 1,150 full-time U.S. desk workers and gave this pattern a name that stuck almost immediately across the business press:</p><p> workslop. Their definition is precise, and worth sitting with, because it&#8217;s narrower than &#8220;bad AI content&#8221;: workslop is AI-generated work that <em>looks</em> complete and polished on the surface, but lacks the substance to actually accomplish the task it was meant to accomplish, and in doing so, quietly offloads the real cognitive labour onto whoever receives it next.</p><p>The numbers were larger than almost anyone in the study expected going in. Forty percent of employees said they&#8217;d received workslop from a colleague in just the past month. Workers estimated that 15.4% of everything they receive from teammates now falls into this category. More than half of managers, 54%, report receiving it regularly, compared with 38.5% of individual contributors, a gap that makes sense once you realise managers sit at the checkpoint where unfinished thinking either gets caught or ships to a client. And more than half of respondents, 53%, admitted to having sent workslop themselves at least once, which is the detail that turns this from a story about a few careless employees into a story about an entire incentive structure.</p><p>Stanford&#8217;s Jeff Hancock, who co-led the research, described the underlying shift in a way that cuts closer to the mechanism than most coverage of &#8220;AI at work&#8221; usually gets:</p><blockquote><p>&#8220;Now that [the effort] piece is gone, I can generate a lot of useless or unproductive content very easily.&#8221;</p></blockquote><p>That sentence is worth reading twice. It isn&#8217;t a complaint about AI quality. It&#8217;s a description of what happens when the cost of producing the appearance of finished work drops to nearly zero, while the cost of verifying whether it&#8217;s actually finished stays exactly where it always was: squarely on another human being&#8217;s afternoon.</p><div><hr></div><h3>How we got here: a familiar shape wearing a new name</h3><p>Every technology that lowers the cost of producing plausible-looking output eventually produces some version of this problem, and it&#8217;s worth being honest that workslop isn&#8217;t entirely unprecedented. Desktop publishing software in the 1990s produced a wave of beautifully formatted internal memos that said almost nothing: the joke at the time was that PowerPoint had made it possible to look prepared without being prepared. Stock photography and template decks did something similar a decade later: professional-looking scaffolding standing in for actual thinking. What&#8217;s different this time is the scale, the speed, and the specific way the deception operates. A 1990s memo took real time to format even if it said nothing. Workslop takes twelve minutes to generate something that would have taken three hours to produce honestly, and it does so with a fluency and internal consistency that makes the absence of substance far harder to spot on a first read than a sloppy old-fashioned memo ever was.</p><p>There&#8217;s a useful contrast with an adjacent, better-known failure mode: AI hallucination. Hallucination is usually a factual problem: the model states something false with confidence, and once you catch it, the fix is straightforward: correct the fact. Workslop is structurally different and, in a specific sense, more corrosive: nothing in it may be technically false. The competitor names in Denise&#8217;s deck were real companies. The formatting was accurate. What was missing wasn&#8217;t correctness: it was judgement about what actually mattered, what needed verifying, and what the document was supposed to accomplish for the person receiving it. You can fact-check a hallucination. It&#8217;s much harder to fact-check the absence of thought.</p><p>The MIT Media Lab&#8217;s NANDA initiative added a data point in August 2025 that reads, at first, like a completely separate finding, but fits the workslop pattern almost exactly: 95% of organisations piloting generative AI in business processes report no measurable return on that investment. Adoption metrics across the same organisations were climbing fast: more licences issued, more tools rolled out, more employees &#8220;using AI&#8221; by any usage-log definition. The value those adoption charts were supposed to represent simply wasn&#8217;t showing up in the numbers that mattered. Workslop is a large part of the missing link between those two graphs: usage goes up and to the right, while a meaningful share of what that usage produces creates net-negative work for whoever downstream has to deal with it.</p><div><hr></div><h3>The mechanism: fluency severed from labour</h3><p>Here is the mechanism in its simplest form. Human communication has always used fluency (clean structure, confident tone, professional formatting) as a rough, imperfect but genuinely useful proxy for effort and thought. A well-organised report was reasonable evidence that someone had done the underlying work, not because fluency and substance are the same thing, but because, historically, producing fluent output without substance took almost as much effort as just doing the work properly. That coupling has now snapped, cleanly and almost overnight, for a huge share of everyday knowledge work.</p><p>A generative model can produce fluency (clean structure, confident tone, polished formatting) for close to zero marginal effort, entirely independent of whether any actual thinking happened underneath it. That means the signal receivers have relied on for decades to triage their attention, &#8220;does this look put-together?&#8221;, has stopped correlating reliably with the thing it was always a proxy for. And because most people haven&#8217;t consciously updated their triage instincts to reflect that, workslop routinely sails through the first-glance filter that would have caught a genuinely sloppy, honestly-unfinished piece of work in the pre-AI era. Ironically, the worse and more obviously rushed a document looks, the more scrutiny it tends to get. Workslop is dangerous specifically because it looks finished, which is exactly when people&#8217;s guard comes down.</p><p>The direction of flow matters too, and the study&#8217;s data on it is telling. Workslop moves sideways between peers 40% of the time, up to managers 19% of the time, and down from leaders to teams 16% of the time. It isn&#8217;t concentrated at any single level of seniority: it&#8217;s a property of the incentive structure itself, appearing wherever someone faces a task, a time constraint, and a tool that can manufacture the appearance of having met the deadline faster than actually meeting it.</p><p>There&#8217;s also a straightforward asymmetry hiding inside the mechanism, and it&#8217;s the part that makes workslop so durable once it starts. Generating fluent, plausible-looking output costs the sender almost nothing: a prompt, a few seconds of model latency, a quick skim for typos. Verifying that same output properly, checking the numbers, confirming the named facts, testing whether the logic actually holds together, costs the recipient real time and real attention, often more than it would have taken to produce the thing honestly from scratch. Any system where the cost of producing a claim is a rounding error compared with the cost of checking it will, predictably, fill up with unverified claims. That isn&#8217;t a statement about anyone&#8217;s character. It&#8217;s closer to a law of incentives, and it would apply to workslop&#8217;s human-only predecessors too, if humans could generate boilerplate as cheaply as a model can.</p><div><hr></div><h3>What gets lost</h3><p>The most visible cost is the time. The average piece of workslop costs its recipient one hour and fifty-one minutes to identify, unpick, and either fix or redo: about twenty minutes longer, on average, than it would have taken the original sender to simply do the work properly the first time. Multiply that across a large organisation and BetterUp&#8217;s researchers arrive at roughly $186 in wasted time per affected employee per month, or north of $9 million a year in a company of 10,000 people. That number exists nowhere on any organisation&#8217;s financial statements, because there is no line item for &#8220;hours spent decoding a colleague&#8217;s chatbot output,&#8221; even though the hours are entirely real and entirely lost.</p><p>The second cost is relational, and the study&#8217;s data here is sharper than most coverage of it acknowledges. When people receive workslop, 54% report feeling annoyed, 46% frustrated, 38% confused, and 22% describe themselves as outright offended: a striking word to use about a piece of office correspondence, and a sign of how personally people take being handed something that wastes their time while pretending not to. More consequentially, more than half of recipients say the experience made them view the sender as less creative, less capable, and less reliable. Over 40% see the sender as less trustworthy going forward. Nearly a third say they&#8217;re less willing to collaborate with that person again. The person who sent the workslop, in other words, thought they were being efficient. Their colleague now quietly trusts them less: a cost that never shows up in any productivity metric, but shows up very clearly the next time that person needs a favour, a reference, or the benefit of the doubt.</p><p>The third cost is the hardest to quantify and, in the long run, probably the most important: an erosion of the norm that finished work should actually be finished before it leaves your hands. Once workslop becomes common enough inside a team, the entire distribution of trust shifts. People start reflexively re-verifying things that used to be safe to take at face value, which is its own tax, levied on everyone, including the honest senders who never produced a slop deck in their lives.</p><div><hr></div><h3>Four ways this shows up</h3><p>Not everyone producing or receiving workslop is doing the same thing for the same reason, and collapsing all of it into &#8220;people being lazy with AI&#8221; misses most of what&#8217;s actually happening. Four recognisable patterns show up across the research and across most teams once you start looking for them.</p><p><strong>The Overwhelmed Corner-Cutter.</strong> Genuinely underwater (too many deliverables, not enough hours) and reaching for AI as the only way to hit a deadline that was unrealistic before AI ever entered the picture. This person isn&#8217;t being dishonest so much as making a rational trade under bad constraints: something delivered on time beats something correct delivered late, in a culture that measures the former far more visibly than the latter.</p><p><strong>The Mandate Follower.</strong> Was told, often vaguely, to &#8220;use AI more&#8221; by leadership eager to show adoption numbers, with no accompanying guidance on where AI output still needs human judgement layered on top. This person is complying with an instruction as literally as it was given. The resulting workslop isn&#8217;t a personal failure so much as a predictable outcome of an unclear directive handed down without the quality guardrails to go with it.</p><p><strong>The Confident Skimmer.</strong> Uses AI output as a first draft with every intention of reviewing it properly, then runs out of time, attention, or diligence before the review actually happens, and ships the draft anyway, genuinely believing it&#8217;s closer to finished than it is. This is arguably the largest and most sympathetic category, and the hardest to fix with policy alone, because the failure happens silently, inside someone&#8217;s own judgement about their own remaining time.</p><p><strong>The Downstream Absorber.</strong> The recipient-side archetype: the manager, teammate, or client-facing employee who catches workslop before it does real damage, at direct personal cost: the extra two hours, the late night, the quiet erosion of trust in a colleague they still have to work with tomorrow. This is the person actually paying the tax the other three archetypes generate, and the one whose cost is least visible in any usage dashboard, because absorbing workslop successfully looks, from the outside, exactly like normal work getting done.</p><p>Most teams contain some blend of all four simultaneously, which is exactly why a single fix (a training session, a new AI usage policy, a stern all-hands email) rarely solves the whole problem on its own. Solve for the Mandate Follower with clearer guidance and you&#8217;ll still have Overwhelmed Corner-Cutters reaching for the fastest available option under deadline pressure the guidance never addressed, and Confident Skimmers whose failure happens entirely inside their own private judgement about how much review time they actually have left. A policy aimed at one archetype is, at best, a partial fix for the other three.</p><div><hr></div><h3>What actually holds up</h3><p>The researchers behind the original study were careful to frame their findings as a management problem rather than an individual-behaviour problem, and the practical implications follow from taking that framing seriously.</p><p>For individual contributors: treat AI-generated first drafts exactly like drafts, not like finished deliverables, regardless of how polished they look on screen. The specific discipline that helps most is verifying the parts of any AI output that are cheapest to fake convincingly (named facts, comparative claims, anything presented with confident specificity) because those are precisely the details that read as most credible while requiring the least underlying effort to fabricate.</p><p>For managers: the instinct to reward speed and visible AI adoption needs a counterweight that explicitly values verified, load-bearing work over merely fast-looking work. A few managers interviewed alongside the original study started asking a simple diagnostic question before accepting any AI-assisted deliverable: &#8220;walk me through the one part of this you&#8217;d bet your reputation on.&#8221; Workslop tends to fail that question immediately, because there usually isn&#8217;t a specific part the sender actually stands behind: the whole document was generated with roughly uniform, unverified confidence, cover to cover.</p><p>For leaders: an AI adoption mandate that measures itself purely by usage (seats activated, queries run, tools rolled out) is optimising for exactly the wrong variable, and workslop is the fully predictable output of that specific measurement choice. The fix isn&#8217;t slowing AI adoption down. It&#8217;s pairing every mandate to &#8220;use AI&#8221; with explicit, concrete guidance on where human judgement still has to sit on top of the output, and building review capacity into timelines rather than assuming AI adoption makes that step optional. Leadership research on this consistently points to the same root causes: unclear mandates from the top, and overwhelmed teams with no safe way to admit they don&#8217;t have time to do the verification properly. Both of those are organisational design problems, not individual character problems, and both are entirely within a leadership team&#8217;s power to fix, which is, depending on how you look at it, either the most hopeful or the most damning part of the entire finding.</p><div><hr></div><h3>The closing thought</h3><p>Denise never told her analyst how much of that night she spent rebuilding his deck from scratch. She didn&#8217;t think it would land the way she needed it to: he genuinely believed he&#8217;d delivered on the ask, and in a narrow sense, measured against the instruction he was actually given, he had. What she quietly changed instead was her own definition of &#8220;done&#8221; for anything AI-assisted crossing her desk: not delivered, not polished, not confident-sounding, but specifically verified, on the parts that would actually cost something if they turned out to be wrong.</p><p>That&#8217;s a small, individual-level fix to a problem the research is clear is mostly structural, and it won&#8217;t scale to an entire organisation on its own. But it points at the actual shape of what&#8217;s being lost underneath the adoption charts and the usage dashboards, all trending confidently up and to the right: not effort, exactly, which AI has always been honest about reducing, but the quiet, unglamorous labour of deciding what&#8217;s actually true and what actually matters before you hand something to somebody else. That labour hasn&#8217;t gotten any cheaper. It&#8217;s just gotten a great deal easier to skip, and, for now, almost entirely someone else&#8217;s problem to notice.</p><p>The organisations that get ahead of this won&#8217;t be the ones that slow down AI adoption or ban the tools outright; the numbers make clear that ship has sailed and isn&#8217;t coming back. They&#8217;ll be the ones that figure out, deliberately and early, how to keep paying for judgement even as the cost of fluency collapses to zero, because judgement was always the scarce, valuable half of the work. Fluency was just the part that used to be a reasonably reliable clue that judgement had happened underneath it. It no longer is, and pretending otherwise is how a $9 million-a-year tax quietly becomes a permanent line in the budget nobody ever agreed to add.</p>]]></content:encoded></item><item><title><![CDATA[The Competence Theatre.]]></title><description><![CDATA[Exploring how AI-assisted interview cheating has turned hiring into an unfalsifiable performance, and why the honest candidates, not the cheaters, are the ones absorbing most of the real cost.]]></description><link>https://www.shapingminds.co/p/the-competence-theatre</link><guid isPermaLink="false">https://www.shapingminds.co/p/the-competence-theatre</guid><dc:creator><![CDATA[Maxime Mouton]]></dc:creator><pubDate>Tue, 06 Oct 2026 23:01:48 GMT</pubDate><enclosure url="https://substackcdn.com/image/fetch/$s_!EgZU!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa2f4db45-3263-47f9-8a87-fe0c1dcf0d88_1024x1024.png" length="0" type="image/jpeg"/><content:encoded><![CDATA[<div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!EgZU!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa2f4db45-3263-47f9-8a87-fe0c1dcf0d88_1024x1024.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!EgZU!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa2f4db45-3263-47f9-8a87-fe0c1dcf0d88_1024x1024.png 424w, https://substackcdn.com/image/fetch/$s_!EgZU!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa2f4db45-3263-47f9-8a87-fe0c1dcf0d88_1024x1024.png 848w, https://substackcdn.com/image/fetch/$s_!EgZU!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa2f4db45-3263-47f9-8a87-fe0c1dcf0d88_1024x1024.png 1272w, https://substackcdn.com/image/fetch/$s_!EgZU!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa2f4db45-3263-47f9-8a87-fe0c1dcf0d88_1024x1024.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!EgZU!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa2f4db45-3263-47f9-8a87-fe0c1dcf0d88_1024x1024.png" width="1024" height="1024" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/a2f4db45-3263-47f9-8a87-fe0c1dcf0d88_1024x1024.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:1024,&quot;width&quot;:1024,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:606624,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:false,&quot;topImage&quot;:true,&quot;internalRedirect&quot;:&quot;https://www.shapingminds.co/i/219064413?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa2f4db45-3263-47f9-8a87-fe0c1dcf0d88_1024x1024.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!EgZU!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa2f4db45-3263-47f9-8a87-fe0c1dcf0d88_1024x1024.png 424w, https://substackcdn.com/image/fetch/$s_!EgZU!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa2f4db45-3263-47f9-8a87-fe0c1dcf0d88_1024x1024.png 848w, https://substackcdn.com/image/fetch/$s_!EgZU!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa2f4db45-3263-47f9-8a87-fe0c1dcf0d88_1024x1024.png 1272w, https://substackcdn.com/image/fetch/$s_!EgZU!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa2f4db45-3263-47f9-8a87-fe0c1dcf0d88_1024x1024.png 1456w" sizes="100vw" fetchpriority="high"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image buttonBase-GK1x3M"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image buttonBase-GK1x3M"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><h3>The interview that was too clean</h3><p>Priya has screened engineering candidates for eleven years, long enough to develop the thing every senior recruiter eventually develops: a private, unscientific but rarely-wrong sense for when an interview is going too well. The candidate in front of her that Tuesday in November 2025 was going too well. Thirty-five minutes into a live system-design round, he had produced a clean, well-structured answer to a deliberately ambiguous scaling problem, complete with the kind of trade-off language, &#8220;it depends on your consistency requirements here&#8221;, that usually takes people years to acquire, not months. He paused for exactly the right amount of time before each point, the way someone pauses when they&#8217;re reading rather than recalling. When Priya asked one small follow-up, off-script, about a detail he hadn&#8217;t mentioned, there was a half-second delay that hadn&#8217;t been there before, and then a perfectly composed answer to a question she hadn&#8217;t actually thought was answerable that cleanly.</p><p>She didn&#8217;t flag him in the moment. She wasn&#8217;t sure enough, and being wrong about this kind of accusation carries its own cost. She let the interview finish, gave him a strong internal score, and only two weeks later, reading a report her company&#8217;s newly deployed AI-detection tool had generated on the recorded session, did she learn what her instinct had been circling: micro-patterns in his response timing, consistent with reading rather than generating in real time, flagged at 89% confidence. He had, in all likelihood, been fed the answer through a hidden overlay, the kind marketed today as &#8220;invisible to screen-share&#8221;: Cluely, Final Round AI, LockedIn AI, and a dozen less famous competitors, all built for exactly this moment, all doing a brisk business.</p><p>He didn&#8217;t get the job. But Priya&#8217;s story isn&#8217;t really about him. It&#8217;s about the fact that she almost missed it, that her company only caught it because they&#8217;d bought expensive detection software specifically built for this exact scenario, and that, by the numbers now coming out of the recruiting industry, for every candidate like him who gets caught, a comparable number don&#8217;t. Across 19,368 live technical interviews conducted between July 2025 and January 2026, 38.5% of candidates were flagged for AI-assisted cheating behaviour, with the flag rate for technical roles alone climbing to 48%. And of the candidates flagged, 61% scored above the passing threshold and received an offer anyway. The detection worked. The consequences, for most of them, did not follow.</p><div><hr></div><h3>How we got here: the short history of a proxy</h3><p>The job interview has never been a perfect measure of anything. It has always been a proxy: a stand-in, chosen because it was practical, for a thing employers actually want to know and can&#8217;t directly observe: can this person do the work, reliably, under real conditions, for years. Different eras picked different proxies and believed in them with roughly the same misplaced confidence.</p><p>The whiteboard-algorithm era, which peaked in tech hiring through the 2010s, bet that the ability to invert a binary tree under time pressure correlated with the ability to ship production software. It didn&#8217;t correlate especially well: a body of research eventually made that case convincingly enough that companies started phasing whiteboard rounds out even before AI entered the picture, partly because AI coding assistants had already made memorising algorithms less relevant to the actual job. The behavioural-interview era that layered on top of it bet that a well-told story about a past conflict predicted how someone would handle a future one. That proxy had its own well-documented flaws (coachability, rehearsal, the simple fact that articulate storytellers aren&#8217;t always the strongest performers) but it survived for decades because, flawed as it was, nobody had a cheaper or faster substitute.</p><p>What&#8217;s different now isn&#8217;t that the proxy is imperfect. Proxies have always been imperfect. What&#8217;s different is that the proxy has become gameable at scale, cheaply, invisibly, by anyone with an internet connection and twenty dollars a month, and gameable in a way that produces a result which is, to a human evaluator watching in real time, functionally indistinguishable from the real thing. Previous generations of interview gaming (a coached answer, a rehearsed story, a friend&#8217;s practice questions) still required the candidate to actually absorb and reproduce the material themselves. The AI-overlay era removes that last requirement entirely. The candidate doesn&#8217;t need to know the answer. They need to be willing to read it, fluently, off a screen nobody else can see, in real time, while maintaining eye contact and a confident tone. That is a categorically easier skill to acquire than the thing the interview was originally built to measure, and it produces results that score, on every visible metric, just as well.</p><p>There&#8217;s a useful parallel in how academic testing handled a similar shock a few years earlier. When large language models first made take-home essays trivially fakeable, some institutions responded by banning AI outright and trying to detect its use after the fact: an approach that produced a steady stream of false accusations against students who simply write in a clean, structured style, and that degraded almost as fast as the detection tools it depended on. Others responded by redesigning the assessment itself: oral defences, in-class components, work that had to be produced and explained live, in the room, with no opportunity to outsource the thinking beforehand. The second approach held up considerably better, for a simple reason: it stopped trying to detect the presence of AI and started making AI assistance structurally useless for the specific thing being measured. Hiring is now living through the identical decision point, several years behind education and with far higher stakes attached to getting it wrong.</p><blockquote><p>&#8220;The candidates most equipped to beat this system aren&#8217;t the most competent ones. They&#8217;re the ones most comfortable performing competence they don&#8217;t have &#8212; which is, if you sit with it for a moment, close to the exact opposite of what a hiring process is supposed to select for.&#8221;</p></blockquote><div><hr></div><h3>The mechanism: an arms race with no ceiling</h3><p>The tools themselves have moved fast enough that describing them risks going stale within a quarter, but the shape of the arms race is stable enough to describe with some confidence. On the candidate side: browser overlays that sit invisibly on top of a video-call window, capturing the interviewer&#8217;s question via audio or screen-share, running it through a language model, and displaying a generated answer in a window that doesn&#8217;t appear in anything the interviewer can see, because it&#8217;s rendered outside the shared application, or because it exploits how screen-share capture works at a technical level. Some candidates pair this with a Bluetooth earpiece and real-time audio coaching instead of a visual overlay, reading a script fed to them word for word. A smaller, more aggressive tier uses deepfake video tools to swap out who&#8217;s actually appearing on camera entirely, letting a more experienced person sit the interview on someone else&#8217;s behalf while their face is rendered convincingly onto the candidate&#8217;s video feed. Tools originally built for the wave of smart-glasses cheating that got them banned from the SAT are, unsurprisingly, being repurposed for the exact same function in a Zoom call.</p><p>On the employer side: the response has been to fight AI with AI. 61% of companies surveyed in Greenhouse&#8217;s 2026 AI in Hiring Report now use dedicated detection software during live interviews: analysing response-timing patterns, eye-gaze consistency, behavioural biometrics, and the subtle statistical fingerprints that distinguish someone reading generated text from someone generating an answer in real time as they speak. Another meaningful share of companies are actively evaluating similar tools. It is, in the most literal sense, an arms race: an entire specialised market has emerged on both sides of the interview table simultaneously, each side selling tools designed to defeat the other side&#8217;s tools, with candidates and recruiters as the actual customers on either end.</p><p>Nobody involved in this arms race describes it as stable or winning. 62% of hiring professionals surveyed openly admit that candidates are getting better at faking their way through AI-assisted deception faster than recruiters are getting better at catching it. Human accuracy at spotting deepfaked video in an interview setting was measured at just 55.5%, barely better than a coin flip, which is a genuinely remarkable thing to discover about a task hiring managers have spent their careers believing they were good at. And the deception isn&#8217;t limited to live interviews. 91% of recruiters in the same Greenhouse survey report encountering some form of candidate deception in the broader hiring process this year: 63% report resume exaggeration, 48% report fabricated references, and a smaller but rapidly growing share report prompt injections: hidden text embedded in a r&#233;sum&#233; file, invisible to a human reader, engineered specifically to manipulate an AI resume-screening tool into ranking the candidate higher regardless of their actual qualifications, before a human recruiter ever opens the file.</p><div><hr></div><h3>What gets lost</h3><p>The most obvious cost of all this is the one that gets the headlines: a company might hire someone who genuinely cannot do the job they were hired for, discovering it only once real stakes are attached and the scaffolding is gone. That cost is real, but it&#8217;s not actually the largest one, and treating it as the whole story misses what&#8217;s happening underneath it.</p><p>The first hidden cost is speed and cost, distributed across every candidate rather than concentrated on the dishonest ones. 68% of hiring managers report being more personally involved in hiring than they were a year ago: more manual screening, more live problem-solving exercises, more in-person final rounds specifically reintroduced to strip away the conditions that make AI-assisted cheating possible. Google, Cisco, and McKinsey have all shifted at least their final interview rounds back to in-person formats for exactly this reason. That&#8217;s a rational institutional response to a real problem. It&#8217;s also a tax on everyone in the pipeline, honest and dishonest alike, in the form of longer processes, more logistical friction, and more expensive hiring per head: a cost that didn&#8217;t exist five years ago and now exists because the interview itself can no longer be trusted at face value.</p><p>The second hidden cost is a trust collapse that runs in both directions simultaneously, and is arguably more corrosive than either side&#8217;s individual behaviour. 70% of hiring managers say they now trust AI tools to make faster, better hiring decisions than they could make unassisted. Only 8% of job seekers describe AI-driven hiring processes as fair. Neither number is really about AI&#8217;s actual accuracy. Both numbers are about a hiring relationship where each side has become convinced, with substantial justification, that the other side is gaming the system: hiring managers assuming candidates are cheating, candidates assuming AI screening tools are unfairly filtering them out before a human ever looks at their application. Trust, once it degrades this broadly across an entire labour-market relationship, doesn&#8217;t come back because one detection tool gets slightly more accurate. It comes back, if it comes back at all, only once both sides believe the underlying process is worth trusting again, and right now, neither side does.</p><p>The third and least visible cost falls specifically on honest candidates, and it&#8217;s the one that should worry anyone who cares about fairness in hiring more than the headline fraud statistics do. The candidate who spent genuine hours preparing, who answers a beat slower because they&#8217;re actually generating the answer live rather than reading it, who occasionally says &#8220;let me think about that for a second&#8221; because they are, in fact, thinking, that candidate is now being scored, in real time, against a fluency benchmark partly set by people who aren&#8217;t actually thinking at all. Some of those honest candidates are starting to reach for the same tools themselves, not because they want to deceive anyone, but because refusing to use an AI overlay increasingly feels less like integrity and more like showing up unarmed to a competition where the rules have already changed for everyone else.</p><div><hr></div><h3>Four faces of the interview theatre</h3><p>The people inside this system aren&#8217;t uniform, and treating &#8220;AI cheating in interviews&#8221; as one behaviour obscures more than it reveals. In practice, four recognisable archetypes show up on both sides of the table.</p><p><strong>The Augmented Performer.</strong> Uses an AI overlay not because they lack any relevant knowledge, but because the tool removes risk from an already-stressful, high-stakes performance: reading a slightly better-structured version of an answer they could have produced themselves, just slower and less cleanly. This is the hardest case morally and the hardest case to detect, because the underlying competence often genuinely exists; what&#8217;s fabricated is the polish, not the substance.</p><p><strong>The Panicked Improviser.</strong> Has little relevant knowledge for the specific role, discovered the tool out of desperation in a brutal hiring market, and is functionally borrowing an entire skill set for the length of one video call. This is the case the fraud statistics are mostly measuring, and the one most likely to produce a painful collapse once the job actually starts and the overlay is gone.</p><p><strong>The Honest Straggler.</strong> Refuses to use any AI assistance during interviews, on principle or simply because they haven&#8217;t thought to, and is now competing directly against a fluency bar partly set by candidates in the first two categories: absorbing, without realising it, most of the real cost this entire dynamic imposes on the labour market.</p><p><strong>The Detector&#8217;s Blind Spot.</strong> The hiring-side archetype: a recruiter or hiring manager who trusts their own in-person read of a candidate more than they trust detection software, unaware that human accuracy at spotting this specific category of deception sits close to chance. Not naive, exactly, just operating on an instinct that used to be reliable and now, quietly, often isn&#8217;t.</p><p>Most real interviews contain some blend of these on both sides of the table simultaneously, and the blend is precisely what makes any single detection method (human intuition, statistical timing analysis, in-person format) insufficient on its own. A company that solves for the Panicked Improviser with better timing-analysis software will still walk directly into the Augmented Performer, because the statistical fingerprint of &#8220;reading a slightly better version of an answer I could have produced myself&#8221; is far subtler than the fingerprint of &#8220;reading an answer to a question I have never encountered before.&#8221; Solving for one archetype at a time is how a detection strategy ends up looking effective in a vendor&#8217;s own case studies while quietly missing most of the actual problem.</p><div><hr></div><h3>What actually holds up</h3><p>None of this is an argument that hiring is doomed, or that every candidate using AI assistance is acting in bad faith, or that detection software is a solved problem. It&#8217;s an argument for being honest about what an interview can and can&#8217;t currently tell you, and adjusting accordingly on both sides of the table.</p><p>For candidates: the signal that used to differentiate you, sounding sharp and fluent under pressure, is now available to anyone with a hidden browser tab, which means it differentiates you less than it used to, whether or not you personally use any AI assistance. What still differentiates you is depth that survives unscripted follow-up: a body of real, specific, defensible work you can discuss for fifteen minutes past the point any overlay would have run dry, in detail no generated script would have anticipated. Build toward being interrogated, not toward being fluent for exactly as long as a scripted answer lasts.</p><p>For hiring teams: stop optimising interview scoring for fluency, because fluency is now the cheapest thing in the entire process to fake. Score the follow-up chain instead: five or six specific, unscripted &#8220;why&#8221; and &#8220;what if&#8221; questions that force a candidate to reason live, off any script, about their own stated answer. Overlay tools can sustain a first answer convincingly. They struggle badly, and increasingly visibly, past the third layer of genuine improvisation, because genuine improvisation is precisely the thing they were never built to generate under real-time constraint.</p><p>For leaders: if you can&#8217;t currently describe, with some confidence, how your last ten hires actually got hired (not how fast, not how cheaply, but on what evidence you now trust) you&#8217;re running an organisation built partly on signal you can no longer verify. That gap doesn&#8217;t show up in an onboarding week. It shows up the first time someone on your team faces a genuinely novel problem with no script, no earpiece, and no panel watching their confidence instead of their actual output, and by then, the cost of finding out has moved from a bad interview to a bad quarter.</p><div><hr></div><h3>The closing thought</h3><p>Priya still can&#8217;t fully explain, months later, what tipped her off about that candidate before the detection report confirmed it. She describes it as a feeling that the interview was &#8220;too finished&#8221;, that every answer arrived complete, in a way real thinking rarely does, without the small hesitations and self-corrections and half-formed detours that usually mark someone actually working through a problem live. She has started listening for those detours deliberately now, in every interview she runs, treating the mess of real thinking as a signal worth scoring rather than a flaw worth penalising.</p><p>That&#8217;s a small, human-scale adjustment to an arms race that neither candidates nor employers are close to winning outright. It won&#8217;t stop the next overlay tool, and it won&#8217;t restore the interview to whatever imperfect authority it briefly had. But it points at the thing actually worth protecting underneath all of this: not the appearance of fluency, which has become nearly worthless as a signal, but the visible, occasionally clumsy evidence of someone actually thinking, live, with nowhere to hide it and no script to hide behind. That evidence is still real. It&#8217;s just gotten a great deal harder to find in a room full of people who&#8217;ve learned exactly how to look like they have it.</p>]]></content:encoded></item><item><title><![CDATA[The Stalled Escalator.]]></title><description><![CDATA[Exploring why a record number of workers are calling themselves loyal when what they actually are is stuck &#8212; and what happens when the frozen job market finally thaws.]]></description><link>https://www.shapingminds.co/p/the-stalled-escalator</link><guid isPermaLink="false">https://www.shapingminds.co/p/the-stalled-escalator</guid><dc:creator><![CDATA[Maxime Mouton]]></dc:creator><pubDate>Tue, 29 Sep 2026 23:03:06 GMT</pubDate><enclosure url="https://substackcdn.com/image/fetch/$s_!ExG7!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa67342eb-c1b8-4d54-b09f-66766b9aafaa_1024x1024.png" length="0" type="image/jpeg"/><content:encoded><![CDATA[<div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!ExG7!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa67342eb-c1b8-4d54-b09f-66766b9aafaa_1024x1024.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!ExG7!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa67342eb-c1b8-4d54-b09f-66766b9aafaa_1024x1024.png 424w, https://substackcdn.com/image/fetch/$s_!ExG7!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa67342eb-c1b8-4d54-b09f-66766b9aafaa_1024x1024.png 848w, https://substackcdn.com/image/fetch/$s_!ExG7!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa67342eb-c1b8-4d54-b09f-66766b9aafaa_1024x1024.png 1272w, https://substackcdn.com/image/fetch/$s_!ExG7!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa67342eb-c1b8-4d54-b09f-66766b9aafaa_1024x1024.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!ExG7!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa67342eb-c1b8-4d54-b09f-66766b9aafaa_1024x1024.png" width="1024" height="1024" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/a67342eb-c1b8-4d54-b09f-66766b9aafaa_1024x1024.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:1024,&quot;width&quot;:1024,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:454107,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:false,&quot;topImage&quot;:true,&quot;internalRedirect&quot;:&quot;https://www.shapingminds.co/i/217938528?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa67342eb-c1b8-4d54-b09f-66766b9aafaa_1024x1024.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!ExG7!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa67342eb-c1b8-4d54-b09f-66766b9aafaa_1024x1024.png 424w, https://substackcdn.com/image/fetch/$s_!ExG7!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa67342eb-c1b8-4d54-b09f-66766b9aafaa_1024x1024.png 848w, https://substackcdn.com/image/fetch/$s_!ExG7!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa67342eb-c1b8-4d54-b09f-66766b9aafaa_1024x1024.png 1272w, https://substackcdn.com/image/fetch/$s_!ExG7!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa67342eb-c1b8-4d54-b09f-66766b9aafaa_1024x1024.png 1456w" sizes="100vw" fetchpriority="high"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image buttonBase-GK1x3M"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image buttonBase-GK1x3M"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p>Renee has been at the same regional insurance company for four years: three as an underwriting analyst, and one, technically, in the exact same seat, waiting for a promotion that got frozen indefinitely eleven months ago in a two-line Slack message from HR: &#8220;pausing internal role changes while we finalise headcount planning.&#8221; </p><p>She still opens LinkedIn most mornings, out of habit more than hope. She still gets recruiter messages, two or three a month, for roles that would pay maybe 4% more than she makes now, in exchange for an unknown manager, an unknown culture, and a probation period she&#8217;d be serving during the least stable hiring market in a decade. She closes the tab. She has done this, by her own count, more than thirty times this year.</p><p>Renee isn&#8217;t lazy, and she isn&#8217;t disengaged in the way her company&#8217;s annual survey would flag her. She would tell you, if you asked, that she&#8217;s being smart. And on the numbers, she&#8217;s right: 57% of workers now describe themselves the same way Renee would describe herself &#8212; a &#8220;job hugger,&#8221; someone staying in a role not out of enthusiasm but out of a calculated read on how dangerous the alternative currently looks. Five months earlier, when ResumeBuilder ran the identical survey, that number was 45%. Renee&#8217;s read on the market didn&#8217;t change in five months. The market did.</p><p>That twelve-point jump is the real story here, and it isn&#8217;t really a story about Renee, or about any individual&#8217;s tolerance for a job they&#8217;ve outgrown. It&#8217;s a story about what happens to an entire workforce when the two escape routes people have always used to get out of a stalled career &#8212; leaving, or moving up where they are &#8212; both quietly seize up in the same eighteen-month window.</p><div><hr></div><h3><strong>What job hugging replaced</strong></h3><p>It&#8217;s worth remembering how recently the opposite was true. In 2021 and 2022, at the peak of what got called the Great Resignation &#8212; and, more accurately for what actually happened, the Great Reshuffle &#8212; quitting your job wasn&#8217;t a risk. It was frequently the single most reliable way to get a raise. Workers who switched employers during that window saw median wage growth of roughly 16%, compared to single digits for people who stayed &#8212; an 8-to-10 percentage-point gap that made job-hopping, for a couple of years, close to a rational financial obligation. Company loyalty, as a concept, briefly looked almost quaint. LinkedIn profiles updated themselves constantly. Counteroffers became a genre of their own.</p><p>That era didn&#8217;t end with a crash. It ended with a slow freeze, and the freeze has a name now, and it isn&#8217;t &#8220;the Great Resignation&#8221; running in reverse. &#8220;Job hugging&#8221; describes something categorically different from simple loyalty or contentment: it&#8217;s staying put specifically because the calculated risk of leaving has gone up, not because the reward of staying has gone up. The distinction matters enormously, because it means the underlying dissatisfaction that used to drive people toward the exit hasn&#8217;t disappeared. It has simply been priced out of acting on itself.</p><p>This isn&#8217;t the first time the labor market has swung this hard in the other direction. After the 2008 financial crisis, a similar freeze produced what economists at the time called &#8220;job lock&#8221; &#8212; people staying in roles they disliked because unemployment felt catastrophic and re-entry was slow. But job lock in 2009 was mostly about the absence of open positions. Job hugging in 2026 is stranger, because it&#8217;s happening while AI vendors and executives are simultaneously promising a productivity boom, while job postings for AI-adjacent roles are, in some categories, actually growing, and while unemployment itself remains historically unremarkable. The freeze isn&#8217;t a shortage of jobs in the aggregate. It&#8217;s a shortage of jobs anyone currently trusts enough to jump toward &#8212; a subtler, more psychological kind of lock, built less on scarcity than on uncertainty about which roles AI reshapes next, and when.</p><div><hr></div><h3><strong>The mechanism: why leaving got this expensive</strong></h3><p>Three numbers explain most of what&#8217;s happened. The first is the vanishing wage premium for switching jobs. By February 2026, the Federal Reserve Bank of Atlanta&#8217;s Wage Growth Tracker showed job switchers earning median wage growth of 4.7%, against 3.6% for people who stayed in place &#8212; a gap of about one percentage point, down from 8 to 10 points at the 2022 peak. The single biggest financial argument for leaving a job has, for most workers, all but disappeared.</p><p>The second is the price of getting it wrong. The average worker&#8217;s reservation wage &#8212; the lowest offer they say they&#8217;d actually accept to switch jobs &#8212; hit a record $88,387 in July 2026. Reservation wages rise when the perceived risk of unemployment rises; workers are effectively pricing in the cost of landing somewhere unstable, in a market where getting laid off within your first year at a new employer carries much higher stakes than it did when hiring was healthy.</p><p>The third is the hiring and layoff data underneath both of those numbers. Planned U.S. hires fell to 507,647 in 2025 &#8212; the lowest level since 2010, and a 34% drop from the year before. In the same year, employers announced 1,206,374 job cuts, up 58% year-over-year, with AI cited explicitly as the reason for 54,836 of them. Seventy percent of workers now say they&#8217;re worried AI could threaten their own job within six months. And underneath all of it, the U.S. quits rate &#8212; the cleanest available measure of how many people feel safe enough to walk out the door &#8212; has sat at or below 2.0% for seven consecutive months, near its lowest reading since 2016, excluding the initial COVID-19 lockdown.</p><blockquote><p><em><strong>Put simply: the market spent three years teaching workers that moving pays. It has spent the last year and a half teaching them the opposite lesson, just as convincingly, and workers are behaving exactly as rationally now as they were behaving then.</strong></em></p></blockquote><p>None of this required anyone to announce a new policy or coordinate a response. It&#8217;s an emergent property of thousands of individual, entirely sensible decisions, made simultaneously, by people who&#8217;ve done the math and concluded that the devil they know is currently underpriced compared to the devil they don&#8217;t.</p><div><hr></div><h3><strong>The escalator was supposed to be the backup plan</strong></h3><p>Here&#8217;s the part of the story that should worry leaders more than the quit-rate headline. When the external market freezes, the textbook answer is internal mobility &#8212; let people move up, sideways, or into a new team without ever leaving the building, and you retain the ambition that would otherwise walk out the door. LinkedIn&#8217;s own February 2026 Workforce Report shows why that backup plan isn&#8217;t holding: national hiring is down 5.7% year over year and employers are taking longer to fill open roles, but internal movement isn&#8217;t absorbing the slack the way it&#8217;s supposed to. Fifty-one percent of employees say they&#8217;re simply unaware of what internal openings exist at their own company. And sixty percent of high-potential employees name their own direct manager as the primary obstacle standing between them and an internal move.</p><p>That second number is the more revealing one, because it points to a second-order effect that&#8217;s easy to miss. In a hiring freeze, a manager who loses a strong performer to an internal transfer frequently can&#8217;t backfill the seat &#8212; headcount approvals are frozen right alongside external hiring. So the same freeze that&#8217;s making external moves feel dangerous for employees is quietly giving their managers a private incentive to make internal moves harder, too, whether or not that&#8217;s ever said out loud in a one-on-one. Nobody designed this as a retention strategy. It emerged as one anyway, and it&#8217;s a strategy built entirely on friction rather than on anything an employee would recognize as genuine investment in them.</p><p>The result: the two ways people have always advanced &#8212; leaving, or moving up where they are &#8212; have both seized in the same window. Nobody&#8217;s climbing. Nobody&#8217;s transferring. The escalator that was supposed to be the pressure-release valve for a frozen job market is itself frozen, and everyone standing on it is calling the stillness &#8220;stability&#8221; because the alternative explanation is more uncomfortable to sit with.</p><div><hr></div><h3><strong>What gets lost</strong></h3><p>The direct cost of job hugging is invisible almost by design &#8212; it shows up as a number that isn&#8217;t there, a resignation letter that was drafted and never sent, a recruiter call that ended in &#8220;I&#8217;m happy where I am.&#8221; The indirect costs are not invisible at all, once you know where to look, and they show up in three places.</p><p>The first is engagement, and the data here is stark. Fifty-four percent of employees report experiencing some degree of &#8220;quiet cracking&#8221; &#8212; a slow erosion of morale and discretionary effort distinct from quiet quitting, because it isn&#8217;t a decision to disengage so much as a gradual, often unconscious drift into disengagement under sustained insecurity. One in five describe it as frequent or constant. Gallup&#8217;s most recent workforce data puts active engagement at just 31% of U.S. employees &#8212; meaning most retention dashboards showing record-low attrition are sitting directly on top of engagement numbers that tell almost the opposite story. Globally, Gallup estimates disengagement costs the world economy roughly $8.9 trillion a year in lost productivity &#8212; a bill that doesn&#8217;t appear on any single company&#8217;s P&amp;L, but is being paid all the same, distributed invisibly across millions of Renees quietly doing the minimum required to stay safely unremarkable.</p><p>The second is skill development, and it compounds the first. Employees who haven&#8217;t received any training in the past year are 140% more likely to report feeling job insecure &#8212; which means the workers least equipped to move quickly if the market does thaw are disproportionately the same ones sitting still right now, and the ones least likely to be actively developed while they wait. Lateral moves, stretch assignments, and new-employer onboarding have always been quiet but powerful skill-building mechanisms; when all three stall simultaneously, an entire cohort&#8217;s skill growth stalls along with them, at precisely the moment AI is raising the bar on what &#8220;current&#8221; skills need to look like.</p><p>The third is harder to quantify but arguably the most expensive: the erosion of what &#8220;good work&#8221; is understood to require. When advancement stops being connected to performance &#8212; because there&#8217;s simply nowhere to advance to &#8212; the signal that used to link effort and outcome gets fainter. People don&#8217;t stop caring overnight. But caring without any visible mechanism for it to matter is exhausting to sustain, and exhaustion, given enough time, looks identical to indifference from the outside.</p><div><hr></div><h3><strong>Four faces of the stalled worker</strong></h3><p>Job hugging isn&#8217;t one uniform posture, and treating it as one is how well-meaning retention initiatives end up solving the wrong problem &#8212; a generic &#8220;we value you&#8221; email does nothing for someone who&#8217;s actually being structurally blocked by their own manager, and a mobility portal does nothing for someone who&#8217;s already decided no internal move is worth the risk of losing their current, at least-known, seat. In practice, job hugging tends to show up as one of four recognizable types.</p><p><strong>The Loyalist by Necessity.</strong> Would genuinely leave if the math worked, and knows exactly what the math would need to look like. Runs the numbers every few months, usually after a recruiter call, and closes the tab in the same place every time &#8212; the risk-adjusted return still isn&#8217;t there. Not disengaged; extremely aware.</p><p><strong>The Waiting List.</strong> Was told, explicitly or implicitly, that a promotion or transfer is coming &#8212; &#8220;when budget opens back up,&#8221; &#8220;next planning cycle&#8221; &#8212; and has now been told that for multiple cycles running. Still believes it, mostly, because believing it is easier than reassessing everything else about the decision to stay.</p><p><strong>The Ghost Employee.</strong> Present, competent, quietly checked out. This is quiet cracking in its purest form: doing the job well enough that nothing triggers a conversation, while investing nothing beyond what&#8217;s required, because investing more hasn&#8217;t paid off in longer than they can remember.</p><p><strong>The Handcuffed Manager&#8217;s Report.</strong> Wants to move internally, has the skills and the manager&#8217;s private acknowledgment that they&#8217;d thrive elsewhere in the org &#8212; and is blocked by that same manager, not out of malice, but because losing them means losing a headcount line nobody can promise will be refilled.</p><p>Most job huggers are some blend of at least two of these at once, and the blend shifts month to month as recruiter calls come in, promotion cycles pass, and the broader hiring data either firms up or doesn&#8217;t.</p><div><hr></div><h3><strong>The compounding problem</strong></h3><p>The uncomfortable part isn&#8217;t the current state. It&#8217;s what happens when it ends. Seventy-one percent of current job huggers expect to keep hugging their job for at least six more months; 44% think it will take a year or longer before they feel secure enough to move again. That&#8217;s not a workforce settling into a new equilibrium &#8212; it&#8217;s a workforce under sustained pressure, with the release valve deliberately held shut, for a duration long enough that the pressure itself becomes the dominant fact of the arrangement rather than a temporary condition of it.</p><p>Pressure held that long doesn&#8217;t release gently when it finally does release. It tends to release all at once, in a rush that looks nothing like the gradual, individually-timed departures a healthy labor market produces. Organizations that spent 2026 quietly congratulating themselves on record-low attrition, without doing anything to address the engagement and mobility numbers sitting underneath it, are the ones most exposed to that rush &#8212; because low attrition built on fear rather than genuine investment doesn&#8217;t convert into loyalty the moment fear subsides. It converts into an exit queue that&#8217;s been forming, silently, the entire time.</p><p>Some sectors are more exposed than others. Industries where AI has already visibly reshaped day-to-day roles &#8212; customer service, entry-level analysis, first-draft creative and marketing work &#8212; are sitting on the largest hidden queues, because the workers inside them are simultaneously the most anxious about staying and the most anxious about leaving, unsure whether a new employer&#8217;s version of their role even looks like the one they currently hold. Industries where AI&#8217;s effect has been slower or less visible &#8212; skilled trades, in-person healthcare delivery, parts of regulated finance &#8212; are seeing comparatively less hugging behavior, not because those workers are less rational, but because their risk calculation simply has fewer unknowns in it. The size of the eventual thaw, in other words, will not be evenly distributed. It will land hardest on exactly the functions leadership is currently most confident are &#8220;stable,&#8221; because stability was never the honest description of what was happening there.</p><div><hr></div><h3><strong>What actually holds up</strong></h3><p>None of this is an argument that workers should quit recklessly, or that leaders caused a labor market they didn&#8217;t design. It&#8217;s an argument for treating the current calm as exactly what the data says it is &#8212; a function of fear, not of health &#8212; and building accordingly.</p><p>For individuals: staying put right now can look identical to being loyal and be, underneath, just fear wearing a nicer outfit. That&#8217;s not a criticism &#8212; it&#8217;s frequently the financially sound decision &#8212; but it only pays off long-term if the time spent staying is actively used, not just endured. The job huggers who benefit most when hiring thaws will be the ones who spent this period building a visible track record where they already are: new skills, cross-team visibility, a wider internal network, a portfolio of finished work that speaks for them the moment the market opens back up. Waiting and building are not the same activity, even though they can look identical from the outside for months at a time.</p><p>For hiring managers: a candidate with an unusually long, static tenure right now is not automatically a red flag, and it&#8217;s not automatically a loyalty story either. The honest question is what happened during that stretch. Someone who kept growing in place &#8212; new responsibilities, new skills, visible initiative &#8212; is a very different hire from someone who was simply present. That distinction rarely shows up on a r&#233;sum&#233;. It shows up when you ask, directly, what they built or learned during the period they didn&#8217;t move, and listen for specifics rather than a general sense of busyness.</p><p>For leaders: a low attrition number is not, by itself, a result you&#8217;ve earned. Before presenting it as evidence of a healthy culture, check it against engagement data, training investment, and internal mobility rates for the same period. If quiet cracking is running high underneath a green retention dashboard, the honest read is that you&#8217;re not looking at a stable team &#8212; you&#8217;re looking at a stalled one, held in place by external conditions rather than by anything your organization actively did. Stalled things, when the pressure holding them still finally lifts, tend to move all at once, and rarely in the direction leadership was hoping for.</p><div><hr></div><p>Renee still hasn&#8217;t sent an application. She still closes the recruiter messages, still tells herself she&#8217;s being smart, and by any reasonable financial calculation, she still is. But she&#8217;s also started keeping a private document &#8212; nothing dramatic, just a running list of what she&#8217;s actually built this year, updated every few weeks, in case the math ever changes and she needs to move fast when it does.</p><p>That document is the real difference between staying and stalling. An escalator that isn&#8217;t moving can still be climbed, one deliberate step at a time, by anyone willing to do the work the machine was supposed to do automatically. Most job huggers aren&#8217;t doing that. They&#8217;re standing still, waiting for the machine to start again, and calling the wait a strategy. It might be exactly that, for a while. But it&#8217;s worth being honest, at least privately, about which one you&#8217;re actually doing &#8212; because the market that eventually thaws won&#8217;t ask which explanation you preferred. It will just ask what you built while you were waiting.</p>]]></content:encoded></item><item><title><![CDATA[The Fluency Mirage.]]></title><description><![CDATA[Exploring how AI's fluency has quietly decoupled from its competence, and why the people willing to slow down and doubt a polished answer are becoming the last real check in the system.]]></description><link>https://www.shapingminds.co/p/the-fluency-mirage</link><guid isPermaLink="false">https://www.shapingminds.co/p/the-fluency-mirage</guid><dc:creator><![CDATA[Maxime Mouton]]></dc:creator><pubDate>Tue, 22 Sep 2026 23:00:25 GMT</pubDate><enclosure url="https://substackcdn.com/image/fetch/$s_!N24T!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb2d729e3-b3ba-4a67-8d32-0bd06838484a_1024x1024.png" length="0" type="image/jpeg"/><content:encoded><![CDATA[<div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!N24T!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb2d729e3-b3ba-4a67-8d32-0bd06838484a_1024x1024.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!N24T!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb2d729e3-b3ba-4a67-8d32-0bd06838484a_1024x1024.png 424w, https://substackcdn.com/image/fetch/$s_!N24T!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb2d729e3-b3ba-4a67-8d32-0bd06838484a_1024x1024.png 848w, https://substackcdn.com/image/fetch/$s_!N24T!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb2d729e3-b3ba-4a67-8d32-0bd06838484a_1024x1024.png 1272w, https://substackcdn.com/image/fetch/$s_!N24T!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb2d729e3-b3ba-4a67-8d32-0bd06838484a_1024x1024.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!N24T!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb2d729e3-b3ba-4a67-8d32-0bd06838484a_1024x1024.png" width="1024" height="1024" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/b2d729e3-b3ba-4a67-8d32-0bd06838484a_1024x1024.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:1024,&quot;width&quot;:1024,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:293675,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:false,&quot;topImage&quot;:true,&quot;internalRedirect&quot;:&quot;https://www.shapingminds.co/i/216671842?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb2d729e3-b3ba-4a67-8d32-0bd06838484a_1024x1024.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!N24T!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb2d729e3-b3ba-4a67-8d32-0bd06838484a_1024x1024.png 424w, https://substackcdn.com/image/fetch/$s_!N24T!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb2d729e3-b3ba-4a67-8d32-0bd06838484a_1024x1024.png 848w, https://substackcdn.com/image/fetch/$s_!N24T!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb2d729e3-b3ba-4a67-8d32-0bd06838484a_1024x1024.png 1272w, https://substackcdn.com/image/fetch/$s_!N24T!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb2d729e3-b3ba-4a67-8d32-0bd06838484a_1024x1024.png 1456w" sizes="100vw" fetchpriority="high"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image buttonBase-GK1x3M"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image buttonBase-GK1x3M"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p>Priya opens the shared doc at 4:50 p.m. on a Thursday. Her colleague finished the competitive analysis an hour ago &#8212; clean headers, a tidy comparison table, five confidently stated market-share figures, a closing paragraph that reads like it was written by someone who has thought about this problem for a decade. </p><p>She skims it, relieved. Then she notices one figure doesn&#8217;t match what she remembers from last quarter&#8217;s board deck. She checks. It&#8217;s wrong &#8212; not wildly wrong, just wrong enough to have been believable. So she checks the next number. Also wrong. By 6:40 p.m., she has rebuilt half the document from scratch, and she still isn&#8217;t sure which parts of the other half she can trust.</p><p>Nothing about this document looked unfinished. That was the problem. It looked, by every visual and structural signal available to Priya, exactly like good work. Harvard Business Review gave this phenomenon a name in September 2025 &#8212; workslop &#8212; and the researchers at BetterUp Labs and Stanford&#8217;s Social Media Lab who coined it found Priya&#8217;s Thursday evening is now startlingly common: 40% of 1,150 U.S. full-time employees surveyed said they&#8217;d received AI-generated work like this in the past month, costing them nearly two hours of rework, on average, per instance. 53% said it left them annoyed. 42% said it made them trust the sender less. A third said they&#8217;d rather not work with that colleague again.</p><p>What&#8217;s actually being measured here isn&#8217;t an AI capability gap. It&#8217;s a mirage, and mirages are interesting precisely because the failure isn&#8217;t in what you&#8217;re looking at. It&#8217;s in your own perceptual machinery.</p><div><hr></div><h3>Where the mirage comes from</h3><p>Long before anyone trained a transformer, psychologists had already mapped the terrain AI would eventually colonise. In the 1990s, researchers including Norbert Schwarz and Rolf Reber began documenting what they called processing fluency: the ease with which the brain processes a piece of information becomes, all by itself, a signal the brain uses to judge whether that information is true. Statements printed in a clearer font were rated as more truthful than the identical statements printed in a harder-to-read one. Words that were easier to pronounce were judged more trustworthy. None of this had anything to do with the content. It was entirely about the packaging.</p><p>This is not a flaw we can shame ourselves out of. It&#8217;s a load-bearing shortcut. </p><blockquote><p><strong>Evaluating every claim on its actual merits, from scratch, every time, would be cognitively unaffordable &#8212; so the brain outsources a huge portion of its trust calibration to surface cues: confidence, fluency, structure, specificity.</strong> </p></blockquote><p>For most of human history, that shortcut worked reasonably well, because producing fluent, confident, well-structured, specific-sounding content was actually hard. It required expertise, rehearsal, or both. Fluency was, imperfectly but usefully, correlated with competence. Con artists and skilled salespeople have always understood how to break that correlation deliberately, but they were rare, and rarity was itself a kind of natural defence.</p><p>Generative AI didn&#8217;t invent the fluency heuristic. It did something more consequential: it made fluency free, infinite, and instant, for anyone, on any topic, at any hour, completely severing the correlation the heuristic was built to exploit. The packaging that used to be expensive to produce, and therefore a semi-reliable signal, is now the cheapest part of the entire pipeline. Only the substance remains expensive. And substance is exactly what the fluency heuristic was never designed to check.</p><p>A related finding from the same era of research makes the picture sharper still. The illusory truth effect, first documented by Lynn Hasher, David Goldstein, and Thomas Toppino in the late 1970s, showed that people rate a statement as more likely true simply because they&#8217;ve encountered it before, independent of whether it was true the first time either. Repetition alone manufactures a feeling of familiarity, and familiarity gets misread as validity. Put fluency and repetition together and you get something close to a complete account of how confident nonsense survives contact with a smart, careful reader: it sounds right, it feels familiar, and both of those sensations arrive before any actual verification has had the chance to begin. </p><p><strong>AI-generated text is unusually good at triggering both at once: fluent by construction, and often repeating, in slightly different words, the same plausible-sounding claim across a document</strong>, which makes that claim feel more corroborated with every restatement, even though it has exactly one source: the model&#8217;s own prior sentence.</p><div><hr></div><h3>The mechanism, made visible</h3><p>It&#8217;s worth being precise about why this happens, because &#8220;AI sounds confident&#8221; undersells the mechanism. A large language model is not making a judgement about whether it knows something and then choosing how to express that judgement. It is predicting, token by token, the most statistically plausible continuation of a prompt, shaped by training and reinforcement to produce answers that human raters found satisfying. Human raters, being human, are subject to the same fluency heuristic as everyone else &#8212; they tend to rate confident, well-structured, elaborate answers more highly than hedged, uncertain, terse ones, regardless of accuracy. The result is a system trained, at a deep level, to optimise for the appearance of competence, because that&#8217;s what the training signal actually rewarded.</p><p>Researchers have now measured the downstream consequence directly. In a set of controlled experiments, participants were shown AI-generated answers that varied in length and elaborateness. Longer, more detailed explanations reliably increased participants&#8217; confidence in the answer but did not improve their ability to tell correct answers from incorrect ones. Only 26% of participants could accurately perceive when an AI response was overconfident relative to its actual reliability. Verbosity was functioning as a proxy for expertise: length and elaborateness were triggering what researchers describe as an epistemic authority heuristic, one that bypasses genuine comprehension checking almost entirely.</p><blockquote><p>Across these studies, a consistent pattern holds: the more elaborate and confident an AI&#8217;s explanation, the more people trust it, and the less that trust tracks whether the explanation is actually correct.</p></blockquote><p>This is the mechanism underneath every piece of workslop Priya has ever received. It&#8217;s not that the model is lying with unusual skill. It&#8217;s that the model never learned to signal uncertainty the way a careful human expert instinctively does &#8212; the pause, the hedge, the &#8220;I&#8217;d want to double-check this before you use it,&#8221; the visible discomfort of a person who knows the difference between confidence and correctness. An LLM has no discomfort to display. It presents a fabricated statistic with exactly the same tonal certainty as a verified one, because tonal certainty was never connected to truth in the first place. It was connected to what got rewarded during training.</p><div><hr></div><h3>What gets lost</h3><p>The direct cost of the fluency mirage is the two hours Priya spent on Thursday. The indirect cost is larger and slower-moving, and it shows up in three places.</p><p>The first is <strong>trust between colleagues</strong>. The workslop data on this point is unambiguous. Handing someone fluent-but-hollow work doesn&#8217;t just cost them time; it changes how they see you. Forty-two percent of workslop recipients said it made them view the sender as less trustworthy; roughly half rated the sender as less capable, less creative, or less reliable than before. AI is being used, by well-intentioned people trying to move faster, in ways that are quietly corroding the interpersonal trust that actual collaboration depends on.</p><p>The second is <strong>what happens to judgement itself when it goes unpracticed.</strong> Verification is a skill, and like any skill, it atrophies without use. If the default posture toward AI output becomes acceptance rather than scrutiny &#8212; because scrutiny is effortful and the output looks so finished &#8212; then the muscle required to catch the next, more consequential error weakens exactly when the stakes are rising. </p><p>This is not hypothetical. MIT Sloan Management Review&#8217;s 2026 research on AI verification makes the trajectory explicit: as AI systems are given longer, higher-risk, more autonomous tasks, checking whether the work was actually done correctly becomes harder and slower &#8212; not easier &#8212; even as organisational reliance on that work accelerates. The gap between how much we trust AI output and how well we can verify it is widening, not narrowing, at precisely the moment the stakes attached to that output are growing. A parallel 2026 global executive survey found 86% of leadership teams now consider AI central to strategic priority-setting &#8212; meaning the quality of human oversight has quietly become a strategic variable, not just an operational nicety.</p><p>The third is subtler: <strong>the mirage doesn&#8217;t just produce bad individual decisions.</strong> It changes what &#8220;good work&#8221; is perceived to look like across an entire organisation, because the visual and structural markers of quality &#8212; polish, structure, confident phrasing, comprehensive-seeming coverage &#8212; have become disconnected from the underlying rigor those markers used to signal. Teams start optimizing, often unconsciously, for the appearance that gets rewarded rather than the substance that was supposed to produce it. That&#8217;s a much harder problem to reverse than a single bad quarter, because it&#8217;s not a mistake &#8212; it&#8217;s a slowly shifting incentive structure that nobody explicitly chose.</p><div><hr></div><h3>Four faces of the mirage</h3><p>The fluency mirage doesn&#8217;t show up as one uniform failure. In practice, it tends to take one of four recognisable shapes.</p><ul><li><p><strong>The Instant Expert.</strong> An AI-generated answer arrives with the tone and structure of someone who has spent a career in the domain &#8212; assured phrasing, domain vocabulary used correctly, a confident framing of trade-offs. Nobody asks how the model would know this, because it doesn&#8217;t sound like a guess. It sounds like expertise. The tell isn&#8217;t in what&#8217;s said; it&#8217;s in the complete absence of the specific, hard-won caveats a genuine expert would volunteer unprompted.</p></li><li><p><strong>The Verbose Alibi.</strong> Length gets mistaken for rigour. A three-paragraph answer feels more trustworthy than a three-sentence one, even when the extra length is padding, restatement, or elaboration on an unverified premise. This is the mechanism the verbosity research captured precisely: elaborateness functions as a proxy for diligence, whether or not any additional diligence actually occurred.</p></li><li><p><strong>The Certainty Engine.</strong> The response never hedges, never flags uncertainty, never says &#8220;I&#8217;m not fully sure about this specific figure.&#8221; Because the model&#8217;s tone doesn&#8217;t shift between confident-and-correct and confident-and-fabricated, the human reading it loses the single cue &#8212; hesitation &#8212; that would normally prompt a second look.</p></li><li><p><strong>The Downstream Debtor.</strong> This is workslop&#8217;s actual delivery mechanism. The polished, fluent, unverified output gets passed along &#8212; to a colleague, a manager, a client &#8212; and the obligation to notice the gap between fluency and substance transfers with it, usually without anyone naming that a transfer has occurred. The person who generated it experiences speed. The person who receives it experiences the bill.</p><div><hr></div></li></ul><h3>The compounding problem</h3><p>All of this was true when the worst an AI system could do was write one wrong paragraph. It matters more now, because the unit of AI-produced work is no longer a paragraph &#8212; it&#8217;s a multi-step task, executed with growing autonomy across research, drafting, coding, and decision-support, each step building on the fluent-sounding output of the step before it. MIT Sloan&#8217;s 2026 research on AI verification names this directly: as systems take on longer, higher-risk, more autonomous tasks, checking whether the work was actually done correctly becomes harder and slower, not easier, because there are more intermediate steps, each one a fresh opportunity for a plausible-sounding error to get quietly folded into the next stage before anyone looks closely. A wrong number in a single answer is a two-hour problem, &#224; la Priya. A wrong assumption embedded at step two of a fourteen-step agentic workflow is a problem nobody notices until it surfaces three departments away, dressed in the confident, finished-looking output of everything built on top of it. The mirage doesn&#8217;t stay contained to the document it started in. It propagates, fluently, at every layer it touches &#8212; and each layer adds its own varnish of polish, making the original error progressively harder to spot the further downstream it travels.</p><p>This is also why the comfortable assumption &#8212; that organisations will simply get better at catching this over time, the way they got better at spotting spam email or phishing attempts &#8212; doesn&#8217;t hold up well under scrutiny. Phishing emails get caught because their fluency is usually imperfect: a slightly wrong logo, an odd turn of phrase, a domain that&#8217;s almost right. The fluency mirage has no equivalent tell. It is, definitionally, the case where the packaging is flawless. There is no typo to notice, no broken image, no uncanny phrasing &#8212; just a confident, well-structured, entirely plausible claim that happens to be wrong, sitting in a document that looks exactly like every other document that was actually right.</p><div><hr></div><h3>What actually holds up</h3><p>None of this is an argument against using AI for real work &#8212; it&#8217;s an argument for pricing verification back into how that work gets planned, evaluated, and rewarded, deliberately, rather than assuming it will happen for free because it always used to.</p><ul><li><p>For individuals, that starts with treating fluency as a neutral signal rather than a positive one. A polished, confident answer earns exactly zero epistemic credit until it&#8217;s been checked; the smoother it is, the more consciously worth checking it becomes, precisely because smoothness is the cheapest thing about it now. One useful ritual: before passing along any AI-assisted output, name out loud &#8212; even just to yourself &#8212; the single number, claim, or assumption in it you are least sure about, and check that one thing before you check anything else. It&#8217;s a small habit, but it directly counters the illusory-truth trap, because it forces a specific claim to be evaluated on its own merits rather than absorbed into the general glow of a well-formatted document. Building this instinct is uncomfortable early on &#8212; it means being the person who says &#8220;let me verify that&#8221; in a meeting full of people nodding along, which can feel like friction for its own sake. It isn&#8217;t. It&#8217;s the only mechanism in the room actually distinguishing fluent from true.</p></li></ul><ul><li><p>For hiring managers, this reframes what a strong candidate looks like. The ability to produce fluent, well-structured work is no longer a differentiator &#8212; it&#8217;s table stakes, available to anyone with an API key. What&#8217;s scarce, and getting scarcer, is the ability to interrogate fluent output and articulate specifically why it might be wrong: to name the missing caveat, spot the plausible-but-unverified number, ask the question the confident tone was designed to make you forget to ask. That capability shows up far more reliably in a structured conversation &#8212; &#8220;here&#8217;s a polished answer, tell me what&#8217;s wrong with it&#8221; &#8212; than anywhere in a r&#233;sum&#233;, and it&#8217;s worth building directly into how candidates are evaluated rather than assuming it will surface on its own.</p></li><li><p>For leaders, the implication is structural. If output volume is being measured without measuring downstream verification cost, the organisation is tracking a number that workslop is subsidising &#8212; quietly, and usually with the time of the most conscientious people on the team, the ones who can&#8217;t bring themselves to pass along something they haven&#8217;t checked. Making verification visible &#8212; treating it as legitimate, budgeted work rather than an invisible tax someone absorbs after the fact &#8212; is not a productivity drag. It&#8217;s the correction that lets the productivity number mean anything at all. That might mean building a verification checkpoint into a workflow the same way a code review checkpoint already exists; it might mean explicitly rewarding the person who caught the error rather than only the person who moved fast. Either way, the goal is the same: make the invisible cost visible before it becomes someone&#8217;s Thursday evening.</p></li></ul><div><hr></div><p>Priya finishes rebuilding the document a little after 7. Nobody will ever see the two hours it took her &#8212; not in the deliverable, which now looks exactly as polished as it did before she started, and not in any metric her organisation tracks. That invisibility is the entire mechanism of the fluency mirage in miniature: the correction disappears into the same seamless-looking output that necessitated it, and next week, someone hands her something else that looks finished.</p><p>The uncomfortable truth isn&#8217;t that AI produces bad work. It&#8217;s that AI produces work indistinguishable, on the surface, from good work, and the surface is the only thing most of us have time to check. Fluency was never supposed to be the whole test. For most of history, it was a reasonable proxy, because faking it convincingly was expensive. That&#8217;s no longer true, for anyone, about anything. The proxy broke. What&#8217;s left, the only thing left, is the slower, less comfortable, entirely human work of actually checking &#8212; <strong>and organisations are only beginning to notice that they stopped budgeting for it right around the time they started needing it most.</strong></p>]]></content:encoded></item><item><title><![CDATA[The Memory Leak.]]></title><description><![CDATA[Exploring why organisations have never had faster access to knowledge and have never been worse at making any.]]></description><link>https://www.shapingminds.co/p/the-memory-leak</link><guid isPermaLink="false">https://www.shapingminds.co/p/the-memory-leak</guid><dc:creator><![CDATA[Maxime Mouton]]></dc:creator><pubDate>Tue, 15 Sep 2026 23:00:42 GMT</pubDate><enclosure url="https://substackcdn.com/image/fetch/$s_!2vpr!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F4ff0868d-0b6c-45a6-ba12-e5b1ec7e85dd_1024x1024.png" length="0" type="image/jpeg"/><content:encoded><![CDATA[<div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!2vpr!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F4ff0868d-0b6c-45a6-ba12-e5b1ec7e85dd_1024x1024.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!2vpr!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F4ff0868d-0b6c-45a6-ba12-e5b1ec7e85dd_1024x1024.png 424w, https://substackcdn.com/image/fetch/$s_!2vpr!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F4ff0868d-0b6c-45a6-ba12-e5b1ec7e85dd_1024x1024.png 848w, https://substackcdn.com/image/fetch/$s_!2vpr!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F4ff0868d-0b6c-45a6-ba12-e5b1ec7e85dd_1024x1024.png 1272w, https://substackcdn.com/image/fetch/$s_!2vpr!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F4ff0868d-0b6c-45a6-ba12-e5b1ec7e85dd_1024x1024.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!2vpr!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F4ff0868d-0b6c-45a6-ba12-e5b1ec7e85dd_1024x1024.png" width="1024" height="1024" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/4ff0868d-0b6c-45a6-ba12-e5b1ec7e85dd_1024x1024.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:1024,&quot;width&quot;:1024,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:415850,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:false,&quot;topImage&quot;:true,&quot;internalRedirect&quot;:&quot;https://www.shapingminds.co/i/215157700?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F4ff0868d-0b6c-45a6-ba12-e5b1ec7e85dd_1024x1024.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!2vpr!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F4ff0868d-0b6c-45a6-ba12-e5b1ec7e85dd_1024x1024.png 424w, https://substackcdn.com/image/fetch/$s_!2vpr!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F4ff0868d-0b6c-45a6-ba12-e5b1ec7e85dd_1024x1024.png 848w, https://substackcdn.com/image/fetch/$s_!2vpr!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F4ff0868d-0b6c-45a6-ba12-e5b1ec7e85dd_1024x1024.png 1272w, https://substackcdn.com/image/fetch/$s_!2vpr!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F4ff0868d-0b6c-45a6-ba12-e5b1ec7e85dd_1024x1024.png 1456w" sizes="100vw" fetchpriority="high"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image buttonBase-GK1x3M"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image buttonBase-GK1x3M"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p>3 years ago, a question you could not answer had a price attached to it.</p><p>You searched the internal wiki and found a page last edited in 2021 by someone who had left. You asked the two people most likely to know and got a shrug and a maybe. You then had a choice: drop it, or spend a day working it out. If you worked it out, you almost always wrote it down, not because the company had a documentation culture, but because you had just paid for that answer and had no intention of paying twice.</p><p>That cycle, repeated a few thousand times a year by a few hundred people, is how an institution accumulates knowledge. It is not elegant. It is driven almost entirely by irritation.</p><p>Today, the same question takes 4 seconds and produces a confident, well-structured, largely correct answer. Nothing is searched, nobody is asked, nothing is written down, and &#8212; crucially &#8212; nobody learns that the organisation had never worked it out in the first place.</p><p>The answer was excellent. The transaction that used to make the organisation smarter did not occur.</p><p><strong>This is the shape of the thing I want to describe: not a failure, not a loss, but a quiet cessation of accumulation, taking place inside a system that has never felt better informed in its life.</strong></p><div><hr></div><h3>What happens to a person</h3><p>Start at the individual scale, where it has actually been measured.</p><p>In June 2025, a team at the MIT Media Lab, led by Nataliya Kosmyna, published a study with the deliberately provocative title Your Brain on ChatGPT: Accumulation of Cognitive Debt when Using an AI Assistant for Essay Writing Task. 54 participants wrote essays across 4 months under 3 conditions: with an LLM, with a search engine, or with nothing but their own head. The researchers ran EEG throughout and tested recall afterwards.</p><p>The essays produced by the LLM group were fine. That matters, because this is not a story about bad output.</p><p>The recall was not fine. More than 80% of the LLM users could not quote a single sentence from an essay they had finished minutes earlier. </p><h4><strong>Asked to reproduce their own text after a delay, the LLM group managed around 17%; the unassisted group managed around 46%.</strong> </h4><p>The EEG showed weaker connectivity across the networks associated with the effortful integration of new material. And the participants reported something subtler and more revealing: a diminished sense of authorship. They did not quite feel the essays were theirs.</p><p>They were right. In the only sense that matters for memory, the essays were not theirs. Memory is not a recording device that captures whatever passes in front of it. Encoding is a cost. It is paid in effort: in retrieval attempts, in failed sentences, in the specific discomfort of holding a half-formed idea while trying to make it a whole one. Remove the effort and you do not get the memory for free. You get the artefact without the memory.</p><p>The study is a preprint and has not yet been peer reviewed, and it deserves the usual caution. </p><h4>But the finding it points at is not exotic. It is one of the most robust results in cognitive psychology, arriving in new clothes: we remember what we generate far better than what we are given.</h4><p>Now stop thinking about one person and one essay. Think about 10,000 people, 3 years, and every decision, diagnosis, judgement and explanation those people produce.</p><div><hr></div><h3>What an organisation is actually made of</h3><p>Institutions have always had a memory problem, and it has always been worse than anyone admits, because most of what an organisation knows has never been written anywhere.</p><p>In 1996, the anthropologist Julian Orr published Talking About Machines, an ethnography of Xerox photocopier technicians that has quietly influenced a generation of thinking about work. Orr rode along with technicians for months, and his central finding was awkward for everyone who had commissioned it: the knowledge that made these people good at the job was essentially absent from the service manuals they had been given. It lived in stories, told at breakfast, in car parks, over the phone. This machine in this office with this humidity. That fault which presents as a paper jam and is always a worn sensor. The customer who will describe the symptom wrongly, in a specific and predictable way.</p><blockquote><p><strong>&#8220;The circulation of stories among the technicians is the principal means by which they stay informed of the developing subtleties of machine behaviour.&#8221;</strong></p><p><strong>&#8212; Julian E. Orr, Talking About Machines: An Ethnography of a Modern Job, 1996</strong></p></blockquote><p><strong>Xerox&#8217;s response has become a small legend in knowledge management:</strong> they gave the technicians two-way radios, so the stories could keep circulating without everyone having to be in the same room at the same time. The intervention was not to write the knowledge down. It was to protect the channel through which it moved.</p><p>The expensive version of the same lesson belongs to NASA. The F-1 engine that lifted Saturn V off the pad was, by any measure, one of the most thoroughly documented machines ever built; Rocketdyne ran a dedicated production knowledge retention programme that produced 20 volumes covering injector rings, valves, assembly, checkout, thermal insulation, cabling. Everything a reasonable person would think you needed.</p><p>When engineers returned to the F-1 decades later, the 20 volumes were not enough. Each engine had been effectively hand-built, with its own undocumented quirks. Welding and fabrication techniques lived in the hands of specific people, and those people had retired or died. The drawings had been produced under crushing deadline pressure without computer aids, and a drawing made that way records the shape of the thing but not the reasoning, the failed alternative, or the trick that made it work.</p><p>The blueprints survived. The knowledge did not. And nobody at NASA was careless: they had done everything the textbook says to do.</p><h4>Both stories converge on the same uncomfortable point. The valuable part of institutional knowledge was never the record. It was the person who could tell you why the record was wrong.</h4><div><hr></div><h3>The absence that did all the work</h3><p>Here is the mechanism I think we have broken, and it is worth being precise about it, because it is easy to mistake for nostalgia.</p><blockquote><p><em>Organisations do not learn because they are curious. They learn because they periodically run into the wall of their own ignorance, and the collision hurts enough to produce a response.</em></p></blockquote><p>The collision had a very specific form: you asked, and nothing came back. That silence was not an inconvenience. It was a measurement. It told you, with total reliability, that this was something the organisation had never worked out &#8212; as distinct from something it had worked out and filed somewhere you had not looked. Those are entirely different states, and the old system distinguished between them for free.</p><p>Almost everything good followed from that distinction. It told you where the frontier was. It told you which questions were worth someone&#8217;s afternoon. And it created the only reliable motive for documentation ever observed in the wild, which is not diligence but resentment: I am never doing this again.</p><p>AI-mediated knowledge access removes the silence. Every question now returns a fluent, immediate, structurally impeccable answer, and the answer looks exactly the same whether it was retrieved from something the organisation genuinely knows or reconstructed on the spot from the general shape of the world.</p><p>This is not speculation. Anna Gausen, Bhaskar Mitra and Si&#226;n Lindley, writing at ACM FAccT in 2024, examined how AI-mediated enterprise knowledge access systems reshape organisational memory. </p><p><strong>Among their findings: these systems increase the visibility of knowledge that already exists while simultaneously diminishing members&#8217; organic awareness of knowledge gaps.</strong> Workers stop developing an accurate internal map of what the organisation does not know, because they no longer encounter its edges.</p><p>An organisation that cannot detect its own ignorance does not become ignorant dramatically. It simply stops filling anything in, and the gaps persist indefinitely, invisibly, being papered over on demand, 4 seconds at a time.</p><div><hr></div><h3>Four ways an organisation leaks</h3><p>The failure is not one thing. It is four distinct leaks, and they compound, because each one hides the next.</p><ul><li><p><strong>The Vanished Gap.</strong> Knowledge that never gets created, because the absence that would have prompted its creation is no longer perceptible. Nobody decides not to investigate; the question simply never presents itself as open. This is the deepest leak and the only one that is genuinely invisible, because its symptom is the non-occurrence of an event. You cannot audit for work that was never triggered. <strong><span data-color="#ff00ff" style="color: rgb(255, 0, 255);">The tell, when it eventually surfaces, is a company that has been operating for 3 years on an assumption nobody ever tested, defended by a confident answer that has been given 400 times.</span></strong></p></li><li><p><strong>The Ephemeral Answer.</strong> Knowledge that is created but has nowhere to land. The reasoning happens inside a conversation with a model, genuinely good reasoning, often better than what would have happened otherwise&#8230;and then the tab closes. <em>It is not written down, because writing it down feels redundant when the thing that produced it is always availabl</em>e. But the model does not remember your organisation. It remembers nothing about the decision, the constraint, or the four options you rejected. The next person asks the same question and gets a different plausible answer, and neither of them will ever know they disagreed. <strong><span data-color="#ff00ff" style="color: rgb(255, 0, 255);">Institutional memory is being replaced by a per-session hallucination of institutional memory.</span></strong></p></li><li><p><strong>The Hollow Fluency.</strong> Knowledge that is produced and delivered by a person who has not encoded it. This is the MIT finding at organisational scale. The output is real and often correct; the person cannot answer a follow-up question, cannot spot when the situation has changed enough to invalidate the answer, and cannot teach it to anyone. A workforce in this state looks extremely capable in every artefact it produces and extremely thin in every unscripted conversation. <strong><span data-color="#ff00ff" style="color: rgb(255, 0, 255);">It is also, quietly, unable to train its own successors, because you cannot transmit what you never held.</span></strong></p></li><li><p><strong>The Severed Inheritance.</strong> Knowledge that used to move between people and now does not, because the channel has been rerouted. Orr&#8217;s whole point was that the stories were the transmission mechanism. When a junior colleague asks a senior one a question, the answer is the smallest part of what transfers; they also acquire the reasoning, the hesitation, the aside about the time this went wrong in 2019, and, not trivially, a relationship that makes the next question possible. <strong><span data-color="#ff00ff" style="color: rgb(255, 0, 255);">Asking a model returns the answer with none of the freight. It is more efficient in precisely the way that a wire transfer is more efficient than a conversation about money.</span></strong></p></li></ul><p>The four compound in a specific order. The Severed Inheritance dries up the stories. The Hollow Fluency means nobody notices, because everyone still sounds competent. The Ephemeral Answer means nothing new is being written to replace what is being lost. And the Vanished Gap means no alarm ever sounds, because the organisation has lost the instrument that used to detect absence.</p><div><hr></div><h3>Where the leak becomes visible</h3><p>If all of this were purely invisible, it would be hard to argue about. But there is one place the water shows on the ceiling, and it is worth looking at closely.</p><p>In July 2025, METR ran a randomised controlled trial with 16 experienced open-source developers, covering 246 real tasks in mature repositories on which the developers had an average of 5 years of prior experience. The developers expected AI tools to speed them up by 24%. Afterwards, they reported having been sped up by about 20%. Measured, they were 19% slower.</p><p>The perception gap, nearly 40 points, is the part that gets quoted. The mechanism is the part that matters here. These were extraordinarily high-context environments. The developers carried, in their heads, years of accumulated knowledge about why this module is structured strangely, which tests lie, what the maintainer will reject in review. The model had none of that and no way to get it. So the developers spent their time explaining their own tacit knowledge to a system that could not retain it, then reviewing output that did not reflect it.</p><p>The productivity finding is interesting. The structural finding is more important: the slowdown was largest exactly where human accumulated knowledge was deepest. Which tells you something uncomfortable about the incentive gradient. </p><p><strong>In low-context work, where nobody has accumulated anything, the tools are transformative. In high-context work, they are a drag, and the way to make them stop being a drag is to lower the context.</strong> <strong>To standardise, flatten, document less idiosyncratically, and gradually stop building the deep specific knowledge that made the environment hard for the model in the first place.</strong></p><p>Nobody will announce that decision. It will arrive as a series of sensible efficiency choices, each of which is defensible, and at the end of it the organisation will be perfectly legible to its tools and will contain nothing that took 15 years to learn.</p><div><hr></div><h3>How to hold water</h3><p>The instinct at this point is to reach for documentation policy, and the instinct is wrong, or at least badly insufficient. NASA had 20 volumes. Documentation captures what was decided. The leak is in why, and in who could tell you the record is out of date.</p><ul><li><p><strong>If you lead an organisation:</strong> restore the ability to see absence. This is the single highest-leverage intervention available, and it is mostly a matter of instrumentation and honesty. Any internal AI system that answers from your own material should be able to tell the difference between &#8220;this is grounded in something we wrote and here it is&#8221; and &#8220;this is a reasonable reconstruction,&#8221; and it should say so, visibly, every time. That distinction is the modern equivalent of the empty wiki search, and if your system does not expose it, you have bought a machine whose primary function is to conceal the state of your own knowledge from you. Then measure the right thing. Every organisation now measures output, and output has never been less informative. <strong><span data-color="#ff00ff" style="color: rgb(255, 0, 255);">Ask instead: what did we learn last quarter, where is it written, and who wrote it? If nobody can answer without opening a chat history, you do not have institutional memory.</span></strong></p></li><li><p><strong>If you manage a team:</strong> protect the channel, not the archive. Xerox&#8217;s answer to Orr was radios, and it was correct. The equivalent today is deliberately preserving the conditions in which people tell each other things: the review conversation that could have been a comment, the pairing session, the fifteen minutes at the end of an incident where somebody says what actually happened rather than what the report will say. These look like inefficiency and they are the transmission mechanism. And make the reasoning the deliverable. <strong><span data-color="#ff00ff" style="color: rgb(255, 0, 255);">A decision record that says what was chosen is worth a fraction of one that says what was rejected and why, because the rejected options are the part a model will confidently reinvent for you next year.</span></strong></p></li><li><p><strong>If you are doing the work:</strong> understand that recall has become a choice, and that it now has to be made deliberately, because the default is no longer to remember. <strong><span data-color="#ff00ff" style="color: rgb(255, 0, 255);">Pick two or three domains where you intend to be genuinely deep, and refuse the shortcut there: do it the slow way, generate the answer before you check it, be willing to be slower for a year. Be fast everywhere else, without guilt.</span></strong> And write down not what you concluded, but what you tried that failed. That is the part nobody else has, the part no model can reconstruct, and the part that will still be worth something when the answer to every well-posed question is free.</p></li><li><p><strong>If you are early in your career:</strong> you are entering an environment that will let you produce a competent answer to almost any question, and remember almost none of it. <strong><span data-color="#ff00ff" style="color: rgb(255, 0, 255);">That is an extraordinary offer and it is a trap, because in 10 years your value will be almost entirely the small set of things you can speak about with nothing open in front of you.</span></strong><span data-color="#ff00ff" style="color: rgb(255, 0, 255);"> </span>Also: keep asking senior people questions you could ask a model. Not for the answer. For the 20 minutes around the answer, which is where the actual transfer happens and which is the thing quietly disappearing from professional life.</p></li></ul><div><hr></div><h3>The uncomfortable truth</h3><p>The prevailing story is that AI makes organisations smarter. Every measurement available supports it: questions answered, time to answer, coverage, satisfaction. On any dashboard you could build, an organisation with good AI-mediated knowledge access is dramatically better informed than the same organisation was three years ago.</p><p>That story is true and it is describing the wrong quantity. It is measuring access, not accumulation. Retrieval, not memory. And the two feel identical from inside, which is precisely why this can run for years without anyone raising it.</p><p>The distinction is not academic. A person with excellent access and no memory can answer any question and cannot notice that a question has stopped making sense. An organisation in the same state can serve every request and cannot tell that the ground beneath one of its oldest assumptions has moved, because the mechanism that used to report ground movement was the failure to find an answer, and it no longer fails.</p><p>Ruth Schwartz Cowan&#8217;s washing machines did not reduce housework because the standard rose. Jevons&#8217; efficient engines did not reduce coal because demand rose. This one is stranger than either, because nothing rose. Something simply stopped: the small, irritating, unglamorous loop by which a company converts a moment of not-knowing into something it permanently knows.</p><p><strong>Nobody switched it off. It just stopped being triggered, because the condition that triggered it &#8212; silence &#8212; no longer occurs anywhere in the building.</strong></p><p><strong>So ask your organisation what it learnt last year. Not what it produced, shipped, answered or automated. What it learnt, where that learning is written, and whose name is on it.</strong></p><p>If the honest answer is that it knows a great deal more than it did and has learned nothing at all, that is not a paradox. That is the leak, and it has been running the whole time, at exactly the speed of your fastest answer.</p>]]></content:encoded></item><item><title><![CDATA[The Expectation Ratchet.]]></title><description><![CDATA[Exploring why the time AI saves never reaches the person who saved it.]]></description><link>https://www.shapingminds.co/p/the-expectation-ratchet</link><guid isPermaLink="false">https://www.shapingminds.co/p/the-expectation-ratchet</guid><dc:creator><![CDATA[Maxime Mouton]]></dc:creator><pubDate>Tue, 08 Sep 2026 23:01:39 GMT</pubDate><enclosure url="https://substackcdn.com/image/fetch/$s_!V4Uy!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc918b5ce-458b-486b-b6b7-35f86dee17cd_1024x1024.png" length="0" type="image/jpeg"/><content:encoded><![CDATA[<div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!V4Uy!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc918b5ce-458b-486b-b6b7-35f86dee17cd_1024x1024.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!V4Uy!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc918b5ce-458b-486b-b6b7-35f86dee17cd_1024x1024.png 424w, https://substackcdn.com/image/fetch/$s_!V4Uy!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc918b5ce-458b-486b-b6b7-35f86dee17cd_1024x1024.png 848w, https://substackcdn.com/image/fetch/$s_!V4Uy!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc918b5ce-458b-486b-b6b7-35f86dee17cd_1024x1024.png 1272w, https://substackcdn.com/image/fetch/$s_!V4Uy!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc918b5ce-458b-486b-b6b7-35f86dee17cd_1024x1024.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!V4Uy!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc918b5ce-458b-486b-b6b7-35f86dee17cd_1024x1024.png" width="1024" height="1024" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/c918b5ce-458b-486b-b6b7-35f86dee17cd_1024x1024.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:1024,&quot;width&quot;:1024,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:517921,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:false,&quot;topImage&quot;:true,&quot;internalRedirect&quot;:&quot;https://www.shapingminds.co/i/214376395?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc918b5ce-458b-486b-b6b7-35f86dee17cd_1024x1024.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!V4Uy!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc918b5ce-458b-486b-b6b7-35f86dee17cd_1024x1024.png 424w, https://substackcdn.com/image/fetch/$s_!V4Uy!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc918b5ce-458b-486b-b6b7-35f86dee17cd_1024x1024.png 848w, https://substackcdn.com/image/fetch/$s_!V4Uy!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc918b5ce-458b-486b-b6b7-35f86dee17cd_1024x1024.png 1272w, https://substackcdn.com/image/fetch/$s_!V4Uy!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc918b5ce-458b-486b-b6b7-35f86dee17cd_1024x1024.png 1456w" sizes="100vw" fetchpriority="high"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image buttonBase-GK1x3M"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image buttonBase-GK1x3M"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p>In March, an operations analyst discovers that the weekly reporting pack &#8212; eleven hours of his life, every week, for six years &#8212; can be assembled in four.</p><p>He does not tell anyone. This is not deviousness; it is instinct, and the instinct is correct. He spends the first genuinely empty Friday afternoon of his professional life reading about something entirely unrelated to logistics, and feels, for about three weeks, that a small and private justice has been done.</p><p>In April, someone notices the pack has been arriving on Thursday rather than Friday. Nothing is said. In May, a colleague in another team refers, in passing, to &#8220;when the pack lands on Thursday,&#8221; and the sentence goes unchallenged, because it is now simply a description of reality. By June, Thursday is the deadline. Nobody moved it. No one held a meeting about it, no policy was amended, no manager made a decision they would recognise as a decision. The deadline moved the way a shoreline moves.</p><p>Then, because the team is now visibly capable of more, a second pack appears &#8212; the regional breakdown, discussed for years and always deemed impossible. It is not impossible any more. It is a genuine improvement to the business, everyone is pleased, and the analyst builds the template.</p><p>By July he is working eleven hours a week on reporting again.</p><p>Ask him what happened and he will describe a series of reasonable events, each of which he would defend individually. He is not overworked because of a villain. He is overworked because of a ratchet, and the defining property of a ratchet is that it turns one way, quietly, under load, with a mechanism so ordinary that nobody thinks to look at it.</p><div><hr></div><h3>What the eight-month study actually found</h3><p>In February 2026, the Harvard Business Review published research by Aruna Ranganathan and Xingqi Maggie Ye who had followed roughly 200 employees at a US technology company for eight months as generative AI worked its way through their jobs. It is one of the few studies of the period that watched the same people for long enough to see the second-order effects rather than the launch-week enthusiasm.</p><p>The tools worked. That is worth stating plainly, because the finding is not a story about disappointing technology. People moved faster. They handled more kinds of task. By any reasonable measure of individual capability, the intervention succeeded.</p><p>And 83% of them said their workload had increased.</p><p>The researchers identified three distinct mechanisms, and it is worth sitting with each, because none of them look like a problem while they are happening.</p><p>Task expansion. Work that had previously been out of reach became accessible, so people reached for it. Not because they were instructed to, but because the barrier that used to make it a non-question had gone. The regional breakdown was impossible for six years; the moment it stopped being impossible, it stopped being optional, without anyone ever converting it from one to the other.</p><p>Blurred boundaries. Work began leaking into the interstitial spaces that used to be breaks. If a thing takes ninety seconds instead of twenty minutes, it can be done in a lift, in a queue, at 22:40, between two other things. Each individual instance is trivially small, which is precisely why none of them ever gets refused. The working day did not get extended by decision. It got extended by capillary action.</p><p>Multitasking. With execution faster, people ran more threads simultaneously. This is the most insidious of the three, because sustained partial attention produces a strong internal sensation of productivity while degrading the quality of thought &#8212; and the sensation is what people report, while the degradation is what shows up three months later as fatigue nobody can source.</p><p>The common feature of all three: nobody chose them. There was no moment at which an organisation resolved to spend its AI dividend on intensification rather than on quality, or margin, or rest. In the absence of a decision, the system defaulted to more. Systems generally do.</p><div><hr></div><h3>The oldest pattern in the history of technology</h3><p>If this feels novel, that is only because we are inside it. It is one of the most thoroughly documented patterns in economic and social history, and it has been observed at least twice with total clarity by people nobody listened to.</p><p>In 1865, the English economist William Stanley Jevons published The Coal Question, addressing a debate about whether Britain&#8217;s coal reserves would last. The prevailing view was reassuring: engines were becoming dramatically more efficient, therefore less coal would be needed. Jevons demolished it in a sentence that has since been named after him.</p><blockquote><p><strong>&#8220;It is wholly a confusion of ideas to suppose that the economical use of fuel is equivalent to a diminished consumption. The very contrary is the truth.&#8221;</strong></p><p><strong>&#8212; William Stanley Jevons, The Coal Question, 1865</strong></p></blockquote><p>His logic was simple and inescapable. Efficiency reduces the cost of using something. Reducing the cost of something increases the demand for it. Watt&#8217;s improved engine did not reduce Britain&#8217;s coal consumption; it made steam power cheap enough to put in places it had never been, and consumption rose by an order of magnitude. Efficiency was not the brake. It was the accelerator.</p><p>A century later, the historian Ruth Schwartz Cowan asked the domestic version of the same question. Her 1983 book More Work for Mother traced household technology from the open hearth to the microwave and confronted a fact that ought to have been a scandal: after washing machines, vacuum cleaners, running hot water, gas ovens, commercial flour and refrigeration, American women were spending about as many hours on housework as their great-grandmothers had.</p><p>Cowan&#8217;s explanation was not that the appliances were bad. They were transformative. Several things happened at once. Work previously done by servants, husbands and children was quietly absorbed by one person, because the machines made it a one-person job. And &#8212; the part that matters here &#8212; the standard rose to meet the new capability. Weekly laundry became daily laundry. Acceptable cleanliness became a moving target that tracked, almost exactly, the capability of the equipment available to achieve it. The washing machine did not buy time. It bought a higher definition of clean.</p><p>That is the mechanism we are living in now, running at software speed. Cowan&#8217;s ratchet took decades to turn. Ours turns in about a quarter.</p><div><hr></div><h3>Two accurate reports of the same event</h3><p>The strangest artefact of this period is a pair of statistics that appear to contradict each other and do not.</p><p>The Upwork Research Institute surveyed 2,500 executives, employees and freelancers across four countries and found that 96% of C-suite leaders expected AI to raise productivity &#8212; while 77% of employees actually using the tools said those tools had added to their workload. A further 47% said they had no idea how to deliver the productivity gains being expected of them.</p><p>The standard reading of this is a communication gap: leadership doesn&#8217;t understand the coalface, someone should run a listening tour. That reading is comfortable and it is wrong, because it assumes one of the two groups is mistaken.</p><p>Neither is. They are describing the same event from opposite ends of the ratchet. At the organisational level, output per person genuinely rose &#8212; the executives are reading their instruments correctly. At the individual level, the work genuinely became heavier &#8212; the employees are reading theirs correctly too. Both measurements are accurate. The gain and the cost simply landed on different people, and there is no single vantage point inside the organisation from which both are visible at once.</p><p>The Harvard data shows exactly where each landed. Burnout was reported by 62% of associates and 61% of entry-level workers, against 38% of C-suite leaders. The people who set the pace are not the people who run at it. This is not a moral failing on the part of leadership; it is a structural feature of how the information travels. Throughput is legible upward. Strain is not. A dashboard will show you a rising line months before it shows you what the line cost, and by then the line is the baseline and the baseline is not negotiable.</p><div><hr></div><h3>What actually gets consumed</h3><p>It is tempting to describe all this as a story about time, but time is not really the resource being eaten. The resource being eaten is slack.</p><p>Slack is the loose, uncommitted, faintly embarrassing space inside a working system. The gap between finishing one thing and starting the next. The Thursday afternoon with nothing due. The meeting that ended early. The conversation in the corridor that had no agenda and produced, six weeks later, the only good idea of the quarter.</p><p>On any dashboard, slack is indistinguishable from waste. That is its central tragedy. It has no output, no ticket number, and no defender in a budget meeting. Which makes it the very first thing an efficiency programme finds, and the very last thing anyone thinks to protect.</p><p>But slack is where several things happen that happen nowhere else. It is where people learn &#8212; not through training, but through the unhurried repetition and reflection that turns procedure into judgement. It is where people notice: the mis-stated assumption, the number that looks slightly wrong, the client who has gone quiet. Noticing requires spare attention, and spare attention is the first casualty of running three threads at once. It is where people recover, and a system with no recovery capacity is not efficient but brittle, in the specific engineering sense that it has no ability to absorb a shock without deforming.</p><p>And it is where people ask whether the work is the right work. This is the most valuable function of slack and the easiest to lose, because the question only occurs to people who have a moment in which nothing is due. Fill every moment and you get an organisation that executes with tremendous velocity and never once asks where it is going.</p><p>Here is the uncomfortable arithmetic. AI creates a large, visible, easily measured productivity gain. Slack is a large, invisible, entirely unmeasured buffer. When the gain arrives, the pressure to convert it into output falls first on the part of the system that cannot demonstrate its own value. The buffer is consumed before anyone realises it was an asset, and its absence is only detectable later, by the strange fact that nobody in the organisation seems to be learning anything or catching anything early.</p><div><hr></div><h3>The four positions on the ratchet</h3><p>The pattern presents differently depending on where you are standing. Four positions, and almost everyone is in one of them right now.</p><ul><li><p>The <strong>Absorber</strong>. Discovers a genuine efficiency gain and quietly reinvests all of it in more output, telling no one. The motives are usually decent: pride in the work, a wish to be useful, or a well-founded suspicion that admitting to spare capacity is professionally unwise. The effect is to set a new baseline for everyone, including themselves, on the basis of a capability they never disclosed. Absorbers are rewarded exactly once, and measured against the new level permanently. The tell is that they cannot explain how their workload grew, only that it did &#8212; and that when they eventually slow down, it registers not as a return to normal but as a decline.</p></li><li><p>The <strong>Sprawler</strong>. Responds to lowered barriers by expanding scope in every direction. Everything now feels doable, so everything gets attempted: the second report, the side analysis, the redesign nobody asked for. The work is real and often good. But scope acquired because it is possible, rather than because it is important, has no natural limit, and the Sprawler ends up carrying nine responsibilities at a level of attention appropriate to three. Their year-end review says &#8220;broad impact.&#8221; Their calendar says something else. The Sprawler&#8217;s error is treating capability as an instruction.</p></li><li><p>The <strong>Leaker</strong>. Never took on extra work and never agreed to longer hours, yet works appreciably more than a year ago. The mechanism is the ninety-second task: small enough to do in a queue, on a sofa, at 22:40, and therefore never large enough to justify refusing. The working day did not expand by decision; it expanded by a thousand individually trivial concessions, none of which would survive being described out loud as a policy. Leakers are usually the last to recognise the problem, because at no point did they do anything unreasonable.</p></li><li><p>The <strong>Ratchet-Setter</strong>. Sits above the work, watches throughput rise, and adjusts the expectation upward &#8212; reasonably, incrementally, and without ever having produced at the new rate personally. This is not villainy; it is the most natural act in management, and the information reaching them fully supports it. The rising line is real. What the line does not contain is the multitasking load, the evaporated slack, or the fact that the gain was one-off while the expectation is permanent. The Ratchet-Setter&#8217;s characteristic mistake is to treat a capability ceiling as a floor. Their characteristic surprise arrives around month nine, in the form of resignations from people who never once complained.</p><div><hr></div></li></ul><h3>How to hold a line</h3><p>The first thing to accept is that the ratchet has no author. There is nobody to persuade and nothing to appeal. It is a default that operates in the absence of a decision, which means the only counter available is an explicit decision, made early, and said out loud.</p><p>If you lead an organisation: name what the gain is for. There are four possible destinations &#8212; more output, higher quality, wider scope, or recovered capacity &#8212; and if you do not choose, the system chooses more output every single time. Choosing is not a soft gesture; it is the only lever that exists. And treat slack as infrastructure rather than waste. Some of the most durable firms run deliberate, funded unproductivity &#8212; protected time with no deliverable attached &#8212; not from generosity but because they have worked out that a system at 100% utilisation has no capacity to learn, notice, or absorb anything unexpected.</p><p>If you manage a team: make baseline changes visible. When a deadline moves earlier or a new deliverable appears, say so explicitly, in writing, as a change &#8212; because the danger is not the change itself but its silence. A baseline that everyone can see can be discussed and, if necessary, reversed. A baseline that arrived by drift cannot even be identified. And notice that your best performers are the ones setting the pace for everyone else, usually without meaning to. The Absorber on your team is quietly rewriting the standard your whole department will be held to.</p><p>If you are the one doing the work: stop treating your saved time as a private windfall to be hidden, and start treating it as a negotiating position to be spent deliberately. Say what you are doing with it &#8212; depth on the important thing, the analysis nobody has had time for, the review step you always skipped. Time claimed for a stated purpose is defensible. Time simply not visible gets reallocated by someone else. And learn to state what you did not do and why: the scope you declined, the request you pushed back a week. In an environment where everything is possible, the ability to say what you deliberately left undone is the only remaining evidence that judgement is being exercised at all.</p><p>If you are early in your career: understand that you have arrived at the top of a ratchet and will be told the current pace is normal. It is not normal. It is roughly three years old, and the people who set it did not have to sustain it while learning the job. Build your own protected slack before anyone can accuse you of having spare capacity, and be extremely careful about being the fastest person in the room. Speed is rewarded once. The baseline it creates lasts.</p><div><hr></div><h3>The uncomfortable truth</h3><p>The prevailing story about AI and work is one of eventual liberation. First a difficult adoption period, then the productivity dividend, then &#8212; the four-day week, the reclaimed evening, the human hours restored. It is a decent story and it has one flaw: it assumes that the gain, once created, flows to the person who created it. Nothing in the history of technology supports that assumption.</p><p>The gain from the steam engine was real, and it was spent on more steam. The gain from the washing machine was real, and it was spent on cleaner houses. Neither was stolen. In both cases the capability was converted, invisibly and almost immediately, into a higher standard of what counted as adequate &#8212; and the higher standard, once established, was never renegotiated downward. Nobody in 1900 proposed returning to a fortnightly wash.</p><p>What makes this cycle different is only its speed. Cowan&#8217;s ratchet turned over generations. Ours turns over quarters, which means a person can now watch the entire arc happen to them personally &#8212; discover a gain in March, see it absorbed by June, and be described as tired by July &#8212; while remaining unable to point at the moment anything changed, because no such moment exists.</p><p>So the question worth asking is not whether AI will give you your time back. That framing has already conceded the argument, because it treats the outcome as something the technology decides.</p><p>The question is what your organisation decided to do with the gain, and whether anyone can remember deciding. If nobody can, that is not an oversight. That is the answer. In the absence of a decision, the ratchet decides, and the ratchet has exactly one setting.</p><p>Everyone is waiting for AI to hand back their time. It already did. It arrived in March, on an ordinary Wednesday, and it was gone by June &#8212; and the most unsettling part is not that it was taken. It is that nobody took it.</p>]]></content:encoded></item><item><title><![CDATA[The Articulation Debt.]]></title><description><![CDATA[Exploring how the paradox that protected human judgement from automation for 60 years &#8212; we know more than we can tell &#8212; has quietly inverted into a bill.]]></description><link>https://www.shapingminds.co/p/the-articulation-debt</link><guid isPermaLink="false">https://www.shapingminds.co/p/the-articulation-debt</guid><dc:creator><![CDATA[Maxime Mouton]]></dc:creator><pubDate>Tue, 01 Sep 2026 23:01:17 GMT</pubDate><enclosure url="https://substackcdn.com/image/fetch/$s_!CRiY!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff1945b4f-e865-4342-b875-1d7251ba9ef1_1024x1024.png" length="0" type="image/jpeg"/><content:encoded><![CDATA[<div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!CRiY!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff1945b4f-e865-4342-b875-1d7251ba9ef1_1024x1024.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!CRiY!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff1945b4f-e865-4342-b875-1d7251ba9ef1_1024x1024.png 424w, https://substackcdn.com/image/fetch/$s_!CRiY!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff1945b4f-e865-4342-b875-1d7251ba9ef1_1024x1024.png 848w, https://substackcdn.com/image/fetch/$s_!CRiY!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff1945b4f-e865-4342-b875-1d7251ba9ef1_1024x1024.png 1272w, https://substackcdn.com/image/fetch/$s_!CRiY!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff1945b4f-e865-4342-b875-1d7251ba9ef1_1024x1024.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!CRiY!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff1945b4f-e865-4342-b875-1d7251ba9ef1_1024x1024.png" width="1024" height="1024" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/f1945b4f-e865-4342-b875-1d7251ba9ef1_1024x1024.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:1024,&quot;width&quot;:1024,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:342537,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:false,&quot;topImage&quot;:true,&quot;internalRedirect&quot;:&quot;https://www.shapingminds.co/i/213489650?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff1945b4f-e865-4342-b875-1d7251ba9ef1_1024x1024.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!CRiY!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff1945b4f-e865-4342-b875-1d7251ba9ef1_1024x1024.png 424w, https://substackcdn.com/image/fetch/$s_!CRiY!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff1945b4f-e865-4342-b875-1d7251ba9ef1_1024x1024.png 848w, https://substackcdn.com/image/fetch/$s_!CRiY!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff1945b4f-e865-4342-b875-1d7251ba9ef1_1024x1024.png 1272w, https://substackcdn.com/image/fetch/$s_!CRiY!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff1945b4f-e865-4342-b875-1d7251ba9ef1_1024x1024.png 1456w" sizes="100vw" fetchpriority="high"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image buttonBase-GK1x3M"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image buttonBase-GK1x3M"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p>A partner at a mid-sized consultancy is asked to do something she has never been asked to do in twenty-three years of practice. Her firm has bought an AI drafting system, and to configure it properly the implementation team needs one thing from her: a document describing what a good client deliverable looks like.</p><p>She is, by universal agreement, the best judge of that in the building. Juniors circulate drafts to her before they circulate them to anyone else. She reads three pages, makes four marks, and the thing is transformed. Nobody has ever successfully described what she does. They just say she has an eye.</p><p>She books a morning to write the document. She writes: &#8220;Clear. Rigorous. Client-ready.&#8221; She looks at it. It is true, and it is worthless &#8212; every deliverable she has ever rejected was also aiming to be clear, rigorous and client-ready. She tries again, harder, and produces two pages of the kind of prose that appears in every consultancy&#8217;s quality handbook and has never once changed an outcome. By lunchtime she has a document that would not stop a single one of the four thousand mistakes she has caught in her career.</p><p>The system is configured anyway, using her two pages. It produces work that is clear, rigorous and client-ready, and that she rejects at roughly the rate she has always rejected things. When the implementation team asks her why, she says the thing she has always said, the thing that used to be enough: it&#8217;s not quite there.</p><p>Nothing here is a failure of intelligence, effort or seniority. She is not a bad expert. She is a superb expert running into a bill that has been quietly accruing beneath her entire career, and which has just been presented, in full, with no warning and no instalment plan.</p><div><hr></div><h3>The shield we were handed in 1966</h3><p>In 1966, the chemist-turned-philosopher Michael Polanyi opened The Tacit Dimension with a sentence that would end up doing sixty years of quiet load-bearing work in how we think about human skill.</p><blockquote><p><strong>&#8220;I shall reconsider human knowledge by starting from the fact that we can know more than we can tell.&#8221;</strong></p><p><strong>&#8212; Michael Polanyi, The Tacit Dimension, 1966</strong></p></blockquote><p>His examples were homely and devastating. You can recognise a friend&#8217;s face in a crowd of ten thousand and cannot describe that face precisely enough for a stranger to do the same. You can ride a bicycle and cannot state the rule you are obeying &#8212; which is, in fact, a rather specific relationship between the angle of imbalance and the radius of the corrective turn, a rule almost no cyclist has ever heard of and every cyclist perfectly obeys. Knowing and telling are separate faculties, and the first is vastly larger than the second.</p><p>For most of the twentieth century this was an interesting philosophical observation. Then computers arrived, and it became an economic prophecy.</p><p>In 2014, the MIT labour economist David Autor formalised it in a paper for the National Bureau of Economic Research and gave it the name it now carries: Polanyi&#8217;s Paradox. His argument was structural. Automation requires specification. A machine can only be given a task that has been fully and explicitly described. Therefore the tasks that resist automation are precisely those that draw on tacit knowledge &#8212; the ones demanding flexibility, judgement and common sense that we understand only implicitly and cannot write down. The frontier of automation was not set by how clever machines were. It was set by how articulate humans could be.</p><p>This became the great professional reassurance of the last decade, repeated in every keynote, every reskilling deck, every reassuring memo about the future of work. The routine goes; the judgement stays. And it was correct. The thing worth noticing now is why it was correct &#8212; because that reason has changed.</p><p>Tacit knowledge was safe not because it was valuable, but because it was unspeakable. Your expertise was protected by a wall built out of your own inability to describe it. That is a strange thing to have been relying on. It is stranger still that nobody thought to ask what would happen if a machine turned up that did not need the wall taken down brick by brick &#8212; only a rough sketch of what was on the other side.</p><div><hr></div><h3>How the shield became an invoice</h3><p>Every previous wave of automation demanded complete specification. To automate a task with software you had to decompose it into unambiguous rules covering every branch and every edge case. That was an enormous, expensive, often impossible act of articulation, and Polanyi&#8217;s paradox stood in the way of nearly all of it. The bar was so high that most human judgement never came close to being tested.</p><p>Generative AI lowered that bar to the floor, and in doing so changed the nature of the problem entirely. It does not need your task decomposed. It arrives already carrying an enormous amount of general competence &#8212; it can write, structure, analyse, design, summarise and argue at a baseline level without being told how. What it needs from you is not a procedure. It is a standard: a statement of what, among the millions of competent outputs it could produce, counts as the right one.</p><p>That sounds easier than writing rules. It is in fact the harder half, because it is the half that was always tacit. The procedure was never the secret. Any competent junior can execute the procedure. The secret was the judgement that separates the acceptable version from the correct one &#8212; and that judgement has spent your entire career living in your hands and your gut, never in language.</p><p>So the paradox has not been solved. It has been inverted. It used to protect you by making your knowledge unautomatable. It now bills you by making your knowledge unusable &#8212; because the machine will happily do the work, at speed and at scale, at exactly the level of the standard you were able to state. And you were never trained to state one.</p><p>Worse: the gaps do not stay empty. This is the part most organisations have not yet noticed. When you fail to specify something, you do not get a blank where your standard should be. You get the model&#8217;s default &#8212; a plausible, well-formed, statistically central choice drawn from everything it has ever seen. Every unarticulated preference in your brief is silently filled in by somebody else&#8217;s average. The output is not missing a standard. It is carrying one you did not choose and cannot see.</p><p>And there is a second-order cruelty that the decision-making literature has documented for decades. Articulation is not merely difficult; it is unreliable. Gary Klein spent a career studying how genuine experts decide under pressure &#8212; fireground commanders, intensive-care nurses, military officers &#8212; and found they do not compare options at all. They recognise patterns, and the right course of action presents itself already formed. Crucially, when asked to explain, they produce accounts that are confident, coherent and frequently wrong about their own process. This is precisely why Klein and his colleagues had to invent Cognitive Task Analysis: an entire elicitation methodology, involving structured critical-incident interviews and probe questions, built on the premise that you cannot get expertise out of an expert by asking them for it.</p><p>Which means the first specification you write is almost never your standard. It is your theory of your standard. And the machine will build your theory, faithfully, at scale, while you stare at the result knowing something is wrong and unable to say what.</p><div><hr></div><h3>What the debt actually costs</h3><p>The bill is already showing up in the aggregate numbers, misfiled as something else.</p><p>Forrester&#8217;s research on organisational &#8220;AI quotient&#8221; found that the share of employees who understand prompt engineering rose from 22% in 2024 to 26% in 2025 &#8212; four percentage points in a year of the most intense technology adoption in modern corporate history. That is usually reported as a training failure. It is more honestly read as evidence that the underlying capability is not a technique you can teach in an afternoon. You are not asking people to learn a syntax. You are asking them to make explicit something that has been implicit for their entire working lives.</p><p>Meanwhile, a Workday report in January 2026 found that almost 40% of apparent AI productivity gains in the workplace were being lost to rework and low-quality output. Nearly half the benefit, evaporating. The instinctive explanation is that the models are not good enough yet. Set that against the fact that model capability has risen sharply across the same period while the rework figure has not correspondingly fallen, and a different reading becomes hard to avoid: a large share of that 40% is not the machine failing to meet the standard. It is the standard never having been stated. That is the interest payment on the articulation debt, and it is being booked as a technology problem.</p><p>The distributional effect is the part that will reshape careers, and it runs in a direction almost nobody has priced in.</p><p>Seniority, in most professions, is a store of accumulated tacit judgement. Twenty years of pattern recognition; a library of cases; a finely calibrated sense of when something is off. In a world where work is executed by hand, that store converts directly into value &#8212; you do the work, and your judgement is embedded in every line of it, without ever needing to leave your head. In a world where work is executed by instruction, that same store converts into value only through the narrow aperture of what you can say. The library is still there. The door out of it has shrunk to the width of a sentence.</p><p>The consequence is genuinely uncomfortable: the twenty-year veteran with immaculate taste and no vocabulary for it can be functionally slower, right now, than a five-year mid-level who has less judgement but can state precisely what they want. Not because the veteran knows less. Because less of what they know is transmissible, and transmissibility has just become the constraint on everything.</p><p>And then there is the loss nobody is measuring at all. Standards that are never articulated are not merely underused &#8212; they are unpropagated. They do not enter the systems, the briefs, the templates or the model configurations. Which means the taste layer of an entire organisation quietly converges on whatever the model&#8217;s defaults happen to be, while the actual expertise sits in three or four people&#8217;s heads, retiring on schedule.</p><div><hr></div><h3>The four debtors</h3><p>The debt does not present the same way to everyone. Four recognisable positions, and most people are standing in one of them right now.</p><ul><li><p><strong>The Silent Master.</strong> Decades of genuine, hard-won judgement and almost no language for any of it. Their feedback vocabulary is a small set of gestures &#8212; not quite, closer, that&#8217;s it &#8212; which worked perfectly for thirty years because the recipient was a human who could triangulate from tone, context and repetition. A model cannot triangulate. The Silent Master carries the largest debt in the building and, painfully, the least awareness of carrying it, because until now their inability to explain was simply read as the mystique of expertise. The tell is a rejection rate that stays high while the quality of the instructions never improves.</p></li><li><p><strong>The Over-Specifier.</strong> Has correctly grasped that specification matters, and drawn exactly the wrong conclusion from it. Now writes twelve-hundred-word briefs describing tone, audience, structure, format, length and philosophy &#8212; everything, that is, except the specific discriminating judgement that actually separates the good version from the merely adequate one. They have confused volume with precision. Detail is not discrimination. A brief that describes everything equally has ranked nothing, and a model given a flat landscape will pick a plausible point on it. The Over-Specifier&#8217;s output is reliably competent, reliably generic, and reliably not what they wanted.</p></li><li><p><strong>The Borrowed Standard.</strong> Has no articulated standard of their own and, rather than confronting that, has quietly adopted the model&#8217;s output as the definition of good. Debt-free by way of bankruptcy. This is the most dangerous position of the four, because from the outside it looks like fluency: their work is fast, polished, well-formed and entirely uncontroversial. What has actually happened is that a human judgement layer has been removed from the system and nobody noticed, because the thing that replaced it produces confident, professional-looking work. Scale this across a department and the organisation&#8217;s taste becomes the statistical centre of the internet, applied consistently.</p></li><li><p><strong>The Translator.</strong> The rare person who both holds a real standard and can put it into words another person &#8212; or a machine &#8212; could act on. For most of their career this was not treated as a talent. It was treated as a personality trait, usually a slightly irritating one: the colleague who wanted the style guide written, who asked what &#8220;good&#8221; meant in the kickoff meeting, who could never let a vague brief through. They were the pedant. They are now, abruptly, the most leveraged individual in the organisation, because their judgement is the only judgement that can be installed anywhere other than in their own hands.</p><div><hr></div></li></ul><h3>How to start paying it down</h3><p>The first move is to stop treating this as a prompting problem. Prompting is a syntax, and syntaxes are learned in weeks. Articulating a standard is an act of self-excavation, and it is slow, effortful, and &#8212; this is the part that surprises people &#8212; genuinely improves the underlying expertise. Klein&#8217;s whole field exists because forcing tacit knowledge into language does not just extract it. It sharpens it.</p><ul><li><p><strong>If you are the expert:</strong> stop trying to write your standard from a blank page. That is the one method the research says will not work; you will produce your theory of your standard and nothing more. Work from artefacts instead. Take twenty pieces of past work you rejected and twenty you approved, and for each rejected one write a single sentence naming the specific thing that made it wrong. The pattern will emerge from the pile, not from introspection. This is Cognitive Task Analysis in cheap, self-service form, and it is far more effective than any amount of staring thoughtfully out of a window.</p></li><li><p><strong>If you are early in your career:</strong> you carry far less debt, and that is a real, temporary and rapidly appreciating advantage. Build the habit now of writing down what good looks like before you generate, not after you are disappointed. But do not mistake being articulate for having taste. Specifying well and knowing well are different capabilities, and only one of them takes years to acquire. The person who can say precisely what they want and wants the wrong thing has an efficient route to being confidently mediocre at scale.</p></li><li><p><strong>If you manage the work:</strong> treat articulation as work. Not a documentation chore appended to Friday afternoons, not a wiki page created in a burst of enthusiasm and abandoned in a fortnight &#8212; a funded activity with time, attention and someone accountable for it. The highest-return exercise available to most teams right now is embarrassingly low-tech: sit your best practitioner beside your best writer and have the writer interview the practitioner about specific past decisions until a usable standard falls out. Then also change what you reward. If you promote on output volume, you will get Over-Specifiers and Borrowed Standards. If you reward the person who made the team&#8217;s judgement legible to everyone else, you will build an organisation whose expertise survives its experts.</p></li><li><p><strong>If you lead the organisation:</strong> understand what is actually on your balance sheet. Your firm&#8217;s competitive advantage is very likely a set of standards that exist nowhere except in the heads of a handful of long-tenured people, and every one of those heads has a departure date. Historically this was a slow-burning succession risk. It is now an acute one, because the competitor who articulates their standards can install them into systems that run continuously, at scale, without fatigue &#8212; and you cannot. Ask a blunt diagnostic question: if your three best people left tomorrow, what would remain of their judgement? If the honest answer is &#8220;nothing written down,&#8221; you do not have an AI strategy problem. You have an articulation debt, and it is your largest unrecorded liability.</p><div><hr></div></li></ul><h3>The uncomfortable truth</h3><p>There is a story we have been telling ourselves since roughly 2023, and it is a flattering one. In the story, AI takes the routine work and humans ascend to the judgement work &#8212; the taste, the discernment, the irreducibly human layer. It is comforting, it is widely believed, and it rests on an assumption nobody has examined: that judgement, once elevated, can actually be applied to a system that only receives language.</p><p>It cannot, for most of us, yet. Not because we lack judgement, but because our judgement has spent its entire existence in a form that never had to be spoken. We built careers on a paradox we treated as a fortress, and it turns out to have been a debt facility. Every year you were valued for knowing more than you could tell was a year of borrowing, drawn against a future in which someone would eventually need you to tell.</p><p>That future arrived without an announcement. The bill is not a training gap or a technology gap. It is the accumulated distance between what you know and what you have ever been able to say &#8212; and it is now the single most expensive gap in professional work.</p><p>The professionals who come through this well will not be the ones with the deepest expertise. They will be the ones who did the unglamorous, uncomfortable, genuinely difficult work of dragging their expertise into language, and discovered &#8212; as everyone who attempts it does &#8212; that some of what they thought they knew does not survive being said out loud.</p><p>For 100 years we were paid for knowing more than we could tell. The debt was always there. AI did not create it. It simply called it in, all at once, and asked us to speak.</p>]]></content:encoded></item><item><title><![CDATA[The Vigilance Trap.]]></title><description><![CDATA[A radiologist at a large teaching hospital gets a new AI triage tool.]]></description><link>https://www.shapingminds.co/p/the-vigilance-trap</link><guid isPermaLink="false">https://www.shapingminds.co/p/the-vigilance-trap</guid><dc:creator><![CDATA[Maxime Mouton]]></dc:creator><pubDate>Tue, 25 Aug 2026 23:00:38 GMT</pubDate><enclosure url="https://substackcdn.com/image/fetch/$s_!kjo1!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd3951869-5508-464f-8089-64072ae7bdc5_1024x1024.png" length="0" type="image/jpeg"/><content:encoded><![CDATA[<div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!kjo1!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd3951869-5508-464f-8089-64072ae7bdc5_1024x1024.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!kjo1!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd3951869-5508-464f-8089-64072ae7bdc5_1024x1024.png 424w, https://substackcdn.com/image/fetch/$s_!kjo1!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd3951869-5508-464f-8089-64072ae7bdc5_1024x1024.png 848w, https://substackcdn.com/image/fetch/$s_!kjo1!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd3951869-5508-464f-8089-64072ae7bdc5_1024x1024.png 1272w, https://substackcdn.com/image/fetch/$s_!kjo1!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd3951869-5508-464f-8089-64072ae7bdc5_1024x1024.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!kjo1!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd3951869-5508-464f-8089-64072ae7bdc5_1024x1024.png" width="1024" height="1024" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/d3951869-5508-464f-8089-64072ae7bdc5_1024x1024.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:1024,&quot;width&quot;:1024,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:152236,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:false,&quot;topImage&quot;:true,&quot;internalRedirect&quot;:&quot;https://www.shapingminds.co/i/212361909?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd3951869-5508-464f-8089-64072ae7bdc5_1024x1024.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!kjo1!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd3951869-5508-464f-8089-64072ae7bdc5_1024x1024.png 424w, https://substackcdn.com/image/fetch/$s_!kjo1!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd3951869-5508-464f-8089-64072ae7bdc5_1024x1024.png 848w, https://substackcdn.com/image/fetch/$s_!kjo1!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd3951869-5508-464f-8089-64072ae7bdc5_1024x1024.png 1272w, https://substackcdn.com/image/fetch/$s_!kjo1!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd3951869-5508-464f-8089-64072ae7bdc5_1024x1024.png 1456w" sizes="100vw" fetchpriority="high"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image buttonBase-GK1x3M"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image buttonBase-GK1x3M"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p>A radiologist at a large teaching hospital gets a new AI triage tool. It reads each incoming chest scan, flags the ones that look urgent, and pre-marks suspected findings on the image before she ever opens it. Her job is unchanged on paper: she reads every scan and signs off. In practice her job has changed entirely. She is no longer the first pair of eyes. She is the second &#8212; the one confirming or overruling a machine that, in validation, agreed with expert consensus more than nine times in ten.</p><p>For the first fortnight she reads each scan as she always has, eyes tracking the lungs edge to edge, treating the AI&#8217;s marks as a colleague&#8217;s opinion rather than a verdict. Then the pattern of the work teaches her what the pattern of the work always teaches. The tool is right. It is right on Monday and right on Thursday and right for a hundred scans in a row. Her overrules get rarer. Her reads get faster. Somewhere around scan four hundred, without a single decision to do so, she stops reading the image and starts reading the marks &#8212; checking whether the AI&#8217;s boxes look plausible rather than searching the scan for what the boxes might have missed.</p><p>Then comes the scan the tool reads as clear, on a patient whose tumour sits in exactly the region the model is weakest on. The finding is faint but visible &#8212; to a radiologist who is looking. She is no longer looking. She is confirming. She signs off in nine seconds and moves to the next.</p><p>Nothing about this radiologist is negligent. She is highly trained, highly motivated, and doing precisely what the system was designed to make her do. That is the point. The failure was not a lapse in her character. It was the predictable output of asking a human to do the one thing humans are engineered to fail at &#8212; and then calling that arrangement a safety control.</p><div><hr></div><h3>A problem we solved, and named, in 1948</h3><p>During the Second World War, the British military had a problem with radar and sonar operators. The equipment worked. The operators, staring at screens for hours waiting for the rare blip of an enemy submarine, kept missing the blips. Not through incompetence &#8212; through something more fundamental, and more troubling, because it could not be trained or disciplined away.</p><p>A young psychologist named Norman Mackworth was asked to study it. He built an apparatus now known as the Mackworth Clock: a plain clock face with a hand that ticked in regular steps and, at random and infrequent intervals, jumped two steps instead of one. The observer&#8217;s only task was to catch every double-jump across a two-hour watch. It is about the simplest sustained-attention task imaginable.</p><p>The result, published in 1948 and replicated thousands of times since, founded an entire field. Detection accuracy did not hold steady and then tail off with fatigue at the end. It collapsed early. Performance fell by ten to fifteen per cent within the first thirty minutes &#8212; and kept declining from there. This is the vigilance decrement, and its most important property is the one that makes it so dangerous: it afflicts motivated, rested, well-trained people who know they are being tested. Willpower does not touch it. It is not a flaw in particular workers. It is a property of the attentional system every human is issued at birth.</p><p>The cruel structure of it is this. Human attention is not built to be sustained on a source of information where almost nothing happens. The rarer the signal, the faster and deeper the decrement. A monitoring task where events are frequent keeps the mind engaged. A monitoring task where the thing you are watching for almost never occurs is precisely the task the brain cannot hold.</p><p>Which sets up the central irony, articulated in 1983 by the cognitive psychologist Lisanne Bainbridge in a four-page paper, &#8220;Ironies of Automation,&#8221; that has aged better than almost anything written about technology since. Her argument was deceptively simple: we automate the tasks humans are bad at, and in doing so we hand the human the residual task of monitoring the automation &#8212; a task humans are even worse at.</p><blockquote><p><strong>&#8220;We know from many &#8216;vigilance&#8217; studies that it is impossible for even a highly motivated human being to maintain effective visual attention towards a source of information on which very little happens, for more than about half an hour.&#8221;</strong></p><p><strong>&#8212; Lisanne Bainbridge, &#8220;Ironies of Automation,&#8221; Automatica, 1983</strong></p></blockquote><p>Bainbridge&#8217;s paper has survived for four decades because it does not describe a fact about 1983 technology. It describes a structural relationship between humans and reliable machines &#8212; one that gets worse, not better, as the machine improves. And we have just handed that exact relationship to two billion knowledge workers, and given it a reassuring name.</p><div><hr></div><h3>Why AI is the most dangerous automation we have ever monitored</h3><p>Every previous generation of automation that put a human on watch at least had the decency to look mechanical. A cruise control, an autopilot, an assembly-line sensor &#8212; you could tell you were supervising a machine. Generative AI removed that tell. It produces work that looks exactly like the work of a competent, careful colleague. It writes in complete sentences. It cites. It hedges where a thoughtful person would hedge. It sounds certain where a confident person would sound certain. And it is right often enough that scrutinising it begins to feel not just unnecessary but faintly insulting, like re-checking the arithmetic of someone who has never once got the sum wrong.</p><p>This fluency is not a cosmetic feature. It is the mechanism by which the trap springs harder. The research literature on automation bias &#8212; our tendency to over-trust automated systems &#8212; identifies two distinct failure modes, and fluent AI aggravates both simultaneously. The first is the omission error: you fail to notice a problem because the system did not flag it. The radiologist who stops searching the scan and searches the boxes instead is committing omission errors by the hundred; she has outsourced not just the analysis but the very act of looking. The second is the commission error: you actively follow the system&#8217;s recommendation even when other evidence in front of you contradicts it. The more authoritative the system sounds, the more its confident wrong answer overrides your quiet correct doubt.</p><p>What makes this worse than the old radar screen is that the AI is not a source of information on which very little happens. It is a source on which a great deal happens &#8212; a torrent of plausible, polished output &#8212; almost all of which is fine. That is the vigilance decrement&#8217;s ideal habitat, dressed up as its opposite. The operator feels busy, engaged, productive. There is no dead screen to fight. There is a stream of competent work sliding past, and the rare defect is a single deformed shape in a river of well-formed ones, moving at the speed of your approval clicks.</p><p>And here is the reliability paradox in its purest form: the better the model gets, the more certainly the human oversight fails. A model that is wrong ten per cent of the time keeps you at least intermittently alert, because you catch errors often enough to stay in the game. A model that is wrong a tenth of a per cent of the time lulls you completely &#8212; and then delivers its rare error to a reviewer who has not truly reviewed anything in weeks. Improving the AI does not reduce the risk of the human-plus-AI system. Past a certain point, it increases it.</p><div><hr></div><h3>What gets lost, and the debt nobody records</h3><p>The evidence that we have already surrendered the oversight role is not subtle. In the 2025 global study of trust in AI conducted by KPMG and the University of Melbourne &#8212; roughly 48,000 people across 47 countries, one of the largest surveys of its kind &#8212; 66% of respondents said they rely on AI output without evaluating its accuracy. 56% admitted they have made mistakes in their work because of AI. </p><p><strong>These are not the numbers of a species diligently keeping AI in the loop. They are the numbers of a species that has quietly stepped out of it while leaving a mannequin in the chair.</strong></p><p>The cost of this does not appear anywhere it can be easily seen, and that is precisely what makes it accumulate. Every hour AI saves is booked immediately, visibly, and enthusiastically &#8212; in dashboards, in time-saved metrics, in the genuine relief of people whose drudgery just evaporated. But that saved hour is not free. A portion of it is a loan drawn against future vigilance, and the repayment falls due unpredictably, all at once, on whoever happens to be holding the rare error when it finally ships. </p><p><strong>Call it the vigilance debt:</strong> the silent, compounding liability created every time speed is purchased by withdrawing attention, recorded on no ledger because a monitoring failure produces no artefact until the moment it produces a catastrophe.</p><p>Ordinary work leaves a trail of near-misses. You notice yourself almost making a mistake, and the noticing keeps you sharp. Vigilance failure leaves no such trail. The scans you signed off without reading look identical to the scans you signed off after reading. The letters you approved on rhythm look identical to the letters you approved on judgement. There is no feedback, no wobble, no warning tremor &#8212; right up until the one that was wrong goes out to four thousand customers or one patient, and the incident review discovers, to everyone&#8217;s genuine surprise, that the human control everyone was relying on had quietly stopped controlling anything months ago.</p><p>Regulators have noticed what most organisations have not. The European Union&#8217;s AI Act, in its provisions on human oversight, does something almost unheard of in legislation: it names a specific cognitive bias. Automation bias is the single psychological phenomenon the Act explicitly calls out as a threat to effective human oversight of high-risk systems. The lawmakers understood what the average deployment plan does not &#8212; that writing &#8220;a human will review the output&#8221; into a process does not make the review happen. Vigilance is not summoned by an org chart. It is defeated by one.</p><div><hr></div><h3>The four faces of the vigilance trap</h3><p>The trap does not present the same way to everyone. It has recognisable archetypes, and naming them is the first step to noticing yourself becoming one.</p><ul><li><p><strong>The Rhythm Clicker.</strong> This is the reviewer whose approvals have become motor memory. The task has a cadence &#8212; open, glance, approve, next &#8212; and once the cadence sets, the content stops entering conscious attention at all. The Rhythm Clicker is not lazy; they are efficient, and their efficiency is the disease. They have optimised a task down to the point where the one part that mattered, the actual looking, has been optimised away. The tell is that they could not tell you anything specific about the last ten things they approved.</p></li><li><p><strong>The Fluency Truster.</strong> This reviewer still reads &#8212; but reads for polish rather than for truth. Because the AI&#8217;s output is articulate, structured and confident, the Fluency Truster&#8217;s brain accepts fluency as a proxy for correctness, which it never was. They will catch a typo and miss a fabricated statistic, because the typo disrupts the surface and the fabrication does not. This is the most insidious archetype, because it feels like diligence. They are working hard. They are just checking the wrong layer.</p></li><li><p><strong>The Volume Drowner.</strong> Before AI, this person reviewed ten things a week and could give each real attention. AI raised the inflow to a hundred, and nobody adjusted the reviewing capacity, because reviewing was not the thing the rollout was about. The Volume Drowner is trying to be vigilant and is structurally prevented from it. Their failure is not attentional but arithmetic: genuine scrutiny of a hundred artefacts a week was never on the menu, so what gets called review is triage at best and theatre at worst.</p></li><li><p><strong>The Lonely Sentinel.</strong> This is the single human designated as the check on a system that runs thousands of times a day &#8212; the one radiologist, the one approver, the one &#8220;human in the loop&#8221; whose sign-off legitimises the entire pipeline. The Lonely Sentinel carries the full weight of a safety story they cannot possibly bear, and everyone upstream and downstream behaves as though the sentinel&#8217;s presence has made the system safe. Their existence is what allows the organisation to stop worrying. Their existence is the reason it should worry more.</p><div><hr></div></li></ul><h3>What to actually do about it</h3><p>The first and most important move is to stop treating vigilance as a matter of will. Bainbridge told us in 1983 that you cannot exhort your way out of the vigilance decrement, and seventy-five years of data agree. A policy that says &#8220;reviewers must carefully check all AI output&#8221; is not a control. It is a wish, and worse, it is a wish that transfers liability onto individuals for a failure the system made inevitable. Every intervention that actually works is a design intervention, not a motivational one.</p><ul><li><p><strong>If you are an individual reviewer:</strong> your value has quietly inverted. The scarce, rising skill is no longer producing output faster &#8212; the machine wins that outright and permanently. It is being the person who genuinely reads the thing when everyone around you has stopped. Cultivate adversarial review as a deliberate practice: begin from the assumption that the plausible answer in front of you is wrong, and spend your attention hunting for where. Read for truth, not polish. And protect your own attentional conditions, because a Rhythm Clicker is just a good reviewer who was never given a reason to stay awake.</p></li><li><p><strong>If you manage the work:</strong> the highest-leverage thing you can do is design the reviewing task so that a normal human can actually perform it. Cap the length of unbroken monitoring stretches &#8212; the decrement bites at thirty minutes, so rotate reviewers before that, not after. Deliberately re-introduce signal: seed a known error rate into the stream so that the reviewer catches something often enough to stay engaged, the way pilots train on simulated failures and airport screeners are shown planted threat images to keep detection rates up. Measure catch rates, not throughput. And never let one person be the whole control for a high-volume system; the Lonely Sentinel is an org-design failure wearing a job title.</p></li><li><p><strong>If you lead the organisation:</strong> internalise the reliability paradox before it internalises you. The safety of a human-plus-AI system does not rise monotonically with model quality &#8212; it can fall as the model improves, because improvement erodes the human check. This means your risk is highest precisely when your metrics look best and your people feel most confident. Instrument for it. Ask not &#8220;how much time did AI save?&#8221; but &#8220;when did a human last catch something the AI got wrong, and how would we know if they had stopped?&#8221; If you cannot answer the second half of that question, you do not have oversight. You have a green button and a person to press it.</p></li><li><p><strong>If you design these systems:</strong> the goal is not to add a human to the loop. It is to build a loop a human can actually stay awake inside. That means surfacing the model&#8217;s uncertainty rather than hiding it behind uniform fluency, varying the presentation so the reviewer cannot settle into rhythm, forcing genuine engagement at the moments that matter rather than requesting blanket attention that cannot be given, and &#8212; hardest of all &#8212; resisting the commercial pull to make the output so smooth and confident that trusting it becomes the path of least resistance. Every increment of polish you add is an increment of vigilance you take away.</p><div><hr></div></li></ul><h3>The uncomfortable truth</h3><p>We told ourselves a story about AI and human judgement. In the story, the machine handles the volume and the human provides the wisdom &#8212; the oversight, the discernment, the final responsible glance that keeps the whole thing safe. It is a comforting story, and it is the story written into a thousand deployment plans and at least one major piece of European legislation. The trouble is that it depends entirely on a capability we have known for three-quarters of a century that humans do not reliably possess: sustained vigilance over a system that rarely fails.</p><p>The deeper irony is that we are running the experiment backwards. We are pouring effort into making the models more reliable, and each gain in reliability quietly weakens the human check that our safety story rests on. The better it gets, the less we watch. The less we watch, the more the rare failure matters. And the rare failure is the only kind a highly reliable system produces.</p><p>&#8220;Human-in-the-loop&#8221; was never a solution. It was the problem, restated as a reassurance. The organisations that come through this well will be the ones honest enough to admit that a human posted to watch a nearly-perfect machine is not a safeguard but a sedative &#8212; and to redesign the work around the reviewer we actually are, rather than the tireless sentinel we keep pretending to be.</p><p><strong>The machine&#8217;s job is to be right almost always. Ours was supposed to be catching the moment it isn&#8217;t. We should probably find out whether anyone is still watching.</strong></p>]]></content:encoded></item><item><title><![CDATA[The Coordination Tax.]]></title><description><![CDATA[Exploring why AI's enormous gains in individual speed keep failing to show up in organisational output.]]></description><link>https://www.shapingminds.co/p/the-coordination-tax</link><guid isPermaLink="false">https://www.shapingminds.co/p/the-coordination-tax</guid><dc:creator><![CDATA[Maxime Mouton]]></dc:creator><pubDate>Tue, 18 Aug 2026 23:00:03 GMT</pubDate><enclosure url="https://substackcdn.com/image/fetch/$s_!Zjnc!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F9f9cffc3-b346-49b2-a15f-d0d5ec1e793d_1024x1024.png" length="0" type="image/jpeg"/><content:encoded><![CDATA[<div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!Zjnc!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F9f9cffc3-b346-49b2-a15f-d0d5ec1e793d_1024x1024.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!Zjnc!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F9f9cffc3-b346-49b2-a15f-d0d5ec1e793d_1024x1024.png 424w, https://substackcdn.com/image/fetch/$s_!Zjnc!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F9f9cffc3-b346-49b2-a15f-d0d5ec1e793d_1024x1024.png 848w, https://substackcdn.com/image/fetch/$s_!Zjnc!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F9f9cffc3-b346-49b2-a15f-d0d5ec1e793d_1024x1024.png 1272w, https://substackcdn.com/image/fetch/$s_!Zjnc!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F9f9cffc3-b346-49b2-a15f-d0d5ec1e793d_1024x1024.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!Zjnc!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F9f9cffc3-b346-49b2-a15f-d0d5ec1e793d_1024x1024.png" width="1024" height="1024" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/9f9cffc3-b346-49b2-a15f-d0d5ec1e793d_1024x1024.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:1024,&quot;width&quot;:1024,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:829731,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:false,&quot;topImage&quot;:true,&quot;internalRedirect&quot;:&quot;https://www.shapingminds.co/i/202519846?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F9f9cffc3-b346-49b2-a15f-d0d5ec1e793d_1024x1024.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!Zjnc!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F9f9cffc3-b346-49b2-a15f-d0d5ec1e793d_1024x1024.png 424w, https://substackcdn.com/image/fetch/$s_!Zjnc!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F9f9cffc3-b346-49b2-a15f-d0d5ec1e793d_1024x1024.png 848w, https://substackcdn.com/image/fetch/$s_!Zjnc!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F9f9cffc3-b346-49b2-a15f-d0d5ec1e793d_1024x1024.png 1272w, https://substackcdn.com/image/fetch/$s_!Zjnc!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F9f9cffc3-b346-49b2-a15f-d0d5ec1e793d_1024x1024.png 1456w" sizes="100vw" fetchpriority="high"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image buttonBase-GK1x3M"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image buttonBase-GK1x3M"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p>The bids team at a mid-sized engineering firm used to take three weeks to turn a client brief into a submitted proposal. After the AI rollout, the first draft came back in a day and a half. It was good. Not good enough to send unedited, but genuinely good &#8212; structured, costed, referencing the right precedents. The team lead sent it to legal on a Tuesday morning and, with entirely reasonable confidence, told the client to expect it by Friday.</p><p>Legal was one person. Legal had been one person before the rollout, and nobody had thought to change that, because the rollout was about drafting and legal review is not drafting.</p><p>Within a quarter the bids team was producing eleven proposals a week. Legal could review two. The firm&#8217;s average response time to clients &#8212; the only number the client actually experiences &#8212; moved from twenty-two days to twenty-six. It took another full quarter for anyone to notice, because every internal metric anyone was watching had improved dramatically. Time to first draft: down 90%. Drafts produced per head: up 14x. Employee-reported time saved: substantial. Every one of those numbers was true.</p><p>This is not a story about a badly run rollout. It is very close to the median story, and the aggregate data says so. In July 2025, MIT&#8217;s Project NANDA published The GenAI Divide: State of AI in Business 2025, based on more than 300 enterprise deployments, 52 structured case-study interviews and 153 leadership surveys. Their headline finding &#8212; that roughly 95% of an estimated 30 to 40 billion dollars in enterprise generative AI spend had produced no measurable profit-and-loss impact &#8212; briefly moved markets and was then mostly absorbed into the general noise of AI commentary, filed under the reassuring heading of &#8220;early days.&#8221;</p><p>It is not early days. It is the third year. And the reason so much of that spend evaporated is not that the technology underdelivered. In most of these deployments the technology did exactly what it said on the tin. The problem is that the thing it made faster was never the thing that was slow.</p><div><hr></div><h3>What the report actually said, and what everyone heard</h3><p>The MIT authors were reasonably direct about where the failure sits.</p><blockquote><p><strong>&#8220;The core barrier to scaling is not infrastructure, regulation, or talent. It is learning.&#8221;</strong></p><p><strong>&#8212; Aditya Challapally, Chris Pease, Ramesh Raskar et al., The GenAI Divide: State of AI in Business 2025, MIT Project NANDA</strong></p></blockquote><p>What most readers heard was a claim about the models &#8212; that the tools do not retain feedback or adapt to context, which the report also says. But read the sentence again with an organisational eye and it says something broader and more uncomfortable: the barrier is not any of the things a company can purchase. It is the thing a company has to change about itself. And the specific thing most companies did not change is the shape of the path work takes through people.</p><p>Gallup&#8217;s 2026 workplace research gives that gap a number. For the first time in their measurement, half of employed American adults say they use AI in their role at least occasionally, with 13% using it daily. And yet only about one in ten employees inside AI-adopting organisations strongly agree that AI has transformed how work gets done where they work. Gallup&#8217;s own reading is that the benefits are concentrated at the level of individual tasks rather than workplace systems, because most organisations have not redesigned workflows, roles or processes around the technology at all.</p><p>Individual speed: up. Organisational throughput: essentially unchanged. That is not a paradox in need of resolving. It is the predictable result of optimising a link in a chain that was never the constraint.</p><div><hr></div><h3>We have run this experiment before</h3><p>None of this should have surprised anyone, because there is an unusually well-documented precedent. In 1987 Robert Solow made the observation that became the productivity paradox: you could see the computer age everywhere except in the productivity statistics. Firms had spent enormously on computing through the late 1970s and 1980s, and measured productivity growth had gone sideways. The eventual resolution, worked out across a large literature over the following two decades, was not that computers were useless. It was that the gains required complementary organisational investment &#8212; different processes, different job designs, different decision rights &#8212; and those investments take years, cost real money, and depress measured productivity while they are being made. Firms that bought the computers and kept the workflow got the paradox. Firms that redesigned around the computers got the gains, roughly five to seven years later.</p><p>There is an even older piece of arithmetic underneath it. Amdahl&#8217;s law, formulated for parallel computing in 1967, says that the speedup available from accelerating any part of a system is capped by the fraction of the system you did not accelerate. Make one stage of a process infinitely fast and the overall improvement is still bounded by everything else. If the drafting stage was 20% of the elapsed time from brief to submitted proposal, then reducing drafting to zero &#8212; not by 90%, to zero &#8212; improves the whole process by at most 20%. And drafting was almost never 20%. In most knowledge-work chains it is closer to 10%, with the remaining 90% consisting of waiting: for a review, for an approval, for a meeting where three teams can be in the same room, for a decision-maker to have thirty uninterrupted minutes.</p><p>The Atlanta Fed&#8217;s March 2026 working paper, drawing on a survey of nearly 750 corporate executives, gives the current version of the Solow observation its formal name. The authors document what they call a productivity paradox in the AI era: perceived productivity gains are consistently larger than measured productivity gains. Executives are not lying. They are reporting something real &#8212; the acceleration of the visible, individual, task-level work &#8212; and then discovering that it does not appear in the aggregate, because the aggregate was never governed by that stage.</p><div><hr></div><h3>The mechanism: why it is a tax and not merely a disappointment</h3><p>Here is where the story turns from &#8220;less benefit than hoped&#8221; to something with a genuine cost attached.</p><p>Treat any work chain as a queueing system, because that is what it is. Work arrives at a stage, waits, gets processed, moves on. In a system like this, total throughput is governed entirely by the slowest stage, and the only reliable way to make the system faster is to widen that stage. Speeding up a stage that was not the constraint does not improve throughput at all. Worse, it increases the arrival rate at the next stage downstream. If the downstream stage&#8217;s capacity is unchanged, the queue in front of it grows, and the average time work spends in the system goes up.</p><p>This is not a metaphor. It is the actual mechanism in the proposal story: eleven drafts a week arriving at a reviewer with a capacity of two produces a growing backlog, a longer average wait, and a client experience that gets measurably worse while every internal dashboard reports triumph. The organisation has not eliminated a bottleneck. It has fed one.</p><p>The coordination tax is the charge this system levies at every point where work passes between a person doing it and a person who must respond to it. It is paid per handoff. It is levied in elapsed time, in re-explanation, in meetings convened to resolve what a handoff failed to transmit. And it is almost completely indifferent to how fast the work itself was produced &#8212; which means that as production accelerates, the tax does not fall as a share of the total. It rises. It becomes, in relative terms, nearly the whole cost.</p><p>Most organisations have never measured it, because no individual pays it. It is charged to the space between people, and no one owns that space. It appears on no team&#8217;s dashboard, in no one&#8217;s objectives, and in no vendor&#8217;s ROI model. It is precisely the sort of cost that survives a decade of efficiency programmes untouched, and then quietly consumes the entire benefit of the next one.</p><div><hr></div><h3>The second charge: coordination gets more expensive, not just no cheaper</h3><p>If the tax merely stayed constant while production accelerated, the picture would be disappointing but stable. The evidence suggests something worse: introducing AI into collaborative work tends to raise the cost of the coordination itself.</p><p>Reviewing the human-AI teaming literature, Schmutz and colleagues find that adding AI to a team frequently reduces coordination, communication and trust &#8212; that human-AI teams underperform not because the AI is weak but because team cognition and mutual understanding degrade. The mechanism is intuitive once stated. Coordination between people runs on a shared model of what each other knows and has actually thought about. When a colleague sends you a document, how carefully you check it has always depended on your read of how carefully they made it. Remove your ability to infer that &#8212; because the artefact could plausibly have been produced with five minutes of prompting or five hours of reasoning, and looks identical either way &#8212; and your only rational response is to check more.</p><p>So verification effort per handoff rises at exactly the moment volume per handoff rises. Reviewers who could previously skim a colleague&#8217;s work because they knew the colleague now have to read it properly, on three times as many documents. Approvers who could take a recommendation on trust now ask for the reasoning. Alignment meetings that used to converge on two credible options now have to work through six, because generating options got cheap and choosing between them did not.</p><p>This is the part organisations consistently fail to anticipate. They model AI adoption as a reduction in production cost with coordination cost held constant. In practice production cost falls, volume rises, and coordination cost per unit rises simultaneously. Three variables moving, only one of them modelled.</p><div><hr></div><h3>The four tolls</h3><p>The coordination tax is not a single charge. It is collected at four distinct gates, and separating them matters, because each one has a different remedy and only one of them got cheaper after AI arrived.</p><ul><li><p><strong>The Approval Toll.</strong> Work waits for someone with authority to say yes. This is the purest form of the tax, and the most brutally unaffected by AI: the time cost is set entirely by the approver&#8217;s calendar and attention, both of which are fixed. Where an approval chain has three signatures, AI can compress the drafting from three weeks to two days and the elapsed time will fall from, say, thirty-five days to thirty-one. The visible work was never the number. The signatures were.</p></li><li><p><strong>The Context Toll</strong>. Every handoff requires the receiver to be brought up to speed on what the sender knows. AI makes this toll worse in a specific and under-appreciated way: it dramatically increases the number of artefacts in circulation without increasing the shared understanding behind them. More documents, more variants, more options &#8212; each of which arrives at a colleague carrying less implicit context than a hand-made artefact would have, because the person who sent it may not hold all of that context themselves.</p></li><li><p><strong>The Alignment Toll</strong>. Multiple parties must agree before anything moves. This toll scales with the number of options on the table and the number of people who must converge, and AI inflates the first term hard. When producing a strategic option costs an afternoon rather than a fortnight, teams arrive at the alignment meeting with six credible directions instead of two. Generation got a hundred times cheaper; agreement got no cheaper at all, and now has three times as much to agree about.</p></li><li><p><strong>The Verification Toll</strong>. Someone must check the work before it counts. This is the toll that AI has damaged most directly, for the reason described above: volume rises while confidence per artefact falls, so total verification load rises on both axes at once. It is also the toll most likely to be quietly skipped under pressure, which converts a coordination problem into a risk problem without anyone deciding to accept the risk.</p></li></ul><p>Read the four together and the pattern is stark. Of the four gates where organisational time actually goes, AI has meaningfully improved exactly none, made three actively more expensive, and been sold on its ability to accelerate a fifth stage &#8212; production &#8212; which was rarely the binding constraint in the first place.</p><div><hr></div><h3>The variable that actually predicts it working</h3><p>There is a version of this story where AI produces real, compounding, measurable returns. It exists. The 5% in the MIT study are not statistical noise; they were extracting millions in value. The interesting question is what separates them, and the most useful answer in the current literature has nothing to do with tooling.</p><p>Wang, Feng and Sun built an inter-firm mobility network from 460 million job records covering more than 16,000 US companies, tracking how AI capability spreads between firms through the movement of AI workers. They found productivity spillovers two to three times larger than those historically associated with traditional IT &#8212; a striking result on its own. But the effect was conditional in a way that should reframe how leaders think about AI strategy entirely: hiring AI talent out of flatter, more lean-startup-intensive firms generated significant productivity gains, while hiring from firms lacking those traits yielded little benefit. Their mechanism tests point to flat and lean organisations producing more versatile AI generalists who carry richer, more transferable knowledge with them.</p><p>Same technology. Same models, available to everyone at the same price. Comparable people. Different organisational shape, radically different outcome. The authors&#8217; broader framing is that AI spillovers, unlike IT spillovers, depend on experimental and integrative environments rather than on scale and process standardisation &#8212; which is another way of saying that the returns accrue to organisations with short paths between the work and the decision.</p><p>Which is the whole argument in a sentence. AI is not a productivity technology at organisational scale. It is an amplifier of whatever coordination structure you already had. In a flat organisation with few gates it compounds. In a layered one it congests. And the standard response to congestion &#8212; buying more AI, because the first deployment &#8220;clearly worked, look at the time-saved numbers&#8221; &#8212; is paying the same toll twice.</p><div><hr></div><h3>What to actually do about it</h3><ul><li><p>For <strong>individuals</strong>, the strategic implication is uncomfortable but clarifying: your visible output has stopped being a differentiator, because everyone&#8217;s rose at the same time. What is now scarce is the ability to move work through people &#8212; knowing who actually decides, what they need in order to decide, how to get a clean yes on the first pass rather than the third, and when to skip a gate entirely because it exists for historical reasons nobody can articulate. This was always undervalued relative to production skill. It is now the constraint, which means it is where the returns are.</p></li><li><p>For <strong>managers</strong>, the single highest-leverage act is to instrument the whole chain rather than the fast link. Almost every AI dashboard currently in use measures time saved per task, adoption rate, and self-reported productivity &#8212; three metrics that will report success indefinitely regardless of whether anything reaches a customer faster. Replace them, or at least outrank them, with elapsed time from request to delivered, and with queue depth at each internal handoff. The second number is the one that will be unpleasant, and it is the one that tells you where your ceiling is.</p></li><li><p>For <strong>leaders</strong>, the arithmetic to internalise is Amdahl&#8217;s: the return on accelerating any stage is capped by the fraction of elapsed time that stage represents. Before the next tool purchase, map where elapsed time actually goes for one important piece of work &#8212; genuinely map it, in days, from request to delivery &#8212; and count how much of it is production versus waiting. In most organisations the ratio is bad enough to make the case on its own. If 85% of elapsed time is waiting at four gates, then removing a gate is worth more than any conceivable improvement in the model behind the drafting.</p></li></ul><p>And for anyone designing an organisation from here: the Wang, Feng and Sun result suggests the highest-return AI investment available to most firms is not an AI investment at all. It is delayering. Every gate removed is a toll no longer charged, on every piece of work, forever &#8212; and unlike a tooling upgrade, nobody can buy the same advantage next quarter.</p><div><hr></div><h3>The ceiling nobody put on the slide</h3><p>The seductive thing about the coordination tax is that it is invisible from inside every role that pays it. The person drafting sees their own work getting faster and concludes the system is faster. The reviewer sees an unmanageable queue and concludes the drafters are being careless. The executive sees a dashboard of time-saved metrics and concludes the rollout succeeded. The client sees a response arriving twenty-six days after they asked, four days later than last year, and concludes nothing at all, because they have nothing to compare it against.</p><p>Not one of these people has an incorrect view of what they can see. The tax lives in the space between them, which is exactly the space no dashboard covers, no individual owns, and no vendor sells a fix for. It is the reason 95% of an enormous investment produced nothing measurable, and it is also the reason the remaining 5% produced so much: they had fewer gates to begin with, not better models.</p><p>The uncomfortable truth is that the last three years have been a very expensive natural experiment testing a hypothesis nobody stated out loud &#8212; that the constraint on knowledge work was individual production capacity. The experiment has now returned a fairly clear result, at a cost of tens of billions of dollars, and the result is no. The constraint was the structure. It always was. AI simply removed the last remaining excuse for pretending otherwise, by making the production side so fast that there is nothing left to blame.</p><p><strong>You did not buy a faster organisation. You bought a faster way to reach the queue.</strong></p>]]></content:encoded></item><item><title><![CDATA[The Feedback Vacuum.]]></title><description><![CDATA[Daniel Okafor had been writing Python for three years when his team asked him to pick up Trio, a concurrency library nobody else on staff knew well either.]]></description><link>https://www.shapingminds.co/p/the-feedback-vacuum</link><guid isPermaLink="false">https://www.shapingminds.co/p/the-feedback-vacuum</guid><dc:creator><![CDATA[Maxime Mouton]]></dc:creator><pubDate>Wed, 12 Aug 2026 05:00:48 GMT</pubDate><enclosure url="https://substackcdn.com/image/fetch/$s_!Of5J!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F7d931e7c-ef4f-4327-8e6d-aaf9664683c3_1024x1024.png" length="0" type="image/jpeg"/><content:encoded><![CDATA[<div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!Of5J!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F7d931e7c-ef4f-4327-8e6d-aaf9664683c3_1024x1024.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!Of5J!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F7d931e7c-ef4f-4327-8e6d-aaf9664683c3_1024x1024.png 424w, https://substackcdn.com/image/fetch/$s_!Of5J!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F7d931e7c-ef4f-4327-8e6d-aaf9664683c3_1024x1024.png 848w, https://substackcdn.com/image/fetch/$s_!Of5J!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F7d931e7c-ef4f-4327-8e6d-aaf9664683c3_1024x1024.png 1272w, https://substackcdn.com/image/fetch/$s_!Of5J!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F7d931e7c-ef4f-4327-8e6d-aaf9664683c3_1024x1024.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!Of5J!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F7d931e7c-ef4f-4327-8e6d-aaf9664683c3_1024x1024.png" width="1024" height="1024" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/7d931e7c-ef4f-4327-8e6d-aaf9664683c3_1024x1024.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:1024,&quot;width&quot;:1024,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:201114,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:false,&quot;topImage&quot;:true,&quot;internalRedirect&quot;:&quot;https://www.shapingminds.co/i/210326617?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F7d931e7c-ef4f-4327-8e6d-aaf9664683c3_1024x1024.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!Of5J!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F7d931e7c-ef4f-4327-8e6d-aaf9664683c3_1024x1024.png 424w, https://substackcdn.com/image/fetch/$s_!Of5J!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F7d931e7c-ef4f-4327-8e6d-aaf9664683c3_1024x1024.png 848w, https://substackcdn.com/image/fetch/$s_!Of5J!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F7d931e7c-ef4f-4327-8e6d-aaf9664683c3_1024x1024.png 1272w, https://substackcdn.com/image/fetch/$s_!Of5J!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F7d931e7c-ef4f-4327-8e6d-aaf9664683c3_1024x1024.png 1456w" sizes="100vw" fetchpriority="high"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image buttonBase-GK1x3M"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image buttonBase-GK1x3M"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p>Daniel Okafor had been writing Python for three years when his team asked him to pick up Trio, a concurrency library nobody else on staff knew well either. He worked through the self-guided tutorial the way he worked through everything now: with an AI assistant open in a side pane, ready to generate a working example the moment he got stuck. He finished the tutorial in the time the syllabus allotted. He built the sample project. Everything ran.</p><p>Three weeks later, a production job using Trio hung intermittently in a way the tutorial had never covered, and Daniel stared at the stack trace with the specific, sinking recognition of someone who has never actually debugged the thing he supposedly learned. He had finished the course. He had not learned the library. He had learned how to get an AI to finish the course for him, which turns out to be a different skill entirely, and one with a much shorter half-life once the assistant isn&#8217;t in the room.</p><p>Daniel is not a real name, but his experience is close to a real result. In January 2026, Anthropic researchers Judy Hanwen Shen and Alex Tamkin ran fifty-two software developers through exactly this scenario in a randomized controlled trial: learn the Trio library, half with an AI assistant able to generate correct code on demand, half without. The two groups finished in roughly the same amount of time &#8212; AI conferred no meaningful efficiency gain in this setting. What it did confer was a gap: the AI-assisted group scored 17% lower on a follow-up quiz testing conceptual understanding, code reading, and debugging, with the largest losses concentrated in debugging specifically &#8212; the skill you only build by sitting with an error until you understand it.</p><p>The researchers&#8217; own summary of the result is blunt enough to serve as this edition&#8217;s epigraph.</p><blockquote><p><strong>&#8220;AI-enhanced productivity is not a shortcut to competence.&#8221;</strong></p><p><strong>&#8212; Judy Hanwen Shen and Alex Tamkin, &#8220;How AI Impacts Skill Formation&#8221;, Anthropic, 2026</strong></p></blockquote><p>That sentence deserves to be read twice, because it contradicts the entire pitch of the last three years of workplace AI adoption. The pitch was never &#8220;this will make you incompetent faster.&#8221; The pitch was speed, and speed delivered &#8212; sometimes. But underneath the speed, in domain after domain, researchers keep finding the same second effect, arriving quietly and mostly unmeasured: something that used to get built through the ordinary friction of work has stopped getting built, because the friction is gone.</p><p>That something is feedback. This is an account of the vacuum left behind when it disappears.</p><div><hr></div><h3>What feedback actually was</h3><p>It is worth being precise about what got removed, because &#8220;feedback&#8221; has become one of those words flattened by overuse in performance-review culture until it barely means anything. Strip it back to the mechanism. A feedback loop, in the sense that matters here, has four steps: you attempt something, using your current best understanding; the world returns a signal about whether the attempt worked; you notice the gap between what you expected and what happened; and you update your understanding to close that gap next time. Attempt, signal, noticing, update. Run that loop enough times in a domain and the update process compresses &#8212; you stop consciously reasoning through problems you&#8217;ve solved before and start recognising them. That compression is what &#8220;expertise&#8221; is. It is not a personality trait or a certificate. It is thousands of completed loops, most of them too small and too fast to remember individually.</p><p>Every established profession built its training around this mechanism, usually without describing it in those terms. Apprenticeship systems put novices next to masters precisely so that attempts could be corrected quickly and cheaply, on low-stakes work, before the stakes rose. Medical residencies are built entirely around supervised attempts with rapid correction &#8212; the resident makes the call, the attending confirms or corrects it, and the resident updates in real time, thousands of times, before being trusted alone. Newsrooms had sub-editors whose entire function was to hand a piece back covered in corrections, which is a brutal but extremely efficient feedback mechanism, one many journalists will tell you they learned more from than journalism school. None of these systems were designed by anyone thinking about &#8220;feedback loops&#8221; as a formal concept. They were designed by people who noticed, empirically, that competence didn&#8217;t develop any other way.</p><p>What all of them share is a structural feature that AI assistance quietly breaks: the correction has to arrive after the attempt, and the person has to notice it as a correction. If the &#8220;attempt&#8221; step is skipped &#8212; if the AI generates the answer before you&#8217;ve formed your own &#8212; there is nothing for the correction to correct. If the correction happens invisibly, folded into a tool&#8217;s silent auto-fix, there is a correction but no noticing. Either way, the loop that builds competence never completes, even though, from the outside, work is visibly getting done, on schedule, to a high standard. That is the trap. The vacuum is invisible from the output side. It only shows up later, in the moment the tool isn&#8217;t there.</p><div><hr></div><h3>The mechanism: where AI actually intervenes</h3><p>It&#8217;s tempting to describe this as AI simply &#8220;doing the work for you,&#8221; but that framing misses where the damage happens. AI doing routine, low-skill work for you is not the problem &#8212; nobody develops expertise from filing expense reports, and automating them is a pure gain. The Feedback Vacuum opens specifically when AI intervenes in tasks you are still in the process of learning, and it opens at one precise point in the loop: between the attempt and the noticing.</p><p>Consider the two most common patterns of use. In the first, the assistant generates the answer before you&#8217;ve formed your own hypothesis &#8212; you describe the problem, it returns working code, a finished paragraph, a completed diagnosis. There is no attempt for a correction to attach to, so there is no loop, just output. In the second, you do form an attempt, but the assistant &#8220;helps&#8221; by silently repairing the parts that were wrong &#8212; autocomplete finishing your syntax before your typo becomes an error message, a grammar tool smoothing your sentence before its awkwardness registers as a lesson, a code-review bot auto-patching an edge case you never saw. Here an attempt exists, but the signal that would have told you it was wrong is intercepted before it reaches you. Both patterns look identical from the outside: correct output, produced efficiently. Only one of them &#8212; neither, in fact &#8212; leaves anything behind.</p><p>METR&#8217;s 2025 randomized trial of sixteen experienced open-source developers is the sharpest illustration of how invisible this is even to the people it&#8217;s happening to. Given AI tools for real coding tasks in mature codebases, the developers took 19% longer to finish than the control group working unassisted. Beforehand, they had forecast that AI would cut their time by 24%. Afterward &#8212; having just been measurably slower &#8212; they estimated that AI had made them about 20% faster. The gap between the forecast, the outcome, and the post-hoc perception is not a rounding error. It is what a severed feedback loop looks like applied reflexively to the tool itself: the developers had no reliable internal signal for whether the AI was helping, because the very faculty that would normally supply that signal &#8212; noticing when something worked and when it didn&#8217;t &#8212; was itself one of the casualties.</p><p>A 2026 theoretical model from Venkat Ram Reddy Ganuthula and a co-author, published in Human Behavior and Emerging Technologies, formalises why this perception gap is not a coincidence. Their model treats skill as a running balance between learning-through-practice and forgetting-through-disuse, with AI assistance shifting both terms of the equation at once: it raises visible, current-period performance &#8212; you produce good output today &#8212; while simultaneously reducing the practice that maintains skill over time, because the assistant is doing the practising for you. Run the simulation forward and you get a curve that rises before it falls: performance improves in the short run, exactly as advertised, then erodes in the long run, exactly as nobody advertised, and the two phases are far enough apart in time that the erosion is easy to misattribute to something else entirely &#8212; a market downturn, a personal slump, &#8220;just not what I used to be.&#8221;</p><div><hr></div><h3>Whose loop, exactly</h3><p>The Feedback Vacuum is often discussed as though it is purely a software engineering phenomenon, because software engineering happens to be the domain with the cleanest randomized trials. It is not confined there, and the clearest evidence of that comes from medicine, where the stakes make the pattern much harder to ignore.</p><p>In a study published in Radiology in 2023, twenty-seven radiologists &#8212; spanning inexperienced, moderately experienced, and highly experienced readers &#8212; assessed fifty mammograms with the assistance of a purported AI system offering a BI-RADS category suggestion. When the AI&#8217;s suggestion was correct, inexperienced readers matched it correctly almost 80% of the time &#8212; a strong result, on its face. When the researchers had the AI suggest an incorrect category, the same inexperienced readers&#8217; accuracy collapsed to under 20%. They were not reading the mammogram and consulting the AI. For all practical purposes, they were reading the AI, and checking the mammogram only enough to notice that it hadn&#8217;t obviously contradicted it.</p><p>This is the Feedback Vacuum in a setting where the &#8220;attempt&#8221; step is a diagnosis and the &#8220;signal&#8221; is, eventually, a biopsy result &#8212; a genuinely high-stakes loop that took decades to build into radiology training. The AI did not remove that loop by design; it removed it by convenience, one confident BI-RADS suggestion at a time, in exactly the cases &#8212; inexperienced readers, still forming their own independent read &#8212; where the loop mattered most. The radiologists who resisted the bias were, unsurprisingly, the most experienced ones: readers who had already banked enough completed loops, before the tool arrived, to have an independent judgment worth defending. The vacuum does not open evenly. It opens fastest in exactly the people who have the least stored expertise to fall back on &#8212; which is to say, the people the profession most needs to be developing.</p><div><hr></div><h3>The four shapes of feedback loss</h3><p>Not everyone loses the loop the same way. Four recognisable patterns of AI use show up across the research and across ordinary workplace observation, and only one of them keeps the loop intact.</p><ul><li><p>The Vending Machine User. Describes the problem, receives the answer, ships it. No hypothesis is ever formed before the AI&#8217;s output arrives, so there is no attempt for a correction to attach to &#8212; the loop never opens in the first place. This is the largest group, the default mode most tools are designed to encourage, and the pattern behind the 17-point comprehension gap in the Anthropic study: not misuse, just the path of least resistance, taken by people with every reasonable intention of doing good work.</p></li><li><p>The Ghost Editor. Forms a genuine attempt, but works inside a tool that silently repairs the parts that were wrong before they&#8217;re consciously registered &#8212; autocomplete finishing the syntax, a smoothing pass cleaning the prose, an auto-fix patching the edge case. An error occurred. Nobody noticed, including the person who made it. This is the subtlest version of the vacuum, because from the inside it feels like fluency, not assistance.</p></li><li><p>The Deferred Debtor. The loop is not erased so much as pushed downstream, past the point where it&#8217;s still useful. An AI-drafted client email goes out with a subtly wrong tone; the client doesn&#8217;t reply for six weeks, and the account quietly cools for reasons nobody connects back to that one email. A hiring rubric drafted with AI screens out a strong candidate; the gap in the team&#8217;s output shows up as a vague sense that &#8220;we&#8217;re just not hiring as well as we used to,&#8221; eighteen months and several unrelated decisions later. The feedback still technically arrives. It arrives too late, and too disconnected from its cause, to teach anyone anything.</p></li><li><p>The Sparring Partner. The protective pattern, and the rarest. Forms an independent attempt first &#8212; a real hypothesis, a real first draft, a real diagnosis &#8212; before consulting AI at all, then uses the AI&#8217;s response specifically as a check against that independent view, actively seeking out the disagreement rather than the confirmation. This maps closely onto the specific interaction patterns the Anthropic researchers found did preserve learning: participants who asked for explanations rather than finished answers, or asked conceptual questions rather than requesting generated code, scored no worse than the unassisted control group. The loop survived because they kept forcing themselves back into the &#8220;attempt&#8221; step the tool was otherwise happy to skip on their behalf.</p></li></ul><p>Most people are not consistently one archetype. A single professional is often a Sparring Partner in their specialism and a Vending Machine User everywhere else &#8212; which is, if anything, the right allocation of a scarce resource: the friction is worth defending exactly where you&#8217;re still building expertise, and worth discarding everywhere you already have it.</p><div><hr></div><h3>What to actually do about it</h3><ul><li><p>For individuals, the operating rule is simple to state and hard to practise: identify which parts of your job you are still learning, as opposed to already competent at, and change your AI usage pattern accordingly. In the domain you&#8217;re building, form your own attempt before you open the assistant, and when you do consult it, ask for critique of your reasoning rather than a replacement for it &#8212; the research is specific here, not vague self-improvement advice: explanation-seeking and concept-checking preserved learning outcomes; answer-generation didn&#8217;t. In domains where you&#8217;re already expert, hand over the routine freely. The friction is only valuable where the loop is still under construction.</p></li><li><p>For managers, the practical move is to stop treating &#8220;time to completion&#8221; as a sufficient quality metric, because it is exactly the metric the Feedback Vacuum leaves undisturbed while the underlying skill erodes underneath it. Build in comprehension checks that don&#8217;t allow the assistant in the room &#8212; a debugging question asked cold, a diagnosis defended without the tool&#8217;s suggestion visible, a draft explained line by line. This will feel like an unnecessary tax on people who are visibly delivering good output on schedule. It is not a tax. It is the only way to distinguish real judgment from a well-camouflaged vacuum before the day arrives that the tool is wrong and no one in the room can tell.</p></li><li><p>For leaders, the Ganuthula model&#8217;s central warning belongs in every AI adoption plan: the performance gain and the skill loss are on different clocks, and the gain will always report first. A rollout that looks unambiguously successful at the six-month mark can be quietly hollowing out the judgment it will need at the three-year mark, and the metrics that would catch this &#8212; comprehension without assistance, debugging under time pressure, an independent second read &#8212; are not metrics most AI adoption dashboards currently track, because nobody built the dashboard with the vacuum in mind.</p></li><li><p>For hiring, treat &#8220;fast with AI tools&#8221; and &#8220;skilled&#8221; as two different claims requiring two different tests. A candidate who has spent two years as a fluent Vending Machine User will interview well on anything the assistant can be present for and poorly on anything it can&#8217;t &#8212; and the gap will not show up unless you specifically design for it to show up, by asking them to debug, diagnose, or explain with the tool switched off.</p><div><hr></div></li></ul><h3>The tuition nobody budgeted for</h3><p>There is a version of this argument that lands as nostalgia for productive suffering, and that is not what this is. Nobody is arguing for friction as a virtue in itself, or for a return to debugging without a debugger, reading film negatives instead of digital scans, or drafting on a typewriter. The argument is narrower and, hopefully, more useful: friction was never decorative. It was the delivery mechanism for a signal that competence has always depended on, and removing the friction without replacing the signal does not make the signal unnecessary. It just makes it disappear, silently, exactly where you can least afford not to notice.</p><p>The uncomfortable truth of the Feedback Vacuum is that it is invisible by construction. Every measure an organisation typically watches &#8212; output quality, time to completion, error rates on delivered work &#8212; can look flat or improving while the underlying capacity to produce that output without assistance quietly erodes underneath it, because none of those measures were built to detect the absence of a loop that used to run silently in the background of ordinary work. You do not find out you are in the vacuum by looking at your metrics. You find out the day the assistant is wrong, or unavailable, or simply not in the room &#8212; and discover, in that moment, whether the last several years actually taught you anything, or just taught you how to ask.</p>]]></content:encoded></item><item><title><![CDATA[The Exception Economy.]]></title><description><![CDATA[Exploring how AI's absorption of routine work is converting every knowledge job into an emergency room.]]></description><link>https://www.shapingminds.co/p/the-exception-economy</link><guid isPermaLink="false">https://www.shapingminds.co/p/the-exception-economy</guid><dc:creator><![CDATA[Maxime Mouton]]></dc:creator><pubDate>Wed, 05 Aug 2026 05:01:37 GMT</pubDate><enclosure url="https://substackcdn.com/image/fetch/$s_!ZqmI!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F813f540f-d469-414f-9801-dda9c9f984da_1024x1024.png" length="0" type="image/jpeg"/><content:encoded><![CDATA[<div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!ZqmI!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F813f540f-d469-414f-9801-dda9c9f984da_1024x1024.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!ZqmI!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F813f540f-d469-414f-9801-dda9c9f984da_1024x1024.png 424w, https://substackcdn.com/image/fetch/$s_!ZqmI!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F813f540f-d469-414f-9801-dda9c9f984da_1024x1024.png 848w, https://substackcdn.com/image/fetch/$s_!ZqmI!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F813f540f-d469-414f-9801-dda9c9f984da_1024x1024.png 1272w, https://substackcdn.com/image/fetch/$s_!ZqmI!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F813f540f-d469-414f-9801-dda9c9f984da_1024x1024.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!ZqmI!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F813f540f-d469-414f-9801-dda9c9f984da_1024x1024.png" width="1024" height="1024" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/813f540f-d469-414f-9801-dda9c9f984da_1024x1024.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:1024,&quot;width&quot;:1024,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:186875,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:false,&quot;topImage&quot;:true,&quot;internalRedirect&quot;:&quot;https://www.shapingminds.co/i/209689477?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F813f540f-d469-414f-9801-dda9c9f984da_1024x1024.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!ZqmI!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F813f540f-d469-414f-9801-dda9c9f984da_1024x1024.png 424w, https://substackcdn.com/image/fetch/$s_!ZqmI!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F813f540f-d469-414f-9801-dda9c9f984da_1024x1024.png 848w, https://substackcdn.com/image/fetch/$s_!ZqmI!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F813f540f-d469-414f-9801-dda9c9f984da_1024x1024.png 1272w, https://substackcdn.com/image/fetch/$s_!ZqmI!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F813f540f-d469-414f-9801-dda9c9f984da_1024x1024.png 1456w" sizes="100vw" fetchpriority="high"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image buttonBase-GK1x3M"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image buttonBase-GK1x3M"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p>Priya Nair had spent 14 years handling claims at a mid-sized insurer in Leeds, the last six as the person colleagues brought the strange ones to. Her queue in 2024 held sixty-odd claims a day. Fifty of them were routine &#8212; a rear-end collision, a burst pipe, a stolen bike. Ten required actual thought. Perhaps one was genuinely strange: dates that didn&#8217;t quite line up, an invoice from a garage that existed mostly on paper, a claimant whose story was a little too polished.</p><p>She caught those. She caught them because &#8212; although she would never have put it this way &#8212; the fifty routine claims were her instrument panel. Ten thousand ordinary claims a year had taught her exactly what ordinary looked like: how a genuine invoice was formatted, when a real claimant rings twice, what an honest delay sounds like. The strange ones announced themselves by their wrongness against a baseline she was refreshing daily without noticing she was doing it.</p><p>In early 2025, the insurer deployed claims automation, and it was good. Within a year it was settling the routine end-to-end: intake, verification, payment, done. Priya&#8217;s queue fell from sixty to fourteen. Management called it &#8220;elevating our people to higher-value work&#8221;, and to be fair to them, they meant it.</p><p>Every one of the fourteen was hard. Complex liability. Distressed claimants. Suspected fraud &#8212; flagged, now, by a model, rather than by the prickle at the back of Priya&#8217;s neck.</p><p>Eighteen months in, Priya had noticed two things. The first was that she was more tired than she had ever been in the job, in a way that weekends didn&#8217;t fix. Every case was a summit; there were no valleys between them any more. The second was harder to name: her sense of what normal looked like was going soft. When a flagged claim was strange, she increasingly could not say what it was strange against. The machine handled the ordinary &#8212; and the ordinary, it turned out, had been the source of her radar.</p><p>Priya&#8217;s job had become harder and shallower at the same time. Nobody designed that. It is simply what is left when you subtract the routine.</p><div><hr></div><h3>A warning from 1983</h3><p>The clearest description of what is happening to Priya was published more than four decades ago. In 1983, the cognitive psychologist Lisanne Bainbridge wrote a short paper in Automatica called &#8220;Ironies of Automation&#8221;, about industrial control rooms and autopilots. It has been quietly famous among human-factors researchers ever since, and it reads today like a memo about the 2026 workplace that arrived forty-three years early.</p><p>Bainbridge&#8217;s argument was structural, not sentimental. When designers automate a process, they automate the parts that can be specified &#8212; the routine, the repeatable, the easy. Whatever cannot be specified is left to the human. That produces two ironies. The first: the human is left holding precisely the tasks the designers could not figure out how to automate &#8212; an arbitrary collection of the hardest, rarest, most ambiguous work. The second is crueller: the automation simultaneously removes the routine practice through which the human maintained the very skills those hard, rare moments require.</p><blockquote><p><strong>&#8220;By taking away the easy parts of the task, automation can make the difficult parts of the human operator&#8217;s task more difficult.&#8221;</strong></p><p>&#8212; Lisanne Bainbridge, &#8220;Ironies of Automation&#8221;, Automatica, 1983</p></blockquote><p>Aviation lived this first, and paid for the lesson in accident reports. Autopilot flies the cruise better than any human, so pilots stopped hand-flying &#8212; and their manual instincts, maintained for decades by thousands of uneventful hours, began to decay. By 1997, American Airlines&#8217; training department was warning its pilots about becoming &#8220;children of the magenta line&#8221; &#8212; crews so accustomed to following the automation&#8217;s guidance that they struggled in the moments it handed the aircraft back. The warnings became case files. When Air France 447 was lost over the Atlantic in 2009, investigators found a crew confronted, at altitude, with a situation the automation had always previously handled &#8212; and manual instincts that thousands of uneventful autopilot hours had quietly let atrophy. The industry&#8217;s eventual answer was telling: regulators and airlines began mandating manual-flying practice. Deliberately reintroduced routine, at real cost, as maintenance for the instincts that the exceptional moments require.</p><p>Aviation could do that because it is one industry, tightly regulated, with its failure modes written up by accident investigators. Knowledge work in 2026 is running the same experiment across the entire economy at once &#8212; with no regulator, no accident report, and no mandated hand-flying.</p><div><hr></div><h3>The machine keeps the routine. You keep the residue</h3><p>What the current generation of AI absorbs is, almost by definition, the routine: the standard ticket, the reconciliation, the first draft, the ordinary claim, the meeting notes, the status report. That is what it means for work to be automatable &#8212; it is regular enough to be learned from examples. So the machine eats from the middle of the bell curve outward, and what it leaves behind is the residue: the complex, the emotional, the ambiguous, the genuinely novel.</p><p>Klarna ran this experiment in public. In 2024 the company announced its AI assistant was doing the work of 700 customer service agents. In 2025 came the quieter second act: the company started hiring humans again. CEO Sebastian Siemiatkowski&#8217;s post-mortem, delivered to Bloomberg, was admirably blunt &#8212; &#8220;We focused too much on cost. The result was lower quality.&#8221; The arrangement Klarna landed on is the template now being stamped across the economy: the AI keeps the routine volume; a smaller pool of humans handles the complex, the emotional and the judgment-heavy. Klarna&#8217;s reversal was reported as a retreat from automation. It was nothing of the sort. It was the Exception Economy finding its stable form.</p><p>The economics are seductive, and they are real. The landmark study of generative AI in the workplace &#8212; Brynjolfsson, Li and Raymond&#8217;s &#8220;Generative AI at Work&#8221;, published in The Quarterly Journal of Economics in 2025 &#8212; followed 5,179 customer support agents and found the tool raised productivity 14% on average, and a remarkable 34% for novice workers, because it hands the newest people the accumulated playbook of the most experienced. Routine work, it turns out, is exactly the work AI does best on a human&#8217;s behalf. Which is why it is disappearing first.</p><p>There is a second stream feeding the residue, and it is easy to miss: the machine&#8217;s own output. Automated work does not arrive finished; it arrives plausible. Somebody has to read it, judge it, and catch the small fraction that is confidently wrong &#8212; and that somebody is doing exception work too, because every review is a judgment call with no routine attached to it. The Upwork Research Institute found 39% of AI-using employees now spend more time reviewing AI-generated content than they expected the tools to save, and nearly half cannot see how the promised productivity gains are supposed to materialise. The routine did not simply leave the workday. It came back as verification &#8212; the one form of routine that offers neither rest nor reps.</p><p>But watch where everything flows. Two conveyor belts now run through every AI-adopting organisation. The routine flows to the machine. The exceptions flow to the most capable human available. Reporting through 2026 keeps surfacing this second routing rule: when agents handle the clean, documented process, the exceptions they generate get escalated to the strongest people on the floor &#8212; usually senior staff who once managed the whole process and now manage only its failures. Their role quietly shifts from execution to escalation. Harvard Business Review put the resulting pattern on its front page in February 2026 with a headline that could serve as this edition&#8217;s subtitle: AI doesn&#8217;t reduce work &#8212; it intensifies it.</p><p>And the remaining human work runs at machine tempo. Microsoft&#8217;s 2025 Work Trend Index, drawing on 31,000 workers across 31 markets, measured the texture of the modern workday: an interruption every two minutes during core hours &#8212; 275 a day &#8212; 153 Teams messages and 117 emails daily, meetings after 8pm up 16% year on year. Nearly half of employees, 48%, describe their work as chaotic and fragmented. That is what a workday feels like when the valleys have been removed from it.</p><div><hr></div><h3>The Drudgery Dividend: what the boring work was paying for</h3><p>Here is the accounting error at the centre of almost every AI business case: routine work was booked as pure cost. Minutes to be recovered, salaries to be redeployed, toil to be eliminated. What never appeared on any ledger is that the routine was simultaneously paying four subsidies to the organisation that hosted it &#8212; call it the Drudgery Dividend. Cancel the routine and you cancel the dividend, whether you noticed you were receiving it or not.</p><p><strong>Recovery</strong>. Sustainable jobs have rhythm: hard calls and easy stretches, peaks and valleys. The valleys were not wasted time &#8212; they were where the peaks got metabolised. Emergency medicine, the one profession that has always done all-exception work, learned this the hard way and engineered around it: shift limits, rotations, decompression, staffing ratios. Knowledge work is now importing the emergency department&#8217;s intensity with none of its safeguards. The strain is already measurable: the Upwork Research Institute found that while 96% of C-suite leaders expect AI to lift productivity, 77% of employees using AI say it has increased their workload &#8212; and 71% report burnout. By 2026, studies were finding frequent AI users reporting markedly higher burnout than non-users &#8212; the opposite of the promise, and exactly what you would predict if the tools were stripping the recovery out of the workday.</p><p><strong>Rehearsal</strong>. Skills are not stored; they are maintained. The easy reps were the maintenance schedule &#8212; the ordinary cases through which a professional&#8217;s pattern library stayed current without anyone calling it training. Bainbridge&#8217;s second irony, operating at economy scale: the same automation that handles the routine removes the practice that kept humans capable of the exceptions. The QJE study&#8217;s most striking number has a shadow side here. If a novice with AI performs near an experienced worker&#8217;s level on routine work, organisations will conclude the routine no longer needs to be humanly practised at all. Those were the reps the next generation of instinct was going to be built from.</p><p><strong>Radar</strong>. Anomaly detection is a by-product of exposure to the normal. Priya could spot the fraudulent claim because she had processed ten thousand honest ones; auditors, security analysts, editors and underwriters all train their sense of wrongness on volume &#8212; ordinary volume. Security operations teams discovered this early: hand the tier-one alert queue to a model, and within a year the senior analysts reviewing its escalations have lost the ambient feel for the network&#8217;s ordinary weather &#8212; the baseline hum against which an intrusion used to stand out. Route the ordinary through the machine, and the human reviewing its escalations is comparing them against a fading memory of what normal looked like. The twist is genuinely cruel: the better the automation gets, the less often its humans see the ordinary, and the weaker their radar becomes &#8212; precisely as the cases reaching them get stranger.</p><p><strong>Ramps</strong>. The easy work was the on-ramp. I wrote in May about the apprenticeship pipeline collapsing as AI absorbs entry-level tasks; the Exception Economy generalises the problem. Ramps were never only for juniors &#8212; they were how career switchers crossed domains, how returners rebuilt confidence, how the newly promoted learned an adjacent craft sideways. A workplace made entirely of hard cases has no shallow end for anyone. Every entrance is a cliff edge.</p><div><hr></div><h3>The four job shapes of the Exception Economy</h3><p>Subtract the routine and the remaining human roles start collapsing into four recognisable shapes. Most organisations contain all four already, unnamed.</p><ul><li><p><strong>The Escalation Magnet.</strong> The most capable person on the team, to whom everything the machine cannot handle now flows. Their reward for excellence is more exceptions; their calendar is other people&#8217;s edge cases; their job title still describes a role that no longer exists. They are the first to burn out &#8212; and when they leave, their queue reroutes to the next most capable person, who inherits both the workload and the trajectory.</p></li><li><p><strong>The Standing Reserve.</strong> Retained &#8220;for oversight&#8221;. They review machine output, approve, and wait. Their risk is not overload but hollowing: they are Bainbridge&#8217;s control-room operator, monitoring a system that almost never needs them, their skills decaying in place &#8212; until the day the system fails in a way that requires everything they used to be able to do.</p></li><li><p><strong>The Emergency Generalist.</strong> Common in smaller firms: the human who spans whatever the agents cannot do that day. Half-finished automations, weird vendor cases, the customer who insists on a person. They context-switch across domains at machine tempo and master none of them. Microsoft&#8217;s every-two-minutes interruption figure is not a statistic to them; it is a biography.</p></li><li><p><strong>The Valley Keeper.</strong> The rarest shape, and the only deliberately designed one: someone whose role intentionally retains a flow of ordinary work &#8212; the audit sample, the manual Friday pass, the rotation through routine cases the machine could have handled cheaper. On a cost spreadsheet they look like waste. They are the last people in the building whose sense of normal is current, whose reps are fresh, and next to whom a junior can still learn. Organisations that keep Valley Keepers are not being sentimental. They are maintaining the baseline everyone else&#8217;s judgment silently depends on.</p><div><hr></div></li></ul><h3>What to do about it</h3><ul><li><p>For individuals, the shift is to treat recovery and routine as skill maintenance rather than slack. Schedule valleys as deliberately as you schedule meetings. Keep a personal flow of ordinary reps in your core craft &#8212; write the ordinary brief yourself sometimes, work a handful of unremarkable cases end-to-end each week &#8212; not from nostalgia, but because your radar and your instincts are calibrated on exposure you are no longer getting by default. And track your own exception load: count what share of your week is escalations. When it approaches all of it, the problem is the role&#8217;s design, not your resilience &#8212; and the negotiation you need is about the role.</p></li><li><p>For managers, the emergency department is the manual. Rotate people on and off the escalation queue the way hospitals rotate trauma shifts, and treat sustained exception load as an occupational exposure to be measured and capped, not a badge of seniority. Then maintain the baseline deliberately: route a sample of ordinary cases through human hands even when the machine could handle them &#8212; auditors have worked this way for a century &#8212; and protect real routine work for development purposes, priced honestly as training rather than disguised as inefficiency.</p></li><li><p>For leaders, the ask is to put the Drudgery Dividend into the automation business case itself. The four subsidies do not disappear as needs when the routine disappears as work; they become unfunded liabilities. Recovery now costs headroom. Rehearsal now costs mandated reps. Radar now costs sampled volume. Ramps now cost deliberately inefficient junior work. An automation plan that books the savings without booking these replacement costs is not a productivity plan &#8212; it is a deferral schedule, and the interest compounds in the working lives of your best people until it gets paid all at once, in resignations. Klarna paid it in public. Most organisations will pay it quietly.</p></li><li><p>For hiring, stop writing roles that are 100% exception handling and calling them senior. Screen for ambiguity tolerance, yes &#8212; but a role designed without valleys will consume whoever you hire into it, and the more capable they are, the faster the Exception Economy will find them. The interview question worth adding is not about coping with pressure &#8212; it is about what the candidate does between peaks, because in the role you are designing, there is no between unless you build one.</p><div><hr></div></li></ul><h3>The part nobody budgeted for</h3><p>The promise was that AI would free people for &#8220;more meaningful work&#8221;, and it is keeping that promise with a precision nobody requested. Meaning, distilled, at machine tempo, with all the filler removed. It turns out the filler was doing something. A workday of pure significance is not a gift; it is a load rating exceeded &#8212; and the people carrying it are, by the routing logic of the whole system, the ones you can least afford to lose.</p><p>The uncomfortable truth of the Exception Economy is that the boring parts of the job were never the obstacle to the best work. They were the price the job was quietly paying to keep people capable of the best work &#8212; the recovery that made intensity survivable, the rehearsal that kept instincts current, the radar that noticed what the machine could not, the ramps the next generation climbed in on. AI has stopped paying that price. The need did not go away.</p><p>Someone still has to pay it. Right now, by default, it is being paid in the working lives of your most capable people &#8212; invisibly, until the Tuesday the machine meets something it has never seen and hands it, at last, to a human whose radar has faded, whose reps have lapsed, and whose last valley was eighteen months ago. That is the moment an organisation discovers what the routine was really for. The wise ones will have discovered it on purpose, earlier, and paid for it while it was still cheap.</p>]]></content:encoded></item><item><title><![CDATA[The Confidence Illusion.]]></title><description><![CDATA[Exploring why AI hasn't made professionals less capable, and how it has broken the feedback loop that used to keep their confidence honest.]]></description><link>https://www.shapingminds.co/p/the-confidence-illusion</link><guid isPermaLink="false">https://www.shapingminds.co/p/the-confidence-illusion</guid><dc:creator><![CDATA[Maxime Mouton]]></dc:creator><pubDate>Wed, 29 Jul 2026 05:01:28 GMT</pubDate><enclosure url="https://substackcdn.com/image/fetch/$s_!LG3h!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F9038fcad-ebac-4648-95da-1861ba55573f_1024x1024.png" length="0" type="image/jpeg"/><content:encoded><![CDATA[<div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!LG3h!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F9038fcad-ebac-4648-95da-1861ba55573f_1024x1024.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!LG3h!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F9038fcad-ebac-4648-95da-1861ba55573f_1024x1024.png 424w, https://substackcdn.com/image/fetch/$s_!LG3h!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F9038fcad-ebac-4648-95da-1861ba55573f_1024x1024.png 848w, https://substackcdn.com/image/fetch/$s_!LG3h!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F9038fcad-ebac-4648-95da-1861ba55573f_1024x1024.png 1272w, https://substackcdn.com/image/fetch/$s_!LG3h!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F9038fcad-ebac-4648-95da-1861ba55573f_1024x1024.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!LG3h!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F9038fcad-ebac-4648-95da-1861ba55573f_1024x1024.png" width="1024" height="1024" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/9038fcad-ebac-4648-95da-1861ba55573f_1024x1024.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:1024,&quot;width&quot;:1024,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:277547,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:false,&quot;topImage&quot;:true,&quot;internalRedirect&quot;:&quot;https://www.shapingminds.co/i/208423102?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F9038fcad-ebac-4648-95da-1861ba55573f_1024x1024.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!LG3h!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F9038fcad-ebac-4648-95da-1861ba55573f_1024x1024.png 424w, https://substackcdn.com/image/fetch/$s_!LG3h!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F9038fcad-ebac-4648-95da-1861ba55573f_1024x1024.png 848w, https://substackcdn.com/image/fetch/$s_!LG3h!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F9038fcad-ebac-4648-95da-1861ba55573f_1024x1024.png 1272w, https://substackcdn.com/image/fetch/$s_!LG3h!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F9038fcad-ebac-4648-95da-1861ba55573f_1024x1024.png 1456w" sizes="100vw" fetchpriority="high"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image buttonBase-GK1x3M"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image buttonBase-GK1x3M"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p></p><p>Elena Bosch had underwritten commercial credit for eleven years at a mid-sized bank in Rotterdam. Colleagues who worked with her described her as &#8220;unnervingly right&#8221; &#8212; not infallible, but right often enough, and wrong in ways that were legible even to her, that people trusted her instinct on files that didn&#8217;t fit the standard scoring model. Her default-rate predictions had landed within two points of actual outcomes for six consecutive years. She could tell you, unprompted, the three times in the past decade she had been badly wrong, and exactly what she had missed each time.</p><p>In early 2025, the bank rolled out an AI underwriting assistant to the commercial lending team. It read financials, cross-referenced sector risk data, and produced a recommendation with a confidence score attached. Elena adopted a habit almost immediately, without being told to: she read the file cold, wrote down her own view &#8212; approve, decline, or flag &#8212; before opening the tool, and only then checked it against the model&#8217;s output. When they agreed, she moved fast. When they diverged, she went back into the file to find out why.</p><p>Her colleague Jorik, two desks over, adopted a different habit, just as unconsciously. He opened the file and the tool at the same time. He read the model&#8217;s recommendation first, then skimmed the underlying file to confirm it looked reasonable, then approved. It was faster. It felt, if anything, more rigorous &#8212; he was, after all, reading the same financials Elena was, just in a different order.</p><p>Eight months later, a portfolio quality review turned up something that unsettled the risk committee more than any single bad loan could have. Elena&#8217;s calibration &#8212; the statistical tightness between how confident she reported being in a decision and how often that decision proved correct &#8212; hadn&#8217;t moved from her pre-AI baseline. Jorik&#8217;s had come apart. On the subset of cases where the model&#8217;s recommendation later proved wrong, Jorik&#8217;s own accuracy had fallen sharply &#8212; but his self-reported confidence in those same decisions remained exactly as high as it had always been. He had no idea anything had changed. Nobody had told him his judgement was slipping, because the correction signal that would normally tell a professional that &#8212; the felt discomfort of being wrong, attributed clearly to your own call &#8212; had never arrived. The model was right often enough, and confident enough in its wrongness, that Jorik&#8217;s errors were absorbed silently into decisions that felt, from the inside, exactly as sound as they always had.</p><p>This is the Confidence Illusion. It is not a story about AI making people less capable. Every available measure of Jorik&#8217;s underlying analytical skill &#8212; his ability to read a balance sheet, to spot the sector risk his manager wanted him to spot &#8212; remained intact. What broke was something upstream of skill: the loop that let his confidence track his own accuracy. And once that loop breaks, a professional can be simultaneously skilled and structurally unable to know it.</p><div><hr></div><h3><strong>Why confidence used to mean something</strong></h3><p>To understand what has broken, it helps to understand what calibration actually is, and where it comes from. It is not a personality trait. It is a trained response, built through a specific, repeatable mechanism: a person forms a judgement under uncertainty, reality responds, and the gap between the prediction and the outcome &#8212; assuming the person actually notices it &#8212; recalibrates the next prediction.</p><p>This is, essentially, the mechanism behind every serious account of how expertise develops. Gary Klein&#8217;s decades of research into naturalistic decision-making &#8212; how firefighters, ICU nurses, and fighter pilots make fast, accurate calls under time pressure &#8212; found that expert intuition is built from exactly this loop, repeated thousands of times, until pattern recognition becomes near-instantaneous. Philip Tetlock&#8217;s forecasting research, most visible in the &#8220;superforecasters&#8221; work, found that the individuals who consistently outperformed professional analysts on geopolitical predictions shared one habit above all others: they tracked their own predictions against outcomes, relentlessly, and adjusted. Calibration, in Tetlock&#8217;s data, was learnable &#8212; but only through that unforgiving feedback loop. People who never checked their predictions against outcomes stayed miscalibrated indefinitely, regardless of how experienced they became.</p><p>The common thread across all of this research is that confidence was never supposed to be a free-floating feeling. It was supposed to be downstream of a track record &#8212; built, case by case, through the friction of being wrong and finding out. Professionals who worked without any decision-support tool got this feedback by default, because there was no alternative: they had to form a view, because nothing else was going to form one for them, and reality corrected them whether they liked it or not.</p><p>AI has not removed reality&#8217;s ability to correct people. It has removed the requirement that a person form an independent view before consulting a second opinion &#8212; and it turns out that requirement was doing almost all of the calibrating work.</p><div><hr></div><h3><strong>The mechanism: how offloading breaks the loop</strong></h3><p>The distinction the research keeps drawing is between two different things people can offload to AI: memory and judgement. Offloading memory &#8212; letting a tool hold facts you&#8217;d otherwise need to recall &#8212; has a long history and a relatively mild effect on calibration; people have used notebooks, databases, and search engines for this without losing their grip on how confident they should be in their own conclusions.</p><p>Offloading judgement is different. A 2026 study presented at the CHI Conference on Human Factors in Computing Systems &#8212; &#8220;Accurate but Not Confident or Confident but Not Accurate? Cognitive Offloading Impairs Confidence Calibration in Human-AI Teams&#8221; &#8212; tested this distinction directly. Participants who worked entirely unaided showed the tightest alignment between their stated confidence and their actual accuracy of any condition in the study. Participants who offloaded judgement specifically &#8212; not memory, but the act of forming an initial view &#8212; showed the sharpest overconfidence effect measured. Combined offloading of both memory and judgement produced a different, but equally distorting, metacognitive bias. The finding was blunt: the moment a person stops forming their own view before seeing an external recommendation, their stated confidence stops being a reliable signal of anything.</p><p>This connects to a separate and older body of research on automation bias and complacency. A recent review in the journal <em>AI &amp; Society</em> offers a useful, precise definition of the mechanism: complacency is what happens when trust closes the gap between &#8220;I believe this system works&#8221; and &#8220;I no longer evaluate whether it worked this time.&#8221; That second clause is the entire mechanism. It is not that people trust AI too much in the abstract. It is that, case by case, they stop running the small internal check &#8212; does this feel right to me, independent of what the tool says &#8212; that used to catch errors before they became decisions. The review notes that this collapse is especially likely to occur when a tool&#8217;s recommendation aligns with a person&#8217;s initial instinct, which creates a reinforcing loop: agreement breeds trust, trust breeds less checking, less checking means agreement is confirmed more often because disagreement is never investigated.</p><blockquote><p><strong>Complacency happens when trust closes the gap between &#8220;I believe this system works&#8221; and &#8220;I no longer evaluate whether it has worked this time.&#8221; This is where users catch errors, flag edge cases, and discover the AI&#8217;s limitations &#8212; and where automation-assisted decision-makers stop doing so.</strong></p><p><strong>&#8212; Automation bias in human&#8211;AI collaboration, AI &amp; Society, 2025&#8211;2026</strong></p></blockquote><p>The mechanism, stated plainly: an unaided professional forms a view, gets it wrong sometimes, and feels that wrongness directly &#8212; this is uncomfortable, and discomfort is what recalibrates confidence. An AI-assisted professional who skips the independent view never generates the raw material discomfort needs. There&#8217;s nothing for the wrongness to attach to. It gets absorbed into a decision that, from the inside, felt entirely reasonable &#8212; because it was never really the professional&#8217;s own decision to feel wrong about.</p><div><hr></div><h3><strong>What gets lost: two faces of the same failure</strong></h3><p>The workforce data suggests this mechanism is producing two distinct, opposite-looking outcomes &#8212; and it&#8217;s worth being precise about why they&#8217;re actually the same failure.</p><p>ManpowerGroup&#8217;s 2026 Global Talent Barometer, based on interviews with nearly 14,000 workers across 19 countries, found that regular AI use jumped 13% in a single year, to 45% of the workforce &#8212; while confidence in using the technology fell 18% over the same period, the first overall decline in worker confidence the barometer had recorded in three years. The drop was steepest among the most experienced workers: down 35% among Baby Boomers, 25% among Gen X. And yet 89% of workers still report confidence in the skills required for their current role. This is not a story about people losing faith in their own competence generally. It is a much narrower and stranger story: people are losing trust specifically in their own independent judgement, in the moments where that judgement now runs alongside a machine&#8217;s.</p><p>A separate 2026 study, reported by the American Psychological Association, adds a piece that clarifies the picture further: overreliance on AI at work does not appear to measurably reduce raw cognitive ability. What it erodes is confidence in independent reasoning, and people&#8217;s sense of ownership over their own ideas &#8212; their felt sense that a conclusion is actually theirs, rather than borrowed and merely endorsed. Researchers flagged the long-term risk plainly: not that AI use makes people less intelligent, but that some professionals become less engaged in the kind of effortful, generative thinking that produces genuinely novel judgement &#8212; because the tool has quietly become the place where the thinking happens first.</p><p>Put the two findings together and the shape of the problem sharpens. One group &#8212; the Jorik pattern &#8212; offloads the initial judgement entirely, stops noticing when they&#8217;re wrong, and drifts toward silent overconfidence that nobody, including them, can see from the inside. A second group &#8212; visible in the Manpower data, concentrated among the most experienced workers &#8212; retains the instinct to form an independent view, notices that view increasingly gets second-guessed or overridden by a fluent machine recommendation, and starts to doubt instincts that were never actually unreliable. Both groups have lost the same thing: a working relationship between what they believe and what is true. One believes too much. The other no longer knows what to believe. Neither can currently tell you, reliably, which of their own judgements to trust &#8212; which is precisely the capability the feedback loop used to provide.</p><div><hr></div><h3><strong>Three archetypes</strong></h3><p>Three professional postures are visible in this transition, and naming them helps predict where a given person or team is heading before a performance review or an audit catches it.</p><ul><li><p><strong>The Silent Drifter</strong> has adopted the Jorik pattern without noticing. They read the AI&#8217;s output before forming their own view, or alongside it rather than before it, and their confidence has not moved even as their independent accuracy &#8212; measurable only by looking at the subset of cases where the AI later proves wrong &#8212; quietly declines. They are, by every self-report metric, doing fine. The gap between their confidence and their accuracy is invisible to them by construction: nothing in their daily experience produces the discomfort that would reveal it. This is the most structurally dangerous archetype, because it self-conceals; the only way to detect it is to deliberately audit decisions after the fact, which almost nobody does until something goes wrong at scale.</p></li><li><p><strong>The Doubt Spiral</strong> is the mirror image, and disproportionately made up of experienced professionals &#8212; the ManpowerGroup data&#8217;s Boomer and Gen X respondents. Their independent judgement is intact, arguably as strong as it has ever been, but it now runs constantly alongside a fluent, confident machine output that occasionally disagrees with it. Each disagreement produces a small, corrosive moment of self-doubt, even when the human was right &#8212; because the AI&#8217;s confidence is expressed with the same fluent certainty whether it is correct or not, and there is no longer an obvious signal for which voice to trust. Over time, this group&#8217;s stated confidence in their own judgement erodes even though their underlying accuracy has not. They are, in a real sense, the collateral damage of a workplace that has not built any mechanism for telling people when their own instinct was the right one.</p></li><li><p><strong>The Calibrated Checker</strong> is the smallest and most valuable group, and their habit is almost embarrassingly simple: they form an independent view before they open the tool, every time, as a fixed discipline rather than an occasional practice. When the AI agrees, they move fast, exactly as anyone would. When it disagrees, they treat the disagreement as diagnostic information rather than as an automatic override in either direction &#8212; sometimes the AI is right and they update; sometimes they are right and the AI&#8217;s confident output was simply wrong in a way that fluent language obscured. Crucially, they track the outcomes of these disagreements over time, which means their confidence keeps being disciplined by the exact mechanism that built expertise in the first place. They are not smarter than the Silent Drifters or more skilled than the Doubt Spirals. They have simply refused to let the tool remove the one step &#8212; form your own view first &#8212; that made confidence mean something.</p><div><hr></div></li></ul><h3><strong>What this means in practice</strong></h3><p>For individuals, the practical implication is almost aggressively simple, which is part of why it is so easy to skip: write down your own view, even briefly, before you open the tool. Not because your first instinct is always right &#8212; often it won&#8217;t be &#8212; but because the act of committing to a view, and then finding out whether it held up, is the only mechanism that keeps your confidence tethered to your actual accuracy. Skipping this step doesn&#8217;t just cost you a marginally worse decision today. It costs you the raw material your judgement needs to stay calibrated over the next decade.</p><p>For organisations, the implication is that AI adoption without a parallel discipline for preserving independent judgement is quietly manufacturing both of the Confidence Illusion&#8217;s failure modes at once &#8212; a population that is dangerously overconfident in eroding judgement, sitting alongside a population that has stopped trusting judgement that was never actually impaired. Neither failure shows up in standard productivity or output-quality metrics in the short term, because AI-assisted output is, on average, good. It shows up later, unpredictably, in the moments the tool is wrong and nobody in the workflow retained the instinct &#8212; or the confidence &#8212; to catch it.</p><p>The practical fix organisations are experimenting with is structural rather than motivational: build the independent-judgement step into the workflow itself, so it doesn&#8217;t depend on individual discipline. Some firms are formalising this as a two-step approval process &#8212; record a human recommendation before the AI recommendation is visible, then compare. It is a small amount of friction, deliberately reintroduced, in a system that has spent two years trying to remove friction wherever it can be found. The firms doing this are, in effect, treating the independent-judgement step the way clinical trials treat a blind assessment: not as inefficiency, but as the only mechanism that keeps the measurement honest.</p><p>For hiring and development, the shift is from screening for confidence &#8212; historically an easy, visible, interview-friendly proxy for competence &#8212; to screening for calibration, which is much harder to fake and much more diagnostic. A candidate who can describe, specifically, a time they were confidently wrong and how they found out is demonstrating the exact muscle the Confidence Illusion is quietly atrophying across the workforce. A candidate who cannot produce that story, or who describes only times they were confidently right, is a much weaker signal than it used to be &#8212; high self-reported confidence, on its own, no longer reliably predicts good judgement in an AI-assisted environment. It may increasingly predict the opposite.</p><div><hr></div><h3><strong>The closing uncomfortable truth</strong></h3><p>There is a final, uncomfortable feature of the Confidence Illusion worth naming directly: it is nearly undetectable from the inside. A Silent Drifter does not feel like someone whose judgement is eroding. They feel exactly like someone who is right most of the time, because they are &#8212; the AI is usually right, and their approval of its usually-right output feels, moment to moment, indistinguishable from good judgement. A Doubt Spiral does not feel like someone whose instincts are being unfairly eroded. They feel like someone who is simply, reasonably, less sure than they used to be, in a world that has gotten more complicated. Neither has access to the information that would tell them which category they&#8217;re in, because the information that used to provide it &#8212; the direct, attributable, felt experience of being wrong &#8212; has been quietly rerouted around them.</p><p>The people whose confidence still means something are not, on average, more talented than everyone else. They have simply refused to let the tool remove the one habit that made confidence a real signal in the first place: forming a view of their own, before they see anyone else&#8217;s &#8212; including a machine&#8217;s &#8212; and finding out, deliberately and repeatedly, whether they were right.</p><p>Everyone else is walking around with a level of confidence that has quietly stopped being about anything at all. The unsettling part is that there is currently no way to tell, from the outside or from the inside, who is who &#8212; until the moment it matters, and the gap between what someone believed and what was actually true finally becomes visible to everyone except the person who should have seen it first.</p>]]></content:encoded></item><item><title><![CDATA[The Legibility Deficit.]]></title><description><![CDATA[Exploring how the ability to make your thinking visible, structured, and machine-interpretable is becoming the decisive professional skill of the AI-agent era.]]></description><link>https://www.shapingminds.co/p/the-legibility-deficit</link><guid isPermaLink="false">https://www.shapingminds.co/p/the-legibility-deficit</guid><dc:creator><![CDATA[Maxime Mouton]]></dc:creator><pubDate>Tue, 21 Jul 2026 23:01:25 GMT</pubDate><enclosure url="https://substackcdn.com/image/fetch/$s_!dz-S!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F81faf67b-deb0-4898-8da7-98c32c3637b7_1024x1024.png" length="0" type="image/jpeg"/><content:encoded><![CDATA[<div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!dz-S!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F81faf67b-deb0-4898-8da7-98c32c3637b7_1024x1024.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!dz-S!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F81faf67b-deb0-4898-8da7-98c32c3637b7_1024x1024.png 424w, https://substackcdn.com/image/fetch/$s_!dz-S!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F81faf67b-deb0-4898-8da7-98c32c3637b7_1024x1024.png 848w, https://substackcdn.com/image/fetch/$s_!dz-S!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F81faf67b-deb0-4898-8da7-98c32c3637b7_1024x1024.png 1272w, https://substackcdn.com/image/fetch/$s_!dz-S!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F81faf67b-deb0-4898-8da7-98c32c3637b7_1024x1024.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!dz-S!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F81faf67b-deb0-4898-8da7-98c32c3637b7_1024x1024.png" width="1024" height="1024" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/81faf67b-deb0-4898-8da7-98c32c3637b7_1024x1024.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:1024,&quot;width&quot;:1024,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:761586,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:false,&quot;topImage&quot;:true,&quot;internalRedirect&quot;:&quot;https://www.shapingminds.co/i/207618094?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F81faf67b-deb0-4898-8da7-98c32c3637b7_1024x1024.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!dz-S!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F81faf67b-deb0-4898-8da7-98c32c3637b7_1024x1024.png 424w, https://substackcdn.com/image/fetch/$s_!dz-S!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F81faf67b-deb0-4898-8da7-98c32c3637b7_1024x1024.png 848w, https://substackcdn.com/image/fetch/$s_!dz-S!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F81faf67b-deb0-4898-8da7-98c32c3637b7_1024x1024.png 1272w, https://substackcdn.com/image/fetch/$s_!dz-S!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F81faf67b-deb0-4898-8da7-98c32c3637b7_1024x1024.png 1456w" sizes="100vw" fetchpriority="high"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image buttonBase-GK1x3M"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image buttonBase-GK1x3M"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p>The consultant who could not brief a machine</p><p>Marco had spent 14 years at a mid-size strategy consultancy in Zurich. In those 14 years, he had built a reputation for something genuinely rare in his profession: he could walk into a client situation he had never seen before, ask 3 questions, and have a thesis. He was, by every metric that mattered in consulting, an excellent thinker. Partners sought him for the ambiguous engagements. Clients requested him by name.</p><p>In February 2026, his firm deployed AI agents across the practice. Every consultant received access to the same system and the same three-week onboarding. Three months later, the pilot review threw up a pattern that the managing partner described as &#8220;inexplicable.&#8221; The highest-performing consultants in the pilot were not the most experienced. They were not the most technically capable. By most internal performance ratings, they were unremarkable &#8212; except for a single habit that their colleagues had always found slightly excessive.</p><p>They wrote very long, very precise briefs. Before they touched the agent, they spent the first hours of any engagement writing a detailed problem statement: naming not just what they needed, but why they needed it, what they already knew, what constraints were non-negotiable, and what judgment calls the agent should leave to them.</p><p>Marco wrote briefs the way senior partners write briefs: short, confident, jargon-efficient. The kind a junior colleague who had worked with him for years could interpret without clarification. The kind that presumed substantial shared context.</p><p>The agent had no shared context. It took what it was given and produced, from it, a comprehensive, confident, thoroughly wrong analysis.</p><p>This is the Legibility Deficit. It is not a story about AI fluency. It is a story about the sudden, brutal surfacing of a skill gap that the social infrastructure of knowledge work had spent decades papering over &#8212; and the professional advantage now accruing to the people who, for one reason or another, never developed the habit of being vague.</p><div><hr></div><h3>Why knowledge work was never legibility-tested before</h3><p>Legibility &#8212; the ability to make your thinking visible, structured, and interpretable by others &#8212; has always been a valued skill. The best writers, strategists, engineers, and lawyers are, among other things, unusually good at externalising their reasoning in a form that others can act on without supplementary interpretation.</p><p>But the operative phrase is &#8220;supplementary interpretation.&#8221; Human colleagues are astonishingly good at it. They infer the unstated context. They read the relationship, the tone, the institutional history. They ask the clarifying question. They complete the half-formed thought. They compensate, in thousands of micro-interactions every day, for the gaps between what was said and what was meant.</p><p>This compensatory infrastructure is so pervasive and so effective that it is essentially invisible. It is the reason that knowledge work organisations can function despite the fact that most of the communication within them is, by any rigorous standard, massively underspecified. &#8220;Can you take a look at this?&#8221; &#8220;We need to think about the client situation.&#8221; &#8220;The numbers feel off.&#8221; These instructions contain almost no information &#8212; yet work gets done, because the person receiving them can infer, from context, relationship, and institutional knowledge, approximately what is required.</p><p>This infrastructure has a name in organisational theory: tacit knowledge. It is the accumulated, uncodified understanding that lives in the social fabric of an organisation &#8212; in its norms, its shared vocabulary, its accumulated history of past projects and past failures. Michael Polanyi described it in 1966 as &#8220;the kind of knowledge that we know more of than we can tell.&#8221; Most of what enables knowledge workers to be productive is tacit. And none of it is transferable to an AI agent through a brief.</p><p>This is not a criticism of AI agents. It is a precise description of the challenge they surface. A human colleague carries tacit knowledge that lets them compensate for an underspecified instruction. An AI agent takes the instruction as given. It has no relationship with you, no memory of your previous projects, no sense of the institutional norms that would tell a human reader what &#8220;take a look at this&#8221; actually means in your firm. It produces output from exactly what you provide &#8212; and what most professionals provide, once the human compensators are removed, turns out to be remarkably thin.</p><p>The AI-agent transition is, at its core, a legibility audit. It is the first time in the history of knowledge work that the quality of thinking &#8212; specifically, the ability to externalise that thinking precisely enough for it to be acted on without inference &#8212; has been systematically tested, at scale, across an entire workforce, in real time. The results are uncomfortable.</p><div><hr></div><h3>The mechanism: how legibility becomes leverage</h3><p>The economist&#8217;s version of the Legibility Deficit is simple. When AI agents can do the execution, the returns flow to whoever can most precisely specify what should be executed &#8212; because that specification is the input the agent depends on and cannot generate on its own.</p><p>Specification &#8212; the act of making intent explicit, naming constraints, articulating context, and identifying the judgment calls that require human decision &#8212; is legibility. And like all scarce complements to an abundant input, it commands a premium that rises as the input becomes more abundant.</p><p>A 2025 paper tracking skill emergence and obsolescence across more than 12 million job postings in the LLM era found that the fastest-growing skill categories were not technical. They were what the authors called &#8220;articulation-adjacent&#8221;: structured communication, specification writing, problem framing, context-setting, and the ability to translate a complex, multi-constraint situation into an actionable instruction. These skills were growing at three to five times the rate of even AI-specific technical skills, and they were commanding the sharpest wage premiums of any category tracked.</p><p>McKinsey&#8217;s 2025 State of AI report put numbers on the organisational version of this. Firms that had developed systematic legibility practices &#8212; structured brief formats, explicit context-capture workflows, defined escalation criteria for judgment calls &#8212; showed &#8220;significantly higher AI performance and adoption rates&#8221; than those that had provided tool access and assumed use would follow. The variable that predicted outcome was not the AI system. It was the quality of the human specification the AI system received.</p><p>A 2025 cross-sector employer survey found that 91% of firms reported effective AI use required genuine language competence &#8212; not vocabulary, but the ability to state intent, name constraints, and identify what &#8220;correct&#8221; looks like before the work begins. 92% said this capacity was becoming more important in their organisations as AI tool adoption increased.</p><p>The paradox &#8212; and there is always a paradox &#8212; is that the tool designed to make work more productive has made the quality of the human thinking that precedes the work more consequential, not less.</p><div><hr></div><h3>What the social infrastructure was hiding</h3><p>The most uncomfortable implication of the Legibility Deficit is that it retroactively reveals how much of what passed for &#8220;strong communication&#8221; in professional settings was actually the recipient&#8217;s effort being invisibly compensated for.</p><p>Consider the anatomy of a typical knowledge-work brief. A partner at a law firm sends a junior associate a one-line instruction: &#8220;Look into the precedent here &#8212; I want to understand our exposure.&#8221; What has actually been communicated? The area of law (implied by context). The specific risk the partner is concerned about (not named, but inferable from the matter). The level of depth required (not specified, but guessable from the time available). The format expected (assumed based on firm norms). The judgment calls the associate should make independently versus escalate (left entirely to instinct, shaped by relationship).</p><p>The associate completes the brief correctly &#8212; or at least correctly enough &#8212; by deploying all of this tacit knowledge. The partner, watching the work arrive at the right level of depth and in the right format, concludes: &#8220;I gave her a clear brief and she delivered.&#8221; An AI agent, receiving the same brief, would ask: Which jurisdiction? Which precedent? What specific risk? What format? How much depth? In the absence of those answers, it proceeds with default assumptions that may or may not align with what the partner meant. The output is technically responsive to the instruction and potentially useless to the person who gave it.</p><p>The brief was not clear. It was always underspecified. The clarity was being supplied, invisibly, by the recipient&#8217;s interpretive effort. AI agents have removed that effort from the equation, and what remains is the instruction itself &#8212; which, stripped of its compensatory infrastructure, is often a great deal thinner than the person who wrote it believed.</p><blockquote><p>&#8220;Humans often struggle to explicitly articulate their goals and objectives&#8221; &#8212; and this has been identified as one of the core challenges in designing AI agents that align with human intent, because the social systems that previously compensated for that struggle are absent in an agentic workflow.</p><p>          &#8212; Overseeing Agents Without Constant Oversight, arXiv 2025</p></blockquote><p> The legibility gap is not uniformly distributed across the workforce. It is strongly correlated with seniority &#8212; because seniority, in most organisations, is precisely the state in which the most tacit context exists and the most compensatory effort is applied by the people around you. Junior professionals have always had to be more explicit &#8212; their colleagues know less about what they mean. Senior professionals have been able to be less explicit for years, because their accumulated institutional capital means everyone around them already knows a great deal about what they mean before they speak.</p><p>AI agents invert this hierarchy. The junior professional, who was always forced to externalise their thinking, may adapt faster than expected. The senior professional, whose vagueness has been compensated for by a decade of relationship equity, is discovering that the agent has no relationship equity with them at all.</p><div><hr></div><h3>Three archetypes</h3><p>        It helps to name the professional postures emerging in this transition, because they predict trajectories before the performance reviews do.</p><ul><li><p><strong>The Tacit Fluency Professional</strong> is genuinely excellent at thinking, but their thinking has always been externalised through conversation, relationship, and social iteration rather than through writing. They work best in rooms: they read the situation, adjust in real time, clarify through dialogue. Their intelligence is real, but it is interactional rather than compositional &#8212; it lives in the exchange, not the brief. With AI agents, they are discovering that the exchange does not happen first. The brief does. And their briefs, stripped of the interactional channel through which their actual thinking emerges, are thin. Their output quality is declining not because they think less well, but because they are being asked to think in a medium they have never needed to develop fluency in.</p></li><li><p><strong>The Legibility Native</strong> was always explicit. They started every project by writing the problem statement. They asked the clarifying question before they started work, not during. They specified the success criteria before the brief went out. Colleagues often found this excessive &#8212; surely everyone already knew the situation? &#8212; but the habit was formed and sustained because it was intrinsically useful to them, independent of the interpretive infrastructure around them. With AI agents, their habit turned out to be exactly the skill the moment required. They did not change what they did. The value of what they had always done changed around them.</p></li><li><p><strong>The Legibility Developer</strong> has recognised the shift and is deliberately rebuilding their practice. They are learning to write the problem statement before they touch the agent. They are developing brief templates that force explicit constraint-naming. They are reviewing their outputs not just for quality but for specification &#8212; asking, after the fact, what the agent would have needed to know to produce this correctly, and building that back into their upfront process. This is learnable. It is harder, the more senior you are, because the habits of implicit communication are deeply grooved &#8212; but the ceiling is genuinely high for those who take it seriously.</p><div><hr></div></li></ul><h3>What this means in practice</h3><p>For organisations, the Legibility Deficit changes what the most valuable professional development investment is. It is not AI tool training. It is legibility training &#8212; the practice of writing the problem statement before starting the work, naming the constraints explicitly, specifying the desired outcome unambiguously, and identifying the judgment calls that the agent should not make without human sign-off.</p><p>These are teachable skills. The practice is not complicated: write the problem statement before you write the prompt. Name the constraints you would usually leave implicit. Specify what &#8220;correct&#8221; looks like before you ask for the output. Identify the judgment call that the agent should not make without you. These are habits, not talents. They can be built deliberately, at any career stage, by anyone willing to invest the first ten minutes of every task in clarity rather than starting with the prompt.</p><p>The structural risk for firms is the same pattern that emerged in every previous wave of automation: the technology gets deployed without the complementary human-skill development, early performance disappointments are attributed to the technology rather than to the human specification it received, and the firms that invested in both the tool and the legibility training pull ahead while everyone else debates the tool quality.</p><ul><li><p>For individuals, the implication is sharpening fast. Fluency with AI tools is becoming table stakes &#8212; a baseline competency, not an edge. The edge flows to the complement: the thing the tool cannot supply and the market cannot sell you. In this case, that complement is legibility. The capacity to state what you need in a form precise enough that a system without your tacit context can act on it correctly is becoming the fastest-growing professional premium in the knowledge economy.</p></li></ul><ul><li><p>For early-career professionals, this is clarifying. The discipline that was always demanded of you &#8212; be explicit, ask the clarifying question, write the problem statement &#8212; turns out to be the discipline the market is now rewarding. The habit of externalising your thinking before you start was not just a professional expectation. It was practising for a world that would eventually require it of everyone.</p></li></ul><ul><li><p>For senior professionals, the implication is sharper and less comfortable. The vagueness that felt like authority &#8212; the ability to give an underspecified directive and trust that the organisation would interpret it correctly &#8212; was always a tax on the people below you. It is now a tax on your own output. Learning to say things precisely, after fourteen years of not having to, turns out to be harder than it looks.</p></li></ul><div><hr></div><h3>The closing uncomfortable truth</h3><p>There is a final, generational dimension to this that deserves naming. Legibility is learned through the discipline of writing &#8212; through the habit of committing to a position before you know how the room will react, of stating what you need without the benefit of immediate feedback, of externalising your reasoning into a form that has to stand on its own. A professional cohort that forms its habits in an environment where the agent produces the draft and the human edits it may never develop the specification muscle at all &#8212; because the muscle is built in the act of writing the brief, not in the act of editing the response.</p><p>The organisations now deploying AI agents without a parallel investment in legibility development are not just creating a short-term performance gap. They are potentially creating a long-term capability gap &#8212; a cohort of professionals who are fluent with the tools and vague about what they need from them, and who, unlike their senior colleagues, have no accumulated tacit context that even theoretically justifies the vagueness.</p><p>This is not inevitable. The window for deciding to get there intentionally is shorter than it looks. The Legibility Deficit is already present in the data. It is already showing up in performance reviews, in AI pilot results, in the quiet reputational shifts inside organisations that have deployed AI agents and are watching, with some puzzlement, who is thriving and who is not.</p><p>This is, in the end, a story not about AI but about thinking. AI agents have not changed what excellent thinking looks like. They have made the quality of thinking legible &#8212; in a way that the social infrastructure of the workplace had, for decades, allowed people to avoid demonstrating.</p><p>The ones who always thought clearly just got very expensive. And the rest of us have a season or two to decide whether to get there deliberately &#8212; or to wait and discover, the hard way, what was actually in our briefs all along.</p>]]></content:encoded></item><item><title><![CDATA[The Compounding Divide.]]></title><description><![CDATA[Exploring why the AI you can buy is converging toward a commodity and why the only thing that compounds is the human-fed learning loop you cannot purchase,]]></description><link>https://www.shapingminds.co/p/the-compounding-divide</link><guid isPermaLink="false">https://www.shapingminds.co/p/the-compounding-divide</guid><dc:creator><![CDATA[Maxime Mouton]]></dc:creator><pubDate>Tue, 14 Jul 2026 23:00:49 GMT</pubDate><enclosure url="https://substackcdn.com/image/fetch/$s_!PEYk!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F5dce8590-78b2-4a01-91ba-b85315fadae6_1024x1024.png" length="0" type="image/jpeg"/><content:encoded><![CDATA[<div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!PEYk!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F5dce8590-78b2-4a01-91ba-b85315fadae6_1024x1024.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!PEYk!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F5dce8590-78b2-4a01-91ba-b85315fadae6_1024x1024.png 424w, https://substackcdn.com/image/fetch/$s_!PEYk!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F5dce8590-78b2-4a01-91ba-b85315fadae6_1024x1024.png 848w, https://substackcdn.com/image/fetch/$s_!PEYk!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F5dce8590-78b2-4a01-91ba-b85315fadae6_1024x1024.png 1272w, https://substackcdn.com/image/fetch/$s_!PEYk!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F5dce8590-78b2-4a01-91ba-b85315fadae6_1024x1024.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!PEYk!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F5dce8590-78b2-4a01-91ba-b85315fadae6_1024x1024.png" width="1024" height="1024" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/5dce8590-78b2-4a01-91ba-b85315fadae6_1024x1024.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:1024,&quot;width&quot;:1024,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:167248,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:false,&quot;topImage&quot;:true,&quot;internalRedirect&quot;:&quot;https://www.shapingminds.co/i/206668298?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F5dce8590-78b2-4a01-91ba-b85315fadae6_1024x1024.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!PEYk!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F5dce8590-78b2-4a01-91ba-b85315fadae6_1024x1024.png 424w, https://substackcdn.com/image/fetch/$s_!PEYk!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F5dce8590-78b2-4a01-91ba-b85315fadae6_1024x1024.png 848w, https://substackcdn.com/image/fetch/$s_!PEYk!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F5dce8590-78b2-4a01-91ba-b85315fadae6_1024x1024.png 1272w, https://substackcdn.com/image/fetch/$s_!PEYk!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F5dce8590-78b2-4a01-91ba-b85315fadae6_1024x1024.png 1456w" sizes="100vw" fetchpriority="high"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image buttonBase-GK1x3M"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image buttonBase-GK1x3M"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p>There is a financial services firm in Singapore &#8212; call it a composite, because the pattern is now common enough to be a type rather than a case &#8212; that spent 2025 acquiring the most advanced AI capability money could buy. Frontier models on enterprise contracts. A dedicated compute allocation that would have been a national-scale resource a decade ago. A new internal platform team. A board deck with a slide titled, without irony, &#8220;AI Moat.&#8221;</p><p>By any procurement standard, they had won. They owned more raw AI capability than any competitor in their market. And for a while, the dashboards agreed: faster reporting, quicker turnaround, lower cost per task.</p><p>Eighteen months later, a mid-sized competitor &#8212; running older, cheaper, demonstrably less powerful models &#8212; was consistently making better calls in exactly the situations that mattered most: the ambiguous ones, the novel ones, the ones with no precedent in the training data. The Singapore firm had more AI. The competitor was getting more from it. And the gap between them was not closing. It was widening, quarter on quarter, at an accelerating rate.</p><p>This is the Compounding Divide. It is the most important strategic distinction of the current AI moment, and most organisations are on the wrong side of it without knowing it. The divide is not between firms that have AI and firms that don&#8217;t; that race is essentially over, and almost everyone has it. The divide is between firms whose AI gets smarter every time it&#8217;s used and firms whose AI simply runs faster while the people around it slowly stop thinking.</p><div><hr></div><h3>The accounting distinction nobody expected from a CEO</h3><p>In June 2026, Satya Nadella published a long essay &#8212; &#8220;A frontier without an ecosystem is not stable&#8221; &#8212; that was viewed more than 28 million times. What made it land was not a product announcement or a benchmark. It was a piece of accounting.</p><p>Nadella proposed that two kinds of capital now define a firm in the AI era. The first he called token capital: the AI capability a company builds and owns &#8212; its proprietary systems, its data, its evaluations, its tuned and orchestrated workflows sitting on top of foundation models. (The &#8220;token&#8221; is the unit of text a model reads and generates. It has nothing to do with cryptocurrency.) The second is human capital: the knowledge, judgement, relationships, ingenuity, and pattern recognition of a company&#8217;s people.</p><p>Then came the line that most readers treated as reassurance and that I read as a warning:</p><blockquote><p><strong>&#8220;Human capital does not become less valuable as token capital grows. It only becomes more valuable&#8230; Without human direction, you have compute running in circles.&#8221;</strong></p><p><strong>&#8212; Satya Nadella, June 2026</strong></p></blockquote><p>The reassuring reading is: don&#8217;t worry, humans still matter. The harder reading &#8212; the one Nadella&#8217;s own framing actually supports &#8212; is that the two kinds of capital behave completely differently as assets. One you can buy. One you cannot. And only one of them compounds. Understanding why is the whole game.</p><div><hr></div><h3>Why token capital converges</h3><p>Token capital has a seductive property: it is purchasable. You can sign a contract, provision the compute, license the model, stand up the platform, and own meaningful AI capability within a quarter. It is legible to a board, it appears on a balance sheet, and it can be acquired with a decision rather than earned through years of practice.</p><p>That same property is its weakness. Anything you can buy, your competitor can also buy &#8212; from the same providers, on roughly the same terms, at roughly the same time. </p><p><strong>Frontier capability is steadily becoming a utility:</strong> metered, broadly available, and increasingly undifferentiated at the point of use. The history of general-purpose technologies is unambiguous on this point. Electrification, in its early decades, conferred enormous advantage on the firms that had it. Then everyone had it, and having it stopped being an advantage: it became the precondition for being in business at all. The same arc ran through enterprise software, through cloud computing, through broadband. The general-purpose layer commoditises. The advantage migrates to the complement, the thing the technology cannot supply and the market cannot sell you.</p><h4><strong>The economist&#8217;s version of this is straightforward: when a valuable input becomes abundant and cheap, the returns flow to whatever scarce input it depends on. </strong></h4><p>Make compute and frontier models abundant, and the scarce complement is the human judgement that directs them and the proprietary loop that improves them. PwC&#8217;s 2026 Global AI Jobs Barometer puts numbers on the migration: the wage premium for AI skills has climbed to 62%, and &#8220;professionalised&#8221; roles that combine domain judgement with AI are growing roughly twice as fast as &#8220;democratised&#8221; ones, with 42% faster wage growth since 2021. The market is already repricing the complement. Most corporate AI strategies are still buying the commodity.</p><div><hr></div><h3>The depreciation default</h3><p>To see why the loop is so unusual, it helps to remember how almost every asset a firm owns actually behaves: it depreciates. A machine wears. A patent expires. A software platform ages into legacy. A trained workforce forgets, leaves, and has to be retrained. The natural tendency of value, in the physical and organisational world, is to leak away. Most of management is, in effect, the work of fighting depreciation &#8212; maintenance, retraining, reinvestment, replacement. The default direction of an asset is down.</p><p>Token capital obeys this default with unusual speed. A frontier model that is state of the art today is mid-tier within a year and a commodity within two, as the next generation arrives and the price of the previous one collapses. The compute you provisioned is a depreciating capital expense. The platform you built ages the moment it ships. Bought capability does not merely fail to compound &#8212; it actively decays, and it decays on the same schedule for you as for every competitor who bought the same thing.</p><p>A genuine learning loop is the rare asset that runs the other way. Because it is fed by accumulated judgement and proprietary feedback rather than by hardware or licences, each cycle leaves it slightly more capable than the last. It appreciates through use rather than depreciating despite it. This is what Nadella means when he calls it &#8220;unlike most assets.&#8221; The strategic error of the Token Buyer is not that they bought a bad asset. It is that they bought a depreciating one and assumed it would behave like an appreciating one &#8212; that owning the engine was the same as owning the compounding.</p><div><hr></div><h3>The mechanism: why the loop compounds</h3><p>Nadella&#8217;s real argument is not about either kind of capital in isolation. It is about the engine that links them &#8212; what he calls a learning loop. The idea is deceptively simple. Every time your people use your AI systems, both sides should get smarter. People learn from what the AI surfaces. The AI capability improves from the data, corrections, evaluations, and judgement your people feed back into it. Run that loop repeatedly and it accumulates value the way compound interest does &#8212; rather than depreciating the way most assets do. Nadella describes the result as &#8220;a hill-climbing machine&#8221; that becomes &#8220;the new IP of the firm.&#8221;</p><p>This is the part you cannot buy. There is no contract for it. You can only build it, slowly, through use &#8212; through thousands of cycles in which a human applies judgement to an AI output, the output improves, the human&#8217;s understanding sharpens, and the improved system raises the ceiling on what the next cycle can attempt.</p><p>And here is the structural fact that makes the divide so unforgiving: compounding is exponential. A firm that improves its loop by a small percentage each cycle, sustained over hundreds of cycles, does not end up slightly ahead of a firm that simply bought capability and left it static. It ends up exponentially ahead. The distance between them does not grow at a constant rate. It grows at an accelerating one. This is why the Singapore firm&#8217;s competitor kept pulling further away rather than being caught: the leader had purchased a level; the competitor had built a slope.</p><p>PwC&#8217;s data shows what this looks like in aggregate. The top 20% of the most AI-exposed companies achieved average labour-productivity growth of 163% relative to 2018: nearly 5 times higher than the most AI-exposed companies overall. Same access to frontier AI. Radically divergent outcomes. The variable that separates them is not how much AI they bought. It is whether the AI was wired into a loop that compounds human judgement, or simply deployed to run existing tasks faster.</p><div><hr></div><h3>What gets starved</h3><p>If the loop is the source of all the compounding, then the human judgement that feeds it is the single most important input in the system. Which makes the central irony of the current moment almost unbearable: that input is precisely what most organisations are quietly degrading.</p><p>The Microsoft and Carnegie Mellon University 2025 study of 319 knowledge workers found that higher confidence in generative AI inversely correlated with critical thinking. The more a worker trusted the AI&#8217;s output, the less they scrutinised it. Participants reported applying no critical thinking at all to a substantial share of their AI-assisted tasks. Read through Nadella&#8217;s framework, this is not a productivity footnote. It is the fuel line to the engine being cut. The corrections, the caught errors, the applied judgement &#8212; the very inputs that make the loop compound &#8212; stop being supplied at exactly the moment the organisation believes it is becoming more efficient.</p><p>The training and mentorship picture compounds the problem. PwC found that even as AI skills command a 62% wage premium, more than half the global workforce reported no recent training and 57% lacked access to mentorship. Organisations are accumulating token capital on the asset side while letting human capital &#8212; the only thing that makes token capital compound &#8212; go uncultivated. They are buying more engine and draining more fuel, and reading the short-term speed as success.</p><p>There is a generational edge to this that deserves naming. The corrective judgement that feeds the loop is itself built through years of doing the work &#8212; forming positions, being wrong, being challenged, and recalibrating. A junior cohort that arrives into an environment where the AI produces the position and the human merely approves it never builds that judgement in the first place. The independent research is directionally consistent here: studies of cognitive offloading have repeatedly found the effect strongest in younger users, precisely the group entering the workforce now and forming the professional instincts they will rely on for decades. An organisation can therefore be starving its loop on two horizons at once &#8212; degrading the judgement of the people it has, and failing to grow the judgement of the people it is hiring. The fuel line is being cut at both the present and the future end.</p><p>The Work AI Index 2026 offers the inverse, hopeful signal. Its &#8220;high AI achievers&#8221; do not simply prompt and accept. They spend more time reviewing and correcting AI output than low achievers (40% of their AI time versus 33%), and they are markedly more likely to deliberately decline to use AI on certain tasks where their own judgement is the better instrument. The differentiator at the individual level is not usage volume. It is the deliberate application of judgement &#8212; the behaviour that feeds the loop. The people getting the most out of AI are the ones doing the most thinking around it, not the least.</p><div><hr></div><h3>Three archetypes</h3><p>It helps to name the postures organisations are adopting, because the labels make the trajectory visible before the financials do.</p><ul><li><p><strong>The Token Buyers</strong> have defined AI as a procurement problem. They measure success by capability acquired and cost removed. Their dashboards are green. Their AI runs their existing processes faster, and they have mistaken that speed for a moat. They are, in Nadella&#8217;s phrase, running compute in circles &#8212; accumulating a depreciating asset on equal terms with every competitor who signed the same contracts, while the human judgement that might have made it compound goes unexercised. The bill has not arrived, so they believe there is no bill.</p></li><li><p><strong>The Loop Tourists</strong> understand, in principle, that the loop matters. They have read the essay. They talk about feedback and human-in-the-loop and continuous improvement. But they have not changed a single incentive, workflow, or metric to make it real. Their people are still rewarded for output speed, not for the judgement that improves the system. The loop is in the strategy deck and absent from the working day. This is, currently, the largest category &#8212; and the most dangerous, because the language of compounding provides cover for an organisation that is not actually doing it.</p></li><li><p><strong>The Loop Builders</strong> &#8212; the rarest &#8212; have rebuilt their operating model around the loop. They instrument the points where human judgement meets AI output and treat those points as the firm&#8217;s most valuable real estate. They reward the analyst who caught the subtle error, not just the one who shipped fast. They protect the cognitive work that feeds the system even when it looks, on a quarterly dashboard, like friction. They are often slower than the Token Buyers in any given quarter. They are building the slope while everyone else buys the level.</p></li></ul><div><hr></div><h3>What this means in practice</h3><p>For organisations, the strategic question has to change. &#8220;How much AI capability have we acquired?&#8221; is now close to meaningless &#8212; the honest answer for most firms is &#8220;roughly the same as our competitors, and increasingly so.&#8221; The question that actually predicts the future is: is our organisation getting measurably smarter every time it uses its AI, or just faster? If you cannot point to the specific mechanism by which judgement is captured, fed back, and accumulated, you do not have a learning loop. You have a faster way of doing what you already did, available on equal terms to everyone you compete with.</p><p>The practical moves follow from this. Instrument the human-AI interface and treat the corrections, overrides, and judgements that happen there as a first-class asset, not as exhaust. Reward the application of judgement, not just the velocity of output &#8212; because the moment your incentives favour speed over scrutiny, you are training your people to stop feeding the loop. Protect the cognitive work that builds expertise even when it reads as inefficiency, because expertise is the input the loop runs on, and an organisation that has automated away its own judgement has quietly switched off its compounding.</p><p>For individuals, the implication is sharper and, I think, clarifying. The era in which &#8220;I can use AI&#8221; was a differentiator is ending. Everyone can use AI. Fluency with the tools is becoming what literacy with a spreadsheet became &#8212; a baseline, not an edge. </p><p><strong>The durable position is to be the human judgement that makes the loop compound:</strong> the person who notices what the model missed, who distrusts the plausible answer, who can correct the system rather than merely operate it, and who feeds that correction back so the next cycle starts higher. Being a fluent prompter makes you interchangeable with everyone else who prompts fluently. Being the judgement in the loop makes you load-bearing &#8212; the scarce complement to an abundant, commoditising input.</p><p>This is the actionable core of Nadella&#8217;s &#8220;only becomes more valuable.&#8221; Human capital becomes more valuable not automatically, and not for everyone, but specifically for the people and firms positioned at the point where judgement compounds AI capability. For everyone else, the abundance of cheap, capable AI is not an opportunity. It is a rising tide that lifts competitors who built loops and slowly submerges those who only bought tokens.</p><div><hr></div><h3>The closing uncomfortable truth</h3><p>The deepest discomfort in the Compounding Divide is its timing. The divide becomes most dangerous at the exact moment AI feels most democratised. When everyone has access to frontier capability on similar terms, the natural conclusion is that the playing field has been levelled. The opposite is true. Equal access to a commoditising input is precisely the condition under which the only remaining differentiator &#8212; the compounding loop you cannot buy &#8212; matters most.</p><p>So the firms that feel safest are often the most exposed: they have the AI, the dashboards are green, the speed is real, and none of it is compounding because the human judgement that would make it compound has been optimised into silence. And the firms that feel behind &#8212; the ones whose people still argue with the model, still correct it, still insist on understanding before they ship &#8212; are quietly building the one asset that accumulates while everyone else&#8217;s depreciates.</p><p>Token capital is the part you can buy. That was always going to make it the part that converges. The advantage was never going to live in the asset everyone can acquire on equal terms. It lives in the loop &#8212; and the loop only turns if a human keeps feeding it judgement.</p><p><strong>You can buy the tokens. You have to earn the loop. And the gap between the two is already widening faster than anyone buying their way in can see.</strong></p>]]></content:encoded></item><item><title><![CDATA[The Friction Premium.]]></title><description><![CDATA[Exploring why eliminating friction from knowledge work destroys the hidden mechanisms by which organisations learn, adapt, and generate genuinely novel ideas.]]></description><link>https://www.shapingminds.co/p/the-friction-premium</link><guid isPermaLink="false">https://www.shapingminds.co/p/the-friction-premium</guid><dc:creator><![CDATA[Maxime Mouton]]></dc:creator><pubDate>Tue, 07 Jul 2026 23:00:38 GMT</pubDate><enclosure url="https://substackcdn.com/image/fetch/$s_!YFlj!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F912432bd-1c9b-4f19-9335-34851fff7043_1024x1024.png" length="0" type="image/jpeg"/><content:encoded><![CDATA[<div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!YFlj!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F912432bd-1c9b-4f19-9335-34851fff7043_1024x1024.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!YFlj!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F912432bd-1c9b-4f19-9335-34851fff7043_1024x1024.png 424w, https://substackcdn.com/image/fetch/$s_!YFlj!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F912432bd-1c9b-4f19-9335-34851fff7043_1024x1024.png 848w, https://substackcdn.com/image/fetch/$s_!YFlj!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F912432bd-1c9b-4f19-9335-34851fff7043_1024x1024.png 1272w, https://substackcdn.com/image/fetch/$s_!YFlj!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F912432bd-1c9b-4f19-9335-34851fff7043_1024x1024.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!YFlj!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F912432bd-1c9b-4f19-9335-34851fff7043_1024x1024.png" width="1024" height="1024" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/912432bd-1c9b-4f19-9335-34851fff7043_1024x1024.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:1024,&quot;width&quot;:1024,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:438585,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:false,&quot;topImage&quot;:true,&quot;internalRedirect&quot;:&quot;https://www.shapingminds.co/i/204770918?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F912432bd-1c9b-4f19-9335-34851fff7043_1024x1024.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!YFlj!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F912432bd-1c9b-4f19-9335-34851fff7043_1024x1024.png 424w, https://substackcdn.com/image/fetch/$s_!YFlj!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F912432bd-1c9b-4f19-9335-34851fff7043_1024x1024.png 848w, https://substackcdn.com/image/fetch/$s_!YFlj!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F912432bd-1c9b-4f19-9335-34851fff7043_1024x1024.png 1272w, https://substackcdn.com/image/fetch/$s_!YFlj!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F912432bd-1c9b-4f19-9335-34851fff7043_1024x1024.png 1456w" sizes="100vw" fetchpriority="high"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image buttonBase-GK1x3M"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image buttonBase-GK1x3M"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p>There is a management consulting firm in Amsterdam &#8212; call it a composite, because the pattern it represents is now widespread &#8212; that spent 2025 systematically removing friction from its knowledge work. Not the bureaucratic friction of approvals and sign-off chains, but the intellectual friction: the first-draft writing that analysts used to do themselves, the three-hour debates about strategic framing, the laborious manual synthesis of research before a client presentation.</p><p>The AI-assisted workflow they designed is, by any conventional productivity measure, excellent. Client-ready documents in a third of the time. Proposal turnaround in 48 hours instead of two weeks. Partners freed from review bottlenecks. Senior consultants finally able to focus on client relationships rather than document production. The metrics trend positive across the board.</p><p>Eighteen months in, a senior partner raised a problem that had no metric attached to it. The junior analysts &#8212; two cohorts&#8217; worth, hired in 2024 and 2025 &#8212; could not explain why they believed the things they were recommending. Not in the sense of being unable to defend the AI&#8217;s logic. In the sense of having no formed view at all. The AI had produced a position. They had adopted it. The friction that would have produced the position in them &#8212; the struggle to structure an argument, the debate that forced articulation, the constraint that demanded creative problem-solving &#8212; had been optimised away along with everything else.</p><p>The firm had become very fast at producing work it no longer deeply understood.</p><p>This is the Friction Premium problem. It is not a technology problem. It is a structural one &#8212; and it is arriving across almost every organisation that has deployed AI substantively in knowledge work.</p><div><hr></div><h3>The science they left out of the AI strategy deck</h3><p>The case against removing all friction from knowledge work has been building in the academic literature for thirty years. It simply hasn&#8217;t made it into most enterprise AI adoption frameworks.</p><p>In 1994, UCLA cognitive psychologist Robert Bjork coined the term &#8220;desirable difficulties&#8221; to describe a counterintuitive finding that had been accumulating across learning research for decades. Certain forms of resistance during learning &#8212; spaced retrieval rather than massed review, interleaved practice rather than block repetition, varied conditions rather than stable ones &#8212; consistently improve long-term retention and the transfer of skills to new contexts, even though they make learning feel harder in the moment and produce worse performance during the learning period itself.</p><p>The mechanism is not mysterious once you understand it. </p><p><strong>Difficulty creates what psychologists call &#8220;generation effects&#8221;</strong> &#8212; when you have to retrieve, reconstruct, or produce something rather than simply recognise it, you engage different and deeper cognitive processes. You build connections between concepts. You construct understanding rather than merely encountering it. Those connections produce durable knowledge that transfers when the situation changes.</p><p>The smooth path &#8212; re-reading, summarising, reviewing already-formatted material &#8212; produces the sensation of understanding without the underlying encoding that makes knowledge usable in genuinely novel situations. You feel like you know. You may not know in the way that matters when the context shifts.</p><p>Bjork called the inverse of this the <strong>Fluency Trap:</strong> when processing feels easy, we interpret that ease as comprehension. The problem is that ease of processing and depth of understanding are not the same thing. Fluency is a feeling, not a fact. And it is the feeling that AI is extraordinarily good at producing &#8212; on behalf of the people who use it.</p><p>The Fluency Trap has an organisational-level equivalent. When an organisation runs its knowledge work through AI systems that produce fluent, plausible, well-structured outputs, the cognitive signal to evaluate critically is dampened across the board. The output looks like understanding. It carries the surface structure of careful thought. It may or may not have the underlying depth.</p><div><hr></div><h3>The empirical case at scale</h3><p>The Microsoft and Carnegie Mellon University 2025 study of 319 knowledge workers is the sharpest quantitative picture of what this looks like in practice. Participants reported applying no critical thinking to 40% of their AI-assisted tasks. Not reduced critical thinking &#8212; none. More significantly, the study found that user confidence in GenAI inversely correlated with critical thinking application: the professionals who trusted AI most scrutinised its outputs least.</p><p>This is the Fluency Trap made visible at scale. When the output is fluent and confident in tone, the cognitive trigger for critical evaluation is not activated. When the human reviewer has high confidence in the AI system, their own evaluation is further reduced. Two compounding effects that together produce, across thousands of decisions per day, a systematic withdrawal of the cognitive work that was previously producing understanding.</p><p>The directional consistency across independent studies is striking. Gerlich&#8217;s 2025 study, published in MDPI&#8217;s AI Tools in Society, found a negative correlation between frequent AI usage and critical thinking ability, with the effect stronger in younger participants &#8212; exactly the cohort entering knowledge work organisations now and developing the professional judgement that will define their careers. A 2026 University of Technology Sydney analysis of cognitive offloading found that extensive reliance on AI tools can lead to a decline in cognitive engagement and skill development, though the effect is responsive to deliberate interaction design.</p><p>The mitigation finding is important. The problem is not the technology. It is the absence of intentional design. Most organisations have not designed their AI deployments to preserve cognitive friction. They have deployed AI to eliminate it, measured the resulting productivity gains, and called the job done.</p><div><hr></div><h3>What the friction was actually for</h3><p>To understand what is being lost, it helps to decompose productive friction into its three distinct forms. They are different in mechanism, they produce different kinds of value, and they require different interventions to preserve.</p><p>Cognitive friction is the effort of articulation &#8212; the work of formulating your own argument before the AI does it for you. The labour of structuring a position, identifying its weaknesses, finding the right evidence, and presenting it in a form that holds together under scrutiny. This process does not merely produce a document. It produces understanding in the person doing it. The output is a side effect. The cognitive work is the point.</p><p>When AI writes the first draft, the human no longer does the work of articulation. They do the work of evaluation &#8212; which is genuinely valuable, but a different and often shallower cognitive task, particularly when the output is fluent and the evaluator has high confidence in the AI&#8217;s capability. The Fluency Trap reduces the quality of the evaluation step. The generation step &#8212; where real understanding is built &#8212; is skipped entirely.</p><p>Over time, the person who never articulates their position in writing has not built the same depth of understanding as the person who did. The outputs may be indistinguishable in the short term. The expertise is not. This difference only becomes visible when something genuinely novel arrives and the depth of understanding has to transfer to a situation the AI&#8217;s training data did not anticipate.</p><p>Social friction is the structured disagreement that forces better thinking. The meeting where two people with genuinely different frameworks argue until the logic becomes clearer for both. The pre-mortem that requires someone to articulate specifically and on paper why the plan will fail. The adversarial collaboration where a committed sceptic&#8217;s challenge produces a more robust position than any amount of internal consensus would have generated. These interactions are often uncomfortable. They are productive precisely because of the discomfort &#8212; the discomfort is the signal that genuine thinking is happening, that positions are being tested rather than ratified.</p><p>AI-assisted workflows tend to reduce social friction systematically. When the AI synthesises the debate rather than the debate happening in full, when the AI identifies risks rather than a sceptic articulating and defending them, when the AI generates the pre-mortem rather than a team constructing it through genuine anticipation &#8212; the social process that produced the improvement in thinking is compressed or eliminated. The conclusions may be similar. The understanding built in the room is not.</p><p>Structural friction is the constraint that forces creative solutions. The budget limit that requires rethinking the entire approach rather than adding resources. The technical restriction that pushes engineers toward solutions they would not have considered with unlimited flexibility. The deadline that eliminates the option of the perfect solution and requires the good-enough one that, in the search for it, reveals something the perfect solution would have permanently hidden.</p><blockquote><p><strong>&#8220;Training is frequently non-optimal because it fails to incorporate the variability, delays, uncertainties, and other challenges the learner can be expected to face in a real-world job setting.&#8221;</strong></p><p><strong>&#8212; Robert Bjork, UCLA Bjork Learning and Forgetting Lab</strong></p></blockquote><div><hr></div><h3>What gets lost: expertise versus the output of expertise</h3><p>The most important distinction the Fluency Trap obscures is between expertise and the output of expertise.</p><p>AI can produce the output of expertise remarkably well. Given sufficient training data and a capable model, an AI system can produce a strategy document, a due diligence report, a legal brief, a financial model, or a market analysis that is indistinguishable from the work of a domain expert. This is real. It is valuable. It is one of the genuine and transformative capabilities AI brings to knowledge work.</p><p>What AI cannot produce is the expertise itself &#8212; the durable, transferable, judgement-forming understanding that exists in the person who would otherwise have done the work. In a world where AI routinely produces the output, it becomes far less obvious that this matters. The output is there. The client is satisfied. The process completes. Why should it matter whether any specific human deeply understood what was produced?</p><p>It matters for three reasons that only become visible at critical moments. First, evaluation: someone has to be able to tell whether the AI&#8217;s output is right, subtly wrong, or dangerously wrong in ways that fluent presentation conceals. The consultant who has never constructed their own analysis from first principles doesn&#8217;t know what a misleading analysis looks like from the inside. Second, adaptation: when conditions change in ways that weren&#8217;t in the training data, the organisation needs people who understand the domain, not people who can prompt an AI that understands it. The difference is invisible under normal conditions and critical under unusual ones. Third, succession: when the people who carry genuine expertise leave &#8212; which they always do &#8212; the organisation needs the next generation to have built expertise through their own cognitive work. If the junior generation never built expertise because AI produced the output throughout their development years, the knowledge exists nowhere a human can reach it.</p><p>Bain&#8217;s 2025 Innovation Report captures one dimension of this in findings about ideation quality. AI-assisted ideation produces a high volume of solutions with strong forecasted value. Human-generated ideas remain significantly stronger on novelty &#8212; particularly for breakthrough, category-defining innovation. The serendipitous interactions, the unexpected collaborations, the constraint-forced lateral thinking: these are precisely what AI cannot replicate, because they are produced by the conditions AI is optimised to eliminate.</p><div><hr></div><h3>Three archetypes: how organisations relate to productive friction</h3><ul><li><p><strong>The Friction Eliminators</strong> have defined their AI strategy primarily in terms of process efficiency. Friction is categorised as unnecessary by default &#8212; anything that slows output is a candidate for elimination. Their short-term productivity metrics are improving. Their talent development outcomes, their capacity to handle genuinely novel problems, and their organisational resilience when conditions shift are not being measured. The bill has not arrived yet.</p></li><li><p><strong>The Friction Preservers</strong> have maintained pre-AI working practices alongside AI deployment &#8212; requiring analysts to write first drafts before using AI assistance for refinement, maintaining structured debate in strategy sessions rather than letting AI-generated summaries replace the debate itself. They are being described internally as &#8220;not using AI to its full potential.&#8221; They are building organisations that can think independently of their AI tools.</p></li><li><p><strong>The Friction Designers</strong> &#8212; the rarest category &#8212; have distinguished systematically between process friction and productive friction and have used AI to eliminate the former while deliberately designing the latter into their workflows. They require AI-assisted drafts to be critically annotated before any recommendation is made. They use AI to generate the pre-mortem and then require the team to argue against it. They set explicit constraints on AI-assisted option generation to preserve the creative problem-solving that unconstrained generation would eliminate. They are building AI-augmented workflows that make the cognitive work harder, not easier, at the points where the cognitive work is most valuable.</p></li></ul><div><hr></div><h3>The friction audit</h3><p>For any organisation deploying AI in knowledge work, the practical starting point is what I call the friction audit. Not &#8220;what friction have we eliminated?&#8221; &#8212; the answer is measurable and probably positive by any conventional metric. But the harder question: what category was the friction we eliminated?</p><p>Process friction &#8212; time spent on handoffs, approvals, administration, formatting, and coordination that moves information between people and systems without transforming it &#8212; is generally waste. Eliminating it releases time for higher-value work. This is real and worth pursuing.</p><p>Cognitive, social, and structural friction are different in kind. Eliminating them does not release capacity for higher-value work. It eliminates the mechanism by which higher-value work was being produced. The time saved is real. The capability that was building in that time is quietly gone.</p><p>The audit question for each workflow where AI has removed friction is specific: what was the human cognitive, social, or structural work occurring inside that friction? If that work was producing understanding, judgement, or creative insight &#8212; even as a side effect of something that looked inefficient from the outside &#8212; its elimination has a hidden cost that the productivity metrics will not capture until the capability it was building is needed and is not there.</p><div><hr></div><h3>The closing uncomfortable truth</h3><p>The Fluency Trap, at the organisational level, runs like this: the organisation that deploys AI most aggressively in knowledge work may become the most fluent at producing work it doesn&#8217;t deeply understand. The outputs will be excellent. Clients will be satisfied. The metrics will trend positive. The organisation will feel capable and efficient.</p><p>The exposure arrives when conditions change &#8212; when the novel problem appears that requires genuine understanding rather than fluent pattern-matching, when the expert who actually knew things has left, when the AI&#8217;s training data no longer maps to the situation at hand, when someone needs to explain not just what was concluded but why it was right.</p><p>The Acar, Tarakci, and van Knippenberg meta-review of 145 empirical studies found that a healthy dose of constraints benefits individuals, teams, and organisations alike. The constraints organisations are optimising away are not purely inefficiency. Some of them are the conditions under which people develop the judgement to do this work well.</p><p><strong>The Friction Premium is not a case against AI deployment.</strong> It is a case for precision &#8212; for understanding the difference between friction that was genuinely waste and friction that was structural value disguised as inefficiency.</p><p>The organisations that understand this distinction will build AI deployments that eliminate process friction while preserving productive friction. They will be slower than the Friction Eliminators in the short run. They will be more capable when the conditions that reveal the difference between fluency and understanding finally arrive.</p><p><strong>Speed is not intelligence. Smoothness is not competence.</strong></p><p>The premium, in the long run, goes to organisations that know the difference &#8212; and had the discipline to preserve the friction that was worth keeping.</p>]]></content:encoded></item><item><title><![CDATA[The Accountability Void.]]></title><description><![CDATA[Exploring why AI deployment has outpaced accountability assignment.]]></description><link>https://www.shapingminds.co/p/the-accountability-void</link><guid isPermaLink="false">https://www.shapingminds.co/p/the-accountability-void</guid><dc:creator><![CDATA[Maxime Mouton]]></dc:creator><pubDate>Wed, 01 Jul 2026 11:03:31 GMT</pubDate><enclosure url="https://substackcdn.com/image/fetch/$s_!Ocxj!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F53eedf6f-8fb3-44ad-9660-d5d7e05cd987_1024x1024.png" length="0" type="image/jpeg"/><content:encoded><![CDATA[<div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!Ocxj!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F53eedf6f-8fb3-44ad-9660-d5d7e05cd987_1024x1024.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!Ocxj!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F53eedf6f-8fb3-44ad-9660-d5d7e05cd987_1024x1024.png 424w, https://substackcdn.com/image/fetch/$s_!Ocxj!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F53eedf6f-8fb3-44ad-9660-d5d7e05cd987_1024x1024.png 848w, https://substackcdn.com/image/fetch/$s_!Ocxj!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F53eedf6f-8fb3-44ad-9660-d5d7e05cd987_1024x1024.png 1272w, https://substackcdn.com/image/fetch/$s_!Ocxj!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F53eedf6f-8fb3-44ad-9660-d5d7e05cd987_1024x1024.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!Ocxj!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F53eedf6f-8fb3-44ad-9660-d5d7e05cd987_1024x1024.png" width="1024" height="1024" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/53eedf6f-8fb3-44ad-9660-d5d7e05cd987_1024x1024.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:1024,&quot;width&quot;:1024,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:115852,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:false,&quot;topImage&quot;:true,&quot;internalRedirect&quot;:&quot;https://www.shapingminds.co/i/202685685?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F53eedf6f-8fb3-44ad-9660-d5d7e05cd987_1024x1024.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!Ocxj!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F53eedf6f-8fb3-44ad-9660-d5d7e05cd987_1024x1024.png 424w, https://substackcdn.com/image/fetch/$s_!Ocxj!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F53eedf6f-8fb3-44ad-9660-d5d7e05cd987_1024x1024.png 848w, https://substackcdn.com/image/fetch/$s_!Ocxj!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F53eedf6f-8fb3-44ad-9660-d5d7e05cd987_1024x1024.png 1272w, https://substackcdn.com/image/fetch/$s_!Ocxj!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F53eedf6f-8fb3-44ad-9660-d5d7e05cd987_1024x1024.png 1456w" sizes="100vw" fetchpriority="high"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image buttonBase-GK1x3M"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image buttonBase-GK1x3M"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p>On August 2, 2026, the EU AI Act reaches full enforcement. For the first time in any major jurisdiction, organisations deploying high-risk AI systems are legally required to assign human oversight responsibilities to a named individual &#8212; someone with the specific competence to understand the system&#8217;s outputs and the actual authority to act when something goes wrong. Under corporate law, directors who consciously disregard significant AI governance obligations now face personal liability, not just organisational exposure.</p><p>The regulation is forcing an answer to the question most organisations have not asked. Not &#8220;do we have a responsible AI policy?&#8221; &#8212; 89% of organisations now do, according to Stanford&#8217;s 2026 AI Index.</p><blockquote><p><strong>But the harder question: who, specifically, is personally accountable when an AI-driven decision causes harm to a specific person?</strong></p></blockquote><p>These are not the same question. One is answered by a document. The other requires a name, a defined scope, and a consequence attached to that name. Organisations have produced documents at scale. They have not produced names.</p><p>The accountability void is the gap between those two things &#8212; and it is, right now, one of the most consequential and least examined structural problems in AI deployment.</p><div><hr></div><h3>How the void forms</h3><p>The accountability void is not the product of deliberate evasion. It is the product of how AI deployment actually happened &#8212; through a series of individually reasonable decisions that collectively produced an unreasonable result.</p><p>When organisations began embedding AI into consequential workflows &#8212; screening job applications, scoring creditworthiness, triaging medical records, flagging compliance risk &#8212; they typically did so by treating AI output as an input to a human decision. The framing was: the AI recommends, the human decides. The human reviewing the recommendation was accountable for the decision. The AI was a tool, not a decision-maker. This framing made the accountability architecture feel settled.</p><p><strong>But as AI capability expanded and the volume of AI-assisted decisions grew, the human review step became faster, more cursory, and less substantive. </strong></p><p>What had been genuine evaluation became ratification. The AI recommendation increasingly was the decision. The human approval was a procedural step &#8212; performed, in many cases, without the time, the contextual information, or the technical understanding required to meaningfully evaluate what the AI had concluded.</p><p>The accountability architecture never moved. It still formally points at the human decision-maker &#8212; who is now on the legal hook for a decision they did not meaningfully make. The practical decision-making sits with a system that has no legal subjectivity and cannot be held accountable.</p><p><strong>The void is the space between these two positions: formal accountability assigned to a human, practical authority exercised by an algorithm.</strong></p><p>What makes the void structurally stable &#8212; and therefore dangerous &#8212; is that it is invisible as long as everything works. The AI recommendation is accepted. The human ratifies. The outcome is fine. No audit trail reveals that the human didn&#8217;t actually evaluate the recommendation; they simply processed it. The void is only exposed at the moment it matters most: when the AI is wrong, the harm is real, and someone needs to answer for it.</p><div><hr></div><h3>The evidence: incidents rising, response quality falling</h3><p>Stanford&#8217;s 2026 AI Index provides the most comprehensive quantitative picture of how this void is developing. The AI Incident Database recorded 362 documented AI incidents in 2025 &#8212; up 55% from 233 in 2024. The rate of increase significantly outpaces the growth in AI deployment, suggesting that the tail-risk exposure is growing as a proportion of the deployed base, not just in absolute terms.</p><p>More telling than the incident count is what happened to organisational response capability in the same period. The share of organisations rating their own AI incident response as &#8220;excellent&#8221; dropped from 28% in 2024 to 18% in 2025. The organisations deploying more AI are, by their own assessment, becoming less capable of handling its failures.</p><p>Simultaneously, the Foundation Model Transparency Index dropped from an average score of 58 in 2024 to 40 in 2025. The systems that organisations are deploying are becoming less transparent about their own workings at exactly the moment when those organisations need to be more accountable for the outcomes those systems produce.</p><div><hr></div><h3>When the void becomes a lawsuit</h3><p>The legal exposure of the accountability void moved from theoretical to concrete in 2025. In May, a US federal court certified a nationwide collective action in Mobley v. Workday. Workday&#8217;s AI-powered hiring platform was accused of systematically screening out applicants over 40, using a model that evaluated skills alignment and provided ranked recommendations to employers. Applicants received automated rejections without any disclosed AI involvement.</p><p>A parallel case targeting Eightfold AI raised the same structural question: applicants were scored and rejected without knowing AI was involved, without access to the criteria, and without a meaningful mechanism for human review. The legal question at the centre of both cases is the accountability void made concrete: if a candidate is scored and rejected by an AI system, and the human reviewer never substantively evaluated the underlying case, who is accountable for the outcome?</p><blockquote><p><strong>&#8220;The rapid deployment of AI systems at scale could create substantial responsibility gaps, increasing the likelihood of damages, losses, and wrong expectations.&#8221;</strong></p><p><strong>&#8212; London Business School, &#8220;The Governance Gap at the Heart of the AI Boom&#8221; (2025)</strong></p></blockquote><div><hr></div><h3>The policy illusion</h3><p>89% of organisations now have a formal responsible AI policy. The documents are real. The governance intentions are, in many cases, genuine. The problem is structural: responsible AI policies are written at the organisational level. Accountability for a specific decision affecting a specific person must sit at the individual level.</p><p>Organisations have the former. They almost universally lack the latter.</p><p>Grant Thornton&#8217;s 2026 AI Impact Survey found that most organisational AI governance frameworks remain internal guidelines with no external verification, no shared standards, and no mechanism for assigning individual accountability to specific AI systems. They specify what the organisation believes about AI use. They do not specify who is personally responsible when a specific AI output causes a specific harm.</p><div><hr></div><h3>Three archetypes of nominal accountability</h3><p>The <strong>Policy Owne</strong>r has genuine accountability for the policy&#8217;s existence. They have no meaningful accountability for the specific outputs of specific AI systems. When a specific AI decision causes harm, they can point to the policy&#8217;s existence; they cannot answer for the decision.</p><p>The <strong>Approving Manager</strong> signed off on deployment. Their ongoing accountability for specific outputs is formal rather than substantive. Their accountability is institutional &#8212; they said yes to the system &#8212; but not individual: they did not make the decision that produced the harm.</p><p>The <strong>Human in the Loop</strong> is the formal oversight mechanism. In practice, they are processing volume that makes genuine evaluation impossible. A recruiter reviewing 400 AI-screened candidates in a day cannot meaningfully evaluate 400 AI recommendations. Their formal accountability is intact; their practical capacity to exercise it is not.</p><div><hr></div><h3>What genuine accountability looks like</h3><p>Genuine accountability for an AI system requires four specific elements.</p><ul><li><p>First, a named individual &#8212; not a team, not a policy document &#8212; with defined scope.</p></li><li><p>Second, the competence to understand those outputs: the named individual must have access to the system&#8217;s logic, training, known failure modes, and performance data.</p></li><li><p>Third, the authority to act: the named individual must have the formal power to override, pause, or escalate without requiring multiple levels of approval.</p></li><li><p>Fourth, a defined consequence: what happens, specifically, when the named individual fails in their oversight function?</p></li></ul><p><strong>Most organisations have zero of these four elements specified for most of their AI systems.</strong></p><p>The EU AI Act is forcing all four for high-risk systems. The rest remains in the void.</p><div><hr></div><h3>The closing uncomfortable truth</h3><p>The accountability void will not resolve itself through continued policy development. It will resolve &#8212; in most organisations &#8212; through a serious failure that forces the question of who is personally accountable into a context where the answer can no longer be deferred.</p><p>The organisations best positioned when that moment arrives are those doing the unglamorous work now: naming the humans accountable for specific AI systems, equipping them with the competence and authority their role requires, and attaching a consequence to that accountability that is real rather than nominal.</p><p><strong>Most organisations have a responsible AI policy. Most organisations cannot name the specific human accountable for a specific AI output that harmed a specific person.</strong></p><p>One is a document. The other is governance. The document exists. The governance hasn&#8217;t arrived yet.</p>]]></content:encoded></item><item><title><![CDATA[The New Org Chart.]]></title><description><![CDATA[Exploring how the five-layer Organisation of the Future resolves into a single legible structure.]]></description><link>https://www.shapingminds.co/p/the-new-org-chart</link><guid isPermaLink="false">https://www.shapingminds.co/p/the-new-org-chart</guid><dc:creator><![CDATA[Maxime Mouton]]></dc:creator><pubDate>Tue, 23 Jun 2026 23:01:20 GMT</pubDate><enclosure url="https://substackcdn.com/image/fetch/$s_!CNg4!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F43c9a690-5dd2-4460-9c8e-2694fc08491c_1024x1024.jpeg" length="0" type="image/jpeg"/><content:encoded><![CDATA[<div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!CNg4!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F43c9a690-5dd2-4460-9c8e-2694fc08491c_1024x1024.jpeg" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!CNg4!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F43c9a690-5dd2-4460-9c8e-2694fc08491c_1024x1024.jpeg 424w, https://substackcdn.com/image/fetch/$s_!CNg4!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F43c9a690-5dd2-4460-9c8e-2694fc08491c_1024x1024.jpeg 848w, https://substackcdn.com/image/fetch/$s_!CNg4!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F43c9a690-5dd2-4460-9c8e-2694fc08491c_1024x1024.jpeg 1272w, https://substackcdn.com/image/fetch/$s_!CNg4!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F43c9a690-5dd2-4460-9c8e-2694fc08491c_1024x1024.jpeg 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!CNg4!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F43c9a690-5dd2-4460-9c8e-2694fc08491c_1024x1024.jpeg" width="1024" height="1024" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/43c9a690-5dd2-4460-9c8e-2694fc08491c_1024x1024.jpeg&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:1024,&quot;width&quot;:1024,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:281441,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/jpeg&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:false,&quot;topImage&quot;:true,&quot;internalRedirect&quot;:&quot;https://www.shapingminds.co/i/202247192?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F43c9a690-5dd2-4460-9c8e-2694fc08491c_1024x1024.jpeg&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!CNg4!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F43c9a690-5dd2-4460-9c8e-2694fc08491c_1024x1024.jpeg 424w, https://substackcdn.com/image/fetch/$s_!CNg4!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F43c9a690-5dd2-4460-9c8e-2694fc08491c_1024x1024.jpeg 848w, https://substackcdn.com/image/fetch/$s_!CNg4!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F43c9a690-5dd2-4460-9c8e-2694fc08491c_1024x1024.jpeg 1272w, https://substackcdn.com/image/fetch/$s_!CNg4!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F43c9a690-5dd2-4460-9c8e-2694fc08491c_1024x1024.jpeg 1456w" sizes="100vw" fetchpriority="high"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image buttonBase-GK1x3M"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image buttonBase-GK1x3M"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p>The corporate hierarchy was not designed to survive this</p><p>It was designed to manage information in a world where information was expensive to move. The seven-to-nine-layer enterprise org chart &#8212; the one that defines almost every company of consequence built between 1920 and 2015 &#8212; is, at its structural core, a solution to a 1920 problem: how do you get information from the front line to the person who needs to act on it, and instructions back to the front line, without it dissolving into noise along the way?</p><p>The answer was layers. Each layer served as a compression function. Front-line workers generated data. First-line supervisors synthesised it into summaries. Middle managers translated those summaries into cross-functional coordination. Senior managers turned coordination into strategy inputs. The C-suite made decisions and sent instructions back down the same chain. The org chart was, in every operational sense, an information routing architecture built from people.</p><p>McKinsey&#8217;s 2026 &#8220;State of Organizations&#8221; report found something that might be the most understated finding of the year: two-thirds of leaders say their organisations are overly complex and inefficient, and nearly 40% say that redefining process flows &#8212; not restructuring, not headcount reduction &#8212; is the single biggest productivity unlock available to them right now. The complexity they are describing is not accidental. It is the residue of an information routing architecture that is no longer needed for the purpose it was designed for.</p><p>The AI Stack changes the economics of information relay at every layer. A generative engine synthesises. A predictive engine anticipates. A perceptive engine monitors in real time. An agentic engine routes, escalates, and executes. An optimisation engine continuously improves. The five-layer AI Stack &#8212; the subject of the first piece in this series &#8212; performs, automatically and at scale, the compression and relay function that occupied most of the coordination middle of the traditional org chart.</p><p>The question is not whether the hierarchy will change. Gartner estimates 20% of organisations will eliminate more than half their middle management positions through AI-driven restructuring by 2026. Korn Ferry found that 41% of employees already report their company has trimmed management layers in 2024&#8211;25. The question is whether the change is intentional &#8212; or just a smaller, more confused version of the same broken architecture.</p><p>This is the fifth and final piece in my series on the Organisation of the Future. The first four named the building blocks: the AI Stack (the engines), the Operator (the humans who run them), the Verifier (the humans who ensure the outputs earn trust), the Workflow Designer (the humans who architect the road). This piece draws the org chart they all live on.</p><div><hr></div><h3>How the hierarchy got so tall</h3><p>To understand why the org chart is changing, it helps to understand why it became what it is.</p><p>Frederick Taylor formalised the division of labour in the 1910s. Alfred Sloan built the modern divisional corporation at General Motors in the 1920s &#8212; the model that the Fortune 500 spent the next fifty years replicating. The divisional structure needed layers because it was managing scale without computers. A VP of Operations at GM in 1950 had no automated monitoring of production lines across twelve plants. They had reports from plant managers, who had reports from shift supervisors, who had reports from team leads. Each layer existed because someone needed to synthesise, check, and relay what was happening in the layer below.</p><p>The corporate computer age, beginning in the 1970s and accelerating through the 1990s, compressed some of this &#8212; enterprise resource planning systems made data more visible across layers, and the internet enabled real-time communication that shortened some relay chains. But the fundamental management architecture of the industrial corporation survived into the 2020s largely intact. Most Fortune 500 companies still had seven to nine reporting layers between a frontline worker and the CEO in 2024.</p><p>The reason those layers persisted, even as technology improved, is that information synthesis &#8212; the judgment call about what matters and what doesn&#8217;t, what to escalate and what to absorb &#8212; was still fundamentally a human task. An ERP system could show you that SKU 7843 was running 14% under plan. It could not tell you whether that mattered, why it was happening, who needed to know, or what to do about it. That judgment lived in the middle layer. The middle layer persisted because judgment was scarce.</p><p>The AI Stack changes the scarcity calculus on judgment at three levels simultaneously. It automates the monitoring (perceptive engines). It synthesises the signal from the noise (predictive engines). It routes the escalation to the right human seat, with the right context packet, at the right time (agentic engines). The judgment that middle management spent 70% of its time preparing for &#8212; the ten minutes of actual decision-making that justified the hour of synthesis and the two hours of reporting &#8212; can now be delivered pre-synthesised to the person who needs to make it.</p><div><hr></div><h3>What gets lost</h3><p>Before drawing the new org chart, there is something important to acknowledge about what is structurally lost in the transition.</p><p>Middle management is not simply a coordination mechanism. It is also an institutional memory system. The manager who has been in post for six years and knows that the finance-sales handoff has a seventeen-step workaround because of a legacy system migration in 2019 is carrying institutional knowledge that does not live in any process document, any ERP system, or any AI training dataset. That knowledge exists as context in a person. When that person leaves &#8212; whether voluntarily as part of a restructuring or involuntarily as part of a headcount reduction &#8212; the knowledge leaves with them.</p><p>This is not a small problem. Gartner&#8217;s May 2026 analysis found that AI-driven restructuring is creating budget room but not delivering the productivity returns companies expected. The mechanism is this: companies cut the coordination layer, expecting the AI Stack to absorb the coordination function, but find that the AI Stack was not trained on the institutional context those people carried. The workflow breaks in subtler ways. The escalation goes to the manager who no longer exists. The synthesis misses the context the predictive engine was never given. The agentic engine routes correctly according to the workflow specification but incorrectly according to the institutional reality.</p><p>The Workflow Designer&#8217;s primary job &#8212; mapping the actual workflow, not the documented workflow &#8212; is partly a knowledge transfer mechanism. The Mapper archetype of the Workflow Designer role exists precisely because the gap between the process document and the real process is where institutional knowledge lives. Before you can eliminate the coordination middle, you have to extract what it knows. Most companies doing AI-driven restructuring in 2025&#8211;26 are not doing this extraction. They are eliminating the relay runners and hoping the documentation is good enough. It rarely is.</p><div><hr></div><h3>The five-layer architecture</h3><p>The new org chart has five genuine layers. They are not five reporting levels &#8212; they are five functional layers with different relationships to the work, to the AI engines, and to each other. A Verifier may formally report to a Director of Operations, but their functional role is in the Trust Layer regardless of where they sit on a reporting tree. The org chart of the future is a functional map, not just a hierarchy chart.</p><ul><li><p><strong>Layer 1: The Engine Room.</strong> The AI Stack runs in the background of every workflow the organisation executes. Generative, predictive, perceptive, agentic, and optimisation engines &#8212; the five types named in the first piece in this series &#8212; are infrastructure, not personnel. They are the most important layer in the new org because they are the one that changes the economics of everything above them. And they are the one most organisations are building without the other four layers in place. The Engine Room is not empty of humans &#8212; it requires engineers, architects, and calibration specialists &#8212; but those humans are infrastructure roles, not coordination roles.</p></li><li><p><strong>Layer 2: The Execution Layer.</strong> The Operators &#8212; Conductors, Translators, Mechanics, and Surgeons, as named in the second piece &#8212; are the humans who run the AI-augmented workflows. They are not managing people. They are managing processes that combine human judgment with AI output at every consequential step. The Execution Layer is also the largest human layer in the new org by headcount. Most of the people who survived the reduction of the coordination middle are now Operators, whether or not their job title says so.</p></li><li><p><strong>Layer 3:</strong> <strong>The Trust Layer.</strong> The Verifiers &#8212; Domain Expert, Critic, Auditor, Red Team, as named in the third piece &#8212; are the humans who ensure that outputs from the AI Stack earn organisational trust before they are acted on, communicated, or escalated. The Trust Layer is functionally new. In the old org, trust was built through hierarchy: something was trustworthy because a director had signed off on it. In the new org, the director-as-trust-mechanism is being replaced by a systematic verification function. In regulated domains &#8212; finance, healthcare, hiring, content moderation &#8212; this layer is now legally load-bearing under the EU AI Act, which reached full enforcement in August 2026.</p></li><li><p><strong>Layer 4: The Architecture Layer.</strong> The Workflow Designers &#8212; Mapper, Boundary Setter, Recovery Designer, Composer &#8212; are the structural engineers of the new org. They sit between the Direction Layer and the Execution Layer, translating strategic goals into designed workflows. They are the new coordination mechanism: instead of a human relay chain synthesising information in real time, a designed workflow specifies in advance where information flows, where it gets synthesised, where humans make decisions, and what happens when the workflow breaks. The Architecture Layer is the smallest human layer in the new org by headcount but the highest-leverage: a single Composer designing a well-specified workflow can enable fifty Operators to execute reliably at scale.</p></li><li><p><strong>Layer 5: The Direction Layer.</strong> The senior leaders who set goals, make strategic bets, and own accountability. What changes at this layer is not title or authority but operating reality. The Direction Layer in the old org received synthesised information through a relay chain and made decisions based on what the relay produced. In the new org, the relay chain has been replaced by designed workflows and AI synthesis &#8212; which means the Direction Layer has direct sight-lines to the actual work, without the compression and distortion that six layers of relay introduced. This is both more powerful and more demanding. A senior leader with direct sight-lines to AI-synthesised workflow data is better informed, faster. They are also being asked to make more consequential decisions with less buffer &#8212; because the buffer was the middle.</p></li></ul><div><hr></div><h3>The deleted layer and the coordination question</h3><p>The layer that the five-band model has no place for is middle management as a coordination mechanism. Not as a person type &#8212; but as a functional role: the human whose primary job is to synthesise information from below, coordinate across functions, and relay upward. That coordination function has been absorbed by three parts of the new architecture: the Workflow Designer&#8217;s Architecture Layer (who designs the coordination logic in advance), the AI Stack&#8217;s agentic and predictive engines (who execute the coordination logic in real time), and the Operator&#8217;s Execution Layer (who own the workflow outcomes and make the in-context judgment calls that the design cannot fully specify in advance).</p><blockquote><p><strong>&#8220;Shifting attention from structure to flow &#8212; with the biggest productivity payoff lying not in reorganising reporting lines but in radically simplifying and unifying processes across the enterprise.&#8221;</strong></p><p>&#8212; McKinsey, The State of Organizations 2026</p></blockquote><p>What this means for people currently in coordination-heavy middle management roles: the function is not disappearing, but its location in the org is changing. The judgment, escalation, and domain expertise components of middle management roles are being elevated into the Operator and Verifier tiers. The synthesis and relay components are being absorbed by the AI Stack and the Workflow Designer. The transition is not &#8220;middle managers are being replaced by AI.&#8221; It is &#8220;the coordination-heavy version of middle management is being replaced by a combination of designed workflows and AI engines, while the judgment-heavy version is being elevated into named functional roles with higher accountability.&#8221; That is a harder story to tell in a restructuring announcement, which is why most companies are not telling it.</p><div><hr></div><h3>Building it deliberately</h3><p>The difference between a company that captures the productivity gain of the new org and one that is still running pilots in 2028 comes down to one question: did they build all five layers, or just the Engine Room?</p><p>McKinsey&#8217;s finding that only 21% of companies have redesigned their workflows end-to-end is, read through the lens of this series, a finding about which companies have invested in all five layers. The 21% have Operators, Verifiers, and Workflow Designers in place around their AI Stack. The 79% have engines and hope.</p><p>Building deliberately means four specific decisions. First: name the role families explicitly. Operator, Verifier, and Workflow Designer need to exist as intentional job descriptions, not as retrofits onto existing titles. Second: do the knowledge extraction before the restructuring. Map the real workflows &#8212; with Mapper-archetype thinking &#8212; before you eliminate the people who carry the institutional context those workflows depend on. The order matters enormously. Most companies are getting it backwards. Third: design the Trust Layer for your regulatory context. In high-risk domains, the Trust Layer is now legally required, not just good practice. The companies that treat the Verifier as optional are building legal liability into the org chart. Fourth: widen spans of control intentionally, not accidentally. Span-widening only works if the Workflow Designers have done their job. If the Architecture Layer is under-resourced, wider spans of control at the top become a recipe for chaos.</p><div><hr></div><h3>The closing uncomfortable truth</h3><p>Gartner&#8217;s most quietly important finding of 2026 is this: AI will create more jobs than it eliminates &#8212; but not until 2028. Through 2026 and 2027, the net effect on global employment is roughly neutral. We are in the transition window &#8212; the period between old org and new org in which both are partially visible.</p><p>The companies that build the new shape deliberately during this window will be the ones with the Architecture Layer, the Trust Layer, and the Execution Layer staffed and operational by the time the transition completes. The ones that cut the relay middle without installing the new structure will find themselves in 2028 with AI engines, no coordination architecture, and a growing list of workflows that break in ways nobody can diagnose &#8212; because the institutional knowledge left with the people who were made redundant in 2026.</p><h4><strong>The org chart of 2030 has fewer layers than today&#8217;s.</strong></h4><p>The people who remain carry more judgment, more accountability, and more leverage than anyone in the 2020 version of the same company. The flat org is not a smaller version of the tall org. It is a different shape entirely.</p><p>Drawing that shape on purpose is the only version of this that works.</p><p><em>This is the fifth and final piece in my series on the Organisation of the Future. The full series: The AI Stack (May 27) &#8594; The Operator (June 3) &#8594; The Verifier (June 10) &#8594; The Workflow Designer (June 17) &#8594; The New Org Chart (June 24). Thanks for reading!</em></p>]]></content:encoded></item></channel></rss>