Full Width [alt+shift+f] Shortcuts [alt+shift+k] TRY SIMPLE MODE
Sign Up [alt+shift+s] Log In [alt+shift+l]
2
Today's links Bluesky creates the world's weirdest, hardest-to-understand binding arbitration clause: What, and I cannot stress this enough, the FUCK does this mean?! Hey look at this: Delights to delectate. Object permanence: No-fly babies; Stephen Harper's Red Dawn; DHS pre-crime. Upcoming appearances: Where to find me. Recent appearances: Where I've been. Latest books: You keep readin' em, I'll keep writin' 'em. Upcoming books: Like I said, I'll keep writin' 'em. Colophon: All the rest. Bluesky creates the world's weirdest, hardest-to-understand binding arbitration clause (permalink) I can't wait to use Bluesky, but I will not be joining Bluesky. As much as I trust and respect the Bluesky executives and board members I am acquainted with, I believe the service itself is insufficiently enshittification-resistant to trust: https://pluralistic.net/2024/12/14/fire-exits/#graceful-failure-modes I've met Bluesky's CEO Jay Graber on a few occasions and heard her speak several times and I'm...
8 hours ago

Improve your reading experience

Logged in users get linked directly to articles resulting in a better reading experience. Please login for free, it takes less than 1 minute.

More from Pluralistic: Daily links from Cory Doctorow

Pluralistic: "Privacy preserving age verification" is bullshit (14 Aug 2025)

Today's links "Privacy preserving age verification" is bullshit: Take it from the guy who invented it. Hey look at this: Delights to delectate. Object permanence: Vampire sf; Trickle-down Sesame Street; Transgenic mouse bribery; WPA StreetView; Walmart's policy origins. Upcoming appearances: Where to find me. Recent appearances: Where I've been. Latest books: You keep readin' em, I'll keep writin' 'em. Upcoming books: Like I said, I'll keep writin' 'em. Colophon: All the rest. "Privacy preserving age verification" is bullshit (permalink) I don't think that it's impossible for politicians, even nontechnical politicians, to make good tech policy. After all, the fact that no one in Congress is a microbiologist doesn't stop federal standards from delivering potable water (and it doesn't excuse the ghastly failures, such as Flint, MI): https://pluralistic.net/2024/11/21/policy-based-evidence/ For politicians to make good policy, they don't need to be technical experts: they need to have solid, independent, well-resourced expert agencies. Those would be the very agencies that Trump and Musk have DOGEd into oblivion, which is pretty ominous, since the work of expert agencies is how you avoid dying of food poisoning, water poisoning, air poisoning, collapsing buildings, faulty antilock brakes, train explosions and plane-crashes. But when it comes to tech policy, politicians get it all so goddamned wrong. Partly that's because the cartel of tech companies lies to them like crazy, even under oath, leading to a kind of nihilistic refusal to believe any expert input. Mark Zuckerberg wants you to think that's it's inconceivable for you to have a social life without him eavesdropping on it, and any rule demanding this is a farce, like a demand to make water that's not wet: https://pluralistic.net/2022/11/08/divisibility/#technognosticism Big Tech's highly resourced bullshit machine convinces some politicians that technical expertise is not to be trusted, and gives other, more cynical politicians cover for ignoring experts by saying, "Oh you people are always telling us that this or that is impossible." For example, since the Clinton era, politicians all over the world demanded a kind of impossible encryption: encryption that works perfectly when it's doing something legitimate, like keeping hackers from pushing malware to your pacemaker or stealing your life's savings or listening in on you through your phone's microphone, but also they require that this encryption offer no protection to criminals, drug dealers, terrorists, child abusers, and other miscreants. This really is like water that's not wet. We can make encryption that works. It's hard to get right, but when we do, it offers a wondrous level of protection from interception and eavesdropping, scrambling our data so thoroughly that you would have to consume multiple universes worth of time and space to build all the computers necessary to guess the descrambling key. We can also make encryption that doesn't work. People do this by accident all the time. Sometimes, the NSA does it on purpose (and doesn't mention that fact to the people who rely on it for their safety and integrity): https://en.wikipedia.org/wiki/Dual_EC_DRBG But what we absolutely, positively, totally cannot make is encryption that both works and does not work, depending on whose secrets it is protecting. That's impossible. But when technologists tell policymakers this, they tell us that they have every confidence in our ingenuity, and also, they can't be certain we're not telling a Zuck-style fable about how the stuff we merely disprefer is actually impossible. They tell us to NERD HARDER! NERD HARDER! is the answer every time a politician gets a technological idée-fixe about how to solve a social problem by creating a technology that can't exist. It's the answer that EU politicians who backed the catastrophic proposal to require copyright filters for all user-generated content came up with, when faced with objections that these filters would block billions of legitimate acts of speech: https://memex.craphound.com/2019/04/03/after-months-of-insisting-that-article13-doesnt-require-filters-top-eu-commissioner-says-article-13-requires-filters/ When politicians seize on a technological impossibility as a technological necessity, they flail about and desperately latch onto scholarly work that they can brandish as evidence that their idea could be accomplished. For example, back in 2019, Trump's Bureau of Land Management tried to impose a ton of absolutely bizarre, environmentally devastating requirements on Burning Man's land-use permit. One of these requirements was to effectively ban LED lights at night (!), on the basis that these were so bright at altitude that they could disrupt nocturnal birds. In support of this measure, the BLM cited a PhD dissertation from a physicist who developed a method for estimating light pollution. That physicist turns out to be a burner, who filed comments in the docket describing how the BLM had misapplied his work, making crude mathematical errors that led them to grossly overstate the amount of light pollution at altitude (I've just spent an hour trying to find this comment and I came up craps – if you can find it, please let me know, as it was delicious). That kind of Annie Hall/Marshall McLuhan/"You know nothing of my work" moment is always fantastic, and especially so when politicians are demanding that technologists NERD HARDER! to realize their cherished impossibilities. That's just happened, and in relation to one of the scariest, most destructive NERD HARDER! tech policies ever to be assayed (a stiff competition). I'm talking about the UK Online Safety Act, which imposes a duty on websites to verify the age of people they communicate with before serving them anything that could be construed as child-inappropriate (a category that includes, e.g., much of Wikipedia): https://wikimediafoundation.org/news/2025/08/11/wikimedia-foundation-challenges-uk-online-safety-act-regulations/ The Starmer government has, incredibly, developed a passion for internet regulations that are even stupider than Tony Blair's and David Cameron's. Requiring people to identify themselves (generally, via their credit cards) in order to look at porn will create a giant database of every kink and fetish of every person in the UK, which will inevitably leak and provide criminals and foreign spies with a kompromat system they can sort by net worth of the people contained within. This hasn't deterred Starmer, who insists that if we just NERD HARDER!, we can use things like "zero-knowledge proofs" to create "privacy-preserving" age verification system, whereby a service can assure itself that it is communicating with an adult without ever being able to determine who it is communicating with. In support of this idea, Starmer and co like to cite some genuinely exciting and cool cryptographic work on privacy-preserving credential schemes. Now, one of the principal authors of the key papers on these credential schemes, Steve Bellovin, has published a paper that is pithily summed up via its title, "Privacy-Preserving Age Verification—and Its Limitations": https://www.cs.columbia.edu/~smb/papers/age-verify.pdf The tldr of this paper is that Starmer's idea will not work and cannot work. The research he relies on to defend the technological feasibility of his cherished plan does not support his conclusion. Bellovin starts off by looking at the different approaches various players have mooted for verifying their users' age. For example, Google says it can deploy a "behavioral" system that relies on Google surveillance dossiers to make guesses about your age. Google refuses to explain how this would work, but Bellovin sums up several of the well-understood behavioral age estimation techniques and explains why they won't work. It's one thing to screw up age estimation when deciding which ad to show you; it's another thing altogether to do this when deciding whether you can access the internet. Others say they can estimate your age by using AI to analyze a picture of your face. This is a stupid idea for many reasons, not least of which is that biometric age estimation is notoriously unreliable when it comes to distinguishing, say, 16 or 17 year olds from 18 year olds. Nevertheless, there are sitting US Congressmen who not only think this would work – they labor under the misapprehension that this is already going on: https://pluralistic.net/2023/04/09/how-to-make-a-child-safe-tiktok/ So that just leaves the privacy-preserving credential schemes, especially the Camenisch-Lysyanskaya protocol. This involves an Identity Provider (IDP) that establishes a user's identity and characteristics using careful document checks and other procedures. The IDP then hands the user a "primary credential" that can attest to everything the IDP knows about the user, and any number of "subcredentials" that only attest to specific facts about that user (such as their age). These are used in zero-knowledge proofs (ZKP) – a way for two parties to validate that one of them asserts a fact without learning what that fact is in the process (this is super cool stuff). Users can send their subcredentials to a third party, who can use a ZKP to validate them without learning anything else about the user – so you could prove your age (or even just prove that you are over 18 without disclosing your age at all) without disclosing your identity. There's some good news for implementing CL on the web: rather than developing a transcendentally expensive and complex new system for these credential exchanges and checks, CL can piggyback on the existing Public Key Infrastructure (PKI) that powers your browser's ability to have secure sessions. When you visit a website with https:// in front of the address (instead of just http://). However, doing so poses several difficulties, which Bellovin enumerates under a usefully frank section header: "INSURMOUNTABLE OBSTACLES." The most insurmountable of these obstacles is getting set up with an IDP in the first place – that is, proving who you are to some agency, but only one such agency (so you can't create two primary credentials and share one of them with someone underage). Bellovin cites Supreme Court cases about voter ID laws and the burdens they impose on people who are poor, old, young, disabled, rural, etc. Fundamentally, it can be insurmountably hard for a lot of people to get, say, a driver's license, or any other singular piece of ID that they can provide to an IDP in order to get set up on the system. The usual answer for this is for IDPs to allow multiple kinds of ID. This does ease the burden on users, but at the expense of creating fatal weaknesses in the system: if you can set up an identity with multiple kinds of ID, you can visit different IDPs and set up an ID with each (just as many Americans today have drivers licenses from more than one state). The next obstacle is "user challenges," like the problem of households with shared computers, or computers in libraries, hotels, community centers and other public places. The only effective way to do this is to create (expensive) online credential stores, which are likely to be out of reach of the poor and disadvantaged people who disproportionately rely on public or shared computers. Next are the "economic issues": this stuff is expensive to set up and maintain, and someone's gotta pay for it. We could ask websites that offer kid-inappropriate content to pay for it, but that sets up an irreconcilable conflict of interest. These websites are going to want to minimize their costs, and everything they can do to reduce costs will make the system unacceptably worse. For example, they could choose only to set up accounts with IDPs that are local to the company that operates the server, meaning that anyone who lives somewhere else and wants to access that website is going to have to somehow get certified copies of e.g. their birth certificate and driver's license to IDPs on the other side of the planet. The alternative to having website foot the bill for this is asking users to pay for it – meaning that, once again, we exclude poor people from the internet. Finally, there's "governance": who runs this thing? In practice, the security and privacy guarantees of the CL protocol require two different kinds of wholly independent institutions: identity providers (who verify your documents), and certificate authorities (who issue cryptographic certificates based on those documents). If these two functions take place under one roof, the privacy guarantees of the system immediately evaporate. An IDP's most important role is verifying documents and associating them with a specific person. But not all IDPs will be created equal, and people who wish to cheat the system will gravitate to the worst IDPs. However, lots of people who have no nefarious intent will also use these IDPs, merely because they are close by, or popular, or were selected at random. A decision to strike off an IDP and rescind its verifications will force lots of people – potentially millions of people – to start over with the whole business of identifying themselves, during which time they will be unable to access much of the web. There's no practical way for the average person to judge whether an IDP they choose is likely to be found wanting in the future. So we can regulate IDPs, but who will do the regulation? Age verification laws affect people outside of a government's national territory – anyone seeking to access content on a webserver falls under age verification's remit. Remember, IDPs handle all kinds of sensitive data: do you want Russia, say, to have a say in deciding who can be an IDP and what disclosure rules you will have to follow? To regulate IDPs (and certificate authorities), these entities will have to keep logs, which further compromises the privacy guarantees of the CL protocol. Looming all of this is a problem with the CL protocol as being built on regulated entities, which is that CL is envisioned as a way to do all kinds of business, from opening a bank account to proving your vaccination status or your right to work or receive welfare. Authoritarian governments who order primary credential revocations of their political opponents could thoroughly and terrifyingly "unperson" them at the stroke of a pen. The paper's conclusions provide a highly readable summary of these issues, which constitute a stinging rebuke to anyone contemplating age-verification schemes. These go well beyond the UK, and are in the works in Canada, Australia, the EU, Texas and Louisiana. Age verification is an impossibility, and an impossibly terrible idea with impossibly vast consequences for privacy and the open web, as my EFF colleague Jason Kelley explained on the Malwarebytes podcast: https://www.malwarebytes.com/blog/podcast/2025/08/the-worst-thing-for-online-rights-an-age-restricted-grey-web-lock-and-code-s06e16 Politicians – even nontechnical ones – can make good tech policy, provided they take expert feedback seriously (and distinguish it from self-interested industry lobbying). When it comes to tech policy, wanting it badly is not enough. The fact that it would be really cool if we could get technology to do something has no bearing on whether we can actually get technology to do that thing. NERD HARDER! isn't a policy, it's a wish. Wish in one hand and shit in the other and see which one will be full first: https://www.reddit.com/r/etymology/comments/oqiic7/studying_the_origins_of_the_phrase_wish_in_one/ Hey look at this (permalink) Australian court finds Apple, Google guilty of being anticompetitive https://www.ghacks.net/2025/08/12/australian-court-finds-apple-google-guilty-of-being-anticompetitive/ Fobazi’s road to recovery: Kidney and liver transplant https://www.gofundme.com/f/support-fobazis-road-to-recovery J.R. “Bob” Dobbs and the Church of the SubGenius https://dobbstown.org/things-to-buy/ Quiet politics and the minimum wage https://dirkmjk.nl/en/453/quiet-politics-and-the-minimum-wage Reddit will block the Internet Archive https://www.theverge.com/news/757538/reddit-internet-archive-wayback-machine-block-limit Object permanence (permalink) #20yrsago Lloyds of London to offer insurance for corporate open source users https://www.theregister.com/2005/08/12/opensource_indemnification/ #20yrsago Vampire novel as a work of first-rate science fiction https://memex.craphound.com/2005/08/14/vampire-novel-as-a-work-of-first-rate-science-fiction/ #10yrsago Chinese theme-park queue-jumping techniques http://www.capndesign.com/archives/2015/08/the_art_of_queue_jumping.php #10yrsago Even when you turn on Win 10’s “privacy” flags, it still spies on you https://arstechnica.com/information-technology/2015/08/even-when-told-not-to-windows-10-just-cant-stop-talking-to-microsoft/ #10yrsago Trickle-down kids’ TV: Sesame Street will air on HBO 9 months before PBS https://memex.craphound.com/2015/08/14/trickle-down-kids-tv-sesame-street-will-air-on-hbo-9-months-before-pbs/ #10yrsago Transgenic mouse company pays academics who cite them in papers https://www.badscience.net/2015/08/so-this-company-cyagen-is-paying-authors-for-citations-in-academic-papers/ #10yrsago Australian court hands copyright trolls their own asses https://torrentfreak.com/dallas-buyers-club-ruling-devastates-copyright-trolling-down-under-150814/ #10yrsago Student suspended for tweeting two words will get to sue his school, police chief https://www.techdirt.com/2015/08/14/school-police-chief-must-face-lawsuit-brought-student-suspended-10-days-tweeting-actually-yes/ #5yrsago Maidan in Belarus https://pluralistic.net/2020/08/14/shock-doctrine/#walkaway #5yrsago NYC Street View, WPA edition https://pluralistic.net/2020/08/14/shock-doctrine/#wpa-nyc #5yrsago NYC homeless lose bathroom access https://pluralistic.net/2020/08/14/shock-doctrine/#everybody-poops #5yrsago The CARES Shock Doctrine https://pluralistic.net/2020/08/14/shock-doctrine/#shock-doctrine #1yrago The one weird monopoly trick that gave us Walmart and Amazon and killed Main Street https://pluralistic.net/2024/08/14/the-price-is-wright/#enforcement-priorities Upcoming appearances (permalink) Ithaca: AD White keynote (Cornell), Sep 12 https://deanoffaculty.cornell.edu/events/keynote-cory-doctorow-professor-at-large/ DC: Enshittification at Politics and Prose, Oct 8 https://politics-prose.com/cory-doctorow-10825 New Orleans: DeepSouthCon63, Oct 10-12 http://www.contraflowscifi.org/ Chicago: Enshittification with Kara Swisher (Chicago Humanities), Oct 15 https://www.oldtownschool.org/concerts/2025/10-15-2025-kara-swisher-and-cory-doctorow-on-enshittification/ San Francisco: Enshittification at Public Works (The Booksmith), Oct 20 https://app.gopassage.com/events/doctorow25 Miami: Enshittification at Books & Books, Nov 5 https://www.eventbrite.com/e/an-evening-with-cory-doctorow-tickets-1504647263469 Recent appearances (permalink) The Utopias Podcast https://www.buzzsprout.com/2272465/episodes/17650124 Tariffs vs IP Law (Firewalls Don't Stop Dragons) https://www.youtube.com/watch?v=LFABFe-5-uQ ORG at 20: In conversation with Maria Farrell https://www.youtube.com/watch?v=M9H2An_D6io Latest books (permalink) Picks and Shovels: a sequel to "Red Team Blues," about the heroic era of the PC, Tor Books (US), Head of Zeus (UK), February 2025 (https://us.macmillan.com/books/9781250865908/picksandshovels). The Bezzle: a sequel to "Red Team Blues," about prison-tech and other grifts, Tor Books (US), Head of Zeus (UK), February 2024 (the-bezzle.org). "The Lost Cause:" a solarpunk novel of hope in the climate emergency, Tor Books (US), Head of Zeus (UK), November 2023 (http://lost-cause.org). "The Internet Con": A nonfiction book about interoperability and Big Tech (Verso) September 2023 (http://seizethemeansofcomputation.org). Signed copies at Book Soup (https://www.booksoup.com/book/9781804291245). "Red Team Blues": "A grabby, compulsive thriller that will leave you knowing more about how the world works than you did before." Tor Books http://redteamblues.com. "Chokepoint Capitalism: How to Beat Big Tech, Tame Big Content, and Get Artists Paid, with Rebecca Giblin", on how to unrig the markets for creative labor, Beacon Press/Scribe 2022 https://chokepointcapitalism.com Upcoming books (permalink) Canny Valley: A limited edition collection of the collages I create for Pluralistic, self-published, September 2025 Enshittification: Why Everything Suddenly Got Worse and What to Do About It, Farrar, Straus, Giroux, October 7 2025 https://us.macmillan.com/books/9780374619329/enshittification/ Unauthorized Bread: a middle-grades graphic novel adapted from my novella about refugees, toasters and DRM, FirstSecond, 2026 Enshittification, Why Everything Suddenly Got Worse and What to Do About It (the graphic novel), Firstsecond, 2026 The Memex Method, Farrar, Straus, Giroux, 2026 The Reverse-Centaur's Guide to AI, a short book about being a better AI critic, Farrar, Straus and Giroux, 2026 Colophon (permalink) Today's top sources: Currently writing: "The Reverse Centaur's Guide to AI," a short book for Farrar, Straus and Giroux about being an effective AI critic. (1049 words yesterday, 30960 words total). A Little Brother short story about DIY insulin PLANNING This work – excluding any serialized fiction – is licensed under a Creative Commons Attribution 4.0 license. That means you can use it any way you like, including commercially, provided that you attribute it to me, Cory Doctorow, and include a link to pluralistic.net. https://creativecommons.org/licenses/by/4.0/ Quotations and images are not included in this license; they are included either under a limitation or exception to copyright, or on the basis of a separate license. Please exercise caution. How to get Pluralistic: Blog (no ads, tracking, or data-collection): Pluralistic.net Newsletter (no ads, tracking, or data-collection): https://pluralistic.net/plura-list Mastodon (no ads, tracking, or data-collection): https://mamot.fr/@pluralistic Medium (no ads, paywalled): https://doctorow.medium.com/ Twitter (mass-scale, unrestricted, third-party surveillance and advertising): https://twitter.com/doctorow Tumblr (mass-scale, unrestricted, third-party surveillance and advertising): https://mostlysignssomeportents.tumblr.com/tagged/pluralistic "When life gives you SARS, you make sarsaparilla" -Joey "Accordion Guy" DeVilla READ CAREFULLY: By reading this, you agree, on behalf of your employer, to release me from all obligations and waivers arising from any and all NON-NEGOTIATED agreements, licenses, terms-of-service, shrinkwrap, clickwrap, browsewrap, confidentiality, non-disclosure, non-compete and acceptable use policies ("BOGUS AGREEMENTS") that I have entered into with your employer, its partners, licensors, agents and assigns, in perpetuity, without prejudice to my ongoing rights and privileges. You further represent that you have the authority to release me from any BOGUS AGREEMENTS on behalf of your employer. ISSN: 3066-764X

2 days ago 2 votes
Pluralistic: Maga's boss class think they are immune to American carnage (13 Aug 2025)

Today's links Maga's boss class think they are immune to American carnage: They're in for a surprise. Hey look at this: Delights to delectate. Object permanence: Paradox of choice (screens); Perpetual Lenovo crapware; Trump's Solicitor General: "bribery is legal"; Marvel's 10¢ comics; Snatched postal sorting-machines; Failed State; Kenk; Glass Houses; Caveman SF; My origin story; FBI vs George Carlin. Upcoming appearances: Where to find me. Recent appearances: Where I've been. Latest books: You keep readin' em, I'll keep writin' 'em. Upcoming books: Like I said, I'll keep writin' 'em. Colophon: All the rest. Maga's boss class think they are immune to American carnage (permalink) It's not just that Texas DA Gocha Ramirez charged a woman with murder for having an abortion (something he wasn't allowed to do, even under Texas law); it's that Ramirez paid for his mistress's own abortion, after he impregnated her while having an affair with her and her sister: https://archive.is/20250812192203/https://www.houstonchronicle.com/news/houston-texas/texas/article/abortion-murder-charge-district-attorney-20812966.php This is perfect Magaism, as captured by Wilhoit's Law: Conservatism consists of exactly one proposition, to wit: There must be in-groups whom the law protects but does not bind, alongside out-groups whom the law binds but does not protect. https://crookedtimber.org/2018/03/21/liberals-against-progressives/#comment-729288 Maga is a coalition of turkeys voting for Christmas, and ax-sharpening farmers planning to make a meal out of them. The Maga base wants a bunch of stuff that the Maga elites would never tolerate, but that's OK, because the Maga elites are pretty sure they will never have to suffer under the laws they pass for others. Peter Theil is happy to support a political movement whose dominant factions would like to put him – and every other gay man – in a concentration camp, because he's pretty sure that only applies to the poor gays, not the billionaire gays. Financiers who back Trump know that they can afford to transport their daughters, wives, mistresses and the housekeepers, babysitters and teenagers they impregnate across state lines (or national borders) to get an abortion should the need arise. Their participation in Maga was a bet that after victory was attained, the base could be made to settle for performative cruelty against people other than them: https://pluralistic.net/2025/01/06/how-the-sausage-gets-made/#governing-is-harder The finance sector is the critical faction in Maga, because the financialized ideal is to accumulate wealth and power without exposure to any real-world risks. As Doug Rushkoff writes in Survival of the Richest, the finance move is to "go meta" – don't drive a taxi, buy a medallion and rent it to a taxi driver. Don't buy a medallion, start a rideshare company. Don't start a rideshare company, invest in a rideshare company. Don't invest in a rideshare company, buy options to invest in a rideshare company: https://pluralistic.net/2022/09/13/collapse-porn/#collapse-porn Crypto is as meta as it gets, so no wonder crypto bros are all-in on Trump, and no wonder Trump is all-in on crypto. As Hamilton Nolan writes: Crypto coins… are pure speculative baubles, endowed with value only to the extent that you can convince another person to pay you more for them than you paid. They are a claim on nothing. They are the grandest embodiment of Greater Fool Theory ever invented by mankind. https://www.hamiltonnolan.com/p/scams-and-bribery-are-becoming-the Trump's tariffs are blowing up the economy and wiping out the agricultural sector. All those rural, Christmas-voting turkeys are getting it in the neck: https://kdwalmsley.substack.com/p/tariffs-wiping-out-american-farmers Trump's answer to this is to fire the government statisticians and replace them with work-for-hire fiction hacks who'll publish whatever numbers he tells them to: https://prospect.org/blogs-and-newsletters/tap/2025-08-13-cooking-inflation-jobs-numbers-trump-bls/ You'd think that this would worry the finance sector, but fake numbers are actually good for finance, provided you're on the right side of them. Plenty of people got dynastically rich off of the fake numbers that propped up the pre-2008 housing bubble and the pre-2001 dotcom bubble. Those same people – and their ideological heirs – are now all-in on AI. It's impossible to overstate how structurally important AI is to the US economy. AI bubble companies now account for the value of 35% of the US stock market: https://www.wheresyoured.at/the-haters-gui/ The instant that bubble pops, the US economy gets a 35% amputation. It's no surprise that, under Trump, the FTC and DoJ have brought the Biden administration's antitrust enforcement against Big Tech to a screeching halt: https://www.citizen.org/article/deleting-enforcement-trump-big-tech-billion-report/ Nothing would be worse for the AI bubble than antitrust and securities-law enforcement. Companies that cook their balance sheets and suck up hundreds of billions in investment capital cannot function in a world with an orderly market system overseen by publicly accountable referees charged with keeping everyday people from having their life's savings stolen. And indeed, Trump's enforcers are running away from their duties, as fast as they can. The latest wheeze is to change the rules so that you can "invest" your retirement savings in cryptocurrency and private equity funds (two tired old swindles whose ropers are scraping the barrel looking for new marks): https://prospect.org/power/2025-06-13-retirement-crisis-401k-private-equity-scrambled/ Not that AI is much better. AI is hemorrhaging money and bringing in pennies: https://www.wheresyoured.at/ai-is-a-money-trap/ And things are looking grimmer for AI by the day. It's not just that Openai's latest, "fifth-generation" model was such a spectacular flop that they've been forced to bring back the old version. Far more important is the utter uselessness of AI as a way of realizing cost-savings for the companies that try it: https://www.nytimes.com/2025/08/13/business/ai-business-payoff-lags.html?unlocked_article_code=1.d08.Re3i.TDnOyE2FgyNJ&smid=url-share After all, AI is implicitly a bet on firing workers. The hundreds of billions in investment, the trillions in valuation – these can't be realized by merely making workers' jobs easier or more satisfying. AI isn't a bet on making radiologists better at diagnosing solid-mass lung tumors: it's a bet on firing nearly all the radiologists and using the remainder to be "humans in the loop" for AI, in order to absorb the blame when you die of cancer. There are plenty of radiologists who might welcome AI as a tool they use alongside their traditional workflow – but their bosses aren't about to hand over vast fortunes just to make those workers happier. This is why AI users often sound like they're using totally different technologies. Workers who get to decide whether and how to incorporate AI into their jobs are doubtless finding lots of utility and delight from the new tool. These workers are "centaurs" – people assisted by machines. The workers who describe their on-the-job AI as a hellish monstrosity are being ordered to use AI, in workplaces where mass firings have terrified the survivors, who are told they must use the AI to make up for their jobless former colleagues. They are reverse-centaurs: machines assisted by human workers: https://pluralistic.net/2025/05/27/rancid-vibe-coding/#class-war There is no way that AI can be worth 35% of the economy if all it does is produce some happy centaurs. The only way that 35% bet pays off is if half the workers get fired and replaced by AI, which is a thing that AI pitchmen are promising, to the letter (a letter that is credulously repeated by the dutiful stenographers of the press): https://www.marketingaiinstitute.com/blog/dario-amodei-ai-entry-level-jobs The problem is that when businesses fire a bunch of workers and replace them with AI, they don't get the promised savings. Instead, they end up with a system that's so broken that all the wage savings are incinerated by the cost of making good on the AI's failures. But for Maga's finance wing, this is all OK. They're going meta. Don't hire workers, hire AI. Don't hire AI, make AI. Don't make AI, invest in AI. So long as the number keeps going up, finance wins, even if that's only because every structurally important firm in America is being thimblerigged into filling their walls with AI-powered, immortal asbestos that is destined to transform their firms into Superfund sites. They're betting that when the bubble finally bursts, that they will have become too big to fail, and will thus be in for the bailouts that rescued the finance sector in 2008. They think that so long as they curry favor with Trump, he'll make sure they're all OK, because they are the people the law protects, but does not bind. This is a pretty good bet. Trump's a gangster capitalist, and fascists love a "dual state" – a system where the law is followed to the letter, except when it suits someone with the protection of the ruling clique to wipe their ass with it: https://archive.ph/8T8of And bailouts for finance crooks are a bipartisan consensus. Remember, it was Obama, not Bush, who took his Treasury Secretary Timothy Geithner's advice to allow the bailed-out banks to steal their borrowers homes and trigger the foreclosure crisis, because this would "foam the runways" for the crashing banks: https://www.salon.com/2014/05/14/this_man_made_millions_suffer_tim_geithners_sorry_legacy_on_housing/ The Obama wing of the party insists that they're the responsible adults in the room, the ones that will govern wisely and hold their gigadonors to account when they wreck the economy. They tell us Zohran Mamdani is – despite all evidence to the contrary – too unpopular to win an election: https://pluralistic.net/2025/06/28/mamdani/#trustbusting They ratfucked Katie Porter, one of finance's most savage and talented opponents, teaming up with the crypto-bros who are Maga's bagmen. Joke's on them, because it looks like Porter is gonna be California's next governor: https://prospect.org/politics/2025-08-13-establishment-struggles-control-california-governors-race/ (I donated $100 I can't afford to her campaign; maybe you will donate, too?) https://secure.actblue.com/donate/kpg_web Maga's finance wing are convinced that the game is rigged in their favor – heads they win and the law protects them, tails we lose and the law binds us. But if there's one thing we know about gangster capitalism, it's that the capo isn't shy about seizing the fortunes of his various underbosses when the mood suits him. One day he's demanding that you quit your job as CEO, the next day he imposes a 15% tax on your products: https://www.firstpost.com/world/trump-meets-intel-chief-calls-him-a-success-days-after-demanding-his-resignation-13923838.html You can bet your ass that if it looks like Trump is gonna lose his grip on power, they'll come sleazing over the Democrats, demanding the defenstration of Mamdani, Porter, and anyone who wants a habitable and just world, rather than a system designed to convert the planet's resources to something that can be sequestered in a luxury bunker or on a private island. Because for all that they moan about "wokeness," they wouldn't want their kids to have to tolerate a shitty boss; they wouldn't want their kids to carry an unwanted pregnancy to term. They wanna live out their cuckold fantasies in peace: https://www.snopes.com/news/2025/06/02/stephen-miller-wife-musk/ They don't have any problem with living in a world where there's lip service to social values and Pricewaterhousecooper has a cringe Pride parade float. They'll happily save a couple bucks on the nanny's abortion by going down to the corner Planned Parenthood rather than flying her to Toronto on the private jet. All that performative cruelty was just a shuck to get some of the dumber surviving turkeys to pull the lever for Christmas. So long as they can live in a world where the law protects them, but does not bind them, they're happy as pigs in shit. Hey look at this (permalink) The Culture War is Completely Exhausted https://www.lukewsavage.com/p/the-culture-war-is-completely-exhausted Why “Spend Before Tax” Is the Key to Unlocking a Future for Young People https://www.nakedcapitalism.com/2025/08/why-spend-before-tax-is-the-key-to-unlocking-a-future-for-young-people.html Back-to-School Inflation Stories Crop Up on TikTok https://www.thebignewsletter.com/p/monopoly-round-up-back-to-school Fragile Movements Crumble https://www.hamiltonnolan.com/p/fragile-movements-crumble AI: great expectations https://rodneybrooks.com/ai-great-expectations/ Object permanence (permalink) #15yrsago Kenk: graphic novel humanizes Toronto’s most notorious bike-thief without apologising for him https://memex.craphound.com/2010/08/13/kenk-graphic-novel-humanizes-torontos-most-notorious-bike-thief-without-apologising-for-him/ #10yrsago Lenovo preloaded laptops with reformat-resistant perpetual crapware https://arstechnica.com/information-technology/2015/08/lenovo-used-windows-anti-theft-feature-to-install-persistent-crapware/ #10yrsago Hilariously terrifying talk about security https://vimeo.com/135347162 #10yrsago Income inequality turns “neglected tropic diseases” into American diseases of “the poor living among the wealthy” https://web.archive.org/web/20150820045551/http://mosaicscience.com/story/america-tropical-disease #10yrsago Rightscorp teams up with lawyers to mass-sue people who ignore blackmail letters https://torrentfreak.com/rightscorp-deal-turns-dmca-notices-into-piracy-lawsuits-150812/ #10yrsago Inside the Machine: a visual history of electronics, technology and art https://meganprelinger.com/book/inside-the-machine-art-and-invention-in-the-electronic-age/ #10yrsago Twitter snoop-requests from UK cops/gov’t more than double in 2015 https://www.bbc.com/news/technology-33882688 #10yrsago The failed writer who became NSA’s in-house “philosopher” https://theintercept.com/2015/08/11/surveillance-philosopher-nsa/ #10yrsago Internet filters considered harmful https://web.archive.org/web/20150809023346/http://knowledgequest.aasl.org/latest-internet-filtering-ala/ #10yrsago FBI opened a file on George Carlin for telling “bad taste” Hoover jokeshttps://www.muckrock.com/news/archives/2015/aug/13/george-carlins-fbi-file/ #10yrsago Caveman Science Fiction https://dresdencodak.com/2009/09/22/caveman-science-fiction/ #5yrsago Florida sheriff bans masks https://pluralistic.net/2020/08/13/better-to-have-loved/#death-cult #5yrsago "Less lethal" is a euphemism, too https://pluralistic.net/2020/08/13/better-to-have-loved/#less-lethals #5yrsago My origin story https://pluralistic.net/2020/08/13/better-to-have-loved/#neofuturians #5yrsago Trump's Solicitor General says bribery is legal https://pluralistic.net/2020/08/12/failed-state/#backhanders-r-us #5yrsago Payday lenders are CFPB's pandemic aid https://pluralistic.net/2020/08/12/failed-state/#cfpb-quislings #5yrsago Sorting machines snatched from post offices https://pluralistic.net/2020/08/12/failed-state/#machine-breakers #5yrsago Marvel's $0.10 mini-comics https://pluralistic.net/2020/08/12/failed-state/#tiny-heroes #5yrsago Failed State https://pluralistic.net/2020/08/12/failed-state/#chris-brown #5yrsago Mexico's terrible copyright is in trouble https://pluralistic.net/2020/08/12/failed-state/#viva-mexico #1yrago The paradox of choice screens https://pluralistic.net/2024/08/12/defaults-matter/#make-up-your-mind-already #1yrago Madeline Ashby's 'Glass Houses' https://pluralistic.net/2024/08/13/influencers/#affective-computing Upcoming appearances (permalink) Ithaca: AD White keynote (Cornell), Sep 12 https://deanoffaculty.cornell.edu/events/keynote-cory-doctorow-professor-at-large/ DC: Enshittification at Politics and Prose, Oct 8 https://politics-prose.com/cory-doctorow-10825 New Orleans: DeepSouthCon63, Oct 10-12 http://www.contraflowscifi.org/ Chicago: Enshittification with Kara Swisher (Chicago Humanities), Oct 15 https://www.oldtownschool.org/concerts/2025/10-15-2025-kara-swisher-and-cory-doctorow-on-enshittification/ San Francisco: Enshittification at Public Works (The Booksmith), Oct 20 https://app.gopassage.com/events/doctorow25 Miami: Enshittification at Books & Books, Nov 5 https://www.eventbrite.com/e/an-evening-with-cory-doctorow-tickets-1504647263469 Recent appearances (permalink) The Utopias Podcast https://www.buzzsprout.com/2272465/episodes/17650124 Tariffs vs IP Law (Firewalls Don't Stop Dragons) https://www.youtube.com/watch?v=LFABFe-5-uQ ORG at 20: In conversation with Maria Farrell https://www.youtube.com/watch?v=M9H2An_D6io Latest books (permalink) Picks and Shovels: a sequel to "Red Team Blues," about the heroic era of the PC, Tor Books (US), Head of Zeus (UK), February 2025 (https://us.macmillan.com/books/9781250865908/picksandshovels). The Bezzle: a sequel to "Red Team Blues," about prison-tech and other grifts, Tor Books (US), Head of Zeus (UK), February 2024 (the-bezzle.org). "The Lost Cause:" a solarpunk novel of hope in the climate emergency, Tor Books (US), Head of Zeus (UK), November 2023 (http://lost-cause.org). "The Internet Con": A nonfiction book about interoperability and Big Tech (Verso) September 2023 (http://seizethemeansofcomputation.org). Signed copies at Book Soup (https://www.booksoup.com/book/9781804291245). "Red Team Blues": "A grabby, compulsive thriller that will leave you knowing more about how the world works than you did before." Tor Books http://redteamblues.com. "Chokepoint Capitalism: How to Beat Big Tech, Tame Big Content, and Get Artists Paid, with Rebecca Giblin", on how to unrig the markets for creative labor, Beacon Press/Scribe 2022 https://chokepointcapitalism.com Upcoming books (permalink) Canny Valley: A limited edition collection of the collages I create for Pluralistic, self-published, September 2025 Enshittification: Why Everything Suddenly Got Worse and What to Do About It, Farrar, Straus, Giroux, October 7 2025 https://us.macmillan.com/books/9780374619329/enshittification/ Unauthorized Bread: a middle-grades graphic novel adapted from my novella about refugees, toasters and DRM, FirstSecond, 2026 Enshittification, Why Everything Suddenly Got Worse and What to Do About It (the graphic novel), Firstsecond, 2026 The Memex Method, Farrar, Straus, Giroux, 2026 The Reverse-Centaur's Guide to AI, a short book about being a better AI critic, Farrar, Straus and Giroux, 2026 Colophon (permalink) Today's top sources: Alice Taylor, Naked Capitalism (https://www.nakedcapitalism.com/). Currently writing: "The Reverse Centaur's Guide to AI," a short book for Farrar, Straus and Giroux about being an effective AI critic. (1086 words yesterday, 29915 words total). A Little Brother short story about DIY insulin PLANNING This work – excluding any serialized fiction – is licensed under a Creative Commons Attribution 4.0 license. That means you can use it any way you like, including commercially, provided that you attribute it to me, Cory Doctorow, and include a link to pluralistic.net. https://creativecommons.org/licenses/by/4.0/ Quotations and images are not included in this license; they are included either under a limitation or exception to copyright, or on the basis of a separate license. Please exercise caution. How to get Pluralistic: Blog (no ads, tracking, or data-collection): Pluralistic.net Newsletter (no ads, tracking, or data-collection): https://pluralistic.net/plura-list Mastodon (no ads, tracking, or data-collection): https://mamot.fr/@pluralistic Medium (no ads, paywalled): https://doctorow.medium.com/ Twitter (mass-scale, unrestricted, third-party surveillance and advertising): https://twitter.com/doctorow Tumblr (mass-scale, unrestricted, third-party surveillance and advertising): https://mostlysignssomeportents.tumblr.com/tagged/pluralistic "When life gives you SARS, you make sarsaparilla" -Joey "Accordion Guy" DeVilla READ CAREFULLY: By reading this, you agree, on behalf of your employer, to release me from all obligations and waivers arising from any and all NON-NEGOTIATED agreements, licenses, terms-of-service, shrinkwrap, clickwrap, browsewrap, confidentiality, non-disclosure, non-compete and acceptable use policies ("BOGUS AGREEMENTS") that I have entered into with your employer, its partners, licensors, agents and assigns, in perpetuity, without prejudice to my ongoing rights and privileges. You further represent that you have the authority to release me from any BOGUS AGREEMENTS on behalf of your employer. ISSN: 3066-764X

3 days ago 4 votes
Pluralistic: Goodhart's Law (of AI) (11 Aug 2025)

Today's links Goodhart's Law (of AI): When a metric becomes a target, AI can hit it every time. Hey look at this: Delights to delectate. Object permanence: Bill Ayers graphic novel; Foxconn in India; Uber loses $4B; Warren Buffet, monopolist. Upcoming appearances: Where to find me. Recent appearances: Where I've been. Latest books: You keep readin' em, I'll keep writin' 'em. Upcoming books: Like I said, I'll keep writin' 'em. Colophon: All the rest. Goodhart's Law (of AI) (permalink) One way to think about AI's unwelcome intrusion into our lives can be summed up with Goodhardt's Law: "When a measure becomes a target, it ceases to be a good measure": https://en.wikipedia.org/wiki/Goodhart%27s_law Goodhart's Law is a harsh mistress. It's incredibly exciting to discover a new way of measuring aspects of a complex system in a way that lets you understand (and thus control) it. In 1998, Sergey Brin and Larry Page realized that all the links created by everyone who'd ever made a webpage represented a kind of latent map of the value and authority of every website. We could infer that pages that had more links pointing to them were considered more noteworthy than pages that had fewer inbound links. Moreover, we could treat those heavily linked-to pages as authoritative and infer that when they linked to another page, it, too, was likely to be important. This insight, called "PageRank," was behind Google's stunning entry into the search market, which was easily one of the most exciting technological developments of the decade, as the entire web just snapped into place as a useful system for retrieving information that had been created by a vast, uncoordinated army of web-writers, hosted in a distributed system without any central controls. Then came the revenge of Goodhart's Law. Before Google became the dominant mechanism for locating webpages, the only reason for anyone to link to a given page or site was because there was something there they thought you should see. Google aggregated all those "I think you should see this" signals and turned them into a map of the web's relevance and authority. But making a link to a webpage is easy. Once there was another reason to make a link between two web-pages – to garner traffic, which could be converted into money and/or influence – then bad actors made a lot of spurious links between websites. They created linkfarms, they spammed blog comments, they hacked websites for the sole purpose of adding a bunch of human-invisible, Google-scraper-readable links to pages. The metric ("how many links are there to this page?") became a target ("make links to this page") and ceased to be a useful metric. Goodhart's Law is still a plague on Google search quality. "Reputation abuse" is a webcrime committed by venerable sites like Forbes, Fortune and Better Homes and Gardens, who abuse the authority imparted by tons of inbound links accumulated over decades by creating spammy, fake product-review sites stuffed with affiliate links, that Google ranks more highly than real, rigorous review sites because of all that accumulated googlejuice: https://pluralistic.net/2024/05/03/keyword-swarming/#site-reputation-abuse Goodhart's Law is 50 years old, but policymakers are woefully ignorant of it and continue to operate as though it doesn't apply to them. This is especially pronounced when policymakers are determined to Do Something about a public service that has been starved of funding kicked around as a political football to the point where it has degraded and started to outrage the public. When this happens, policymakers are apt to blame public servants – rather than themselves – for this degradation, and then set out to Bring Accountability to those public employees. The NHS did this with ambulance response times, which are very bad, and that fact is, in turn, very bad. The reason ambulance response times suck isn't hard to winkle out: there's not enough money being spent on ambulances, drivers, and medics. But that's not a politically popular conclusion, especially in the UK, which has been under brutal and worsening austerity since the Blair years (don't worry, eventually they'll do enough austerity and things will really turn around, because, as the old saying goes, "Good policymaking consists of doing the same thing over and over and expecting a different outcome)." Instead of blaming inadequate funding for poor ambulance response times, politicians blamed "inefficiency," driven by a poor motivation. So they established a metric: ambulances must arrive within a certain number of minutes (and they set a consequence: massive cuts to any ambulance service that didn't meet the metric). Now, "an ambulance where it's needed within a set amount of time" may sound like a straightforward metric, and it was – retrospectively. As in, we could tell that the ambulance service was in trouble because ambulances were taking half an hour or more to arrive. But prospectively, after that metric became a target, it immediately ceased to be a good metric. That's because ambulance services, faced with the impossible task of improving response times without spending money, started to dispatch ambulance motorbikes that couldn't carry 95% of the stuff needed to respond to a medical emergency, and had no way to get patients back to hospitals. These motorbikes were able to meet the response-time targets…without improving the survival rates of people who summoned ambulances: https://timharford.com/2014/07/underperforming-on-performance/ AI turns out to be a great way to explore all the perverse dimensions of Goodhart's Law. For years, machine learning specialists have struggled with the problem of "reward hacking," in which an AI figures out how to meet some target in a way that blows up the metric it was derived from: https://research.google/blog/bringing-precision-to-the-ai-safety-discussion/ My favorite example of this is the AI-powered Roomba that was programmed to find an efficient path that minimized collisions with furniture, as measured by a forward-facing sensor that sent a signal whenever the Roomba bumped into anything. The Roomba started driving backwards, smashing into all kinds of furniture, but measuring zero collisions, because there was no collision-sensor on its back: https://x.com/smingleigh/status/1060325665671692288 Charlie Stross has observed that corporations are a kind of "slow AI," that engage in endless reward-hacking to accomplish their goals, increasing their profits by finding nominally legal ways to poison the air, cheat their customers and maim their workers: https://memex.craphound.com/2017/12/29/charlie-strosss-ccc-talk-the-future-of-psychotic-ais-can-be-read-in-todays-sociopathic-corporations/ Public services under conditions of austerity are another kind of slow AI. When policymakers demand that a metric be satisfied without delivering any of the budget or resources needed to satisfy it, the public employees downstream of that impossible demand will start reward-hacking and the metric will become a target, and then cease to be a useful metric. Which brings me, at last, to AI in educational contexts. In 2008, George W Bush stepped up the long-running war on education with the No Child Left Behind Act. The right hates public education, for many reasons. Obviously, there's the fact that uneducated people are easier to mislead, which is helpful if you want to get a bunch of turkeys to vote for Christmas ("I love the uneducated" -DJ Trump). Then there's the fact that, since 1954's Brown v Board of Ed, Black and brown kids were legally guaranteed the right to be educated alongside white kids, which makes a large swathe of the right absolutely nuts. Then there was the 1962 Supreme Court decisions that banned prayer in school, leading to bans on teaching Christian doctrine, including nonsense like Young Earth Creationism. Finally, there's the fact that teachers a) belong to unions; and, b) believe in their jobs and fight for the kids they teach. No Child Left Behind was a vicious salvo in the war on teachers, positing the problem with education as a failure of teachers, driven by a combination of poor training and indifference to their students. Under No Child Left Behind, students were subjected to multiple rounds of standardized tests, and teachers with low-performing students had their budgets taken away (after first being offered modest assistance in improving those scores). Some of NCLB's standardized tests represented reasonable metrics: we really do want kids to be able to read and do math and reason and string together coherent thoughts at various points in their schooling. But when these metrics became targets, boy did they stop being useful as metrics. It's impossible to overstate how fucking perverse NCLB was. I once met an elementary school teacher from an incredibly poor school district in Kansas. Many of her students were resettled refugees who didn't speak English; they spoke a language that no one in the school system could speak, and which had no system of writing. They arrived in her classroom unable to speak English and unable to read or write in any language, and no one could speak their language. Obviously, these students performed badly on standardized tests delivered in English (it didn't help that they had to take the tests just months after arriving in the classroom, because the clock started ticking on their first test when they entered the system, which could take half a year to place them in a class). Within a couple years, these schools had had most of their budgets taken away. When the standardized tests rolled around, this teacher would lead her students into the only room in the school with computers – the test taking room. For many of these students, this was the first time they had ever used a computer. She would tell them to do their best and leave the room for an hour, while a well-paid proctor (along with test-taking computers, the only thing NCLB guaranteed funding for) observed them as they tried to figure out how a mouse worked. They would all score zero on the test, and the school would be punished. NCLB was such a failure that it was eventually rescinded (in 2015), but by that time, a new system of standardization had rushed in to fill the gap, the Common Core. Common Core is a set of rigid standardized curriciula – with standardized assessment rubrics – that was, once again, driven by contempt for teachers. The argument for Common Core was that students were failing – not because of falling budgets or No Child Left Behind – but because the unions were "protecting bad teachers," who would then go on to fail students. By taking away discretion from teachers, we could impose "accountability" on them. The absolutely predictable outcome followed Goodhart's Law to a tee: teachers prioritized inculcating students with the skills to pass the standardized tests, and when those test-taking skills crowded out actual learning, learning fell by the wayside. This continues up to the most advanced part of public education, the Advanced Placement courses that students aspiring to college are strongly pressured to take. If Common Core is rigid, AP is brittle to the point of shattering. Anyone who's ever parented a kid through the US secondary school system knows how much time their kids spent learning to hit their marks on standardized assessments, to the exclusion of actual learning, and how soul-suckingly awful this is. Take that staple of the AP assessment rubric: the five-paragraph essay (5PE), bane of students, teachers and parents everywhere: https://www.insidehighered.com/blogs/just-visiting/kill-5-paragraph-essay Speaking as a sometime writing teacher and an internationally bestselling essayist, 5PEs are objectively very bad essays. Their only virtue is that they can be assessed in a totally standard way, so the grade any given 5PE is awarded by any grader is likely to be the same grade it receives when presented to any other grader. Grading an essay is an irreducibly subjective matter, and the only way to create an objective standard for essays is to make the essays unrecognizable as essays. And yet, the 5PE is the heart of assessment for many AP classes, from History to English to Social Studies and beyond. A kid who scores high on any humanities APs will have put endless hours into perfecting this perfectly abominable literary form, mastering a skill that they will never, ever be called upon to use (the top piece of college entrance advice is "don't write your personal essay as a 5PE" and college professors spend the first half of their 101 classes teaching students not to turn in 5PEs). The same goes for many other aspects of AP and Common Core assessment. If you do AP Lit, you'll be required to annotate the literature you read by making a set number of marginal observations on every page of the novels, poems and essays you read. Again, as a literary reviewer, novelist, and nonfiction writer who's written more than 30 books, I have to say, this is a batshit way to learn to analyze and criticize literature. Its sole virtue is that it reduces the qualitative matter of literary analysis to a qualitative target that students can hit and teachers can count. And that's where AI comes in. AI – the ultimate bullshit machine – can produce a better 5PE than any student can, because the point of the 5PE isn't to be intellectually curious or rigorous, it's to produce a standardized output that can be analyzed using a standardized rubric. I've been writing YA novels and doing school visits for long enough to cement my understanding that kids are actually pretty darned clever. They don't graduate from high school thinking that their mastery of the 5PE is in any way good or useful, or that they're learning about literature by making five marginal observations per page when they read a book. Given all this, why wouldn't you ask an AI to do your homework? That homework is already the revenge of Goodhart's Law, a target that has ruined its metric. Your homework performance says nothing useful about your mastery of the subject, so why not let the AI write it. Hell, if you're a smart, motivated kid, then letting the AI write your bullshit 5PEs might give you time to write something good. Teachers aren't to blame here. They have to teach to the test, or they will fail their students (literally, because they will have to assign a failing grade to them, and figuratively, because a student who gets a failing grade will face all kinds of punishments). Teachers' unions – who consistently fight against standardization and in favor of their members discretion to practice their educational skills based on kids' individual needs – are the best hope we have: https://pluralistic.net/2025/03/29/jane-mcalevey/#trump-is-a-scab The right hates teachers and keeps on setting them up to fail. That hatred has no bottom. Take the Republican Texas State Rep Ryan Guillen, whose House Bill 462 will increase the state's school safety budget from $10/student to $100/student, with those additional funds earmarked to buy one armed drone per 200 students (these drones are supplied by a single company that has ties to Guillen): https://dronelife.com/2024/12/08/texas-lawmaker-proposes-drones-for-school-security-a-less-lethal-solution/ Imagine how much Texas schools could do with an extra $90/student/year – how much more usefully that money could be spent if it were turned over to teachers. But instead, Rep Guillen wants to put "AI in schools" in the form of drones equipped with pepper-spray, flash bangs, and "lances" that can be smashed into people at 100mph. The problem with AI in schools isn't that students are using AI to do their homework. It's that schools have been turned into reward-hacking AIs by a system that hates the idea of an educated populace almost as much as it hates the idea of unionized teachers who are empowered to teach our kids. (Image: Cryteria, CC BY 3.0; Lee Haywood, CC BY-SA 2.0; modified) Hey look at this (permalink) Cybertruck Leads Tesla’s Used-Car Collapse https://gizmodo.com/cybertruck-leads-teslas-used-car-collapse-2000641133 Hackers Went Looking for a Backdoor in High-Security Safes—and Now Can Open Them in Seconds https://www.wired.com/story/securam-prologic-safe-lock-backdoor-exploits/ I clustered four Framework Mainboards to test huge LLMs https://www.jeffgeerling.com/blog/2025/i-clustered-four-framework-mainboards-test-huge-llms The Framework Desktop is a beast https://world.hey.com/dhh/the-framework-desktop-is-a-beast-636fb4ff Leaving MAGA https://leavingmaga.org/they-left-maga/steve-vilchez/ Object permanence (permalink) #15yrsago Bill Ayers’s To Teach: The Journey, in Comics, a humanist look at education https://memex.craphound.com/2010/08/10/bill-ayerss-to-teach-the-journey-in-comics-a-humanist-look-at-education/ #10yrsago Kansas officials stonewall mathematician investigating voting machine “sabotage” https://www.kansas.com/news/politics-government/article27951310.html #10yrsago Chinese mega-manufacturers set up factories in India https://web.archive.org/web/20150811043714/https://www.itworld.com/article/2968375/android/foxconn-to-invest-5b-to-set-up-first-of-up-to-12-factories-in-india.html #10yrsago Oracle’s CSO demands an end to customers checking Oracle products for defects https://arstechnica.com/information-technology/2015/08/oracle-security-chief-to-customers-stop-checking-our-code-for-vulnerabilities/ #10yrsago Girl Sex 101: “for EVERYone who wants to bone down with chicks, regardless of your gender/orientation.” https://www.ohjoysextoy.com/girlsex-101/ #10yrsago John Oliver on the brutal state of sex-ed in America https://www.youtube.com/watch?v=L0jQz6jqQS0 #10yrsago Insurance monitoring dashboard devices used by Uber let hackers “cut your brakes” over wireless https://www.wired.com/2015/08/hackers-cut-corvettes-brakes-via-common-car-gadget/ #10yrsago US lobbying for TPP to lock up clinical trial data https://theconversation.com/how-the-battle-over-biologics-helped-stall-the-trans-pacific-partnership-45648 #10yrsago Larry Lessig considers running for the Democratic presidential nomination https://www.youtube.com/watch?v=CaqrQz71bMk #10yrsago Felicia Day’s “You’re Never Weird on the Internet (Almost)” https://memex.craphound.com/2015/08/11/felicia-days-youre-never-weird-on-the-internet-almost/ #10yrsago Overshare: Justin Hall’s biopic about the first social media/blogging https://www.youtube.com/watch?v=AxD4mqFtySQ #5yrsago When you hear "intangibles"… https://pluralistic.net/2020/08/11/nor-glom-of-nit/#capitalists-hate-competition #5yrsago How they're killing the post office https://pluralistic.net/2020/08/11/nor-glom-of-nit/#sos-usps #5yrsago Terra Nullius https://pluralistic.net/2020/08/11/nor-glom-of-nit/#terra-nullius #5yrsago Uber lost $4b in H1/2020 https://pluralistic.net/2020/08/10/folksy-monopolists/#bezzled #5yrsago Warren Buffet, monopolist https://pluralistic.net/2020/08/10/folksy-monopolists/#folksy-monopolists Upcoming appearances (permalink) Ithaca: AD White keynote (Cornell), Sep 12 https://deanoffaculty.cornell.edu/events/keynote-cory-doctorow-professor-at-large/ DC: Enshittification at Politics and Prose, Oct 8 https://politics-prose.com/cory-doctorow-10825 New Orleans: DeepSouthCon63, Oct 10-12, 2025 http://www.contraflowscifi.org/ San Francisco: Enshittification at Public Works (The Booksmith), Oct 20 https://app.gopassage.com/events/doctorow25 Miami: Enshittification at Books & Books, Nov 5 https://www.eventbrite.com/e/an-evening-with-cory-doctorow-tickets-1504647263469 Recent appearances (permalink) Tariffs vs IP Law (Firewalls Don't Stop Dragons) https://www.youtube.com/watch?v=LFABFe-5-uQ ORG at 20: In conversation with Maria Farrell https://www.youtube.com/watch?v=M9H2An_D6io Why aren't we controlling our own tech? (Co-Op Congress) https://www.youtube.com/live/GLrDwHgeCy4?si=NUWxPphk0FS_3g9J&t=4409 Latest books (permalink) Picks and Shovels: a sequel to "Red Team Blues," about the heroic era of the PC, Tor Books (US), Head of Zeus (UK), February 2025 (https://us.macmillan.com/books/9781250865908/picksandshovels). The Bezzle: a sequel to "Red Team Blues," about prison-tech and other grifts, Tor Books (US), Head of Zeus (UK), February 2024 (the-bezzle.org). "The Lost Cause:" a solarpunk novel of hope in the climate emergency, Tor Books (US), Head of Zeus (UK), November 2023 (http://lost-cause.org). "The Internet Con": A nonfiction book about interoperability and Big Tech (Verso) September 2023 (http://seizethemeansofcomputation.org). Signed copies at Book Soup (https://www.booksoup.com/book/9781804291245). "Red Team Blues": "A grabby, compulsive thriller that will leave you knowing more about how the world works than you did before." Tor Books http://redteamblues.com. "Chokepoint Capitalism: How to Beat Big Tech, Tame Big Content, and Get Artists Paid, with Rebecca Giblin", on how to unrig the markets for creative labor, Beacon Press/Scribe 2022 https://chokepointcapitalism.com Upcoming books (permalink) Canny Valley: A limited edition collection of the collages I create for Pluralistic, self-published, September 2025 Enshittification: Why Everything Suddenly Got Worse and What to Do About It, Farrar, Straus, Giroux, October 7 2025 https://us.macmillan.com/books/9780374619329/enshittification/ Unauthorized Bread: a middle-grades graphic novel adapted from my novella about refugees, toasters and DRM, FirstSecond, 2026 Enshittification, Why Everything Suddenly Got Worse and What to Do About It (the graphic novel), Firstsecond, 2026 The Memex Method, Farrar, Straus, Giroux, 2026 The Reverse-Centaur's Guide to AI, a short book about being a better AI critic, Farrar, Straus and Giroux, 2026 Colophon (permalink) Today's top sources: Currently writing: "The Reverse Centaur's Guide to AI," a short book for Farrar, Straus and Giroux about being an effective AI critic. (1076 words yesterday, 27803 words total). A Little Brother short story about DIY insulin PLANNING This work – excluding any serialized fiction – is licensed under a Creative Commons Attribution 4.0 license. That means you can use it any way you like, including commercially, provided that you attribute it to me, Cory Doctorow, and include a link to pluralistic.net. https://creativecommons.org/licenses/by/4.0/ Quotations and images are not included in this license; they are included either under a limitation or exception to copyright, or on the basis of a separate license. Please exercise caution. How to get Pluralistic: Blog (no ads, tracking, or data-collection): Pluralistic.net Newsletter (no ads, tracking, or data-collection): https://pluralistic.net/plura-list Mastodon (no ads, tracking, or data-collection): https://mamot.fr/@pluralistic Medium (no ads, paywalled): https://doctorow.medium.com/ Twitter (mass-scale, unrestricted, third-party surveillance and advertising): https://twitter.com/doctorow Tumblr (mass-scale, unrestricted, third-party surveillance and advertising): https://mostlysignssomeportents.tumblr.com/tagged/pluralistic "When life gives you SARS, you make sarsaparilla" -Joey "Accordion Guy" DeVilla READ CAREFULLY: By reading this, you agree, on behalf of your employer, to release me from all obligations and waivers arising from any and all NON-NEGOTIATED agreements, licenses, terms-of-service, shrinkwrap, clickwrap, browsewrap, confidentiality, non-disclosure, non-compete and acceptable use policies ("BOGUS AGREEMENTS") that I have entered into with your employer, its partners, licensors, agents and assigns, in perpetuity, without prejudice to my ongoing rights and privileges. You further represent that you have the authority to release me from any BOGUS AGREEMENTS on behalf of your employer. ISSN: 3066-764X

5 days ago 5 votes
Pluralistic: Millionaire on billionaire violence (10 Aug 2025)

Today's links Millionaire on billionaire violence: Let them fight. Hey look at this: Delights to delectate. Object permanence: Private equity vs investors; French teens who fought Nazis Upcoming appearances: Where to find me. Recent appearances: Where I've been. Latest books: You keep readin' em, I'll keep writin' 'em. Upcoming books: Like I said, I'll keep writin' 'em. Colophon: All the rest. Millionaire on billionaire violence (permalink) For the past year, I've been increasingly fascinated by a political mystery: how has antitrust enforcement become a global phenomenon after spending 40-years in a billionaire-induced coma? https://pluralistic.net/2025/06/28/mamdani/#trustbusting Political scientists will tell you that policies that billionaires hate will not ever be enacted by politicians, no matter how popular they are among the public: https://www.cambridge.org/core/journals/perspectives-on-politics/article/testing-theories-of-american-politics-elites-interest-groups-and-average-citizens/62327F513959D0A304D4893B382B992B And yet, all around the world – the US (under Trump I, Biden and Trump II), Canada, the UK, the EU, Japan, South Korea, Australia, even China – governments have done more on antitrust over the past couple years than over the past four decades. Where is this coming from? My working theory basically boiled down to "enough is enough" – AKA Stein's Law: "Anything that can't go on forever eventually stops." As in: people are just so pissed off with corporate power that politicians are finally acting to curb it. But I was never very satisfied with this. There's lots of stuff that the public is furious about, which politicians aren't acting on, from climate change to taxing billionaires. Why antitrust and not all that stuff? https://pluralistic.net/2025/08/07/the-people-no-2/#water-flowing-uphill I've been mulling this over, and I got to thinking about a low-key disagreement I used to have with comrades in the digital human rights world, just before all the antitrust stuff really kicked off: https://memex.craphound.com/2019/06/04/why-is-there-so-much-antitrust-energy-for-big-tech-but-not-for-big-telco/ Back then, people on the same side as the barricades as me were deeply suspicious of antitrust. They thought that the bubbling policy revival for antitrust was a way for phone and cable companies to enlist the government to go after their adversaries in the tech world, against whom they were (badly) losing the Net Neutrality fight: https://www.techdirt.com/2019/06/04/if-big-tech-is-huge-antitrust-problem-why-are-we-ignoring-telecom/ Back then, my thesis was, Sure, maybe Big Telco is pushing for antitrust to target Big Tech, but once antitrust arises from its long slumber, it will turn on telcos – and every other concentrated industry. Tldr: I'm pretty sure that's what's happening. You see, one part of the antitrust battle boils down to a fight between rentiers and capitalists. The largest tech (and other) companies are primarily rentiers – entities that make money by owning things, rather than doing things. They make rents, at the expense of other companies' profits: https://pluralistic.net/2023/09/28/cloudalists/#cloud-capital Companies like Epic (makers of Fortnite) want to sell your kids skins and mods for their in-game avatars without giving Apple and Google 30% of every dollar that brings in, and they've got a lot of money to make that desire real: https://cdn.ca9.uscourts.gov/datastore/opinions/2025/07/31/24-6256.pdf This is millionaire-on-billionaire violence. It's gigantic corporations going to war against galactic-scale corporations. These pro-antitrust companies are the inheritors of the telcos' mantle, powerful belligerents in a Extremely Large Tech war on Big Tech. There are a lot of these large companies and they're sick of being subjected to a 30% economy-wide App Tax on all the payments they receive in-app: https://pluralistic.net/2025/05/01/its-not-the-crime/#its-the-coverup Let me be clear: I'm not saying that the only reason we're getting muscular, global anti-monopoly action is that slightly smaller corporations (who universally aspire to acquiring monopolies of their own) are fighting for their own self-interest. What I'm saying is that the coalition of everyday people who've had their lives ruined by monopolists and corporations that are stuck paying the app tax (and the 51% tax that Google/Meta take out of every ad-tech dollar, the 45-51% Amazon takes out of every e-commerce dollar, and the sums that Tiktok, Twitter and Meta extort from business customers to "boost" in order to reach their own followers) is, in combination, sufficient to awaken the antitrust giant. Members of the public are critical to this fight – we're the ones who tip the scales from one side to the other. That's why rentiers go to such great lengths to convince policymakers that they have the public on their side, whether that's Amazon trotting out "small businesses" that depend on (and get viciously fucked by) Amazon's ecommerce platform: https://thehill.com/opinion/finance/4760357-amazon-basics-antitrust/ Or leaders of groups like the NAACP who've been bribed to front for the phone companies and cable operators in the fight against Net Neutrality: https://www.techdirt.com/2017/12/19/naacp-fought-net-neutrality-until-last-week-now-suddenly-supports-idea/ All other things being equal, policymakers will simply side the deepest-pocketed, most unified corporate lobby in any fight (which is how the media companies won the Napster Wars). But when the public and one side of the corporate world is one side of an issue, policymakers understand that siding with them will get them votes and money, which is much better than just getting money (which is how we won the SOPA/PIPA fight): https://www.eff.org/deeplinks/2017/01/everyone-made-themselves-hero-remembering-aaron-swartz We can really see this in the EU, where the new Digital Markets Act and Digital Services Act are going after Big Tech with both barrels, with the enthusiastic support of the EU's tech industry. That's because the EU's tech industry barely registers when placed alongside of US Big Tech, which has sucked up nearly 100% of the market oxygen by cheating (on privacy, taxes, wages, etc). Despite the farcical efforts of US tech shills like Nick Clegg (former UK Deputy Prime Minister turned Meta shill, who insisted that Facebook was "defending European cyberspace from Chinese communism"), everyone knew that US tech companies were extracting (billions of euros and the personal information of 500m Europeans) from the bloc and siphoning it off to America, after first cleansing it of any tax obligations by laundering it through Ireland and the Netherlands. If Europe still had thriving tech "national champions" – Olivetti, Nokia, Deutsche Telekom, Ericsson, etc – these companies might plausibly mount an opposition to muscular tech regulation in the EU. But these companies were crippled by predatory capital and then mostly absorbed into US Big Tech (or ground into dust). Back when I was having a friendly blog-argument with my comrades about whether tech antitrust was a Big Telco plot, I averred that it didn't really matter, because Big Tech really was terrible, and because once we'd roused antitrust enforcement from its 40-year slumber, we could wrest control of it from the telecoms monopolists who'd helped us dig it up and reanimate it. In other words: the war against the corruption brought about by corporate concentration is hard to kindle, but it's even harder to extinguish. The corporations that are fanning the flames are focused – as corporations inevitably are, to the detriment of our planet and politics – on the short term gains they stand to reap from their actions. But we can – we must – take the long view. Smashing corporate power is the key to destroying fascism and ensuring our species' survival, so our focus needs to be on building the blaze, and if some of those adding fuel to the fire happen to aspire to building monopolies of their own, then our job is to give 'em a nasty surprise when that day comes. Hey look at this (permalink) Free 3D models of every D&D monster https://www.patreon.com/cw/mz4250 Enough is enough—I dumped Google’s worsening search for Kagi https://arstechnica.com/gadgets/2025/08/enough-is-enough-i-dumped-googles-worsening-search-for-kagi/ AI disagreements https://www.bloodinthemachine.com/p/ai-disagreements An Abundance of Sleaze: How a Beltway Brain Trust Sells Oligarchy to Liberals https://www.thebignewsletter.com/p/an-abundance-of-sleaze-how-a-beltway Fintech Dystopia: Won’t somebody please think of the innovation? https://fintechdystopia.com/chapters/chapter6.html Object permanence (permalink) #15yrsago The Last Musketeer: whimsical, dreamlike, delightful comic https://memex.craphound.com/2010/08/08/the-last-musketeer-whimsical-dreamlike-delightful-comic/ #15yrsago Resistance: YA comic about the kids who served in the French resistance https://memex.craphound.com/2010/08/09/resistance-ya-comic-about-the-kids-who-served-in-the-french-resistance/ #5yrsago Test-proctoring software worsens systemic bias https://pluralistic.net/2020/08/09/just-dont-have-a-face/#algorithmic-bias #5yrsago Commercial real-estate's looming collapse https://pluralistic.net/2020/08/09/just-dont-have-a-face/#systemic-risk #1yrago "Carbon neutral" Bitcoin operation founded by coal plant operator wasn't actually carbon neutral https://pluralistic.net/2024/08/09/terawulf/#hunterbrook #1yrago Private equity rips off its investors, too https://pluralistic.net/2024/08/08/sucker-at-the-table/#clucks-definance Upcoming appearances (permalink) Ithaca: AD White keynote (Cornell), Sep 12 https://deanoffaculty.cornell.edu/events/keynote-cory-doctorow-professor-at-large/ DC: Enshittification at Politics and Prose, Oct 8 https://politics-prose.com/cory-doctorow-10825 New Orleans: DeepSouthCon63, Oct 10-12, 2025 http://www.contraflowscifi.org/ San Francisco: Enshittification at Public Works (The Booksmith), Oct 20 https://app.gopassage.com/events/doctorow25 Miami: Enshittification at Books & Books, Nov 5 https://www.eventbrite.com/e/an-evening-with-cory-doctorow-tickets-1504647263469 Recent appearances (permalink) Tariffs vs IP Law (Firewalls Don't Stop Dragons) https://www.youtube.com/watch?v=LFABFe-5-uQ ORG at 20: In conversation with Maria Farrell https://www.youtube.com/watch?v=M9H2An_D6io Why aren't we controlling our own tech? (Co-Op Congress) https://www.youtube.com/live/GLrDwHgeCy4?si=NUWxPphk0FS_3g9J&t=4409 Latest books (permalink) Picks and Shovels: a sequel to "Red Team Blues," about the heroic era of the PC, Tor Books (US), Head of Zeus (UK), February 2025 (https://us.macmillan.com/books/9781250865908/picksandshovels). The Bezzle: a sequel to "Red Team Blues," about prison-tech and other grifts, Tor Books (US), Head of Zeus (UK), February 2024 (the-bezzle.org). "The Lost Cause:" a solarpunk novel of hope in the climate emergency, Tor Books (US), Head of Zeus (UK), November 2023 (http://lost-cause.org). "The Internet Con": A nonfiction book about interoperability and Big Tech (Verso) September 2023 (http://seizethemeansofcomputation.org). Signed copies at Book Soup (https://www.booksoup.com/book/9781804291245). "Red Team Blues": "A grabby, compulsive thriller that will leave you knowing more about how the world works than you did before." Tor Books http://redteamblues.com. "Chokepoint Capitalism: How to Beat Big Tech, Tame Big Content, and Get Artists Paid, with Rebecca Giblin", on how to unrig the markets for creative labor, Beacon Press/Scribe 2022 https://chokepointcapitalism.com Upcoming books (permalink) Canny Valley: A limited edition collection of the collages I create for Pluralistic, self-published, September 2025 Enshittification: Why Everything Suddenly Got Worse and What to Do About It, Farrar, Straus, Giroux, October 7 2025 https://us.macmillan.com/books/9780374619329/enshittification/ Unauthorized Bread: a middle-grades graphic novel adapted from my novella about refugees, toasters and DRM, FirstSecond, 2026 Enshittification, Why Everything Suddenly Got Worse and What to Do About It (the graphic novel), Firstsecond, 2026 The Memex Method, Farrar, Straus, Giroux, 2026 The Reverse-Centaur's Guide to AI, a short book about being a better AI critic, Farrar, Straus and Giroux, 2026 Colophon (permalink) Today's top sources: Currently writing: "The Reverse Centaur's Guide to AI," a short book for Farrar, Straus and Giroux about being an effective AI critic. (1031 words yesterday, 25719 words total). A Little Brother short story about DIY insulin PLANNING This work – excluding any serialized fiction – is licensed under a Creative Commons Attribution 4.0 license. That means you can use it any way you like, including commercially, provided that you attribute it to me, Cory Doctorow, and include a link to pluralistic.net. https://creativecommons.org/licenses/by/4.0/ Quotations and images are not included in this license; they are included either under a limitation or exception to copyright, or on the basis of a separate license. Please exercise caution. How to get Pluralistic: Blog (no ads, tracking, or data-collection): Pluralistic.net Newsletter (no ads, tracking, or data-collection): https://pluralistic.net/plura-list Mastodon (no ads, tracking, or data-collection): https://mamot.fr/@pluralistic Medium (no ads, paywalled): https://doctorow.medium.com/ Twitter (mass-scale, unrestricted, third-party surveillance and advertising): https://twitter.com/doctorow Tumblr (mass-scale, unrestricted, third-party surveillance and advertising): https://mostlysignssomeportents.tumblr.com/tagged/pluralistic "When life gives you SARS, you make sarsaparilla" -Joey "Accordion Guy" DeVilla READ CAREFULLY: By reading this, you agree, on behalf of your employer, to release me from all obligations and waivers arising from any and all NON-NEGOTIATED agreements, licenses, terms-of-service, shrinkwrap, clickwrap, browsewrap, confidentiality, non-disclosure, non-compete and acceptable use policies ("BOGUS AGREEMENTS") that I have entered into with your employer, its partners, licensors, agents and assigns, in perpetuity, without prejudice to my ongoing rights and privileges. You further represent that you have the authority to release me from any BOGUS AGREEMENTS on behalf of your employer. ISSN: 3066-764X

a week ago 7 votes

More in AI

AI Roundup 131: GPT-5's rocky rollout

August 15, 2025.

13 hours ago 3 votes
ML for SWEs 63: Engineers just got a whole lot more important

Welcome to machine learning for software engineers.

3 days ago 7 votes
Pluralistic: Goodhart's Law (of AI) (11 Aug 2025)

Today's links Goodhart's Law (of AI): When a metric becomes a target, AI can hit it every time. Hey look at this: Delights to delectate. Object permanence: Bill Ayers graphic novel; Foxconn in India; Uber loses $4B; Warren Buffet, monopolist. Upcoming appearances: Where to find me. Recent appearances: Where I've been. Latest books: You keep readin' em, I'll keep writin' 'em. Upcoming books: Like I said, I'll keep writin' 'em. Colophon: All the rest. Goodhart's Law (of AI) (permalink) One way to think about AI's unwelcome intrusion into our lives can be summed up with Goodhardt's Law: "When a measure becomes a target, it ceases to be a good measure": https://en.wikipedia.org/wiki/Goodhart%27s_law Goodhart's Law is a harsh mistress. It's incredibly exciting to discover a new way of measuring aspects of a complex system in a way that lets you understand (and thus control) it. In 1998, Sergey Brin and Larry Page realized that all the links created by everyone who'd ever made a webpage represented a kind of latent map of the value and authority of every website. We could infer that pages that had more links pointing to them were considered more noteworthy than pages that had fewer inbound links. Moreover, we could treat those heavily linked-to pages as authoritative and infer that when they linked to another page, it, too, was likely to be important. This insight, called "PageRank," was behind Google's stunning entry into the search market, which was easily one of the most exciting technological developments of the decade, as the entire web just snapped into place as a useful system for retrieving information that had been created by a vast, uncoordinated army of web-writers, hosted in a distributed system without any central controls. Then came the revenge of Goodhart's Law. Before Google became the dominant mechanism for locating webpages, the only reason for anyone to link to a given page or site was because there was something there they thought you should see. Google aggregated all those "I think you should see this" signals and turned them into a map of the web's relevance and authority. But making a link to a webpage is easy. Once there was another reason to make a link between two web-pages – to garner traffic, which could be converted into money and/or influence – then bad actors made a lot of spurious links between websites. They created linkfarms, they spammed blog comments, they hacked websites for the sole purpose of adding a bunch of human-invisible, Google-scraper-readable links to pages. The metric ("how many links are there to this page?") became a target ("make links to this page") and ceased to be a useful metric. Goodhart's Law is still a plague on Google search quality. "Reputation abuse" is a webcrime committed by venerable sites like Forbes, Fortune and Better Homes and Gardens, who abuse the authority imparted by tons of inbound links accumulated over decades by creating spammy, fake product-review sites stuffed with affiliate links, that Google ranks more highly than real, rigorous review sites because of all that accumulated googlejuice: https://pluralistic.net/2024/05/03/keyword-swarming/#site-reputation-abuse Goodhart's Law is 50 years old, but policymakers are woefully ignorant of it and continue to operate as though it doesn't apply to them. This is especially pronounced when policymakers are determined to Do Something about a public service that has been starved of funding kicked around as a political football to the point where it has degraded and started to outrage the public. When this happens, policymakers are apt to blame public servants – rather than themselves – for this degradation, and then set out to Bring Accountability to those public employees. The NHS did this with ambulance response times, which are very bad, and that fact is, in turn, very bad. The reason ambulance response times suck isn't hard to winkle out: there's not enough money being spent on ambulances, drivers, and medics. But that's not a politically popular conclusion, especially in the UK, which has been under brutal and worsening austerity since the Blair years (don't worry, eventually they'll do enough austerity and things will really turn around, because, as the old saying goes, "Good policymaking consists of doing the same thing over and over and expecting a different outcome)." Instead of blaming inadequate funding for poor ambulance response times, politicians blamed "inefficiency," driven by a poor motivation. So they established a metric: ambulances must arrive within a certain number of minutes (and they set a consequence: massive cuts to any ambulance service that didn't meet the metric). Now, "an ambulance where it's needed within a set amount of time" may sound like a straightforward metric, and it was – retrospectively. As in, we could tell that the ambulance service was in trouble because ambulances were taking half an hour or more to arrive. But prospectively, after that metric became a target, it immediately ceased to be a good metric. That's because ambulance services, faced with the impossible task of improving response times without spending money, started to dispatch ambulance motorbikes that couldn't carry 95% of the stuff needed to respond to a medical emergency, and had no way to get patients back to hospitals. These motorbikes were able to meet the response-time targets…without improving the survival rates of people who summoned ambulances: https://timharford.com/2014/07/underperforming-on-performance/ AI turns out to be a great way to explore all the perverse dimensions of Goodhart's Law. For years, machine learning specialists have struggled with the problem of "reward hacking," in which an AI figures out how to meet some target in a way that blows up the metric it was derived from: https://research.google/blog/bringing-precision-to-the-ai-safety-discussion/ My favorite example of this is the AI-powered Roomba that was programmed to find an efficient path that minimized collisions with furniture, as measured by a forward-facing sensor that sent a signal whenever the Roomba bumped into anything. The Roomba started driving backwards, smashing into all kinds of furniture, but measuring zero collisions, because there was no collision-sensor on its back: https://x.com/smingleigh/status/1060325665671692288 Charlie Stross has observed that corporations are a kind of "slow AI," that engage in endless reward-hacking to accomplish their goals, increasing their profits by finding nominally legal ways to poison the air, cheat their customers and maim their workers: https://memex.craphound.com/2017/12/29/charlie-strosss-ccc-talk-the-future-of-psychotic-ais-can-be-read-in-todays-sociopathic-corporations/ Public services under conditions of austerity are another kind of slow AI. When policymakers demand that a metric be satisfied without delivering any of the budget or resources needed to satisfy it, the public employees downstream of that impossible demand will start reward-hacking and the metric will become a target, and then cease to be a useful metric. Which brings me, at last, to AI in educational contexts. In 2008, George W Bush stepped up the long-running war on education with the No Child Left Behind Act. The right hates public education, for many reasons. Obviously, there's the fact that uneducated people are easier to mislead, which is helpful if you want to get a bunch of turkeys to vote for Christmas ("I love the uneducated" -DJ Trump). Then there's the fact that, since 1954's Brown v Board of Ed, Black and brown kids were legally guaranteed the right to be educated alongside white kids, which makes a large swathe of the right absolutely nuts. Then there was the 1962 Supreme Court decisions that banned prayer in school, leading to bans on teaching Christian doctrine, including nonsense like Young Earth Creationism. Finally, there's the fact that teachers a) belong to unions; and, b) believe in their jobs and fight for the kids they teach. No Child Left Behind was a vicious salvo in the war on teachers, positing the problem with education as a failure of teachers, driven by a combination of poor training and indifference to their students. Under No Child Left Behind, students were subjected to multiple rounds of standardized tests, and teachers with low-performing students had their budgets taken away (after first being offered modest assistance in improving those scores). Some of NCLB's standardized tests represented reasonable metrics: we really do want kids to be able to read and do math and reason and string together coherent thoughts at various points in their schooling. But when these metrics became targets, boy did they stop being useful as metrics. It's impossible to overstate how fucking perverse NCLB was. I once met an elementary school teacher from an incredibly poor school district in Kansas. Many of her students were resettled refugees who didn't speak English; they spoke a language that no one in the school system could speak, and which had no system of writing. They arrived in her classroom unable to speak English and unable to read or write in any language, and no one could speak their language. Obviously, these students performed badly on standardized tests delivered in English (it didn't help that they had to take the tests just months after arriving in the classroom, because the clock started ticking on their first test when they entered the system, which could take half a year to place them in a class). Within a couple years, these schools had had most of their budgets taken away. When the standardized tests rolled around, this teacher would lead her students into the only room in the school with computers – the test taking room. For many of these students, this was the first time they had ever used a computer. She would tell them to do their best and leave the room for an hour, while a well-paid proctor (along with test-taking computers, the only thing NCLB guaranteed funding for) observed them as they tried to figure out how a mouse worked. They would all score zero on the test, and the school would be punished. NCLB was such a failure that it was eventually rescinded (in 2015), but by that time, a new system of standardization had rushed in to fill the gap, the Common Core. Common Core is a set of rigid standardized curriciula – with standardized assessment rubrics – that was, once again, driven by contempt for teachers. The argument for Common Core was that students were failing – not because of falling budgets or No Child Left Behind – but because the unions were "protecting bad teachers," who would then go on to fail students. By taking away discretion from teachers, we could impose "accountability" on them. The absolutely predictable outcome followed Goodhart's Law to a tee: teachers prioritized inculcating students with the skills to pass the standardized tests, and when those test-taking skills crowded out actual learning, learning fell by the wayside. This continues up to the most advanced part of public education, the Advanced Placement courses that students aspiring to college are strongly pressured to take. If Common Core is rigid, AP is brittle to the point of shattering. Anyone who's ever parented a kid through the US secondary school system knows how much time their kids spent learning to hit their marks on standardized assessments, to the exclusion of actual learning, and how soul-suckingly awful this is. Take that staple of the AP assessment rubric: the five-paragraph essay (5PE), bane of students, teachers and parents everywhere: https://www.insidehighered.com/blogs/just-visiting/kill-5-paragraph-essay Speaking as a sometime writing teacher and an internationally bestselling essayist, 5PEs are objectively very bad essays. Their only virtue is that they can be assessed in a totally standard way, so the grade any given 5PE is awarded by any grader is likely to be the same grade it receives when presented to any other grader. Grading an essay is an irreducibly subjective matter, and the only way to create an objective standard for essays is to make the essays unrecognizable as essays. And yet, the 5PE is the heart of assessment for many AP classes, from History to English to Social Studies and beyond. A kid who scores high on any humanities APs will have put endless hours into perfecting this perfectly abominable literary form, mastering a skill that they will never, ever be called upon to use (the top piece of college entrance advice is "don't write your personal essay as a 5PE" and college professors spend the first half of their 101 classes teaching students not to turn in 5PEs). The same goes for many other aspects of AP and Common Core assessment. If you do AP Lit, you'll be required to annotate the literature you read by making a set number of marginal observations on every page of the novels, poems and essays you read. Again, as a literary reviewer, novelist, and nonfiction writer who's written more than 30 books, I have to say, this is a batshit way to learn to analyze and criticize literature. Its sole virtue is that it reduces the qualitative matter of literary analysis to a qualitative target that students can hit and teachers can count. And that's where AI comes in. AI – the ultimate bullshit machine – can produce a better 5PE than any student can, because the point of the 5PE isn't to be intellectually curious or rigorous, it's to produce a standardized output that can be analyzed using a standardized rubric. I've been writing YA novels and doing school visits for long enough to cement my understanding that kids are actually pretty darned clever. They don't graduate from high school thinking that their mastery of the 5PE is in any way good or useful, or that they're learning about literature by making five marginal observations per page when they read a book. Given all this, why wouldn't you ask an AI to do your homework? That homework is already the revenge of Goodhart's Law, a target that has ruined its metric. Your homework performance says nothing useful about your mastery of the subject, so why not let the AI write it. Hell, if you're a smart, motivated kid, then letting the AI write your bullshit 5PEs might give you time to write something good. Teachers aren't to blame here. They have to teach to the test, or they will fail their students (literally, because they will have to assign a failing grade to them, and figuratively, because a student who gets a failing grade will face all kinds of punishments). Teachers' unions – who consistently fight against standardization and in favor of their members discretion to practice their educational skills based on kids' individual needs – are the best hope we have: https://pluralistic.net/2025/03/29/jane-mcalevey/#trump-is-a-scab The right hates teachers and keeps on setting them up to fail. That hatred has no bottom. Take the Republican Texas State Rep Ryan Guillen, whose House Bill 462 will increase the state's school safety budget from $10/student to $100/student, with those additional funds earmarked to buy one armed drone per 200 students (these drones are supplied by a single company that has ties to Guillen): https://dronelife.com/2024/12/08/texas-lawmaker-proposes-drones-for-school-security-a-less-lethal-solution/ Imagine how much Texas schools could do with an extra $90/student/year – how much more usefully that money could be spent if it were turned over to teachers. But instead, Rep Guillen wants to put "AI in schools" in the form of drones equipped with pepper-spray, flash bangs, and "lances" that can be smashed into people at 100mph. The problem with AI in schools isn't that students are using AI to do their homework. It's that schools have been turned into reward-hacking AIs by a system that hates the idea of an educated populace almost as much as it hates the idea of unionized teachers who are empowered to teach our kids. (Image: Cryteria, CC BY 3.0; Lee Haywood, CC BY-SA 2.0; modified) Hey look at this (permalink) Cybertruck Leads Tesla’s Used-Car Collapse https://gizmodo.com/cybertruck-leads-teslas-used-car-collapse-2000641133 Hackers Went Looking for a Backdoor in High-Security Safes—and Now Can Open Them in Seconds https://www.wired.com/story/securam-prologic-safe-lock-backdoor-exploits/ I clustered four Framework Mainboards to test huge LLMs https://www.jeffgeerling.com/blog/2025/i-clustered-four-framework-mainboards-test-huge-llms The Framework Desktop is a beast https://world.hey.com/dhh/the-framework-desktop-is-a-beast-636fb4ff Leaving MAGA https://leavingmaga.org/they-left-maga/steve-vilchez/ Object permanence (permalink) #15yrsago Bill Ayers’s To Teach: The Journey, in Comics, a humanist look at education https://memex.craphound.com/2010/08/10/bill-ayerss-to-teach-the-journey-in-comics-a-humanist-look-at-education/ #10yrsago Kansas officials stonewall mathematician investigating voting machine “sabotage” https://www.kansas.com/news/politics-government/article27951310.html #10yrsago Chinese mega-manufacturers set up factories in India https://web.archive.org/web/20150811043714/https://www.itworld.com/article/2968375/android/foxconn-to-invest-5b-to-set-up-first-of-up-to-12-factories-in-india.html #10yrsago Oracle’s CSO demands an end to customers checking Oracle products for defects https://arstechnica.com/information-technology/2015/08/oracle-security-chief-to-customers-stop-checking-our-code-for-vulnerabilities/ #10yrsago Girl Sex 101: “for EVERYone who wants to bone down with chicks, regardless of your gender/orientation.” https://www.ohjoysextoy.com/girlsex-101/ #10yrsago John Oliver on the brutal state of sex-ed in America https://www.youtube.com/watch?v=L0jQz6jqQS0 #10yrsago Insurance monitoring dashboard devices used by Uber let hackers “cut your brakes” over wireless https://www.wired.com/2015/08/hackers-cut-corvettes-brakes-via-common-car-gadget/ #10yrsago US lobbying for TPP to lock up clinical trial data https://theconversation.com/how-the-battle-over-biologics-helped-stall-the-trans-pacific-partnership-45648 #10yrsago Larry Lessig considers running for the Democratic presidential nomination https://www.youtube.com/watch?v=CaqrQz71bMk #10yrsago Felicia Day’s “You’re Never Weird on the Internet (Almost)” https://memex.craphound.com/2015/08/11/felicia-days-youre-never-weird-on-the-internet-almost/ #10yrsago Overshare: Justin Hall’s biopic about the first social media/blogging https://www.youtube.com/watch?v=AxD4mqFtySQ #5yrsago When you hear "intangibles"… https://pluralistic.net/2020/08/11/nor-glom-of-nit/#capitalists-hate-competition #5yrsago How they're killing the post office https://pluralistic.net/2020/08/11/nor-glom-of-nit/#sos-usps #5yrsago Terra Nullius https://pluralistic.net/2020/08/11/nor-glom-of-nit/#terra-nullius #5yrsago Uber lost $4b in H1/2020 https://pluralistic.net/2020/08/10/folksy-monopolists/#bezzled #5yrsago Warren Buffet, monopolist https://pluralistic.net/2020/08/10/folksy-monopolists/#folksy-monopolists Upcoming appearances (permalink) Ithaca: AD White keynote (Cornell), Sep 12 https://deanoffaculty.cornell.edu/events/keynote-cory-doctorow-professor-at-large/ DC: Enshittification at Politics and Prose, Oct 8 https://politics-prose.com/cory-doctorow-10825 New Orleans: DeepSouthCon63, Oct 10-12, 2025 http://www.contraflowscifi.org/ San Francisco: Enshittification at Public Works (The Booksmith), Oct 20 https://app.gopassage.com/events/doctorow25 Miami: Enshittification at Books & Books, Nov 5 https://www.eventbrite.com/e/an-evening-with-cory-doctorow-tickets-1504647263469 Recent appearances (permalink) Tariffs vs IP Law (Firewalls Don't Stop Dragons) https://www.youtube.com/watch?v=LFABFe-5-uQ ORG at 20: In conversation with Maria Farrell https://www.youtube.com/watch?v=M9H2An_D6io Why aren't we controlling our own tech? (Co-Op Congress) https://www.youtube.com/live/GLrDwHgeCy4?si=NUWxPphk0FS_3g9J&t=4409 Latest books (permalink) Picks and Shovels: a sequel to "Red Team Blues," about the heroic era of the PC, Tor Books (US), Head of Zeus (UK), February 2025 (https://us.macmillan.com/books/9781250865908/picksandshovels). The Bezzle: a sequel to "Red Team Blues," about prison-tech and other grifts, Tor Books (US), Head of Zeus (UK), February 2024 (the-bezzle.org). "The Lost Cause:" a solarpunk novel of hope in the climate emergency, Tor Books (US), Head of Zeus (UK), November 2023 (http://lost-cause.org). "The Internet Con": A nonfiction book about interoperability and Big Tech (Verso) September 2023 (http://seizethemeansofcomputation.org). Signed copies at Book Soup (https://www.booksoup.com/book/9781804291245). "Red Team Blues": "A grabby, compulsive thriller that will leave you knowing more about how the world works than you did before." Tor Books http://redteamblues.com. "Chokepoint Capitalism: How to Beat Big Tech, Tame Big Content, and Get Artists Paid, with Rebecca Giblin", on how to unrig the markets for creative labor, Beacon Press/Scribe 2022 https://chokepointcapitalism.com Upcoming books (permalink) Canny Valley: A limited edition collection of the collages I create for Pluralistic, self-published, September 2025 Enshittification: Why Everything Suddenly Got Worse and What to Do About It, Farrar, Straus, Giroux, October 7 2025 https://us.macmillan.com/books/9780374619329/enshittification/ Unauthorized Bread: a middle-grades graphic novel adapted from my novella about refugees, toasters and DRM, FirstSecond, 2026 Enshittification, Why Everything Suddenly Got Worse and What to Do About It (the graphic novel), Firstsecond, 2026 The Memex Method, Farrar, Straus, Giroux, 2026 The Reverse-Centaur's Guide to AI, a short book about being a better AI critic, Farrar, Straus and Giroux, 2026 Colophon (permalink) Today's top sources: Currently writing: "The Reverse Centaur's Guide to AI," a short book for Farrar, Straus and Giroux about being an effective AI critic. (1076 words yesterday, 27803 words total). A Little Brother short story about DIY insulin PLANNING This work – excluding any serialized fiction – is licensed under a Creative Commons Attribution 4.0 license. That means you can use it any way you like, including commercially, provided that you attribute it to me, Cory Doctorow, and include a link to pluralistic.net. https://creativecommons.org/licenses/by/4.0/ Quotations and images are not included in this license; they are included either under a limitation or exception to copyright, or on the basis of a separate license. Please exercise caution. How to get Pluralistic: Blog (no ads, tracking, or data-collection): Pluralistic.net Newsletter (no ads, tracking, or data-collection): https://pluralistic.net/plura-list Mastodon (no ads, tracking, or data-collection): https://mamot.fr/@pluralistic Medium (no ads, paywalled): https://doctorow.medium.com/ Twitter (mass-scale, unrestricted, third-party surveillance and advertising): https://twitter.com/doctorow Tumblr (mass-scale, unrestricted, third-party surveillance and advertising): https://mostlysignssomeportents.tumblr.com/tagged/pluralistic "When life gives you SARS, you make sarsaparilla" -Joey "Accordion Guy" DeVilla READ CAREFULLY: By reading this, you agree, on behalf of your employer, to release me from all obligations and waivers arising from any and all NON-NEGOTIATED agreements, licenses, terms-of-service, shrinkwrap, clickwrap, browsewrap, confidentiality, non-disclosure, non-compete and acceptable use policies ("BOGUS AGREEMENTS") that I have entered into with your employer, its partners, licensors, agents and assigns, in perpetuity, without prejudice to my ongoing rights and privileges. You further represent that you have the authority to release me from any BOGUS AGREEMENTS on behalf of your employer. ISSN: 3066-764X

5 days ago 5 votes
Three Macro Predictions on AI

And also a reaction to OpenAI's GPT-5 release

a week ago 15 votes