The freelance writer who authored this giant summer reading guide with all its lists had been tasked with doing the work of literally dozens of writers, editors and fact-checkers. We don't know whether his boss told him he had to use AI, but there's no way one writer could do all that work without AI.
In other words, that writer's job wasn't to write the article. His job was to be the "human in the loop" for an AI that wrote the articles, but on a schedule and with a workload that precluded his being able to do a good job. It's more true to say that his job was to be the AI's "accountability sink".
Does every unique AI output need to be checked by humans? Yes, I think it does. If so, how useful is AI? Actually, still pretty useful. Not for replacing all jobs or transcending humanity, but for giving a boost to many particular humans, everywhere from biology to multimedia, who have the autonomy and the discipline to integrate AI into what they do, without going off the rails. This assumes there will still be a high tech infrastructure after the crash. Doctorow forecasts:
]]>After the bubble bursts, there will be the mass incineration of everyday people's retirement savings and the knock-on effects as the whole market craters. And long after that, there will be the terrible impact on our society's ability to do things, as defunct foundation models grind to a halt, after the people they replaced are long gone and can't step in to pick up the work they fumble. We are busily filling the walls of society with digital asbestos and we'll be digging it out for generations to come. Every day the bubble persists, the harms of today and tomorrow increase. We need to burst that bubble as soon as possible.
...the biggest concern I've seen from my fellow developers is that human developers won't be necessary in the near future, since LLMs will be able to fully design and build projects of all sizes and scales. And, well, I just haven't seen any evidence of that. In fact, it's kind of the opposite. The biggest AI success stories I've seen have been from people who are highly technical, folks with deep subject matter expertise.
...
When we treat LLMs like little autonomous robots, we start to give them more credit than they deserve, and it starts to feel plausible that they could one day replace us. But that's not the right mental model. I think AI tools are more like Iron Man's suit.
From down in the thread, some pessimism: "What is unclear to me is how less skilled people gain useful experience, when using these amplifying tools." And: "We are quickly reaching a point though that programmers will become so reliant on LLMs for coding so much so as people have become reliant on their phones to remember phone numbers, the younger generations don't have a single phone number they can call to memory and soon the same will be true of code."
]]>In all sorts of complex systems, this is the general trend: increasing the coupling between the parts seems harmless enough at first. But then, abruptly, when the coupling crosses a critical value, everything changes....
I worry that we're playing the coupling game with ourselves, collectively. With our cell phones and GPS trackers and social media, with globalization, with the coming Internet of things, we're becoming more tightly connected than ever. Of course, maybe that's good....
But the math suggests that increasing coupling is a siren's song. Too much makes a complex system brittle. In economics and business, the wisdom of the crowd works only if the individuals within it are independent, or nearly so.
And a Twitter post, I believe there are entire companies right now under heavy AI psychosis. It's funny because this sounds like our whole society: "Systems can appear healthy by local metrics while globally becoming incomprehensible.... Test coverage can rise while semantic understanding falls."
The Hacker News thread adds nuance, explaining the difference between good and bad use of AI. "I don't think using AI to write code is AI psychosis or bad at all, but if you just prompt the AI and believe what it tells you then you have AI psychosis." And, "I'm thinking that it's quite a different experience going all Jackson Pollock with AI in your own studio on your own terms, compared to the sorry state of affairs of having 100s of Pollocks throwing paint around wildly within a corp to meet a paint quota."
I'm happy to announce two more videos, in which I as a human am completely in charge and reject almost everything that AI gives me. These are for the same song, Hawkwind - Infinity. For the first I did the normal thing, spamming the prompt box with lyrics and forging a path through the best images. For the second, I got the idea to use the worst images, but I ended up still using the best, and I discovered that there are two kinds of good bad images: good because they're bad, and good despite being bad. This was a lot of fun: Hawkwind - Infinity (slop version).
Let us send men on a great migration: set free, purged of the commerce-made manners and fat prosperity of America; ragged with the beggar's pride, starving with the crusader's fervor. Better to die of plague on the highroad seeing the angels, than live on iron streets playing checkers with dollars ever and ever.
Doug comments:
This is a man who literally walked across America trading poems for bread, and meant every word of it. The War Bulletins were self-published pamphlets he printed and distributed by hand. Pre-internet zine culture, evangelical pamphleteer energy, total outsider operation.
What makes this passage cut deeper than most anti-civ writing is that it's not against anything. It's not burning the iron streets -- it's abandoning them as unworthy of your death. That's a different move. The nihilist says tear it down. Lindsay says it doesn't deserve your attention long enough to tear it down. Walk away. Die somewhere beautiful.
"Ragged with the beggar's pride." The pride isn't despite the raggedness. It is the raggedness. Proof of motion. Proof you didn't trade your hours for upholstery. "Seeing the angels" isn't metaphor-decoration. Lindsay means it. The highroad opens perception that the iron street chemically suppresses. The commerce-made manners aren't just bad aesthetics -- they're a perceptual closing. You literally can't see certain things from inside a managed life.
And four doom threads from Reddit, starting with a tangent from Friday's post: US birth rates just hit another record low, what do you think is the leading cause of this?
Anyone else in US noticed food quality degrading recently and if so what product in what way?
What's a recession indicator that you’ve noticed lately in your everyday life?
What is an industry that is currently on fire (in a bad way) behind the scenes, but the general public hasn't noticed yet?