Discussion about this post

User's avatar
Nathan Lambert's avatar

Great post. I will quibble with the computer use and robotics example, though, as those capabilities came into the models after substantial data was curated in the ecosystem. That data is much more defined and easier to create, relative to the messiest, most influential knowledge work.

i do agree we should understand how to manage strong recursion, and regulate it, even though I disagree strongly with the claims that it is coming very soon (claims not by dean).

Brendan McGuire's avatar

Dean, this is one of the clearest pieces I've read on recursive self-improvement. Separating weak from strong recursion is the kind of calibration this moment needs. Fear doesn't help us discern, and panic writes bad law.

Pope Leo XIV's new encyclical, Magnifica Humanitas, gives us a lens that fits your argument. He warns of a future where we gain "having more" without "being more" (§94). He also warns that "a more moral AI is not enough if that morality is determined by a few" (§107). The danger isn't only runaway machines. It's power gathering in too few hands, whether those hands belong to companies or to the state, as you rightly warn.

The Church's answer is subsidiarity and solidarity. We need smart regulation shaped at every level of society: labs, governments, universities, faith communities, families. Yes, RSI is a real risk. But if we manage it together, and judge it by its impact on all of society, AI can serve the flourishing of the whole human family, not a narrow few.

That will require us to come together in ways we never have before. AI can help us do that. But we have to care about the means as much as the ends.

— Fr. Brendan McGuire

7 more comments...

Ready for more?