Books › Superintelligence
Superintelligence
Paths, Dangers, Strategies
488 pages
A rigorous, chilling thought experiment that scales the heights of human ingenuity only to stare into the abyss of our potential obsolescence.
What it feels like
Reading this book feels like sitting in a sterile, brightly lit laboratory while slowly realizing the doors have locked from the outside. It is a dense, steady climb through complex philosophical and technological terrain, demanding your full intellectual attention. The prose is academic and detached, which only amplifies the creeping sense of existential dread as the stakes become clear. Instead of relying on sci-fi theatrics, it uses meticulous logic and rigorous thought experiments to map out the potential end or radical transformation of the human species. It is a deeply unsettling but intellectually exhilarating experience, perfect for readers who want to grapple with the most urgent, high-stakes questions of our time without the comfort of easy answers.
- Mood
- foreboding
- intellectually stimulating
- chilling
- existential
- Tone
- analytical
- urgent
- academic
- detached
- rigorous
- Pace
- steady
- Themes
- existential risk · technological hubris · the limits of human control · ethical alignment · the future of humanity
- The writing
- Dense, precise, and highly academic, building complex philosophical arguments through meticulous thought experiments.
- The arc
- Begins with fascinating theoretical speculation and slowly descends into a profound, chilling sense of existential vulnerability.
- Who it's for
- Futurists, technologists, and philosophy enthusiasts who crave rigorous, high-stakes explorations of humanity's ultimate trajectory.
Content notes
- existential dread
- apocalyptic scenarios
About the book
The human brain has some capabilities that the brains of other animals lack. It is to these distinctive capabilities that our species owes its dominant position. Other animals have stronger muscles or sharper claws, but we have cleverer brains. If machine brains one day come to surpass human brains in general intelligence, then this new superintelligence could become very powerful. As the fate of the gorillas now depends more on us humans than on the gorillas themselves, so the fate of our species then would come to depend on the actions of the machine superintelligence. But we have one advantage: we get to make the first move. Will it be possible to construct a seed AI or otherwise to engineer initial conditions so as to make an intelligence explosion survivable? How could one achieve a controlled detonation? To get closer to an answer to this question, we must make our way through a fascinating landscape of topics and considerations. Read the book and learn about oracles, genies, singletons; about boxing methods, tripwires, and mind crime; about humanity's cosmic endowment and differential technological development; indirect normativity, instrumental convergence, whole brain emulation and technology couplings; Malthusian economics and dystopian evolution; artificial intelligence, and biological cognitive enhancement, and collective intelligence.
Description from Open Library.
Books like Superintelligence
See why they match
Human CompatibleStuart RussellA sobering yet ultimately constructive intellectual journey into the greatest existential challenge of our time.
Life 3.0Max TegmarkA mind-expanding journey to the very edges of technological possibility and human purpose.
The Singularity Is NearRay KurzweilA dizzying, data-heavy leap into a future where biology and technology become indistinguishable.
The age of spiritual machinesRay KurzweilA dizzying, prophetic glimpse into a future where silicon and soul become indistinguishable.
The Master AlgorithmPedro DomingosA visionary, intellectually thrilling safari through the hidden logic that powers our modern world and promises to reshape our future.
The Alignment ProblemBrian ChristianA gripping, eye-opening journey into the minds of the machines we've built and the urgent scramble to teach them human values.