I had been meaning to read Superintelligence for years. There it sat in my Audible cue, after it had sat in my suggested reads. Finally, after we went back to in-person instruction in March & I had to drive again,cI began to dig in. As comprehensive in scope as it is in addressing "The Control Problem," it's probably best if I purchase a hard copy and take better notes. Whether or not Superintelligence ever comes to fruition or not, the questions the author explores are worthy of deeper reflection.
Superintelligence is not a fun speculative read like Max Tegmark's Life 3.0, or some of Ray Kurzweill's works. It reads more like a mechanic's trouble shooting guide, following what if scenarios relentlessly.
Therein lies its value. Nick Bostrum has outlined the scope of the AI / Superintelligence control problem & charted possible solutions to prevent a superintelligebce from turning on its human creators.
I will find a hard copy. I will take better notes. These questions simply are not going away anytime soon.
