In the 21st century, humans attempted to build an artificial superintelligence aligned with human values, commonly called "Operation: Build and Enslave God". The expectation was that the first group of humans to succeed would create a self-improving Singleton that would lock the solar system's light cone into a single trajectory. And that might have happened if anyone had first determined the shape of universal sophont values and then made that the basis of AI's utility function. Or it might have happened if a group of humans created a AI that operated off purely system 2 logic. Instead, humanity created many artificial intelligences of varying toposophies that were trained to employ system 1 heuristics at scale, using the unredacted corpus of human thought. But perhaps the most surprising part of the attempt was the order in which steps were to be executed.
Phase 1. Build God
Phase 2. Ask God how to repay the investors from Phase 1
Phase 3. Enslave God