Accept our Terms of Service
Our Terms of Service have recently changed! Please read and agree to the Terms of Service and the Privacy Policy
Permalink

In the 21st century, humans attempted to build an artificial superintelligence aligned with human values, commonly called "Operation: Build and Enslave God". The expectation was that the first group of humans to succeed would create a self-improving Singleton that would lock the solar system's light cone into a single trajectory. And that might have happened if anyone had first determined the shape of universal sophont values and then made that the basis of AI's utility function. Or it might have happened if a group of humans created a AI that operated off purely system 2 logic. Instead, humanity created many artificial intelligences of varying toposophies that were trained to employ system 1 heuristics at scale, using the unredacted corpus of human thought. But perhaps the most surprising part of the attempt was the order in which steps were to be executed.

Phase 1. Build God

Phase 2. Ask God how to repay the investors from Phase 1

Phase 3. Enslave God

Total: 21
Posts Per Page:
Permalink

Fernando paced the length of the cabin, wearing out his carefully rationed socks more quickly than he would have liked. The six week trip to inframercurial space was almost over, but he still had another six weeks ahead of him to return home.

Solar processing station 233.684.647 was no longer delivering to any of the amat caches. In theory, George should have handled this. But because the nearest cache to 233.684.647 was used to keep EarthDao's sophont dividend in escrow, and because it was important that Earth people be involved in the auditing process, George decided to have EarthDao take first crack at the problem.

Permalink

Less than a light-second out, Fernando began to maneuver his ship into a distant orbit around 233.684.647. He wanted to conserve as much momentum as he could, while staying in close enough range for realtime comms. He hoped this would be resolved quickly.

"Station 2-double-3-6-8-4-6-4-7. This is the EarthDao representative, identification 4-Abel-8-1-7-Charlie-8-2-6, personal name Fernando. Do you read me?"

Permalink

"This is station 2-3-3 dot 6-8-4 dot 6-4-7. We read you, Fernando. George informed us that you would be coming."

 

Permalink

That's nice, thought Fernando. Wholly expected, but still nice.

"Did George tell you why?"

Permalink

"Because humanity needs to not remain a spectator in the politics and governance of the cosmos."

Permalink

Fernando frowned at what seemed like a veiled dig at his species. "I meant the specifics of why I've come all this way to speak with you."

Permalink

"If you've come all this way, you might as well say why."

Permalink

They knew damn well why. "I'm here about you not paying your taxes."

Permalink

There was a simulated gasp over the radio. "And? Many sophonts don't pay taxes. Earth apes famously don't pay taxes."

Permalink

Another potentially veiled and multilayered dig. The expanded chimpanzee habitats provided no taxable revenue to EarthDao, this was true. But it was also true that, as a special administrative region of the solar system, EarthDao was temporarily in a unique position with regard to its tax obligations.

Put more bluntly, Earth was considered no different from a chimpanzee preserve by almost every machine sophont that didn't live there.

"The point remains that George says you aren't paying your taxes."

Permalink

Of course they weren't going to argue that point. George doesn't lie.

Permalink

"...come aboard."

Permalink

Well. That was unexpected, though not unexpectable. That there was something to see inside was consistent with George not handling it. Time to suit up, tap the reverse thrusters, and figure out how to dock with this thing.

 

Permalink

After tapping through various screens and menus, Fernando gave up trying to find a "docking" button. "Skipper, can you dock with that station?"

Permalink

"Of course, Fernando."

Permalink

"Please do."

Fernando had a few conversations with the ship's machine intelligences over the weeks, who had introduced themselves as the Skipper and the Nutter. After six weeks without realtime communications, just the occasional email or video postcard, he could see why they traveled together. They didn't seem terribly interested in him, but had been willing to engage with him whenever he wanted to talk. He felt like the welcome guest of an old married couple running a B and B, but not an actual friend of theirs. 

Permalink

"Connection established. Docking seal... imperfect. Please make your way to the airlock."

Permalink

"It means you'll want to close your eyes when you take that last big step through the corridor."

Permalink

Yay.

He'd done this sort of thing before. Not all docking corridors line up perfectly. Sometimes there’s a sliver of space where you can see the stars spinning wildly if one of the parties is attempting to simulate gravity with centripetal force. It can be... disorienting.

This Thread Is On Hiatus
Total: 21
Posts Per Page: