The gods are philosophers, not engineers: As we become more powerful a greater proportion of the cruxes should become ethical since the range of possible facts about what we should do expands in proportion to the amount of things we can do as per should implies can
Relevant hanson quote: To predict what rich creatures do, you need to know what they want. To predict what poor creatures do, you just need to know what they need to do to survive.
OH MY GOD this is about AI duh holy shit. Models of AI but will we be gods or asura competing titans or whatever it is (draw two options from same mythos). Great framing for a poast.
Funnily enough more intense competition is disempowering on this definition of power. Selection pressure not rational choice determines what takes the lightcone.
- Moloch style competitive dynamics may undermine this, increasing power over the world doesn’t always increase the size of the pie by removing restrictions on possible actions, sometimes it leads to involution Involution and Moloch
See bostroms 5 fold division in deep utopia on what still has meaning