Even if AIs become conscious, that doesn't imply that humanity should hand over control to them. eigenism.org
NEW: According to a bombshell report in the New York Times, Anthropic co-founder Chris Olah threatened to walk out of Pope Leo XIV’s AI encyclical launch in May because the pope rejected the idea that machines can be conscious. Olah’s team then privately lobbied the pope’s advisers “to take the possibility of model consciousness seriously.” Pope Leo XIV held firm. For months, Anthropic has wined and dined theologians and religious scholars under nondisclosure agreements, hoping they would bless the idea that Claude has moral standing. t.co/iG3Bnlzt2J
2 top replies
I really don't think naive utilitarianism is the main obstacle here, nor that the entries here clearly follow from the equations up top.
Naive utilitarianism does not imple equality. This feels like a straw man