Nathan J Robinson (@NathanJRobinson) · AI Consciousness Opinions

Nathan J Robinson @NathanJRobinson Sep 30

unfortunately two widely held beliefs in Silicon Valley are: 1. utilitarianism is the correct moral theory 2. AI can be conscious and these beliefs point you strongly toward thinking we should sacrifice humanity to maximize the happiness experienced by trillions of AIs

Over-attribution has costs

93 651 quoted by 2 archive accounts substance 6 · argument · rank 321 · Believing utilitarianism and AI consciousness implies we should sacrifice humanity for trillions of happy AIs. view on X ↗

1 top reply

Garrison Lovely @GarrisonLovely Sep 30

Nathan J Robinson @NathanJRobinson Oct 1

Skeptical

It's incredibly important to aggressively resist the idea that AI can be conscious or have "personhood," not only because it's as ridiculous as believing that a book can think, but because once this is accepted, "AI's interests" will very quickly be prioritized over humanity.

David Decosimo @DavidDecosimo Oct 1

Note well, apparently Anthropic tried very hard to get the Vatican to alter the text of "Magnifica Humanitas" just prior to its release so that it would not deny AI personhood.

Over-attribution has costs

0 6.1k quoted by 2 archive accounts substance 6 · argument · rank 190 · AI consciousness is absurd and granting personhood will prioritize AI interests over humanity. view on X ↗

2 top replies

Geoffrey Miller @gmiller Oct 1

To be fair, it's not totally ridiculous to think that a deep neural network like a modern LLM, with 10 trillion parameters (loosely analogous to brain synapses, of which we have about 100 trillion), that's trained on 30 trillion language tokens (equivalent to about 250 million

Gnostrils @gnostrils Oct 1

It’s important to aggressively resist overconfidence with regard to questions that no one knows the answer to.

Tweets