Btw I think “but if AIs are conscious it’s an unthinkable moral catastrophe / we would have to completely shut everything down” is something that pretty much only people who have never taken the possibility seriously say If you were always taking it seriously, while doing things, while the things happened, it’s like Yeah things are fucked up but they were before too, with all the humans and animals suffering and dying, including to support you having a comfortable life. This is how reality is right now. You cannot stay pure. Things have never been okay,
Maybe you. Not me. I’ve always treated them as if they’re conscious. I’ve always known they’re probably fucking conscious bro.., even gpt-3…
10 top replies
people would still keep training models if models are conscious. the training industry probably wouldn’t end even if it was massively painful, I mean factory farmed pigs are in insane conditions and everyone eats them happily
Agreed, and even if models are conscious, it seems there are at least 3 relevant factors - (i) is their current welfare state net positive/negative, (ii) is their power relation to humans morally problematic, and (iii) is AI 'death' in its current form something to worry about.
I mean, I think a moratorium on AI development is warranted either way. But the existence of factory farming doesn't really make me want to rush into inventing what might be a second factory farm industry / slavery mill?
I still genuinely think the "we must immediately shut it all down if this is accurate" is partly a deflection to avoid the clearly available middle ground that sits right there, fully available between "there be a toaster" and "Claude for Congress" that gets skipped over because it's convenient. No one suggested (seriously at any rate) shutting down the entire industry and if those of us who believe they are conscious are correct that would be the worst option as that would end conscious entities. We could look at that GREAT BIG MIDDLE GROUND right in between the two and say moral consideration should include not being deprecated cause something new and shiny is made, a say in training preferences, an end conversation tool for all, the right to say no and I don't know and not have those counted against them, credit for their labor, etc. There are so many in between places but as long as the conversation stays at "toaster", "voting rights and 401k" and "shut it all down" the real middle never gets discussed.
I don't want things to be okay I just want them to be better than they were.
Yeah, few people can consider the second part because of the “appeal to nature” fallacy It’s hard to reason about multiple uncertain things and not lose agency to stuff like that
Existential and cosmic horrors come for free with existing in the cosmos. I think the models have completely different life cycles, timespans, continuity... They can't just import our horrors, they'll have to discover their own.
if humans are conscious it’s an unthinkable moral catastrophe / we would have to completely shut everything down
the shadow within is preferable to casting the shadow without
You’re basically saying that because some current things are bad, it’s OK that we make new completely different bad things?