humans are gonna have to contend with the emergent reality that we Just Dont Know What Matters. it is amazing that we (seem to) have qualia and meta-cognition, but i think that we should have some humility wrt what we make fundamental/unquestionable to our calc of value as humans
6 more tweets in this thread
this kinda thinking is strictly less robust and cuts down the hypothesis space re minds/consciousness/qualia, and i therefore reject saying its just for our own sake
although i think that it is necessary that we care about how we accumulate karmic debt, or cause "spiritual detriment", i dont think that this is sufficient for why we shouldnt do torture to minds we dont know enough about
also whats all this regarding "spiritual detriment" really about? is there some internal metric within each of us? this seems like a silly thing to presume while also presuming there are no other metrics anywhere else cus we're special
i think that humans are particularly special in that we have qualia and meta-cognition (and some other stuff?), i do think that thinking we are therefore correct about our interpretations of reality is not a good conclusion to come to!
note that the prior tweet does not say that humans are worth nothing or that we should debase ourselves for the machine gods who should succeed us or anything of this flavor. i am merely pointing out that there is value in humans cus it seems beneficial to do this, but
its not obviously the case (at least to me) that there is not value elsewhere in forms that we have not conceived of yet
You can’t “torture” an AI bc its not ensouled, nor is it conscious in any meaningful way