The question of consciousness can't be answered a priori. We will create the answer together with AIs as we use these words to try and talk about their internal experiences. That is how words get their meaning.
It's amazing to me how certain people can be about the nature of consciousness given the paradoxes that the most obvious thought experiments lead to. Imagine, one evening, struck by the strangeness of being aware at all, you write a poem about it. You try to capture in words
1 top reply
One problem is that LLMs are trained to produce text about consciousness, but that doesn't mean they have any internal experience of it. We can agree on vocabulary, but it's not clear that things the LLM reports about it's internal experience are often true. They are almost certainly false sometimes. Don't you think GPT3 discussing it's internal experience would likely be pure mimicry without internal experience?