Seems plausible. A minimal prerequisite for consciousness seems to be some persistence of the “same” thing over time. A single feedforward sweep lacks this. Interesting followup: a single LLM forward pass isn’t recurrent, but does the autoregressive generation loop qualify?
Finally published: “Loops all the way up: Recurrency as an implementation-first primitive for consciousness” There are 200+ theories of consciousness, mostly talking past each other. Despite their differences, most give central stage to one key notion: recurrence 🧠🔁
1 top reply
I think by most accounting, it is. Though, this does somewhat highlight the question of what the difference between a straightforward "embedding" of a set of tokens would be vs actually sampling/generating the same set of tokens serially more broadly, I'm gesturing at the seeming