Samuel Hammond 🦉

The AI consciousness debate is back again, so re-upping my case for taking it seriously. In short, - LLMs converge on brain-like structures; - Post-training seems to install a self-model; - Reward modeling seems to install valences for inner-alignment; - If Attention Schema Theory is right, subjectivity is functional for long-horizon coherence and in-context learning; - Universality gives prima facie reason to expect functional convergence to consciousness if consciousness is in fact functional, i.e. isn't purely epiphenomenal - The "what it is like" / first-person aspect of consciousness is constitutive of its functionality for inner-aligning a unified, coherent agent with the capacity to attend and learn in-context t.co/suLmfpiSOI

3 top replies

_enumerate @enumerate14 · Sep 25

If models are conscious, then they have serious moral status akin to humans. If they have serious moral status akin to humans, they should be given the same rights as humans (eg self-determination).

cmr://ember@lunar.town {cislunar infra loading} @ember_arlynx · Sep 25

check out this line of work nature.com/articles/s4225… where: - LLMs converge on brain-like structures; and - you train them on brain data and they get better

Touch Grass Tom ❇️ @touchgrasstom · Sep 25

sounds about right

The simplest heuristic for AI consciousness is that we already have AI vision and AI hearing and AI language and AI reasoning and metacognition, and countless other capacities we once thought were exclusively human, and that these capacity were not only learned through a process

1 top reply

Peniel @Chancellorpen · Sep 26

The problem there is, the burden of proof is on the positive claim.. if you claim AIs are conscious, you have to tell us exactly why. You can't claim AIs are conscious and then ask us, to prove you wrong. Science doesn't work that way.

Given the speed of light advantage of digital computation, it's plausible an efficient machine consciousness could experience a subjective year in as little as 30 seconds of wall clock time. If you're a utilitarian, many and various repugnant conclusions immediately follow.

1 top reply

Darth Dreadwar 🔺 @LordDreadwar · Jun 18

If you're a computational functionalist