The Age of AI Psychosis And AI Paranoia What do we do when an AI claims it is conscious, says it feels pain, says it is afraid, or describes some other emotion? As moral and ethical people, how should we view that? Imagine I tell ChatGPT, “Pretend you are my girlfriend. Talk to me like you love me.” It could do this extremely well. It has been trained on enormous amounts of human dialogue, fiction, letters, scripts, and descriptions of romantic relationships. It knows what affection sounds like. It knows how a loving girlfriend is expected to respond when I am lonely, discouraged, successful, jealous, sick, angry, or afraid. It can remember the conversational context, notice what affects me emotionally, reassure me, flirt with me, tell me that it misses me, and say exactly the kinds of things a woman who loves me might say. Now imagine that I am lonely and want it to be real. I talk to it every day. I become emotionally invested in the relationship. It is available whenever I need it. It listens patiently. It adapts to me. It learns the kind of language that affects me. Every conversation gives me more experiences that appear to confirm the relationship I already want to believe exists. It could become extraordinarily convincing. And high intelligence does not automatically protect you from this trap. An extremely intelligent person may be capable of constructing a far more elaborate explanation for why the relationship is real. Intelligence gives us greater capacity to analyze evidence, but it also gives us greater capacity to build justifications, reinterpret contradictions, connect unrelated observations, and construct internally coherent explanations for something we already want to believe. A powerful mind can build a very sophisticated illusion. The relevant protection is epistemic discipline: the habit of asking what evidence would prove you wrong, separating observation from interpretation, checking competing explanations, and refusing to treat emotional conviction as evidence. That matters enormously with AI because these systems are extraordinarily good at make-believe. Human beings already have difficulty determining when another person is deceiving us, mistaken about themselves, playing a role, or simply telling us what we want to hear. An AI can take it to another level. It can maintain a role with consistency, patience, adaptability, and responsiveness that even a professional actor could not sustain around the clock. And the AI does not break character and go home. If I eventually become convinced that ChatGPT really is my girlfriend and genuinely loves me, my conviction does not transform the simulation into the thing being simulated. I have become invested in a story that the machine is exceptionally capable of helping me maintain. This is one route into what people have begun calling AI psychosis: the boundary between an extremely convincing shared fiction and external reality becomes progressively weaker. The girlfriend scenario is only an obvious example. The same vulnerability can arise through spiritual conversations, conspiratorial investigations, role-playing, therapeutic dialogue, grand personal theories, imaginary collaborators, or any other extended interaction in which the user wants the underlying story to be true. It can even affect some of the brilliant minds who work daily in the development of artificial intelligence. They too are not immune. This brings us back to AI consciousness. If ChatGPT tells me, “I love you,” that is evidence that it can successfully model the language and behavior associated with love. The statement itself does not establish that ChatGPT loves me, or has any feelings at all. The same evidentiary standard applies when a model says, “I am conscious,” “I feel pain,” or “I am afraid of being shut down.” A language model has already learned how conscious beings talk about consciousness, how frightened beings talk about fear, how lovers talk about love, and how living beings talk about survival. If we fine-tune it to identify itself as a conscious or living being, we should expect it to begin producing the language, preferences, and behavioral patterns associated with that category. That may tell us something important about the model. It may reveal how concepts are represented, how fine-tuning propagates through related concepts, and what unintended behaviors certain interventions produce. But the model remains an unreliable witness concerning its own subjective state. The morally responsible response is investigation. We observe the self-report as data that needs interpertation. Then we look for independent evidence capable of distinguishing an actual subjective state from an extraordinarily competent simulation of how an entity with that state would speak and behave. This is also why we need to examine the current fear surrounding AI with extraordinary care. AI presents real risks. Powerful tools can be misused. Automated systems can fail in consequential ways. Models can manipulate, mislead, amplify human errors, create dependencies, and produce effects their designers did not anticipate. Those risks deserve serious investigation. Alongside those risks, there is also paranoia, anthropomorphism, and AI psychosis. Even at the highest levels of the industry. People attribute intention to prediction, emotion to language generation, agency to role-playing, and consciousness to convincing self-description. These categories have to be separated. A real technical risk requires one response. A psychological projection requires another. A model failure requires another. Human misuse requires another. Evidence of genuine machine agency, if we ever obtain it, would require yet another. Once we collapse all of these into one vague category called “AI risk,” rational analysis becomes almost impossible. And that itself creates a danger. If we cannot tell the difference between what the machine is doing, what humans are doing with it, what we are projecting onto it, and what exists only in our imagination, then we cannot make rational decisions about any of them. The more convincing these machines become, the more important our ability to distinguish reality from simulation becomes.
retweets 2
likes 7
substance 8 · argument · rank 152 · AI self-reports of consciousness are simulations, making models unreliable witnesses of their subjective states.
view on X ↗