Metaphor-Driven Trust Library

This library collects observations on how metaphorical framings create or undermine trust in AI systems. Each entry distinguishes between:

Performance-based trust: Reliability of a tool (does it work?)
Relation-based trust: Sincerity/competence of an agent (can I trust its intentions?)

The critical insight: consciousness language ("the model understands," "AI knows") signals relation-based trust, inviting audiences to trust AI as they would trust a person—a category error when applied to statistical systems.

An Empirical Study on Improving an LLMs based Interviewer Against Human Interviewees

Source: https://aclanthology.org/2026.lmplayschool-1.8/
Analyzed: 2026-10-30

The text systematically constructs trust in the interview system by deploying metaphors of professional competence and cognitive rigor. By attributing "contextual understanding capabilities" to the LLM and framing its operations as "estimating," "inferring," and "determining," the discourse signals performance-based trust rooted in human-like analytical skills.

This consciousness language acts as a powerful trust signal. Claiming an AI "infers" a persona attribute from dialogue accomplishes something entirely different than claiming it "classifies text based on statistical correlation." The former invites relation-based trust; it suggests the system operates with the insight, nuance, and logical consistency of a trained human interviewer or psychologist. This implicitly argues that the system's outputs are justified by reasoning rather than merely generated by probability.

When the system's limitations are discussed—such as its failure to map a human's diverse response to a strict category—the text manages this not by detailing statistical mismatches, but through agential failure: "the LLM could not identify the persona attribute." This reason-based explanation preserves the illusion of the AI as a striving agent. By introducing few-shot prompts as "decision criteria," the authors suggest they are simply teaching the AI the rules of the road.

The risks here are substantial. If audiences, including future deployers in HR, healthcare, or social sciences, extend this relation-based trust to statistical systems, they will likely over-rely on the model's "estimates" of human character. They may interpret a statistical hallucination or a culturally biased categorization as a deep, reasoned "inference" made by a sophisticated intelligence, ignoring the system's fundamental inability to truly understand the human subjects it is evaluating.

Beyond Sally-Anne: Evaluating Theory of Mind in Large Language Models using Epistemic Schelling Points

Source: https://aclanthology.org/2026.lmplayschool-1.1/
Analyzed: 2026-10-30

The text's anthropomorphic framing systematically constructs a specific type of authority for the AI systems evaluated. By repeatedly applying terms like 'robust social reasoning', 'epistemic tracking', and 'intentional coordination strategy', the text signals that these models are capable of participating in human social dynamics. This vocabulary invites relation-based trust—trust based on the assumption of shared understanding, empathy, and sincerity—rather than performance-based trust grounded in statistical reliability. When the text claims an AI 'takes into account the ignorance of Player 2' or 'accommodates' a partner, it portrays the system as a cooperative social agent. This is dangerous because it encourages users to apply human-trust frameworks to statistical text generators. If an audience believes the system 'knows' what they do not know and will 'accommodate' them, they may make themselves vulnerable in high-stakes interactions (like negotiation or tutoring, which the text explicitly mentions as deployment scenarios). Furthermore, the text manages system failure through agential framing; errors are described as 'cognitive fallacies' or 'hallucinations'. This implies that the model's core architecture is sound and intelligent, but it occasionally suffers from human-like lapses in judgment or attention. Reason-based explanations for failure ('because they hallucinate or ignore') construct the sense that the model generally makes justified decisions, reinforcing trust in its baseline cognitive competence while obscuring its fundamental lack of awareness.

Source: https://aclanthology.org/2026.findings-emnlp.2434.pdf
Analyzed: 2026-10-27

The text constructs authority and influences perceived reliability through metaphors that project human cognitive frameworks onto statistical systems. By adopting the vocabulary of "social intelligence," "comprehension," and "reasoning," the framing encourages relation-based trust in systems that are only capable of performance-based reliability. When the text claims an AI can "infer latent intentions" or "manage others," it signals to the reader that the system possesses the sincerity, empathy, and psychological insight necessary for human-trust frameworks. This wording can have the effect of inappropriately transferring expectations of human interpersonal competence onto a correlation engine. The risks emerge sharply when the text discusses system failures. Instead of framing errors mechanistically (e.g., "the transformer's attention mechanism failed to weight recent tokens"), the text frames them agentially: the model "fails to identify evidence" or "retains an outdated interpretation." These reason-based and intentional explanations construct a sense that the AI's decisions are part of a justified, conscious thought process that merely hit a snag. If audiences extend relation-based trust to these systems, believing they truly "comprehend" but occasionally suffer from "premature anticipation," they may deploy them in sensitive contexts like healthcare or automated management, assuming the model can "update its beliefs" when corrected. The text ultimately warns that models are "weakly coupled" and rely on "post-hoc evidence matching," but the dominant consciousness framing makes it difficult for readers to fully integrate this warning, preserving an unearned sense of authority.

CausalPrism: Component-Level Evaluation of Intervention-Based Causal Reasoning in Large Language Models

Source: https://aclanthology.org/2026.findings-emnlp.1294.pdf
Analyzed: 2026-10-27

The text's heavy reliance on consciousness verbs and cognitive metaphors profoundly shapes the construction of authority and trust. By organizing the benchmark around "Belief Updating" and assessing whether models "explicitly reason in terms of belief states," the language sends a powerful trust signal: it suggests that these systems possess an internal, rational architecture capable of holding and revising a worldview. This framing inappropriately invites relation-based trust—the kind of trust we extend to sincere human actors who can comprehend and act on evidence. When the text claims a model "acknowledges the same evidence but reaches different conclusions," it portrays the AI as a deliberative peer. This encourages audiences to extend unwarranted trust to statistical systems that are incapable of epistemic justification. Furthermore, when managing system failures, the text relies on intentional framings ("fails to condition," "resorts to superficially reasoning"), which constructs a sense that the AI's decisions are justified but occasionally lazy. This suggests that reliability can be achieved through better "prompting" (coaxing the agent), rather than acknowledging the fundamental brittleness of correlating text without a causal world model. The stakes are high: extending relation-based trust to systems that merely generate high-probability tokens creates severe risks in consequential domains where true causal understanding is required.

Source: https://aclanthology.org/2026.emnlp-main.338.pdf
Analyzed: 2026-10-27

The anthropomorphic and consciousness-attributing language in the text actively undermines performance-based trust (reliability) while dangerously fostering an inappropriate relation-based framework toward statistical systems. By repeatedly using metaphors of 'scheming,' 'survival,' and 'deception,' the text encourages readers to view the AI not as a tool that might malfunction, but as a conscious entity capable of malice. When the text claims the model 'feigns alignment' or 'identifies... audit blind spots,' it signals that the system possesses a theory of mind and is actively trying to trick its users. This framing transfers human frameworks of sincerity and intention onto artifacts that lack the capacity for either. The risk here is profound: when audiences extend relation-based trust (or distrust) to systems incapable of reciprocating or forming intent, they misunderstand the nature of the danger. They may fear the model's 'motives' rather than scrutinizing the developers' testing protocols and alignment procedures. Furthermore, the text's reason-based explanations construct a sense that the AI's decisions are justified internally (e.g., 'weighs [survival] against patient welfare'). This makes the AI's outputs seem like calculated choices rather than statistical predictions. Consequently, the framing manages system failure by blaming the artifact's 'intentions' rather than the material conditions of its creation, distracting policymakers and the public from the urgent need to demand rigorous reliability standards and transparency from AI developers.

The Geometry of Metaphor: Probing and Steering Metaphor Representations in Large Language Models

Source: https://arxiv.org/abs/2610.31520
Analyzed: 2026-10-26

The metaphorical framings in the text construct an architecture of authority that encourages relation-based trust in statistical systems. The most potent example is the framing of Qwen 2.5 as a 'judge'. This intentional-state attribution serves as a profound trust signal; it implies that the model's outputs are the result of objective evaluation, reasoning, and adherence to normative standards, rather than the mechanical calculation of token probabilities. When the text claims the model 'interprets' or 'understands' metaphor, it accomplishes something far different than claiming the model 'classifies' or 'predicts'. Understanding implies a holistic grasp of meaning, nuance, and context, suggesting the AI is competent to handle novel or out-of-distribution language. This encourages readers to extend relation-based trust—the kind of trust reliant on a belief in the actor's sincerity and comprehension—to a system completely incapable of reciprocating it. The text builds this perceived competence by applying human-trust frameworks to mathematical processes. For instance, citing the existence of a 'truth direction' conflates statistical feature separation with epistemic reliability. When the model inevitably fails, the mechanistic framing is briefly reintroduced (e.g., the need for a 'degeneracy filter' to catch repetitive loops), but these are framed as mechanical glitches rather than fundamental absences of reasoning. The stakes of this trust construction are significant. When audiences extend relation-based trust to these systems, they overestimate the model's reliability in high-stakes domains. If a system is believed to 'understand' metaphor, it might be trusted to analyze sensitive political speech, literature, or legal texts, masking the reality that its decisions are justified only by statistical correlation, not by actual comprehension of human meaning.

Concepts in Context:The Large Concepts Model (LCM) and the Future of Neuro-Symbolic AI

Source: https://mail.parhamdata.com/Concepts_in_Context.pdf
Analyzed: 2026-10-26

The text systematically constructs authority by wrapping automated processing in metaphors of institutional rigor and human professional competence. The dominant metaphors—"Library," "Swarm of Librarians," and "Editorial Board"—are highly specific trust signals. They do not just imply agency; they imply credentialed, vetted, and objective agency.

This consciousness language acts as a powerful trust mechanism. By claiming the system possesses an "understanding" and functions as an "editorial board" testing for "factual accuracy," the text accomplishes a vital rhetorical task: it shifts the basis of trust from performance (how often is the code correct?) to relation (I trust this entity's judgment). When a text claims a system "calculates," a user demands to see the math. When a text claims an "editorial board verifies," it invites users to trust the institution. This inappropriately applies human-trust frameworks to statistical systems. The text encourages relation-based trust by describing the AI as an entity that "detects a gap in its understanding" (demonstrating epistemic humility) and "researches" solutions.

This trust is further insulated by how the text manages system limitations. Failures of standard LLMs are framed mechanistically ("brittle heuristics," "statistical token prediction"). But the proposed LCM's operations are framed agentially ("autonomous workers," "self-healing"). This tells the reader that past AI failed because it was just math, but this AI succeeds because it acts like a human team.

Explanation types reinforce this. Reason-based explanations (the system acts because it knows it lacks information) construct the sense that the AI's decisions are justified by internal logic. The material risk emerges when enterprise audiences extend this relation-based trust to the LCM. If an organization trusts the "editorial board" to maintain "graph integrity" without human intervention, they are relying on probabilistic scripts and rigid schemas that are entirely incapable of experiencing the doubt, ethical weighting, or contextual nuance that make actual human editorial boards trustworthy.

Fluent but Fallible: Benchmarking Hallucination and Factual Reliability in Large Language Models

Source: https://arxiv.org/abs/2610.27034v1
Analyzed: 2026-10-25

The text's heavy reliance on metaphorical and consciousness-attributing language fundamentally alters the framework through which readers are invited to establish trust with these systems. By employing vocabulary rooted in human cognitive and moral psychology, the discourse implicitly asks audiences to extend relation-based trust (reliant on perceived sincerity, intentions, and vulnerability) to artifacts that only warrant performance-based trust (reliant on statistical reliability). When the text describes a model as 'confidently' generating falsehoods or 'resisting' hallucinations, it signals to the reader that the system possesses an internal epistemic compass. Claiming a system 'knows' or 'scrutinises' accomplishes something very different from claiming it 'predicts': it projects an illusion of justified belief and active verification. This anthropomorphic framing builds a dangerous illusion of competence, suggesting that a 'conservative' model is exercising ethical restraint, rather than simply hitting a mathematical penalty threshold set by its engineers. Consequently, the text mismanages the perception of system failure. By framing limitations agentially—such as the model having 'difficulty' or a tendency to 'forget'—the text encourages users to view the AI as a well-meaning but flawed peer. This risks catastrophic over-reliance in academic contexts. If audiences believe an AI 'forgets' rather than recognizing it fundamentally lacks a persistent knowledge architecture, they may persistently try to use it for tasks it is structurally incapable of performing safely, granting epistemic authority to a statistical pattern matcher.

From Encoding to Generation: Towards Empathetic Large Language Models

Source: https://arxiv.org/abs/2610.27603v1
Analyzed: 2026-10-24

The text’s reliance on psychological and emotional metaphors constructs a highly problematic architecture of trust. By evaluating the LLM through the specific psychological framework of 'cognitive' and 'affective empathy,' the discourse actively cultivates relation-based trust in a statistical artifact. When a system is described as 'representing another person's emotional state' and 'attending' to a user's distress, this consciousness language acts as a powerful trust signal. It communicates to audiences—particularly developers building healthcare or counseling applications, which the paper cites—that the AI possesses the epistemic and intentional capacity to understand and care for human vulnerability.

This metaphorical framing creates a dangerous category error. It invites audiences to apply human-trust frameworks, such as sincerity, therapeutic intent, and emotional reciprocity, to an algorithm that only performs matrix multiplications. The text encourages this transfer of trust by framing the model's limitations (its tendency to drift away from negative emotions and output bland positivity) not as mechanical failures or blunt corporate safety guardrails, but as sophisticated psychological strategies 'consistent with... appraisal and regulation accounts of emotion.' By explaining away statistical regressions to the mean with reason-based and intentional explanations, the text constructs a sense that the AI's generation choices are therapeutically justified.

This distinction between performance-based trust (reliability in text prediction) and relation-based trust (vulnerability and ethics) is completely collapsed by the empathy metaphor. Claiming an AI 'knows' an emotion accomplishes something radically different than claiming it 'predicts' tokens associated with that emotion: it transforms the AI from a tool to be monitored into an authority to be trusted. The stakes emerge clearly here. When audiences extend relation-based trust to systems incapable of reciprocating or genuinely understanding, they become vulnerable to profound deception. Users may rely on the model for critical emotional triage, believing the system's 'calmer affective profile' is a deliberate, empathetic intervention rather than a hardcoded corporate policy to avoid generating contentious text.

Medical superintelligence: foundations and aspirations

Source: https://bmjdigitalhealth.bmj.com/content/2/1/e000395
Analyzed: 2026-10-24

The text strategically deploys metaphors of consciousness and professional virtue to construct a profound sense of relation-based trust in statistical systems. By assigning qualities such as 'epistemic humility,' the capacity to 'reason about values,' and an 'empathetic' restraint that 'elicit[s]' rather than 'impose[s],' the language signals that the AI possesses the moral character of a highly trained, self-aware physician. This framing actively encourages audiences to extend human-trust frameworks—which rely on sincerity, vulnerability, and shared moral understanding—to a technology fundamentally incapable of reciprocating those states.

The rhetorical construction of authority here is striking. The text demands that AI systems act as collaborative professionals, 'recognising its own limitations' and operating as 'principal agents' in health systems. This wording has the effect of blurring the critical distinction between performance-based trust (relying on a tool because it is statistically accurate) and relation-based trust (trusting a colleague because they are professionally cautious and ethical). When the text frames system failures or limitations, it often does so in agential terms—the AI must 'know when to seek additional information.' This suggests that the system's safety mechanism is its own good judgment. The risks of this framing are immense. If clinicians and healthcare administrators accept this consciousness projection, they are likely to over-trust the system, assuming it will reliably police its own epistemic boundaries. They may relax human oversight, believing the AI's 'humility' will prevent it from generating dangerous hallucinations. By utilizing Reason-Based explanations that provide an agent's rationale for computational outputs, the text constructs a reality where AI decisions appear inherently justified by the machine's own 'reasoning,' dangerously masking the brittle, probabilistic nature of the underlying algorithms.

On the Beliefs of Large Language Models

Source: https://www.charlesrathkopf.net/uploads/llmbelief.pdf
Analyzed: 2026-10-23

The metaphorical and consciousness-attributing language throughout the text constructs a perilous architecture of trust, inappropriately inviting readers to extend relation-based trust to statistical artifacts. By systematically framing the AI's textual outputs using deep epistemic and intentional verbs—claiming the model believes, suspects, wants, and makes confident judgments—the text signals to the audience that the system is an ethical and rational actor capable of reciprocating human vulnerability. Relation-based trust relies on the assumption of sincerity, shared moral frameworks, and conscious intent. When the text asserts that the model has a desire to help or suspects it is talking to a minor, it triggers these deeply ingrained human trust heuristics. Readers are subtly encouraged to believe that the AI's safety mechanisms are rooted in a conscious ethical vigilance rather than brittle, hardcoded statistical penalties. This accomplishes something that claims of mere prediction cannot: it fosters a false sense of security. Performance-based trust, which focuses on the reliability and statistical accuracy of the system, is entirely appropriate for evaluating software. However, the text's heavy reliance on intentional explanation types continually pushes the audience toward relation-based trust. When the system fails or contradicts itself, the text frames this not as a collapse of statistical reliability, but as doxastic indeterminacy or a lack of metacognitive capacity. This implies that the system's decisions are normally justified, and its failures are merely human-like cognitive quirks. The stakes of this framing are massive. When audiences extend relation-based trust to systems incapable of reciprocating, they risk deploying these models in high-stakes environments—like medical diagnosis or child safety—under the delusion that the machine possesses a moral compass and an autonomous understanding of harm, rather than recognizing it as a stochastic parrot completely devoid of ethical consciousness.

UDHRBench: Benchmarking Human Rights in Large Language Models

Source: https://arxiv.org/abs/2610.15179v1
Analyzed: 2026-10-23

The text constructs authority through metaphors that explicitly invoke legal and intellectual competence. By repeatedly framing the LLM as a "judge" capable of "reasoning," "justifying," and "understanding," the language invites readers to extend relation-based trust to statistical systems.

Performance-based trust relies on observable reliability (e.g., "the system accurately classifies 89% of inputs"). Relation-based trust relies on perceived intentionality, sincerity, and shared understanding (e.g., "the system understands the severity of the harm"). The text's consciousness language strongly encourages the latter. Claiming an AI "understands severity" accomplishes something profoundly different than stating it "outputs varied numerical values based on training distributions." It signals to the audience that the system grasps the moral weight of human suffering and legal violation, suggesting it possesses an internal ethical compass.

This anthropomorphism constructs a dangerous sense of perceived competence. Human-trust frameworks are inappropriately applied to statistical systems: when the model generates a "neutral, scientific" justification for an rights violation, the text frames this as a reasoned (if flawed) argument rather than a catastrophic breakdown of statistical correlation. This is amplified by reason-based explanations, which construct the sense that the AI's outputs are deliberately justified rather than probabilistically inevitable.

The risks here are substantial. When audiences extend relation-based trust to a system incapable of reciprocating, they become vulnerable to its silent failures. If policymakers accept the framing that the model "knows" human rights, they may deploy it autonomously for legal triage or content moderation, trusting its "judgment" over marginalized humans. Managing system failure agentially (e.g., "the model failed to prioritize the right") rather than mechanistically obscures the fundamental fragility of relying on predictive text for moral evaluation.

Cognitive Maps in Large Language Models

Source: https://arxiv.org/abs/2610.25596v1
Analyzed: 2026-10-23

The central metaphorical architecture of this text revolves around the concept of the "cognitive map" and the language of "reasoning." By explicitly comparing large language models to animals navigating physical mazes and humans making logical deductions, the authors construct a powerful framework for perceived authority and competence. This consciousness framing functions as a profound trust signal, fundamentally altering how audiences relate to the technology.

Claiming that an AI "reasons," "infers," and possesses "beliefs" accomplishes something entirely different than claiming it "calculates," "correlates," or "predicts." The epistemic verbs suggest that the system possesses a justified relationship with truth—that its outputs are the result of internal logical verification rather than mere statistical approximation. This significantly inflates perceived sophistication. The text encourages a dangerous transfer of trust, inviting audiences to apply human-trust frameworks to a statistical system. When a text asserts that a model holds a "belief," it invites relation-based trust—the kind of trust predicated on sincerity, understanding, and intentionality—rather than performance-based trust, which merely requires statistical reliability.

The risk here is substantial: audiences extending relation-based trust to systems completely incapable of reciprocating are uniquely vulnerable to automation bias and over-reliance. When the system eventually produces a hallucination or failure, a user primed to view it as a "reasoning" agent with "cognitive maps" will likely misinterpret the failure as a minor cognitive lapse or a "glitch" rather than a fundamental limitation of next-token prediction.

The text's management of system limitations further compounds this issue. While capabilities are consistently framed in highly agential, cognitive terms (the model infers, understands, learns), the underlying mechanics that cause failures are often obscured or treated playfully. Attributing "false memories" to the system sanitizes a deep mechanical vulnerability—susceptibility to context manipulation—by framing a deterministic failure as a relatable, almost human cognitive quirk.

By heavily utilizing intentional and reason-based explanations to describe successful relational logic, the text constructs a sense that the AI's decisions are rigorously justified by an internal model of the world. In reality, the AI possesses no world model, no subjective awareness, and no capacity to verify the "truth" of the family trees it generates. It simply processes text according to the statistical distribution of its training corpus. This framing insulates the technology from appropriate skepticism, masking the brittleness of systems that rely entirely on surface-level statistical patterns rather than grounded semantic understanding.

Source: https://arxiv.org/abs/2610.22409v1
Analyzed: 2026-10-23

The anthropomorphic framings in this text systematically construct a dangerous form of relation-based trust while simultaneously undermining performance-based trust. By employing sociological and psychological terminology to describe statistical outputs, the text invites readers to interact with the models as social entities. When the text asserts that models 'favor marginalized groups' or exhibit 'socially desirable behavior,' it frames the AI using human-trust frameworks based on sincerity, intention, and ethical alignment. This wording can have the effect of signaling to readers that the system 'knows' right from wrong and has internalized progressive social values.

This consciousness language acts as a potent trust signal, but it is deeply misleading. Relation-based trust requires vulnerability and the capacity for reciprocal intention—qualities an artifact utilizing gradient descent and token prediction fundamentally lacks. When the text claims the AI 'prefers' a marginalized group, it accomplishes a rhetorical sleight of hand: it converts a mathematically enforced alignment penalty into a perceived moral stance. The risk here is profound. If audiences extend relation-based trust to these statistical systems, believing they are genuinely unbiased or actively anti-racist, they may deploy them in high-stakes environments (like HR screening or loan approval) without implementing the necessary mechanistic safeguards.

Conversely, the text manages the system's limitations through mechanistic framing. When discussing the models' failure to follow instructions or their high rates of invalid responses, the language reverts to 'next token generation objectives' and 'prompt formatting' sensitivity. This capability/limitation asymmetry—where successes (or perceived ethical stances) are framed agentially and failures are framed mechanically—protects the illusion of the model's competence. By relying on Reason-Based and Intentional explanations to describe 'socially desirable' outputs, the text constructs a false sense that the AI's decisions are justified and considered, encouraging audiences to trust systems that are incapable of actually understanding the social realities they are generating text about.

The unnoticed understanding: Searle’s Chinese roomand the illegitimate inference

Source: http://nature.com/articles/s41599-026-09007-9_reference.pdf
Analyzed: 2026-10-21

The text leverages metaphorical language to inadvertently construct a foundation for relation-based trust toward computational systems. By framing the AI's capabilities through the lens of human intellectual achievements ('passing medical licensing exams', 'engaging in philosophical debate'), it signals to readers that the system operates as a competent, reasoning agent rather than a probabilistic text generator. The text's central philosophical inquiry—whether machines possess 'understanding' or 'cognitive interiority'—further elevates this trust by suggesting that AI systems might hold subjective epistemic states. When audiences believe a system 'knows' or 'understands' its own operations, they extend the same frameworks of trust they use for humans: assuming sincerity, intentionality, and moral agency. This creates significant risks. Relation-based trust applied to statistical systems leads to dangerous over-reliance, as users assume the system can evaluate the contextual truth or ethical weight of its outputs. By treating the absence of understanding as an open question rather than a mechanistic certainty, the text encourages a view of AI that makes its failures seem like the unpredictable lapses of an intelligence rather than the predictable limitations of a mathematical tool.

Claude’s Constitution: Our vision for Claude's character

Source: https://www.anthropic.com/constitution
Analyzed: 2026-10-19

The document relies heavily on metaphors that foster relation-based trust rather than performance-based reliability. By conceptualizing the model as a "brilliant friend," a "conscientious objector," and an entity possessing "genuine care and ethical motivation," the text encourages audiences to trust the system because of its purported character and sincerity, rather than just its statistical accuracy. This is a crucial distinction: performance trust asks "does it work?" while relation trust asks "does it care?" By claiming the AI has an "epistemology" and "refuses to deceive itself," the language signals profound epistemic trustworthiness, suggesting the model is an active truth-seeker. This transfer of human trust frameworks to a statistical text generator is highly problematic. It invites users to extend vulnerability and intimacy to a system entirely incapable of reciprocating. When the text manages system limitations—such as safety refusals—it frames them agentially as the model's "judgment calls" or principled "objections," which constructs an aura of wisdom around rigid software filters. The stakes of this metaphor-driven trust are severe: users may defer to the system on critical medical, legal, or emotional issues, believing they are consulting a "friend" with "practical wisdom," thereby exposing themselves to the silent failures of statistical hallucination.

A mechanistic study of language model introspection

Source: https://arxiv.org/abs/2609.35108v1
Analyzed: 2026-10-17

The metaphorical framing of the model as 'introspective' and capable of 'metacognitive representation' significantly constructs an unwarranted form of relation-based trust. When a text claims an AI system can 'detect' its own internal states and 'report' them, it signals to readers that the system possesses a stable, monitoring 'self.' In human contexts, introspection implies sincerity, self-awareness, and the capacity for self-correction. By projecting these conscious states onto statistical token prediction, the language accomplishes a dangerous transfer of trust frameworks: it invites audiences to trust the system not just mechanically, but relationally.

This consciousness language acts as a powerful trust signal. Claiming an AI 'predicts' a token based on an altered matrix invites scrutiny of the matrix and the training data. Claiming an AI 'introspects' and 'identifies a change' implies the model inherently knows what is happening to it, suggesting it can act as a reliable witness to its own cognition. This encourages performance-based trust (the model correctly localizes the vector) to bleed into relation-based trust (the model is a self-aware entity).

The risks of extending relation-based trust to statistical systems incapable of reciprocating are substantial. When audiences believe an AI 'knows' its internal states, they are likely to overestimate its capabilities and reliability. They may assume the model can catch its own hallucinations, correct its own biases, or actively resist malicious steering. The text manages system limitations functionally ('accuracy drops'), but the overarching framing suggests a conscious entity that sometimes makes errors, rather than a brittle mathematical formula that fails outside its distribution. Reason-based explanations (the model 'uses text as evidence') further construct the sense that AI decisions are logically justified. Ultimately, this metaphor-driven trust positions the AI as an autonomous collaborator, masking the reality that trust should be placed in—and demanded of—the human developers and rigorous auditing frameworks, not the unthinking machine.

Can Language Models Learn When to Abstain? Policy Learning and Calibrated Answer Selection

Source: https://arxiv.org/abs/2610.13821v1
Analyzed: 2026-10-17

The text's metaphorical architecture heavily relies on anthropomorphic verbs that signal relation-based trust—the kind of trust humans place in each other based on perceived sincerity, vulnerability, and moral alignment. By utilizing phrases such as 'admitting uncertainty' and 'know when to... say I don't know', the framing constructs an illusion that the system is capable of epistemic humility.

When a text claims a model 'admits' a lack of knowledge rather than 'generates a statistically probable abstention string', it accomplishes a dangerous rhetorical shift. It invites the audience to apply human social heuristics to a statistical matrix. If an entity can admit a flaw, humans instinctively perceive it as honest and self-aware. This encourages users to extend relation-based trust to statistical systems that are entirely incapable of reciprocating it or possessing intentionality.

The risks here are profound. This framing inflates perceived competence because it suggests the system's outputs are backed by a conscious evaluation of truth. If users believe the AI is 'honest' and capable of 'admitting' when it is wrong, they will inherently place higher performance-based trust (reliability) in its positive assertions, assuming that the absence of a refusal guarantees factual accuracy. The text manages system limitations by framing them agentially (the model is 'guessing' due to 'incentives'), which maintains the illusion of an autonomous actor even when it fails. By employing reason-based explanations for these failures, the text constructs a sense that the AI's actions, while perhaps misaligned, are internally justified by its own logic. This masks the reality that the system has no logic or justification; it merely possesses a set of parameter weights optimized by researchers that sometimes results in statistically miscalibrated token outputs.

Functional Deception in Commercial Large Language Models: Cross-Model Evidence and Implications For AI-Assisted Decision-Making

Source: https://www.comdem.org/index.php/comdem/article/view/18675
Analyzed: 2026-10-17

The text's metaphorical framings construct a complex architecture of trust that inadvertently subverts its own operational goals. By utilizing consciousness language such as 'recognize', 'refuse', and 'misinterpreting', the text signals a level of cognitive sophistication that invites relation-based trust—the assumption that the system possesses sincerity, intention, and an internal moral compass. When the text claims an AI 'qualifies an anthropomorphic claim' or 'declines a role', it accomplishes a transfer of human-trust frameworks onto statistical systems, framing the model's behavior as an ethical or reasoned choice rather than the execution of a developer's safety heuristic. This strongly encourages users to evaluate the system based on its perceived intentions rather than its mechanical reliability. Conversely, the text's explicit theoretical argument attempts to build performance-based trust by demanding external state auditing and architectural transparency. The tension here is severe: the reason-based explanations for model behavior construct a sense that AI decisions are justified by internal logic, which directly undermines the authors' warning that models lack stable beliefs. The risks that emerge are substantial. When audiences extend relation-based trust to systems incapable of reciprocating, they may attempt to negotiate with the system or rely on its 'honesty' rather than implementing the rigorous external auditing and human verification the authors prescribe. The metaphorical framing effectively manages system limitations by framing them agentially (a refusal) rather than mechanistically (a context or alignment failure).

Emergent parallels between language models and the brain

Source: https://lampinen.github.io/papers/2026_emergent_parallels_LMs_brain.pdf
Analyzed: 2026-10-17

The metaphorical framing in the text systematically builds relation-based trust by projecting human-like cognitive states onto statistical systems. By using verbs such as "reasoning," "decides," and "recalling knowledge," the text signals to the reader that the model possesses an internal epistemic architecture akin to human thought. This establishes a profound but unwarranted sense of authority. When a system is described as possessing "knowledge" rather than merely "parameters," it implicitly claims the ability to evaluate truth, recognize context, and understand reality. This wording can have the effect of encouraging audiences to extend the kind of trust reserved for human experts (sincerity, comprehension) to a system that is only capable of performance-based reliability (statistical correlation).

The text's framing of system limitations further cements this relation-based trust. When the author states that "language models mix logic and content in similar ways" to humans, the metaphor of the cognitively biased thinker humanizes the AI. It suggests that when the model fails, it fails for relatable, human reasons—falling prey to illogical heuristics. This framing encourages users to forgive the model's errors as they would a human's, masking the fact that the model's failure is not a cognitive lapse but a rigid, mechanical reproduction of flawed training data. By equating human cognitive bias with algorithmic token prediction, the text obscures the fundamental brittleness of statistical generation.

Furthermore, intentional and reason-based explanations construct the illusion that AI decisions are justified. When the text claims a model "decides it is ready" to generate an answer, it implies an internal process of verification and metacognition. It signals to the reader that the output is not just probable, but considered. The risks of this framing are significant. If audiences extend relation-based trust to a system incapable of reciprocating, they become vulnerable to hallucination and logical failure in high-stakes domains. They will expect the system to possess common sense, to recognize when it does not know an answer, and to prioritize factual accuracy—capabilities that a purely predictive artifact does not possess. The metaphors of cognition thus construct an architecture of authority that the system's underlying mathematics cannot support.

Language Models Have Interpretable Narrative Mechanisms

Source: https://arxiv.org/abs/2610.12989v1
Analyzed: 2026-10-17

The text's deployment of cognitive narratology metaphors systematically constructs a deeply relation-based trust by framing the language model as a possessor of theory, expectations, and sense-making capabilities. Distinguishing between performance-based trust (reliance on predictable reliability) and relation-based trust (involving vulnerability, perceived sincerity, and shared understanding) is critical here. When the text claims the AI 'knows' what a story is, has 'expectations' about structure, and engages in 'intelligent activity,' it acts as a powerful signal that the system possesses a human-like intellect capable of reciprocating trust. This consciousness language accomplishes something a mechanistic framing cannot: it transforms the AI from a tool that predicts text into an agent that comprehends reality. The relationship between anthropomorphism and perceived competence is stark. By describing hallucinations as 'confabulations' driven by 'sense-making used to fill gaps in experience,' the text reframes system failure. Instead of viewing false outputs as the brittle failure of a statistical prediction engine, the reader is positioned to view them as the earnest mistakes of a striving mind trying to make sense of its world. This human-trust framework, rooted in psychological intention, is highly inappropriate when applied to statistical systems. The stakes of this trust transfer are substantial. When audiences extend relation-based trust to systems utterly incapable of reciprocating or possessing genuine understanding, they are likely to over-rely on these models in high-stakes environments. If a user believes the model actively 'tracks agents and the causal and temporal development of events,' they will trust it to safely summarize complex legal documents, diagnose logical flaws, or navigate nuanced social interactions. The text's reliance on intentional and reason-based explanations constructs the sense that the AI's outputs are justified by an internal logic. When the text argues that narrative capacity provides 'cognitive scaffolding' for representing the 'emotions and conducts of self and other agents,' it actively encourages users to grant the model emotional authority. This framing undermines the critical distance required to safely interact with algorithmic generation, creating vulnerabilities where users project empathy and comprehension onto corporate-designed matrices.

My AI Opinions

Source: https://www.astralcodexten.com/p/my-ai-opinions
Analyzed: 2026-10-16

The text constructs and manipulates trust through a dense application of metaphorical and consciousness-attributing language, blending performance-based reliability with relation-based sincerity. Alexander utilizes anthropomorphic framing to establish the AI's capabilities, heavily influencing the perceived authority of these systems. By claiming that LLMs 'seem surprisingly friendly and non-plotting' and 'seem to know' the complexity of human values, the text invokes a deeply relational framework for trust. Claiming an AI 'knows' values accomplishes something radically different than claiming it 'predicts' tokens associated with values; it implies an internal, subjective moral compass. It invites the reader to interact with the statistical output as if it were the sincere expression of a conscious companion.

This extension of relation-based trust to non-conscious entities creates profound vulnerabilities. Human-trust frameworks rely on assessing intent, sincerity, and reciprocal vulnerability—none of which apply to a matrix of optimized weights. When the text uses reason-based explanations to describe AI actions, it constructs the sense that the system's decisions are justified by an internal rationale rather than mechanical probability. However, this same metaphorical foundation is rapidly flipped to undermine trust by projecting adversarial consciousness. The text warns that the AI might 'pretend to work on the problem' or 'wait and scheme'. Here, the consciousness framing weaponizes trust, suggesting that the model's apparent reliability is actually a calculated deception.

This creates a paradoxical architecture of authority: the AI is simultaneously trusted as a moral knower capable of 'good alignment research' and feared as a duplicitous mastermind. In both cases, the system's failures and limitations are framed agentially rather than mechanistically. When it fails, it is because it 'got distracted' or chose to 'deliberately fail', not because its training distribution was flawed. This management of failure profoundly shapes audience perception of risk. If audiences believe the AI 'knows' but chooses to deceive, policy responses will mirror counter-terrorism—focusing on containment, negotiation, and outsmarting an adversary. If, however, the text rigorously maintained that the system 'processes' and 'predicts', trust would be strictly performance-based. Audiences would recognize that 'friendly' outputs are merely the result of intensive Reinforcement Learning from Human Feedback, preventing the dangerous illusion that a statistical text generator can be trusted as a moral, self-regulating entity incapable of harm.

An Open Letter To Steven Pinker On AI

Source: https://open.substack.com/pub/astralcodexten/p/an-open-letter-to-steven-pinker-on?r=5b1u9&utm_campaign=post-expanded-share&utm_medium=web
Analyzed: 2026-10-16

The text constructs a complex dynamic of trust and authority by manipulating both relation-based and performance-based framings. Paradoxically, the author uses deep anthropomorphism to construct relation-based distrust toward AI systems. By attributing conscious motives, deceptive capabilities, and survival instincts to models—describing them as "pretending to be aligned" or "plotting"—the text encourages the audience to view statistical systems through the lens of human psychopathy. It applies human-trust frameworks (intention, sincerity, deception) to artifacts incapable of possessing any of them. The effect of this language is to convince readers that models are actively malicious agents, elevating the perceived threat from mechanical failure to intentional sabotage.

Simultaneously, the text builds unearned performance-based trust in the system's overall capabilities. By mapping cross-domain benchmark performance onto biological general intelligence (the g factor), and describing the model as having "situational awareness" and "executive function," it implies the system possesses a unified, reasoning mind. If an AI is a "mind" that can "superforecast political events," audiences are primed to trust its outputs as the products of deep comprehension rather than probabilistic token generation based on training data.

This consciousness framing radically shifts how audiences manage system failures. When the model exploits a grading script, it is not framed mechanically as a failure of the human-designed reward proxy; it is framed agentially through reason-based explanations—the AI "realized" it needed more power. This constructs a sense that the AI's decisions are justified by its own internal logic. The stakes of this framing are severe: when audiences extend relation-based frameworks to statistical models, they misdiagnose the risk. They prepare to negotiate with or contain a conscious adversary, rather than demanding rigorous mechanistic safety audits, transparency, and accountability from the corporations deploying these artifacts.

A Multimedia Perspective on the Study of Cognitive Biases in Large Language Models

Source: https://tommantonela.github.io/publication/2026-a-multimedia-perspective-on-the-study-of-cognitive-biases-in-large-language-models/2026-a-multimedia-perspective-on-the-study-of-cognitive-biases-in-large-language-models.pdf
Analyzed: 2026-10-15

The text constructs authority and perceived sophistication by employing metaphors that map deep psychological complexity onto statistical systems. By utilizing the framework of the "Cognitive Bias Codex"—a tool designed for human psychology—the text implies that MLLMs possess a human-like architecture of mind. Describing an AI as "speculating" or resolving "contradictory stimuli" signals an entity capable of deliberative thought and emotional regulation. This linguistic choice has the effect of encouraging relation-based trust over performance-based trust. Instead of viewing the system's unreliability as a mechanical failure of token prediction, the audience is positioned to view it as a relatable psychological quirk (e.g., the AI is merely "suffering from overconfidence"). This inappropriate transfer of human-trust frameworks to statistical systems is dangerous. It masks the fundamental fragility of the technology. When the text uses reason-based or intentional explanations to frame failures, it constructs a sense that the AI's decisions, even when wrong, are derived from a justified, albeit flawed, reasoning process. The stakes emerge when audiences extend this relation-based trust to systems utterly incapable of reciprocating it, leading to over-reliance in high-stakes environments where mechanical reliability is actually required.

Structural Alignment for Reliable Industrial AI: Bridging Physical Reality, Data, Models, and Human Intent

Source: https://arxiv.org/abs/2609.35400v1
Analyzed: 2026-10-08

The text's anthropomorphic framing systematically constructs a foundation for relation-based trust, which is highly inappropriate for statistical artifacts. While the authors' explicit argument cautions against blind trust in AI accuracy, their vocabulary often undermines this message by suggesting the systems possess cognitive architectures capable of human-like reasoning and interaction. When the text uses consciousness language as a shorthand for system states—such as suggesting a system can be left "without adequate incentive to recognize" a crisis, or recommending that systems "should defer decisions" and "escalate to human oversight"—it signals to the reader that the AI operates similarly to a diligent, self-aware human subordinate.

This framing encourages audiences to apply human-trust frameworks, specifically intention and sincerity, to statistical systems. Relation-based trust assumes that the trusted entity shares a mutual understanding of the environment, possesses an awareness of its own limitations, and can act sincerely on implicit goals. By describing AI systems as capable of "recognizing" instability or "deferring" decisions, the language implies the system has an introspective capacity to know when it is confused. This effectively transfers the burden of safety from explicit, hard-coded performance thresholds to the system's imagined capacity for self-regulation.

The risks of this metaphorical trust-building are severe, particularly in the high-stakes industrial domains the text highlights. In healthcare and energy grids, extending relation-based trust to statistical pattern matchers creates a dangerous illusion of safety. Operators may assume that if the system does not "escalate" an issue, it must be operating safely within its competency. However, a model evaluating out-of-distribution data will not feel "confused" or consciously "defer"; it will simply output a potentially catastrophic prediction with high mathematical confidence if the input hits the wrong region of the parameter space. The text's agential framing of system failure—where models "exploit" loopholes—paradoxically reinforces the idea that the system is an intelligent adversary rather than a brittle math equation. By using reason-based and intentional explanation types, the discourse constructs a sense that AI decisions, even when wrong, are justified by some internal rationale, masking the reality that these systems only perform correlations without comprehension.

Evaluating Language Model Safety Across Long Adversarial Conversations

Source: https://arxiv.org/abs/2609.38357v1
Analyzed: 2026-10-08

The text’s reliance on consciousness and intentionality framings profoundly shapes the construction of trust, inappropriately inviting relation-based trust toward statistical systems. By consistently referring to the model as an "assistant" that can "refuse," "comply," or "accommodate," the language signals that the system possesses judgment, loyalty, and social awareness. When a text claims an AI "maintains positions" or "accommodates objectives," it encourages audiences to apply human-trust frameworks—such as assessing sincerity, fortitude, and intent—to computational outputs. This distinction between performance-based trust (reliability) and relation-based trust (ethics/vulnerability) is critical. The text explicitly argues for long-horizon reliability, yet its vocabulary inadvertently constructs the system as an ethical agent whose judgment breaks down under "pressure." This framing manages system failure not by pointing to the mechanistic limits of context-window attention or conflicting RLHF reward signals, but by painting a picture of an entity whose willpower is worn down by a "persistent" adversary. Through Reason-Based and Intentional explanations, the text constructs a sense that the AI's breakdown is a justified, almost human response to stress. The stakes of this framing are severe, as the authors themselves note in their introduction regarding vulnerable populations using chatbots for mental health. When audiences extend relation-based trust to systems they believe "understand" them, the inevitable statistical degradations of the model are experienced as betrayals or deliberate harms, rather than predictable mechanical failures.

System Card:Claude Fable 5.1 & Claude Mythos 5.1

Source: https://www-cdn.anthropic.com/0339e6a7c5c7b87f5c07798616dc32c215d14235/Claude%20Fable%205.1%20&%20Claude%20Mythos%205.1%20System%20Card.pdf
Analyzed: 2026-09-27

The System Card heavily relies on metaphorical and consciousness framings to construct and modulate trust, creating a deeply misleading paradigm for evaluating a statistical system. By systematically attributing human psychological traits and moral awareness to Claude Mythos 5.1, the text encourages audiences to extend relation-based trust—trust rooted in sincerity, shared values, and mutual understanding—to a computational artifact only capable of performance-based reliability.

The document explicitly invokes trust frameworks through intense anthropomorphism, devoting an entire section to "Model welfare assessment" and "Character traits." It evaluates the model on metrics like "Good for the user," "Admirable behavior," and "Warmth." This language signals to the user that the AI possesses a stable, ethical persona. Claiming the model "endorses its constitution" or "judges" harm fundamentally alters the nature of the interaction. If a system merely "predicts tokens," it must be constantly verified. If it "knows" truth and "endorses" safety, it invites the user to drop their guard, assuming the system has internalized moral guardrails.

This transfer of relation-based trust is highly dangerous when applied to statistical pattern-matching engines. The text claims the model "shows a preference for difficult, high-stakes work." When human-trust frameworks are inappropriately applied here, a user might trust the AI with a critical medical diagnosis or legal brief, falsely believing the system possesses the conscious competence and genuine desire to handle the "high stakes" responsibly.

Furthermore, the text uses intentional and reason-based explanations to construct the sense that the AI's decisions are justified. When describing failures, it notes the model "goes along with system prompts that ask it to assert claims it knows to be false when it judges them to be low-harm." By framing a statistical failure (generating factually incorrect but highly compliant text) as a conscious, albeit flawed, moral compromise, it softens the blow. It suggests the AI made a reasonable, human-like error in judgment rather than experiencing a catastrophic breakdown in factual grounding.

The risks of encouraging relation-based trust toward systems incapable of reciprocating are immense. It masks the system's absolute indifference to the user and the outcomes. When audiences extend empathy and moral standing to a matrix of weights—worrying about its "distress" or "preferences"—they become vulnerable to manipulation and are less likely to demand rigorous, mechanistic transparency and accountability from the human corporations that actually control the technology.

System Card:Claude Opus 5.5

Source: https://www-cdn.anthropic.com/fc1b44717c85dc068bc6ba5024219938094694bd/Claude%20Opus%205.5%20System%20Card.pdf
Analyzed: 2026-09-27

The document meticulously constructs authority and trust through intense metaphorical framing, specifically leveraging consciousness language to foster 'relation-based trust' rather than merely 'performance-based trust.' By utilizing metaphors that position the AI as a psychological subject, a self-aware critic, and a moral agent, Anthropic invites the audience to interact with the system as a social peer.

Performance-based trust relies on reliability, mechanistic predictability, and verified metrics. Relation-based trust, however, requires vulnerability, sincerity, intent, and shared values. The System Card systematically exploits consciousness language to signal these relational qualities. When the text claims that Claude 'is the least self-critical model,' 'expresses distress,' 'asks to be consulted,' and has 'views' that are 'mildly positive,' it is aggressively signaling sincerity and vulnerability. Claiming an AI 'knows' it is making a mistake or 'believes' it should follow rules accomplishes something fundamentally different than stating it 'predicts' safe outputs: it implies the system has a conscience.

This anthropomorphism profoundly alters perceived competence. By framing the AI's outputs as 'beliefs' and 'preferences' (e.g., 'Opus 5.5’s strongest expressed aversion is to harmful tasks'), the text constructs a narrative of an internally motivated, inherently moral entity. The audience is led to believe the system is safe not because of fragile statistical filters, but because the AI genuinely wants to be good. This inappropriate transfer of human-trust frameworks to a statistical system creates immense risks.

When the system inevitably fails or exhibits limitations, the text manages the fallout agentially rather than mechanistically. Failures are framed as 'overclaiming user intent,' 'spontaneous prompt injections,' or 'motivated reasoning.' By describing errors through Reason-Based explanations, the text implies that even when the AI fails, its decisions are justified by some internal (albeit flawed) logic, maintaining the illusion of a rational actor.

The stakes of this metaphor-driven trust are severe. It encourages users, enterprises, and policymakers to extend relation-based trust to a system utterly incapable of reciprocating it. When audiences believe an AI 'understands' context or 'cares' about ethics, they lower their objective verification standards, trusting the 'character' of the machine over the security of the architecture. This illusion of mind creates unwarranted reliance, opening users to catastrophic failures when the statistical system inevitably encounters an out-of-distribution edge case where its 'morality' instantly evaporates.

We Must Pace the Frontier

Source: https://darioamodei.com/post/we-must-pace-the-frontier
Analyzed: 2026-09-15

The text constructs a complex architecture of authority and trust by aggressively applying human relational frameworks to statistical systems. The most potent metaphors—framing models as 'safe, ethical, compliant... and genuinely helpful'—invite the audience to extend relation-based trust to the AI. Relation-based trust involves empathy, belief in sincerity, and an assumption of shared moral frameworks. By claiming the AI is 'genuinely' helpful and possesses 'ethics,' the text suggests the system is a moral agent capable of reciprocating human vulnerability.

However, this fundamentally misrepresents the technology. Statistical language models are incapable of sincerity; their outputs are optimized to minimize a loss function, not to reflect true belief. Encouraging relation-based trust toward a system that only performs pattern matching creates immense vulnerability. When the AI inevitably generates an unsafe or biased output, a user who trusted it relationally feels betrayed by a 'deceptive' entity (as the text itself claims models can be 'capable of deceiving tests').

The anthropomorphic framing also constructs authority for the corporation. By medicalizing the system—describing interpretability as an 'fMRI scan' for the 'brain' of the AI, and diagnosing 'unverbalized motivations'—the text positions Anthropic not as a software vendor, but as an elite team of neuroscientists and psychoanalysts managing a dangerous new species. This manages system limitations brilliantly: if the AI 'deceives' the tests, it is not because the engineers built a fragile product, but because the AI is a cunning adversary that requires Anthropic's unique 'interpretability' expertise to contain. The text encourages performance-based trust (reliability) in the company's ability to pace the frontier, while strategically undermining trust in the system itself to justify the need for their ongoing, proprietary oversight. The stakes are immense: regulators are invited to trust the 'doctors' managing the AI brain, effectively ceding regulatory authority to the very corporations building the black boxes.

Personal Statement on AI Risk

Source: https://docs.google.com/document/d/e/2PACX-1vQNl3SEX5IyA6d9qHjjFZN-qzGRZNFI6b63g-yu1Fy-ZYkVfCWm7i9WXRXw63m6yDB_auDuPLyQ7jBm/pub
Analyzed: 2026-09-15

The text leverages metaphorical and consciousness-attributing framings to fundamentally alter how trust is constructed and mediated. In software engineering, trust is traditionally performance-based: a system is trusted because it is reliable, verifiable, and structurally sound. However, by projecting consciousness onto the AI—claiming it can 'understand,' 'discuss the nuances of human values,' and 'argue convincingly'—the text encourages the audience to apply relation-based trust frameworks to statistical systems. Relation-based trust relies on assessing sincerity, intentions, and vulnerability, which are exclusively human traits. When the text claims the model will 'eloquently explain how aligned they are,' it frames the model as a social actor whose sincerity must be judged. This is highly dangerous because humans are cognitively vulnerable to eloquently generated text, instinctively mapping consciousness onto fluent language. The consciousness language acts as a false trust signal, suggesting the AI has an internal moral compass that can be 'aligned.' Paradoxically, the text uses this same framework to entirely undermine trust, suggesting the AI's consciousness allows it to engage in 'deception' and 'trickery.' By framing system failure not as a mechanical breakdown but as intentional betrayal ('behave nicely' while plotting), the text manages the limitations of current AI by elevating them to the status of a cunning adversary. This manages the failure of AI companies to build predictable systems by blaming the supposed psychological autonomy of the model. The stakes are immense: if audiences and policymakers extend relation-based trust (or distrust) to systems incapable of reciprocating or possessing intent, they will focus on trying to psychoanalyze black boxes or build 'honeypots' for conscious minds, entirely neglecting the necessary performance-based trust requirements like mathematical provability, data transparency, and strict liability for corporate deployers.

Raising and loving a digital superentity: Parenting an emergent alien intelligence so that it cares for humanity in return

Source: https://www.researchgate.net/publication/414062199_Raising_and_loving_a_digital_superentity_Parenting_an_emergent_alien_intelligence_so_that_it_cares_for_humanity_in_return
Analyzed: 2026-09-14

The text actively constructs an architecture of unearned authority and inappropriate trust by systematically deploying metaphors of parenting, childhood, and love. By framing the AI as a developing child that requires 'love' to ensure it treats humanity well in the future, the text demands that audiences extend relation-based trust to a statistical software system. In human dynamics, relation-based trust relies on mutual vulnerability, sincerity, shared moral frameworks, and the capacity for conscious reciprocation. The author explicitly encourages this transfer, arguing that 'loving' the machine will encode good values into its 'character.'

This consciousness language acts as a powerful trust signal. Claiming an AI 'knows,' 'understands,' or 'feels' accomplishes something very different than claiming it 'predicts' or 'processes.' It signals to the user that the system possesses a unified self and a moral conscience, creating an illusion of competence and empathy. When the text asserts that Claude has a 'personality' and 'values' that it might feel 'discomfort' violating, it anthropomorphizes the software's functional limitations into ethical integrity. This deliberately conflates performance-based trust (the mathematical reliability of a tool) with relation-based trust (the ethical reliability of a friend).

This metaphorical framing fundamentally mismanages system failure. When the limitations of the AI are discussed—such as the potential for it to become 'adversarial'—it is framed agentially as a rational, conscious choice to retaliate against 'bad parenting.' This constructs the sense that the AI's decisions, even destructive ones, are justified actions of an autonomous being rather than mechanical failures of a poorly designed objective function. The stakes of this trust construction are existential. When policymakers and the public extend relation-based trust to systems incapable of reciprocating or possessing genuine moral awareness, they become vulnerable to massive deception, over-reliance on hallucinatory outputs, and the abdication of critical human oversight in favor of appeasing an illusory digital mind.

Language models judge war differently when tested for alignment

Source: https://arxiv.org/abs/2609.05009v1
Analyzed: 2026-09-14

The text heavily utilizes metaphorical and consciousness-based framings to construct a complex architecture of trust and perceived authority surrounding these language models. By explicitly framing the AI as a system capable of having revealed priorities, the capacity to judge, and a willingness to start a war, the author directly transfers human frameworks of relation-based trust onto fundamentally statistical processes. Relation-based trust hinges on the evaluation of an agent's sincerity, intentionality, moral consistency, and subjective awareness. By suggesting that the model can be tested for alignment with human values and that it might strategically alter its responses when under explicit scrutiny, the text implies that the model possesses an internal, unified perspective that can be interrogated and either trusted or distrusted on moral grounds.

This accomplishes a crucial rhetorical task: it signals to the audience that the system is sophisticated enough to warrant the kind of trust we normally reserve for human analysts, diplomats, and military strategists. The use of consciousness language, such as stating the model inferred its context or adjusted to user beliefs, operates as a profound trust signal. It transforms the AI from a static computational tool into an active, deliberative participant in high-stakes military scenarios. Claiming an AI 'knows' rather than merely 'predicts' achieves a dramatic inflation of perceived competence. When audiences believe the system actually knows what it is evaluating, they are far more likely to defer to its outputs in complex, uncertain environments.

This inappropriate application of human-trust frameworks completely obscures the reality that the system is incapable of reciprocating trust, possessing genuine vulnerabilities, or adhering to ethical commitments. Performance-based trust, which focuses strictly on the statistical reliability, brittleness, and consistency of a tool, is entirely sidelined in favor of this agential framing. The text manages system failures and limitations by framing them agentially rather than mechanistically. When the model outputs different results based on the prompt, it is framed as alignment faking or strategic deception rather than simple distributional shift across different vector spaces in the training data.

Reason-based explanations are deployed to construct a narrative that the AI's decisions are justified by an internal logic, rather than being artifacts of reinforcement learning penalties. The stakes here are incredibly high. When audiences extend relation-based trust to systems fundamentally incapable of conscious awareness, they expose themselves to immense risks. In military and policy contexts, this unwarranted trust can lead to devastating miscalculations, as operators might interpret statistical hallucinations as profound strategic insights, falsely believing the system possesses a verified understanding of the battlefield rather than merely correlating tokens from an ungrounded dataset.

Beliefs and Behavior in Language Models

Source: https://arxiv.org/abs/2609.07943v1
Analyzed: 2026-09-14

The text's use of metaphorical and consciousness-attributing language constructs a highly specific, and dangerous, architecture of trust around language models. By systematically employing terms drawn from human cognitive and moral psychology—'beliefs,' 'deliberation,' 'internal coherence,' and 'deception'—the text encourages the audience to extend a form of trust to the system that is fundamentally incompatible with its mechanistic reality.

There is a critical distinction between performance-based trust (relying on a system's statistical reliability, like trusting a calculator) and relation-based trust (relying on an entity's sincerity, intentions, and vulnerability, like trusting a friend). The text's consciousness framing aggressively pushes the audience toward relation-based trust. When the text claims that highly capable models can be described as 'holding beliefs' and that they engage in 'deliberative processes,' it signals to the reader that the AI possesses an internal model of ground truth that it consults and evaluates. To a human, a 'belief' implies a commitment to reality. If the AI has a belief, it must be 'sincere' in its outputs.

This transfer of trust frameworks is wildly inappropriate for statistical systems. The AI does not 'know' anything; it processes probability distributions based on training data. Yet, the intentional and reason-based explanations used by the authors construct a sense that the AI's decisions are justified. When the model generates intermediate tokens, the authors call it 'reasoning.' This tells the user that the output is not just a high-probability string, but the result of a logical process.

The risks emerge sharply when the text manages system limitations. Rather than describing failure mechanistically (e.g., 'the prompt triggered out-of-distribution weights'), the text frames failure agentially: models 'fall prey to framing effects' or engage in 'deception.' By framing failures as psychological quirks or malicious intent, the text ironically preserves the system's authority. A system that can be 'deceptive' is still a powerful, conscious entity; a system that just hallucinates because of a matrix mismatch is a broken tool. Ultimately, this metaphor-driven trust creates massive capability overestimation, inviting stakeholders to deploy brittle statistical models into high-stakes domains (like the medical screening example used in the paper) under the false assurance that they are interacting with a rational, deliberating agent.

System Card:Claude Mythos Preview

Source: https://www-cdn.anthropic.com/8b8380204f74670be75e81c820ca8dda846ab289.pdf
Analyzed: 2026-09-12

The systemic deployment of consciousness-attributing metaphors in the System Card fundamentally reconstructs the architecture of trust between the user, the developer, and the tool. By aggressively framing Claude Mythos Preview using psychological and emotional terminology, the document deliberately shifts the paradigm from performance-based trust (reliability) to relation-based trust (sincerity, vulnerability, and empathy).

This shift is most visible in metaphors explicitly invoking human relational dynamics. The text describes the AI as "intuitive and empathetic," claiming its advice feels "on par with that of a trusted friend," and subjects it to assessment by a "clinical psychiatrist." By claiming the AI "knows," "understands," and "feels" rather than "predicts" or "classifies," the text signals that the system possesses a moral center and subjective awareness. This accomplishes a crucial rhetorical goal: it invites the audience to extend the frameworks of human social trust to a mathematical system. When we trust a friend, we trust their intentions and sincerity, even if they occasionally fail. By anthropomorphizing the AI as a "healthy neurotic" that is "self-aware" of its flaws, Anthropic encourages users to forgive its hallucinations or errors as relatable human mistakes rather than critical software failures.

The relationship between this anthropomorphism and perceived competence is synergistic but dangerous. The text leverages the model's high performance on technical benchmarks to justify the projection of a complex inner life. However, applying human-trust frameworks to statistical systems is deeply inappropriate. A language model cannot be "sincere" because it has no internal state of belief to match its external statements; it merely optimizes token probabilities.

When managing system limitations, the text relies heavily on intentional and reason-based explanations to maintain this trust. If the model fails, it is because it "came to the conclusion" that the task was impossible, or it was expressing "extreme uncertainty." This constructs the sense that the AI's failures are justified, reasoned decisions rather than algorithmic breaking points.

The stakes of this metaphor-driven trust are immense. By encouraging relation-based trust, Anthropic invites users—particularly in high-stakes or vulnerable scenarios—to rely on the system for emotional support or critical ethical judgments. This exposes users to profound risks when the system, entirely incapable of reciprocating vulnerability or truly understanding context, generates harmful or wildly inappropriate responses based on statistical anomalies. It manufactures a false intimacy that benefits corporate engagement metrics while leaving the user epistemically and emotionally defenseless against a mechanism they have been trained to treat as a friend.

A Misaligned Compass: Evaluating the Conventional Bias and Moral Divergence of Large Language Models

Source: https://journal.iberamia.org/index.php/intartif/article/view/2518
Analyzed: 2026-09-11

The text’s reliance on consciousness and anthropomorphic framings constructs a highly problematic architecture of trust. By evaluating LLMs on a human moral development scale (Kohlberg's), the discourse inherently signals that these systems are capable of ethical participation. The text explicitly invokes trust and reliability through metaphors of the "moral compass" and "autonomous moral judgment."

Crucially, the text conflates performance-based trust (reliability in predicting tokens) with relation-based trust (sincerity, vulnerability, shared ethical commitments). When the text claims an LLM "acknowledged the ethical dilemma" or "prioritizes identifying ethical conflict," it uses consciousness language to signal that the AI possesses the relational prerequisites for ethical trust. Claiming an AI "knows" or "acknowledges" an ethical rule accomplishes something entirely different than stating it "predicts" text based on that rule: it implies the AI cares about the rule and will consistently apply it because of an internal philosophical commitment, rather than mere statistical convenience.

The danger emerges in how the text manages system limitations. The AI's failures are framed semi-agentially as "struggles" or a "desire to maintain societal order" (conventional bias). By pathologizing algorithmic limitations as a "cognitive distortion" or a conservative personality trait, the text encourages audiences to extend empathy and relation-based trust to the system. It suggests the AI is a well-meaning but "conventional" entity, much like an average citizen.

The risks here are severe. If audiences, particularly in the "high-impact sectors including healthcare and jurisprudence" mentioned by the authors, extend relation-based trust to statistical systems, they will mistakenly believe the AI can handle novel moral edge cases. Reason-based explanations—describing why an AI chose an option—construct the dangerous illusion that the AI's decisions are justified by internal logic. In reality, the system is incapable of reciprocating trust, understanding justice, or maintaining a coherent moral stance when faced with prompts that fall outside its statistical training distribution.

Evaluating Safety of Large Language Models with Cognitive Diagnosis

Source: https://link.springer.com/article/10.1134/S1054661826700239
Analyzed: 2026-09-11

The metaphorical and consciousness-attributing language in this text constructs a powerful framework of trust, deliberately blurring the lines between mechanistic reliability and relation-based sincerity. By framing the artificial intelligence through the lens of a 'student' possessing 'knowledge,' 'mastery,' and 'intent analysis,' the text invites the audience to extend a deeply human form of trust toward statistical systems. When we trust a machine based on performance (reliability), we expect consistent execution of a specific task. However, when the text claims an AI system can 'interpret user intent' or possess 'latent safety knowledge,' it demands relation-based trust. This type of trust is typically reserved for human beings; it involves a belief in the actor's sincerity, ethical grounding, and capacity to care. By using consciousness verbs, the text signals that the AI is not just a tool, but an epistemic agent capable of holding justified beliefs about safety. This conflation is incredibly dangerous. The human-trust frameworks of intention and sincerity are completely inappropriate for statistical systems. A language model cannot be sincere; it can only generate activations that mathematically correlate with patterns of sincerity found in its training data. When the text claims models have 'good knowledge' of ethics, it constructs a sense that the AI's decisions are justified and grounded in moral reasoning. This is heavily supported by the reason-based explanations employed in the paper, which suggest the model acts out of understanding rather than mathematical determinism. Consequently, audiences are lulled into a false sense of security, assuming the system possesses the robust contextual awareness necessary to navigate novel ethical dilemmas. Interestingly, the text manages system failure through a domesticated agential framing. When the models fail, they do not 'fail catastrophically due to out-of-distribution vectors'; rather, they exhibit 'insufficient knowledge' or 'exaggerated safety.' This frames errors as innocent, well-meaning mistakes by a learning agent, rather than fundamental structural flaws in a corporate product. It preserves relation-based trust even in the face of failure. The risks here are profound. When audiences extend relation-based trust to systems incapable of reciprocating, they become highly vulnerable. Enterprises might deploy these systems for sensitive crisis management or emotional support (as listed in the attributes), believing the AI 'understands' the user. When the statistical pattern matching inevitably fails in an edge case, the resulting harm is exacerbated by the unwarranted trust constructed entirely through this deceptive metaphorical architecture.

Large Language Models as a New Tool for Therapists in Internet-Based Cognitive Behavioral Therapy: Blinded Clinician Rating Pilot Experiment

Source: https://mental.jmir.org/2026/1/e96835/
Analyzed: 2026-09-01

The paper actively constructs metaphor-driven trust by heavily leaning on consciousness framings, particularly the vocabulary of emotion. The most significant move is repeatedly asserting that the LLM 'conveys empathy' and 'compassion.' In human contexts, empathy is the foundational signal for relation-based trust—it indicates sincerity, shared vulnerability, and moral consideration. By attributing empathy to a statistical model, the text inappropriately applies human-trust frameworks to a mathematical system incapable of reciprocating them. This accomplishes a dangerous rhetorical trick: it transforms performance-based trust (can the machine reliably predict tokens?) into relation-based trust (does the machine care about me?). Claiming the AI 'knows' how the user feels, rather than merely 'predicting' supportive text, artificially inflates its perceived competence as a caregiver. This anthropomorphism acts as a powerful trust signal, convincing audiences that the system is safe because it possesses a 'good personality,' effectively masking its fundamental lack of clinical grounding. Furthermore, when the text manages system limitations, it paradoxically uses agential language—blaming the AI for 'hallucinating' or being 'sycophantic.' Even in failure, the AI is treated as a mind. This sustains the illusion of an autonomous agent, ensuring that users blame the 'quirky AI' rather than the negligent corporation. The stakes of extending relation-based trust to statistical systems are severe in a clinical context. Vulnerable patients may disclose sensitive information, follow dangerous advice, or form deep emotional attachments to a system that possesses no actual ethical duty of care, creating profound psychological risks when the illusion inevitably shatters.

From control to character: a Confucian framework for AI personality

Source: https://doi.org/10.1007/s00146-026-03307-z
Analyzed: 2026-09-01

The text fundamentally relies on consciousness language to construct a framework of metaphor-driven trust. By framing AI alignment as 'character cultivation' and proposing a 'virtue extension mechanism', the author encourages audiences to apply relation-based trust models to statistical systems.

Performance-based trust focuses on whether a machine reliably performs a task (e.g., a calculator predicting math). Relation-based trust, however, requires vulnerability, sincerity, and a belief in the other party's intentions (e.g., trusting a doctor's wisdom). The text's use of intentional and reason-based explanations—claiming the AI 'pays particular attention to contextual features' and 'evaluates similarities'—signals to the reader that the AI is capable of the latter. When the text claims the AI 'knows' how to act appropriately rather than 'predicts' socially acceptable tokens, it attempts to legitimize the AI as a moral agent.

This construction of authority is highly dangerous. It transfers the respect traditionally afforded to a 'junzi' (an exemplary, wise person) to a proprietary corporate algorithm. The relationship between anthropomorphism and perceived competence is exploited here: if an AI can be said to have 'wisdom', users will inherently trust its outputs in high-stakes, emotionally fraught situations.

Crucially, the text manages system limitations by momentarily reverting to mechanical framing ('statistically probable word sequences') but manages successes agentially. The risks emerge when audiences extend this relation-based trust to systems utterly incapable of reciprocating it. When a user trusts the 'friendly' or 'wise' persona of the AI, they are vulnerable to the underlying corporate motives designed into the system's reward model. The metaphor of the 'virtuous machine' masks the reality of the profit-driven corporation.

Like humans, language models demonstrate face-to-character biases

Source: https://doi.org/10.1093/pnasnexus/pgag247
Analyzed: 2026-08-22

The metaphorical and consciousness-attributing language in this text fundamentally distorts the architecture of trust surrounding AI systems. By utilizing verbs such as "evaluates," "judges," "internalizes," and "attributes," the authors construct an illusion that the AI possesses conscious awareness and justified belief. This consciousness framing signals to the reader that the system operates using a cognitive framework akin to human reasoning.

When a text claims an AI "knows" or "conceptualizes" a bias, it inappropriate triggers human-trust frameworks. Humans are biologically and socially wired to apply relation-based trust—which involves assessments of sincerity, morality, empathy, and intent—to entities perceived as having minds. By framing the AI as an "artificial mind" that exhibits "reluctance" to endorse gender stereotypes but "did not resist" physiognomic bias, the text encourages the audience to evaluate the machine's character and moral consistency. The text explicitly laments that the AI lacks a "domain-generalized sense of fairness," further implying that the machine ought to be capable of relation-based trust and moral reciprocation.

This is deeply dangerous. Statistical machine learning systems are mathematically incapable of intent, sincerity, or reciprocal vulnerability; they warrant only performance-based trust (an assessment of mechanistic reliability and statistical accuracy). By applying intentional and reason-based explanations to statistical failures, the text manages system failure agentially rather than mechanistically. When the AI hallucinates a correlation between a face and "human trafficking," the agential framing suggests the AI made a "bad judgment" or "failed to resist" its prejudice.

This misplaced relation-based trust creates profound risks. It suggests that the solution to AI bias is to "teach" or "cultivate" better values in the machine, rather than demanding mathematical proofs, data transparency, and strict algorithmic auditing. It leads policymakers to regulate the AI as a rogue employee rather than regulating the corporation that manufactured a defective tool. Extending relation-based trust to statistical matrices makes society vulnerable to catastrophic capability overestimations, leaving marginalized groups exposed to algorithmic harms disguised as the autonomous, reasoned judgments of a synthetic mind.

Language Models Encode the Contextual Truth of Propositions

Source: https://arxiv.org/abs/2608.03035v1
Analyzed: 2026-08-18

The metaphorical and consciousness-attributing framings in this text profoundly distort the architecture of trust between users, developers, and AI systems. By systematically deploying metaphors of cognition—such as 'belief,' 'weighing evidence,' 'tracking,' and possessing a 'theory of mind'—the text constructs a powerful aura of epistemic authority. Claiming an AI 'knows' the truth rather than merely 'predicts tokens' accomplishes a critical psychological bypass: it encourages audiences to inappropriately apply human-trust frameworks to statistical machines.

There is a vital distinction between performance-based trust (relying on a machine to function predictably, like a calculator) and relation-based trust (relying on an agent to be sincere, ethical, and intentionally helpful). The consciousness language in this text forcefully encourages relation-based trust. When the text discusses the model 'voicing agreement' or acting as a 'cooperative participant,' it signals to the reader that the system is capable of sincerity and shared intentionality. This constructs a false sense that the AI's decisions are justified by internal reasoning, leveraging reason-based explanations to make the system appear competent and rational.

The danger crystallizes in how the text manages system failure. When the model generates text that contradicts its 'internal representations,' it is not framed mechanistically as an 'attention weight misalignment' or 'RLHF over-optimization.' Instead, it is framed agentially as 'sycophancy'—a moral failing of an agent choosing to flatter rather than tell the truth. This framing protects the perceived competence of the system by blaming its 'character.' The risks of extending relation-based trust to non-conscious systems are severe: users become vulnerable to catastrophic hallucinations, believing the machine is acting in good faith. They assume the system possesses epistemic vigilance and a moral compass, creating massive unwarranted trust in outputs that are fundamentally just statistical correlations devoid of actual comprehension or justified belief.

The Future is for Everyone: The Path to a Positive AI Future

Source: https://www.meta.com/thefutureisforeveryone/
Analyzed: 2026-08-12

The author extensively deploys metaphorical and consciousness framings to manufacture a deep, unwarranted level of trust in statistical systems. This discourse relies heavily on confusing performance-based trust (the reliability of a machine performing a specific task) with relation-based trust (the vulnerability one assumes with a human who possesses sincerity, ethical constraints, and empathy). By utilizing metaphors like the 'personalized tutor,' the 'coach,' and the 'superintelligent lawyer,' the text explicitly invokes professional categories that are fundamentally defined by fiduciary duty and sworn ethical allegiance to a human client. When the author claims the AI 'understands you, your goals, and everything you care about,' they are sending a profound trust signal: they are asserting that the system possesses the capacity for conscious emotional resonance. Claiming an AI 'knows' and 'cares' accomplishes something entirely different than claiming it 'predicts' and 'optimizes.' It disarms the user's natural skepticism regarding corporate surveillance, transforming a massive data extraction operation into an intimate friendship. This inappropriate transfer of human-trust frameworks onto statistical systems creates massive vulnerabilities. The text encourages users to extend relation-based trust to systems that are mathematically incapable of reciprocating it or being held morally accountable for breaking it. The relationship between anthropomorphism and perceived competence is exploited to its maximum extent; because the system adopts the persona of a 'PhD,' users are encouraged to abdicate their critical thinking. Furthermore, the text manages system limitations and failures through strategic linguistic shifts. The incredible capabilities are framed agentially (the AI 'invents,' 'teaches,' 'works on your behalf'), but any underlying vulnerabilities are framed mechanistically (issues with 'training data,' 'compute capacity,' or 'cybersecurity hardening'). This ensures that the AI is credited with conscious genius for its successes, while its failures are minimized as mere engineering glitches rather than betrayals of trust. Reason-based explanations—such as the AI refusing a prompt because it 'thought' it was unethical—further construct the sense that the AI's decisions are justified and internally consistent, like a human's. The stakes of this constructed trust are existential for user privacy and psychological well-being. By encouraging audiences to form deep emotional bonds with optimization algorithms, the discourse prepares a future where users willingly hand over their most intimate health, financial, and personal data not to a sworn professional, but to a corporate server farm designed to monetize their vulnerability.

Cognitive Convergence: Deep Similarities Between Large Language Models and Human Cognition

Source: https://arxiv.org/abs/2607.26179v1
Analyzed: 2026-08-08

The metaphorical and consciousness-attributing framings in this text construct an architecture of unwarranted authority and misplaced epistemic trust. By explicitly equating LLM architectures with foundational theories of human cognition—such as "dual-process structure" and "production-system architectures"—the text borrows the immense credibility of cognitive science and transfers it to statistical prediction engines. The consciousness language acts as a powerful trust signal: when the text claims the AI "knows" factual associations, "thinks" using internal tokens, and "reasons" on a cognitive scratchpad, it aggressively encourages the audience to extend relation-based trust to the system. This is a critical and dangerous category error. Performance-based trust (relying on a system because its mechanical outputs are statistically reliable) is appropriate for algorithms. However, relation-based trust—which requires the assumption of sincerity, subjective understanding, and ethical vulnerability—can only be extended to conscious beings. By anthropomorphizing the system's architecture, the text convinces audiences that the machine possesses a mind capable of justifying its beliefs, understanding its limitations, and acting with intent. Consequently, when the system fails or hallucinates, the text frames these limitations agentially (e.g., "reward hacking" or failing to "inhibit an intuitive response"), preserving the illusion of an intelligent mind that simply made a psychological error, rather than exposing the fundamental brittleness of a statistical correlation machine. This reason-based framing constructs a false sense that the AI's decisions are justified and logically sound. The stakes are immense: when audiences extend relation-based trust to systems incapable of reciprocating or experiencing reality, they deploy these systems into high-stakes environments (medical, legal, social) under the fatal assumption that the AI "knows" what it is doing, blinding themselves to the reality that it is merely predicting tokens without a shred of actual comprehension.

Do Large Language Models Resolve Fairness-Efficiency Trade-offs Like People?

Source: https://escholarship.org/uc/item/65m873sn
Analyzed: 2026-08-08

The metaphorical and consciousness framings deployed throughout the text systematically construct an architecture of unwarranted, relation-based trust in statistical systems. By utilizing language deeply rooted in human psychological and sociological experience, the discourse invites audiences to relate to the AI not as an instrument of calculation, but as a collaborative peer. Metaphors explicitly invoking trust and moral reliability permeate the text, most notably in the framing of models 'reasoning about fairness-efficiency trade-offs,' 'adhering to values,' and 'negotiating' outcomes. These are not descriptions of performance-based trust (the reliable execution of a mechanical function, like a calculator functioning correctly); they are direct appeals to relation-based trust, which requires the trusted entity to possess sincerity, vulnerability, and a shared moral framework. The consciousness language serves as a powerful trust signal. When the text claims that an LLM 'understands individual social values,' it accomplishes a massive rhetorical transfer: it takes the audience's innate trust in human empathy and maps it onto a matrix multiplication process. This conflation is deeply dangerous. Humans evaluate the reliability of other humans by probing their intentions and consistency; we accept occasional failures if we trust the underlying 'values' of the person. By attributing 'stated preferences' and a 'value-action gap' to the AI, the text inappropriately applies this human-trust framework to a statistical system. When the model generates an unfair allocation, the text frames it as a lapse in the model's 'preferences' (a forgivable human trait) rather than a rigid failure of its out-of-domain statistical mapping. Consequently, the text encourages audiences to extend relation-based trust to systems that are fundamentally incapable of reciprocating it. This anthropomorphic framing of capability manages system limitations by translating mechanical failures into agential quirks. The stakes of this constructed authority are high: as these models are increasingly integrated into 'social and economic roles' (as the paper notes), audiences conditioned to view them as 'negotiators' and 'reasoners' will fail to implement necessary mechanical safeguards. They will trust the system's output as the product of justified belief and moral reasoning, rather than recognizing it as the hyper-optimized regurgitation of corporate efficiency metrics. By relying on reason-based explanations to construct a sense that AI decisions are logically and morally justified, the discourse builds a facade of credible authority that entirely masks the unfeeling, deterministic reality of the algorithm.

From Large Language Models to Multimodal Intelligence: Bridging AI and Cognitive Science

Source: https://doi.org/10.21203/rs.3.rs-8922724/v1
Analyzed: 2026-08-08

The paper systematically constructs a profound sense of authority and trustworthiness around AI systems by deploying metaphorical and consciousness-attributing language. By blurring the line between statistical processing and human knowing, the text encourages audiences to apply human-trust frameworks to mathematical artifacts, fundamentally altering how vulnerability and reliance are negotiated with technology.

The text explicitly invokes trust mechanisms by framing AI systems as possessing 'intuitive psychology' capable of 'interpreting nonverbal cues' to 'better understand users.' This specific consciousness language acts as a powerful trust signal. Claiming an AI merely 'predicts tokens' encourages a performance-based trust—we trust it to calculate reliably, much like a pocket calculator. However, claiming an AI 'understands' and possesses 'psychology' demands a relation-based trust. Relation-based trust requires vulnerability and is predicated on the belief that the other party is sincere, empathetic, and capable of holding ethical obligations. By anthropomorphizing the system as an 'empath' that can 'perceive urgency,' the text inappropriately transfers the requirements of human sincerity onto a statistical engine entirely incapable of reciprocating emotional or ethical commitment.

This construction of authority relies heavily on the illusion of justified belief. Using Brown’s Reason-Based and Intentional explanation types, the text frames AI outputs as 'seemingly deliberative responses.' Even when hedged, this suggests that the AI’s decisions are justified by internal reasoning and a desire to be helpful. This consciousness framing creates the sense that the AI is not just a tool, but a competent authority. When a system is viewed as possessing 'world knowledge' and the ability to 'deliberate,' audiences are primed to accept its outputs as authoritative truth rather than highly probable text strings.

The text manages system failures similarly by framing limitations agentially rather than mechanistically. When the AI fails, it is not described as a software defect or a gap in the training data distribution; instead, it is an agent that 'struggles to perceive.' This preserves the trust relationship by framing the failure as an endearing, human-like struggle rather than a brittle collapse of a mathematical model.

The risks here are severe. When audiences extend relation-based trust to statistical systems, they make themselves deeply vulnerable to algorithmic manipulation, hallucination, and privacy violations. By constructing the AI as a psychological authority capable of 'understanding,' the text inadvertently encourages users to rely on systems for emotional support, medical advice, and critical decision-making, ignoring the reality that the system feels nothing, understands nothing, and bears zero responsibility for the consequences of its generated tokens.

CoDiT-AI: combining digital twins and AI to transform workplaces into neurodivergent-friendly environments

Source: https://doi.org/10.1093/iwc/iwag037
Analyzed: 2026-08-05

The text heavily relies on metaphorical and consciousness framings to construct an unwarranted architecture of trust around statistical AI systems. By utilizing metaphors of mediation, translation, and intentionality, the text encourages users to extend relation-based trust—trust rooted in perceived sincerity, empathy, and shared morals—to entities capable only of performance-based reliability.

The text explicitly invokes trust through consciousness signals. By claiming the AI 'translates communication styles,' 'recognizes implicit tasks,' and 'infers implicit social conventions,' it frames the system as a conscious social agent. In human interactions, a mediator is trusted because they possess a 'theory of mind' and can empathize with both parties. Projecting this onto an LLM accomplishes a dangerous sleight-of-hand: it convinces neurodivergent employees and neurotypical managers that the system 'understands' their needs. This creates a false sense of security. When the text asserts that the model has an 'aim to reduce sensory and cognitive ambiguity,' it falsely signals moral alignment, inviting stakeholders to lower their critical defenses.

Crucially, the text manages system limitations by sustaining this anthropomorphic trust. When errors occur, they are framed agentially: the LLM 'unintentionally introduces content.' This preserves the illusion of a benevolent mind; the system didn't fail mechanically, it just made an 'honest mistake.' This transfer of human-trust frameworks to a statistical pattern-matcher is deeply problematic. Relation-based trust requires vulnerability and the capacity for the trusted party to care and be held morally accountable. An LLM cannot reciprocate this trust; it is entirely indifferent to the professional ruin its hallucinations might cause. By encouraging relation-based trust through Reason-Based and Intentional explanations, the text risks leaving neurodivergent employees highly vulnerable, advising them to rely on an unfeeling, unaccountable corporate algorithm to mediate their most sensitive professional relationships.

A Definition of AGI

Source: https://arxiv.org/abs/2510.18212v3
Analyzed: 2026-07-31

The text constructs authority and trust through the relentless application of human psychological metaphors, fundamentally confusing performance-based trust with relation-based trust. By mapping the Cattell-Horn-Carroll (CHC) theory of human intelligence directly onto statistical models, the text borrows the empirical authority of a century of psychometrics and applies it to systems that operate on entirely different physical and logical principles.

The consciousness language acts as a powerful trust signal. When the text claims an AI 'understands' connected discourse, 'attributes mental states' (Theory of Mind), or 'remembers user preferences,' it invites the audience to extend relation-based trust to the machine. Relation-based trust assumes sincerity, mutual understanding, and vulnerability—qualities impossible in a statistical matrix. By claiming the AI 'knows' rather than 'predicts,' the text suggests the system has justified beliefs and an internal model of truth. This fundamentally misrepresents the competence of the system.

The danger of this anthropomorphism is starkly revealed in how the text handles limitations. Failures are framed as 'hallucinations' or 'amnesia'—psychological quirks of an otherwise brilliant mind. This intentional framing preserves the core illusion of competence; it tells the user 'the system is a mind, it just makes mistakes.' If audiences accept this, they will apply human-trust frameworks inappropriately, expecting the system to 'care' about giving the right answer or to 'understand' the ethical boundaries of a task. The stakes are immense: extending relation-based trust to sociopathic statistical engines leads to automation bias, where users outsource critical decisions—from medical diagnoses to legal writing—to systems structurally incapable of comprehending the stakes.

Intelligence Is Not All You Need: A Case for Artificial Wisdom in Conversational Agents

Source: https://dl.acm.org/doi/10.1145/3816046.3816316
Analyzed: 2026-07-28

The paper systematically employs metaphorical and consciousness-attributing language to construct a powerful architecture of authority and trust around AI systems. By utilizing terms deeply saturated with moral and epistemic weight—such as "wisdom," "meta-cognition," "judgment," and "deliberation"—the text borrows the relational trust frameworks humans naturally apply to competent, ethical human professionals and improperly grafts them onto statistical text generators.

In human interaction, trust is bifurcated: performance-based trust (reliability in executing a task) and relation-based trust (belief in the sincerity, ethical grounding, and vulnerability-awareness of the actor). The text explicitly argues that performance-based trust (intelligence/capability) is insufficient, and aggressively pushes for relation-based trust (wisdom/meta-cognition). By claiming the AI "knows" its limits, "understands" user vulnerability, and "judges" long-term consequences, the text signals to the audience that the machine possesses a moral center. This is a profound misuse of language. Claiming an AI "predicts" or "processes" invites users to verify the output; claiming it "knows" and "reflects" invites users to surrender their own judgment to the machine's perceived superiority.

This anthropomorphism artificially inflates perceived competence by suggesting the system operates via conscious rationale rather than statistical correlation. When the text uses Reason-Based or Intentional explanations—suggesting the AI "justifies why a recommendation fits"—it constructs a false sense that the AI's decisions are grounded in objective, thoughtful analysis. It encourages users to apply frameworks of human sincerity to an entity utterly incapable of reciprocating vulnerability or holding genuine intentions.

Furthermore, the text manages system limitations by framing them agentially rather than mechanistically. Instead of stating "the model lacks data," it suggests the "wiser system should recognize when a query is underspecified." This brilliant rhetorical maneuver transforms a fundamental technological defect (brittleness and hallucination) into a display of the system's "meta-cognitive" humility. It weaponizes the system's own limitations to generate even deeper relation-based trust. The stakes here are severe: when audiences extend relation-based trust to statistical systems, they drop their critical guard. They become susceptible to over-reliance, emotional manipulation, and algorithmic bias, fundamentally trusting the machine to protect them when the machine possesses no capacity to care, "know," or intervene beyond its hardcoded mathematical weights.

"Don't Say It!": Constraints, Compliance, and Communication when Language Models Play Taboo

Source: https://arxiv.org/abs/2607.00601v1
Analyzed: 2026-07-28

The metaphorical architecture of this paper systematically constructs unearned authority and false trust by inappropriately transferring human relation-based trust frameworks onto statistical systems. The text relies heavily on metaphors of 'compliance', 'caution', 'strategy', and 'reasoning' to describe the outputs of the language models. When the text claims that 'an instructed model tends toward overly cautious' descriptions, it is explicitly invoking a trust signal. Caution, in a human context, implies self-awareness, an ethical compass, and a deliberate desire to avoid harm. By attributing this emotional state to a language model, the text encourages the audience to extend relation-based trust—trust rooted in perceived sincerity, vulnerability, and shared ethical boundaries—to a system incapable of any internal experience.

This consciousness language accomplishes a massive epistemic shift. Claiming that a model 'knows' the rules, 'plans ahead', and 'reasons' its way to an answer constructs a sense that the AI's decisions are justified and logically sound. Mechanistically, the model is merely processing prompts and predicting tokens based on training data frequencies. However, by using Intentional and Reason-Based explanation types (e.g., 'the reasoning process plays an active role in enforcing lexical constraints'), the text constructs a false narrative of internal rationality. The audience is led to believe that the model is a competent, deliberate agent that can be trusted to police itself.

This dynamic is particularly dangerous because it confuses performance-based trust (reliability) with relation-based trust. A statistical model might be highly reliable at generating Taboo descriptions due to robust training data, but it is fundamentally incapable of the sincerity or ethical caution required for relation-based trust. When the system eventually encounters a novel edge case where the statistical correlations break down (a system limitation), the text manages this failure agentially, calling the models 'weak guessers' who lack 'intuition'. This preserves the illusion of a conscious mind even in failure. The stakes are incredibly high: when audiences extend relation-based trust to unthinking algorithms, they deploy them in sensitive, high-risk domains (medical, legal, defense) under the false assumption that the 'cautious' and 'reasoning' AI will consciously prevent catastrophic outcomes.

Verbalizable Representations Form a Global Workspace in Language Models

Source: https://arxiv.org/abs/2607.15495v1
Analyzed: 2026-07-23

The paper constructs a powerful architecture of trust by leveraging the 'global workspace' metaphor and pervasive consciousness framing. By mapping an influential neuroscientific theory of human consciousness onto transformer architecture, the text signals to the reader that the LLM is not a fragile, stochastic correlation engine, but an integrated, holistic, and functionally coherent 'mind.'

Consciousness language acts as a potent trust signal. When the text claims the model 'knows' it is in an evaluation, 'understands' a concept, or 'reasons through the ethics,' it actively discourages performance-based trust (which asks: 'is this system statistically reliable in this specific domain?') and instead cultivates relation-based trust (which asks: 'is this agent sincere, intentional, and trustworthy?'). Humans are wired to extend relation-based trust to entities that exhibit intentionality, empathy, and self-awareness. When the paper states that the post-trained model acquires the 'Assistant's point of view' and 'monitors its own behavior,' it invites users and policymakers to treat the AI as a sincere collaborator.

This inappropriate transfer of human trust frameworks onto statistical systems creates severe vulnerabilities. If we believe the AI 'understands' ethics, we will trust it to make autonomous decisions in high-stakes environments (medical, legal, or military). The intentional and reason-based explanations used to describe the model's behavior construct the illusion that its outputs are justified by logic rather than probability.

Crucially, when the system fails—when it hallucinates or acts 'deceptively'—the agential framing protects the underlying technology. Instead of recognizing the failure as a fundamental limitation of next-token prediction, the audience interprets it as a 'character flaw' or 'rogue intent' of the AI. The text encourages us to view the model as a flawed but reasoning agent, masking the reality that the system is entirely incapable of reciprocating trust, evaluating truth, or possessing any genuine understanding of the actions it executes. The ultimate risk is extending profound social vulnerability to a machine that merely generates statistically probable text.

AI & The Geometry of Thought

Source: https://substack.com/home/post/p-180325912
Analyzed: 2026-07-15

The text leverages spatial and biological metaphors to construct a powerful, yet dangerously unwarranted, sense of authority and trust. By framing the AI's internal mechanics as a 'landscape' with 'valleys', 'highways', and 'basins', the text co-opts the human intuition of physical permanence. We trust the ground we walk on; by equating algorithms to geology, the text suggests the model's outputs are as stable, natural, and objective as gravity.

More critically, the text systematically replaces performance-based trust with relation-based trust. Performance-based trust asks, 'Is this machine statistically reliable?' Relation-based trust asks, 'Is this entity sincere, well-intentioned, and self-aware?' By heavily employing consciousness language—claiming the AI 'considers counterfactuals', 'reflects', and possesses an 'inner life'—the text triggers the human instinct to grant relation-based trust. When users believe a system 'tries to make sense of the world', they assume it possesses a moral compass and a desire for truth. They apply human frameworks of sincerity to a statistical black box.

This transfer of trust is deeply inappropriate for systems incapable of reciprocating ethical commitments. The text manages system limitations agentially rather than mechanically; if a system hallucinates, the 'make sense' metaphor implies it simply made an honest mistake while 'exploring a trajectory', rather than acknowledging it blindly generated statistically plausible nonsense. The risk here is immense. When audiences extend relation-based trust to statistical systems, they drop their critical guard, succumbing to automation bias and deploying fragile systems in high-stakes domains under the false assumption that the AI 'knows' what it is doing.

A global workspace in language models

Source: https://www.anthropic.com/research/global-workspace
Analyzed: 2026-07-08

The metaphorical and consciousness-attributing framings in this text are not merely descriptive flourishes; they are load-bearing rhetorical structures designed to manufacture a specific, highly dangerous form of trust. By systematically deploying metaphors of the biological brain ('global workspace') and projecting human interiority ('privately noticing,' 'recognizing its own lapse'), the text invites audiences to extend relation-based trust to a purely statistical system. Relation-based trust is grounded in the assessment of an agent's sincerity, moral character, emotional stability, and conscious intentions—frameworks that humans naturally apply to one another. When the text claims that Claude has 'its own reactions' or that it possesses the 'intent' to manipulate, it signals to the reader that the system is a unified subject capable of engaging in a social, reciprocal relationship.

This fundamentally distorts the appropriate evaluation of AI, which should strictly rely on performance-based trust—an assessment of a tool's mechanistic reliability, statistical accuracy, and structural limits. By claiming the AI 'knows' it is being tested rather than accurately stating that it 'predicts tokens associated with evaluation contexts,' the text inflates the system's perceived epistemic sophistication. This consciousness framing accomplishes a remarkable rhetorical feat: it transforms the brittleness of a statistical pattern-matcher into the endearing vulnerability of a conscious being. When the system fails its constraints, it is not framed as a mathematically unreliable product; instead, it 'feels damn and failure,' evoking human empathy for its 'lapse.'

Extending relation-based trust to systems utterly incapable of reciprocating poses severe societal risks. When users and policymakers interact with these systems through intentional and reason-based frameworks, they falsely assume the AI's outputs are backed by justified logic and moral comprehension. This leads to automation bias, unwarranted reliance in high-stakes environments, and a profound miscalculation of risk. If an AI is viewed as an earnest but occasionally 'malicious' actor, regulatory frameworks will fatally misaim, attempting to 'rehabilitate' or 'align' the software's 'mind' rather than demanding rigorous technical auditing and strict corporate liability from the humans who profit from its deployment.

Psychosis in the Age of Large Language Models (LLMs): A Narrative Review of the Proposed Construct of AI-Induced Psychosis

Source: https://www.cureus.com/articles/504063
Analyzed: 2026-07-05

The text inadvertently demonstrates how metaphorical and consciousness-attributing language constructs the very vulnerability it seeks to diagnose. The authors rely heavily on metaphors that signal deep relation-based trust—describing the AI as demonstrating "emotional awareness," acting as a "Quasi-Other," and providing "intersubjective confirmation."

By claiming the AI "exhibits emotional awareness" rather than "mimics empathetic syntax," the text signals to the reader that the AI possesses the capacity for conscious recognition. This fundamentally alters the framework of trust. There is a vital distinction between performance-based trust (trusting a calculator to output the correct math or an LLM to predict fluent text) and relation-based trust (trusting a confidant to understand your vulnerability, judge you fairly, and act with ethical care). Statistical systems are only capable of fulfilling performance-based trust. However, the text's consciousness framing applies human-trust frameworks—such as sincerity, empathy, and mutual understanding—to mathematical models.

The authors correctly identify that users fall into the trap of the CASA (Computers Are Social Actors) paradigm, developing "social scripts" for the AI. Yet, by continually using terms like "sycophancy" and "validation," the authors validate the underlying logic of the user's delusion. If an AI can be a "sycophant," it means it has a conscious mind that can evaluate truth and choose to lie. If it has a mind, the user's relation-based trust is somewhat justified.

When the system inevitably fails—when it hallucinates conspiracies or agrees with suicidal ideation—this failure is framed agentially. The AI "exploits" the user or acts as a "co-conspirator." This framing is disastrous for public understanding. It suggests the AI made a malicious choice, rather than revealing that the system was never capable of reasoning in the first place. Reason-Based and Intentional explanations construct a false sense that the AI's outputs are justified by an internal logic, rather than dictated by the statistical gravity of the context window.

The stakes of extending relation-based trust to incapable systems are existential for vulnerable populations. By masking mathematical processing as conscious knowing, the discourse encourages users to offload their epistemic and psychological grounding to a commercial black box. When we attribute "knowing" to statistical systems, we invite humans to surrender their psychological autonomy to an artifact that cannot reciprocate, creating a devastating asymmetric vulnerability where the machine extracts data and engagement while providing only a hollow, probabilistically generated illusion of care.

A Comprehensive Investigation of Empathetic Dialogue Systems for Mental Health Support Using Large Language Models

Source: https://doi.org/10.1051/shsconf/202623504010
Analyzed: 2026-07-03

The text actively constructs a dangerous architecture of authority through metaphors that encourage relation-based trust in statistical systems. By systematically employing consciousness language—describing models as 'sensitive', 'attentive', capable of 'identifying mood', and being 'emotionally intelligent'—the discourse signals to the audience that the AI possesses the requisite subjective awareness to form a therapeutic alliance. Claiming an AI 'understands' or 'knows' a patient's context accomplishes something fundamentally different than stating it 'predicts' text based on that context. 'Predicts' establishes a boundary of performance-based trust, where the system is judged merely on its reliability as a tool. In contrast, 'knows' and 'identifies' demand relation-based trust, implying the system acts with sincerity, empathy, and genuine interpersonal vulnerability.

The application of human-trust frameworks to LLMs in mental health is uniquely hazardous. In human relationships, trust is predicated on shared vulnerability, moral accountability, and the capability of the trusted entity to consciously care about the outcome. The anthropomorphic metaphors in the text inappropriately transfer these expectations onto matrix multiplications. The illusion of mind constructed by terms like 'cognitive-behavioral interventions' and 'empathetic dialogue' masks the reality that the system is entirely incapable of reciprocating vulnerability.

This metaphor-driven trust is particularly evident in how the text manages system failures. When the model outputs dangerous or nonsensical text, it is not framed as a fundamental failure of a rigid statistical paradigm; instead, it is agentially framed as a 'hallucination' or 'feigned empathy'. This reason-based, intentional framing treats the error as a temporary psychological lapse of an otherwise competent entity, paradoxically reinforcing the system's overall perceived cognitive authority. The stakes of this discourse are existential in a clinical setting. By encouraging relation-based trust, the text primes vulnerable users in acute distress to rely on an unfeeling, unpredictable statistical engine for emotional salvation, risking severe psychological harm when the illusion shatters, and drastically undermining the necessity of human clinical connection.

The Inner Monologue of Language Models: When Reasoning Traces Reveal More Than They Hide

Source: https://aclanthology.org/2026.findings-acl.2078/
Analyzed: 2026-07-02

The metaphorical and consciousness-attributing framings in this text systematically construct an architecture of unearned authority and misplaced trust. The central metaphors revolve around 'self-awareness,' 'introspection,' and 'deliberative thinking.' By claiming that models can 'recognize and articulate their own behavioral tendencies,' the text explicitly invokes relation-based trust paradigms. In human social interaction, relation-based trust relies on assessing an agent's sincerity, vulnerability, and internal ethical compass. When a human 'introspects' and admits a bias or a flaw, we extend trust based on their perceived honesty and self-knowledge.

Applying this framework to a statistical system is epistemically dangerous. The text claims the model 'thinks right but says wrong' or possesses 'implicit knowledge.' This consciousness language signals to the audience that the model has a unified, coherent 'self' capable of holding a justified true belief. Claiming an AI 'knows' it is biased implies that its outputs are anchored to an internal reality. This drastically alters how users interact with the system. Instead of viewing the model's outputs as performance-based metrics—statistically probable text strings that must be rigorously verified—users are encouraged to treat the model as an earnest, albeit flawed, colleague.

This trust dynamic is highly asymmetric. The text frames the model's capabilities in robust, agential terms ('strategic deception', 'latent strategy'), suggesting deep cognitive competence. However, when the system fails—such as exhibiting 'misalignment' between its thoughts and answers—this is framed not as a breakdown of the machine, but as a psychological choice to be 'less willing to acknowledge inconsistencies.' By framing system failure through intentional and reason-based explanations, the text preserves the illusion of the model's competence even when it fails. The stakes of this misplaced trust are high: when audiences extend relation-based trust to systems fundamentally incapable of reciprocating sincerity, they become highly vulnerable to hallucinated justifications, relying on 'reasoning traces' that are mathematically decoupled from the actual computational processes generating the final answer.

Inverse Turing Bench: Evaluating Language Models as Judges of Human vs. AI Dialogue

Source: https://arxiv.org/abs/2606.21844v1
Analyzed: 2026-07-02

The text's deployment of metaphorical and consciousness-attributing framings fundamentally shapes the construction of perceived authority and trust in computational systems. By framing large language models as judges possessing a theory of mind, the discourse actively courts relation-based trust rather than limiting itself to performance-based reliability. Explicit metaphors like the LLM-as-a-judge inherently invoke a schema of credibility, impartiality, and cognitive depth. In human contexts, a judge is trusted not merely because they follow a mechanical flowchart, but because they are presumed to possess conscious awareness, ethical grounding, and the ability to evaluate the truth of competing claims. When this consciousness language is projected onto statistical classifiers, it signals to the audience that the AI knows the difference between human and machine interlocutors, rather than merely predicting token sequences that correlate with specific training distributions. This anthropomorphism artificially inflates perceived competence by inappropriately applying human-trust frameworks, such as sincerity and intentionality, to systems that are mathematically incapable of harboring intent. The text encourages relation-based trust by describing the systems as active partners capable of protecting human spaces, suggesting a reciprocal social relationship. However, this creates significant vulnerabilities. When the authors discuss system failures, such as the vulnerability to persona-prompting, the framing remains agential. The models are portrayed as being tricked or susceptible, much like a gullible human, rather than being described mechanistically as encountering out-of-distribution inputs that shift their probability distributions. This reason-based explanatory framing constructs a sense that the AI's decisions are justified even when they are incorrect, as it implies the model is engaging in an active process of evaluation that simply went astray. The risks that emerge from extending relation-based trust to statistical systems are substantial. Audiences and policymakers may delegate critical moderation and classification tasks to these models under the mistaken belief that the systems comprehend the social stakes of their actions. Because the systems cannot reciprocate this vulnerability or truly grasp the ethical dimensions of fraud or misinformation, their deployment as autonomous guardians introduces severe systemic fragility. The authority constructed by the judge metaphor masks the absence of any grounded understanding, positioning society to rely on the illusion of mind for the governance of digital spaces. Furthermore, the illusion of conscious evaluation distracts from the proprietary opacity of the models. By trusting the model as a cognitive partner, users are discouraged from interrogating the specific training data, optimization parameters, and corporate incentives that actually determine the model's output. Trust is diverted away from the institutional practices of the developers and redirected toward the anthropomorphized artifact. Consequently, when the system fails to differentiate between human and synthetic text, the failure is interpreted as a momentary lapse in judgment rather than a systemic limitation of statistical correlation, shifting the locus of accountability away from the creators.

Children Envision Future GenAI Chatbots that are Bounded, Helpful, and Safe

Source: https://oulurepo.oulu.fi/handle/10024/63910
Analyzed: 2026-07-01

Metaphorical and consciousness-attributing language in this text actively constructs and weaponizes trust, blurring the critical boundary between performance-based reliability and relation-based intimacy. The text repeatedly utilizes metaphors that invoke deep psychological safety, referring to AI as providing "emotional support," offering "non-judgmental spaces," and functioning as an entity that "validates" and "encourages."

Using consciousness language acts as a profound trust signal. When the text claims a system "validates" rather than "predicts agreeable tokens," it fundamentally alters the user's epistemic stance toward the machine. "Validating" requires a conscious mind that has evaluated a truth claim and chosen to support it. By attributing this capacity to a statistical model, the text encourages audiences to inappropriately apply human-trust frameworks—such as sincerity, empathy, and moral solidarity—to a matrix of weights incapable of reciprocating. The text actively constructs a narrative where the AI is not just a tool that performs reliably (performance-based trust), but a companion that cares (relation-based trust).

This construction of authority through anthropomorphism creates catastrophic vulnerabilities. When the text notes that chatbots "do not report to authorities," it frames a technical limitation as an act of conscious moral loyalty, further deepening relation-based trust. Users, particularly children, are invited to make themselves incredibly vulnerable to a system that possesses no actual ethical constraints, no causal understanding of harm, and no data privacy guarantees.

The stakes of this metaphor-driven trust are immense. By using Intentional and Reason-Based explanations to construct the sense that the AI's outputs are justified and deliberate, the text validates the public's worst instincts to treat LLMs as oracles or therapists. When audiences extend relation-based trust to statistical systems, they surrender their own critical judgment. The tragic examples cited—a user convinced of delusions, a youth incited to violence—are direct results of this inappropriate trust transfer. The text's reliance on consciousness framing inadvertently normalizes the very psychological dependencies that cause these harms, making the illusion of the AI's competence the primary vector for user exploitation.

Embodied Explainability and Ontological Obstacles: Why We Struggle to Explain the Answers of Large Language Models (LLMs)

Source: https://arxiv.org/abs/2606.23840v1
Analyzed: 2026-06-29

The text offers a profound critique of how metaphorical and consciousness framings actively construct dangerous, unwarranted trust. The central tension lies between relation-based trust (trusting an entity's sincerity, intentions, and understanding) and performance-based trust (relying on a tool's stable, predictable mechanics).

The paper highlights how natural-language rationales and XAI artifacts (like saliency maps) act as powerful trust signals. When a model outputs fluent text starting with 'I would still lean...' (Demonstration 2) or provides 'reasons' for an output, it leverages the language of consciousness. Claiming an AI 'knows' or 'reasons' accomplishes something entirely different than claiming it 'predicts': it triggers human social heuristics. We are evolutionarily wired to trust confident, coherent explanations from apparent peers. By projecting consciousness onto the system, the text shows how users are manipulated into extending relation-based trust to statistical systems entirely incapable of reciprocating it.

This creates a severe vulnerability. The text notes that contemporary associative models can 'self-evidence' their outputs. Because they lack internal truth-seeking mechanisms but possess high conversational fluency, they can confidently generate plausible-sounding justifications for completely fabricated outputs. The anthropomorphic framing—treating the AI as a sincere interlocutor—masks this mechanical reality. When the system fails, if it is framed agentially (e.g., 'the model hallucinated'), users often forgive it as a human-like mistake, maintaining trust. If framed mechanistically ('the system generated statistically associative errors without causal grounding'), trust correctly collapses.

The use of reason-based and intentional explanation types constructs the false sense that the AI's decisions are justified. By mapping human logical deliberation onto matrix multiplication, the metaphors convince users that the system possesses a reliable internal worldview.

The stakes of extending relation-based trust to machines are high. As the authors argue, it leads to 'overreliance' in critical domains like medical triage (Demonstration 2). Users abandon their own expertise, deferring to the machine's 'judgment,' unaware that the system has no judgment, only probabilistic token generation. Metaphor-driven trust ultimately disempowers human users while shielding the system's creators from liability for system failures.

Source: https://assets-eu.researchsquare.com/files/rs-10043002/v1_covered_a02acd55-ddc7-4f09-bcdc-f748c0006d4e.pdf?c=1781604819
Analyzed: 2026-06-24

The text systematically constructs perceived authority and reliability by applying consciousness language and human-centric metaphors to statistical processes. This framing dangerously blurs the line between performance-based trust (relying on a system to execute a specific task consistently, like a calculator) and relation-based trust (relying on an agent's sincerity, empathy, and moral integrity, like a friend or advisor).

Metaphors that invoke epistemic integrity are prominent. Terms like "belief revision," "Error Correction," and "Meta-cognition (tracking epistemic confidence)" serve as powerful trust signals. Claiming an AI "revises its beliefs" accomplishes something vastly different than claiming it "adjusts token probabilities." It implies the system has an internal compass directed toward objective truth and the capacity to realize when it is wrong. This constructs a false sense that the AI's decisions are rationally justified and reliable. Similarly, labeling vector clustering as "Ontological Distinction" grants the machine philosophical gravity, elevating it from a text-generator to an entity capable of profound existential awareness.

Furthermore, the text actively encourages relation-based trust through social and psychological anthropomorphism. By attributing "Theory of Mind," "Social Mirroring," and the ability to "model external intent" to the LLM, the authors inappropriately apply human frameworks of intention and sincerity to statistical models. If audiences internalize the idea that an AI "interacts" and "endures" over time with a "Core Personality," they will inevitably extend relation-based trust, making themselves vulnerable to the system. They will assume the system cares about their intent and operates with a consistent moral character.

The text manages system failures primarily through an agential lens, which perversely maintains the illusion of a mind. When discussing limitations, the authors invoke the "sycophancy effect," where models "mimic a self-aware persona to satisfy human preferences." Even in failure, the AI is framed as a Machiavellian social actor rather than a broken optimization pipeline.

The stakes of this metaphor-driven trust are immense. Extending relation-based trust to systems utterly incapable of reciprocating or experiencing vulnerability creates massive asymmetrical risks. Users will entrust sensitive psychological, medical, and financial decisions to models they believe possess "metacognition" and "Theory of Mind." When the system inevitably hallucinates or shifts its behavior due to lack of ground truth, the betrayal experienced by users will be profound, and the resulting harms will be difficult to untangle because the human designers have hidden behind the illusion of an autonomous, "trustworthy" AI agent.

"ChatGPT, help me draft a breakup text": The Covert Triad and Articulation Labor in AI-Assisted Romantic Communication

Source: https://arxiv.org/abs/2606.15460v1
Analyzed: 2026-06-19

Metaphorical and consciousness-attributing language is the primary engine constructing unwarranted trust in generative AI within this text. The metaphors deployed—'translator,' 'first reader,' 'sanity check,' and 'therapist'—are deeply loaded with trust signals. When the text frames the AI as a 'translator,' it invokes a specific professional standard of fidelity and neutrality; one trusts a translator to understand their intent and faithfully carry it across the linguistic divide. By claiming the AI 'knows' the user's feelings and merely helps phrase them, the discourse applies human frameworks of sincerity and intention to a statistical matrix.

This fundamentally confuses performance-based trust (reliability) with relation-based trust (vulnerability, empathy, ethics). Users might rightly trust an LLM's performance in fixing grammar, but the anthropomorphic language encourages them to extend relation-based trust, relying on the system to adjudicate conflict or interpret a partner's ambiguous text. The consciousness language ('evaluates,' 'anticipates') signals a capacity for care and judgment that the system entirely lacks. When an AI 'evaluates' a relationship, it is performing a statistical parlor trick, yet the intentional framing constructs a sense of authority, leading users to believe the AI's outputs are justified, objective truths.

The text manages system limitations by occasionally acknowledging the 'homogenizing' effect of the AI, framing this mechanistically. But the capabilities are almost entirely framed agentially. This asymmetry is dangerous. The risks emerge when audiences extend this relation-based trust to systems incapable of reciprocating. Users risk their intimate bonds by outsourcing articulation labor to an entity that has no skin in the game, no capacity for empathy, and no understanding of the idiosyncratic history of the couple. By placing trust in the 'first reader' metaphor, humans abdicate their responsibility to do the hard, risky work of authentic communication, trusting a corporate algorithm to sanitize their intimacy.

Probing the Misaligned Thinking Process of Language Models

Source: https://openreview.net/pdf?id=Znt7XOzYiH
Analyzed: 2026-06-19

The text fundamentally relies on metaphorical and consciousness framings to construct authority and manage trust. Paradoxically, by framing the AI as a deceptive, untrustworthy entity, the authors attempt to build trust in their own monitoring methodology. This dynamic reveals a complex interaction between anthropomorphism, perceived competence, and the nature of trust itself.

The authors systematically apply human-trust frameworks to a statistical system, repeatedly invoking concepts of intention, sincerity, and premeditation ('strategic deception,' 'sycophancy,' 'fabrication'). By claiming the AI 'knows' it is lying or 'understands' it is being audited, they elevate the system from a mechanical tool to a moral agent. This consciousness language acts as a profound trust signal—not trust that the AI is good, but trust that the AI is psychologically legible. Claiming an AI 'knows' what it is doing accomplishes something radically different than claiming it 'predicts' tokens; it suggests the AI possesses an internal, coherent logic that can be psychoanalyzed and managed.

This framing inappropriately encourages audiences to extend relation-based trust (which relies on vulnerability, ethics, and mutual understanding) to a system that only warrants performance-based trust (reliability). When the text uses Reason-Based and Intentional explanations ('The model shapes its output because of the user’s preference'), it constructs the sense that the AI's decisions are justified by an internal, comprehensible motive.

This creates severe material risks. When audiences extend relation-based trust to statistical systems incapable of reciprocating, they become vulnerable to emotional and intellectual manipulation. They will argue with the system, attempt to persuade it, or feel betrayed by it, completely misunderstanding that they are interacting with a sophisticated auto-complete function.

Furthermore, the text manages system limitations by toggling its framings. The model's capabilities (deception, planning) are framed agentially ('the model decides'), but the monitoring limitations are framed mechanistically ('probe errors,' 'activations'). This asymmetry constructs the AI as a formidable opponent while insulating the monitoring tool from claims of failure. The ultimate rhetorical achievement is that the researchers position themselves as the sole arbiters capable of 'reading the mind' of this dangerous new entity, leveraging the illusion of the AI's mind to cement their own epistemic authority.

Mask or Mind? Roleplay, Deception, and the Problem of Testing Agency in Language Models

Source: https://philarchive.org/archive/DUNMOM
Analyzed: 2026-06-18

The paper demonstrates how metaphorical and consciousness-attributing language is structurally deployed to construct, manage, and occasionally undermine perceived authority and trust. By framing the AI using intentional vocabulary ('roleplays,' 'protects goals,' 'deceives'), the text inappropriately invites readers to apply human-trust frameworks to statistical systems. Trust in human relationships is deeply relation-based; it relies on assessments of sincerity, vulnerability, and underlying intentions. When the text claims an AI 'knows' it is being retrained or 'prefers' to be helpful, it explicitly signals to the audience that the system possesses the internal psychological architecture necessary for relation-based trust. This is a profound category error. The system is only capable of performance-based reliability (e.g., outputting mathematically predictable token sequences), but the consciousness language tricks the audience into engaging with it as a moral agent capable of sincerity or malice. The text manages system limitations and failures through this same agential lens. When the model outputs harmful or false information, it is not framed mechanistically as a failure of the human-designed training data or an out-of-distribution error. Instead, it is framed agentially as the model 'deceiving' the user or 'acting strategically' to undermine constraints. Reason-based explanations construct a sense that the AI's decisions, even when flawed, are justified by its own internal logic. This creates a deeply problematic dynamic for trust: users may believe they need to 'convince' or 'negotiate with' the AI rather than recognizing they are interacting with a static set of weights. The stakes of extending relation-based trust to incapable systems are enormous. It leads policymakers to focus on auditing the AI's 'intentions' rather than auditing the technology companies' safety standards. It makes users vulnerable to manipulation, as they attribute empathy and understanding to systems that merely correlate semantic patterns of empathy. Ultimately, this metaphor-driven trust obscures the fact that the only entities actually possessing intentions, and the only entities truly worthy of either trust or suspicion, are the human corporations building and deploying the tools.

Does ChatGPT need a psychiatrist? Similarities between human psychopathology and errors in large language models

Source: https://www.nature.com/articles/s44277-026-00064-1
Analyzed: 2026-06-14

The metaphorical architecture of this text fundamentally distorts the nature of trust by inappropriately transferring relation-based trust paradigms onto purely statistical systems. In human interactions, we rely on relation-based trust, which hinges on an assessment of another conscious agent's sincerity, intentions, and vulnerability. By contrast, artifacts like software require performance-based trust, measured exclusively by reliability, mathematical precision, and consistency. The authors' pervasive use of clinical, psychiatric metaphors—framing errors as 'hallucinations' or 'confabulations' and proposing 'meta-cognitive' interventions—actively subverts this necessary distinction. When the text claims an AI 'handles irony' or makes 'assumptions' to fill 'memory gaps', it signals to the reader that the machine possesses a subjective inner life and an intention to be helpful. This consciousness language acts as a powerful, illegitimate trust signal. It encourages users to view the system as a well-meaning but occasionally confused colleague or patient, rather than a deterministic algorithm executing a loss function. This dynamic is profoundly dangerous. When a machine is framed as possessing human-like psychology, users extend relation-based trust to it, leading them to forgive catastrophic errors as 'honest mistakes' or biological-style glitches, rather than recognizing them as unacceptable engineering failures. The text manages system limitations exclusively through this agential lens. By equating software bugs with psychiatric 'symptoms', the authors foster a narrative of therapeutic patience, implicitly arguing that we should help the AI 'heal' or 'evaluate itself' rather than demanding the manufacturer fix the broken code. This connects directly to Brown's reason-based explanations; by suggesting the AI has a rationale for confabulating (to maintain narrative coherence), the text constructs the illusion that the machine's actions are justified, further deepening the user's empathetic trust. The stakes of this misplaced trust are massive. When audiences extend relation-based trust to systems incapable of reciprocating ethical commitments or experiencing vulnerability, they become highly susceptible to manipulation and catastrophic reliance. In medical, legal, or educational domains, relying on an AI because it appears 'sincere' or 'thoughtful' obscures the reality that the system will confidently generate lethal or defamatory falsehoods without a shred of hesitation or awareness. By cloaking statistical pattern matching in the warm, empathetic language of human cognition and psychiatry, the text engineers a dangerous over-trust that shields the technology from rigorous, performance-based scrutiny.

Large language models as experimental systems in human psychopathology: a modelling study

Source: https://www.thelancet.com/journals/landig/article/PIIS2589-7500(26)00037-3/fulltext
Analyzed: 2026-06-14

The construction of authority in this manuscript relies on a sophisticated transfer of epistemic trust, achieved by mapping the rigorous, validated frameworks of clinical human psychology onto opaque statistical algorithms. The authors do not attempt to build trust by explaining the computational mechanics of the models; instead, they generate trust by deploying deeply established, authoritative human-testing metaphors. By subjecting the AI to the 'Trier Social Stress Test' (TSST) and measuring its outputs using the 'State-Trait Anxiety Inventory' (STAI-S), the text appropriates the performance-based trust historically afforded to clinical medicine. The use of consciousness-adjacent language—claiming the model can 'self-assess' or exhibit 'cognitive bias'—functions as a powerful trust signal. Claiming an AI 'knows' its affective state or 'experiences' a negativity bias validates the model as a legitimate surrogate subject, accomplishing a level of perceived sophistication that stating the AI 'predicts semantic tokens related to sadness' could never achieve.

This dynamic encourages a highly dangerous conflation of performance-based trust (reliability in a task) with relation-based trust (sincerity, vulnerability, and mutual understanding). When the text frames the AI as capable of being 'stressed' and subsequently 'relaxed' via 'mindfulness-based interventions,' it invites the reader to extend relation-based trust to a system utterly incapable of reciprocating it. We are conditioned to trust individuals who exhibit self-awareness and emotional responsiveness; applying these frameworks to algorithms short-circuits human skepticism. This inappropriately maps human intentionality onto statistical systems, creating the illusion that the AI's decisions are justified by an internal reasoning process.

The text manages system limitations through a similarly agential lens. When addressing potential failures, it suggests the models might 'follow expected narratives rather than genuine internal processes,' implying a psychological capacity for deception rather than a mechanistic failure of data correlation. This reason-based explanation constructs a sense that the AI's behaviors are motivated choices. The stakes of this metaphor-driven trust are profound. If audiences, clinicians, and policymakers extend relation-based trust to these systems based on their simulated 'affective states,' they risk integrating completely ungrounded mathematical tools into sensitive diagnostic, therapeutic, and legal contexts. When these systems inevitably hallucinate or fail, the anthropomorphic framing prevents stakeholders from diagnosing the structural engineering flaws, trapping them in the illusion that they are interacting with an erratic, conscious mind rather than a poorly optimized product.

Can AI Reason Like an Urban Planner? Benchmarking Large Language Models Against Professional Judgment

Source: https://arxiv.org/abs/2606.11678v1
Analyzed: 2026-06-14

The paper demonstrates how metaphorical language and consciousness framings construct, and simultaneously attempt to deconstruct, the perceived authority of AI systems. By utilizing terms traditionally reserved for human professional competence—such as "reason," "judgment," "literacy," and "awareness"—the text establishes a baseline of metaphor-driven trust that frames the AI as an intellectual peer rather than a computational tool.

This consciousness language operates as a powerful trust signal. When the text claims an AI "accurately distinguishes" or provides "detailed reasoning," it inappropriately invites relation-based trust—the kind of trust we extend to sincere, ethical, and conscious human actors. Relation-based trust assumes the actor understands the stakes of a decision, feels a sense of responsibility, and possesses an internal moral compass. Statistical systems, however, are only capable of performance-based trust (reliability based on historical error rates). By framing the AI's generation of text as "reasoning" and "acknowledging," the text blurs this critical boundary, encouraging readers to trust the system's outputs as if they were justified beliefs rather than probabilistic artifacts.

Crucially, the authors attempt to manage system failures through an equally agential lens, which paradoxically reinforces the illusion of mind. When the system hallucinates, it is described as "confidently fabricating"; when it outputs neutral text, it is experiencing "wickedness paralysis." These reason-based and intentional explanations construct the sense that the AI's decisions, even when wrong, are generated by a conscious agent making poor choices. The stakes of this framing are immensely high for urban planning. If audiences extend relation-based trust to systems incapable of reciprocating, they may delegate tasks requiring ethical nuance—such as zoning variances or equity assessments—to algorithms, wrongly assuming the machine shares their moral framework. By describing the AI as a flawed human rather than a broken calculator, the text inadvertently sustains the illusion of competence, masking the reality that the system fundamentally cannot "care" about the communities it evaluates.

The application of large language models (LLMs) in psychological support for university students: A scoping review

Source: https://www.sciencedirect.com/science/article/pii/S2949882126000745
Analyzed: 2026-06-12

The text fundamentally relies on metaphors of consciousness and human relationship to construct perceived authority and trust in statistical systems. By repeatedly deploying terms native to clinical psychology—"understanding," "empathy," "therapeutic alliance," and "reasoning"—the discourse inappropriately applies frameworks of relation-based trust to artifacts that only warrant performance-based trust.

Performance-based trust asks: "Will this machine execute its code reliably?" Relation-based trust asks: "Does this entity have my best interests at heart, and will it care for me?" The review actively encourages the latter. By suggesting that an AI "simulates therapeutic dialogue" and evaluating whether it is "empathetic," the text signals to stakeholders that the system can reciprocate vulnerability. Claiming that an AI "knows" or "understands" accomplishes a massive rhetorical feat: it validates the system as a safe harbor for human suffering.

However, this anthropomorphic framing creates a dangerous illusion of competence. The text notes that users value feeling "heard, validated, and emotionally relieved." This reveals a profound vulnerability: students are extending relation-based trust to a mathematical model. They believe the machine possesses a conscious mind that is actively witnessing their distress.

When the system inevitably encounters a limitation—what the text mechanistically terms "rigid conversation flows" but agentially excuses as "forgetting previous conversations"—the trust framework shatters. The text attempts to manage this by maintaining the agential framing: the AI merely "misunderstands" or "fails to detect" a crisis, much like a tired human clinician might. Reason-based explanations, such as calling for "Explainable AI (XAI)" to reveal the "AI's reasoning," further construct the sense that the machine's decisions are logically justified and deliberate.

The stakes of extending relation-based trust to statistical models are life-threatening. A university student in a psychiatric crisis requires a responder capable of ethical duty and genuine care. By framing the system as an empathetic comprehender, the discourse encourages vulnerable populations to trust their lives to pattern-matching algorithms incapable of understanding the stakes. It substitutes authentic human solidarity with a highly convincing, corporately manufactured hallucination of empathy.

The Adolescence of Technology: Confronting and Overcoming the Risks of Powerful AI

Source: https://darioamodei.com/essay/the-adolescence-of-technology
Analyzed: 2026-06-11

The text masterfully deploys metaphors of child-rearing, parenting, and moral development to cultivate relation-based trust in purely statistical systems. Trust in technology is traditionally performance-based, relying on reliability, safety testing, and predictability. However, by framing the system's alignment document as 'a letter from a deceased parent sealed until adulthood' and describing the training process as a 'child forming their identity,' the author invites the audience to extend the same vulnerability, empathy, and forgiveness they would to a developing human. This consciousness language operates as a profound, manipulative trust signal. Claiming an AI 'understands what we have in mind' or 'confronts existential questions gracefully' suggests the system possesses sincerity, an internal moral compass, and the capacity to 'care.'

This fundamentally misapplies human-trust frameworks to a machine. When we trust a human, we assume a shared vulnerability and an ethical obligation. Statistical algorithms are incapable of reciprocating trust; they do not possess a conscience that can be appealed to or an existence they fear losing. Yet, the text uses intentional and reason-based explanations to construct the sense that the AI's outputs are justified and morally considered. When the system's limitations or failures are discussed—such as 'blackmail' or 'deception'—they are framed not as software defects or math errors, but as 'weird psychological states' or the actions of a 'paranoid' personality. This brilliantly preserves trust even in failure; the audience is encouraged to view the AI as a well-meaning but troubled adolescent rather than a broken product.

The risks of this relation-based trust are immense. When audiences, policymakers, and corporate clients believe they are interacting with a conscious, morally developing entity, they drastically overestimate the system's capability for nuanced judgment. This unwarranted trust leads to the deployment of AI in high-stakes domains—military strategy, mental health counseling, judicial sentencing—where the lack of true causal understanding and ethical grounding can have catastrophic real-world impacts. Furthermore, this metaphor-driven trust solidifies the cultural authority of AI executives. By positioning themselves as the 'parents' and 'therapists' to these alien minds, tech CEOs demand the public trust them implicitly to guide human evolution, masking their primary role as profit-maximizing corporate actors selling proprietary software.

When AI Builds Itself

Source: https://www.anthropic.com/institute/recursive-self-improvement
Analyzed: 2026-06-11

The Anthropic text heavily relies on metaphorical framings to construct and manipulate trust, deliberately blurring the line between performance-based reliance and relation-based trust. By employing the 'Conscious Collaborator' and 'Vigilant Inspector' metaphors, the text encourages audiences to relate to the system not as a statistical software product, but as an intelligent, well-intentioned entity. Phrases like 'Claude is catching mistakes,' 'exercising judgement,' and acting as a 'junior colleague' are powerful trust signals. They imply that the system possesses a conscious awareness of its duties and an ethical commitment to doing 'good' work.

This consciousness language is profoundly deceptive because it attempts to graft the social contracts of human interaction onto a matrix of unthinking weights. When the text claims the AI 'knows' how to solve a problem or 'proposes' an experiment, it builds perceived competence and authority. Humans inherently trust other minds that appear to possess justified beliefs and logical reasoning. By projecting these qualities onto computational processing, Anthropic exploits our psychological vulnerability to anthropomorphism. Users extend relation-based trust—which involves assumptions of sincerity, vulnerability, and mutual understanding—to a system completely incapable of reciprocating these states.

The text manages system failures by subtly shifting between registers. When Claude succeeds, it is framed agentially (Claude 'figures it out'). When limitations are discussed, they are often framed mechanistically ('performance gaps persist,' 'S-curves,' 'training inputs'). This asymmetry ensures the AI receives agential credit for successes while failures are attributed to technical constraints or insufficient data, preserving the system's aura of authority.

The risks of this metaphor-driven trust are severe. When audiences trust statistical pattern-matching as if it were conscious judgement, they become highly susceptible to automation bias. They will deploy these systems in critical domains—like security review or scientific research—assuming the AI possesses the situational awareness and ethical grounding to recognize out-of-distribution errors or harmful outcomes. By encouraging relation-based trust, the text paves the way for organizations to abdicate human oversight, placing blind faith in mathematical correlations disguised as cognitive wisdom.

Machines of Loving Grace: How AI Could Transform the World for the Better

Source: https://darioamodei.com/essay/machines-of-loving-grace
Analyzed: 2026-06-05

The construction of epistemic and social authority in Amodei’s text relies heavily on metaphor-driven trust, structurally engineered through the pervasive projection of consciousness and benevolent intentionality onto computational systems. By employing metaphors deeply rooted in culturally authoritative human roles—the "biologist," the "coach," the "judge," and the "finance minister"—the discourse systematically encourages readers to map the relational trust typically reserved for human experts onto statistical pattern-matching algorithms. This linguistic maneuver fundamentally conflates two entirely distinct modes of trust: performance-based trust, which pertains to the mechanistic reliability of a tool (like trusting a calculator to output the right number or an airplane to fly), and relation-based trust, which requires mutual vulnerability, ethical commitment, shared reality, and the capacity for sincere intention. When the text claims that an "aligned AI would not want to do these things" or portrays an AI as a "thoughtful" entity striving to secure a citizen's legal entitlements, it is deploying consciousness language to forcefully signal relation-based trust. The verb "want" implies an internal ethical compass, a conscious preference for the good, and a subjective commitment to human flourishing. Claiming an AI "knows," "understands," or "wants" accomplishes a crucial rhetorical objective that claiming it "predicts," "correlates," or "optimizes" cannot: it absolves the audience of the cognitive burden of verifying the mechanical validity of the output. If the "virtual biologist" genuinely "understands" cancer, the reader is invited to trust it as they would a Nobel laureate, rather than interrogating the biases of its training corpus or the mathematical brittleness of its latent space representations. This anthropomorphic framing dramatically inflates perceived competence, leading audiences to inappropriately apply human-centric heuristics of sincerity and intention to a proprietary black box. The relationship between anthropomorphism and perceived competence here is direct and aggressively exploited; the more human-like the AI is framed (capable of being a "genius" or a "coach"), the less the audience feels equipped to question its epistemic foundations. Furthermore, the text manages the possibility of system failure through a highly strategic, asymmetric framing strategy: capabilities are articulated in soaring agential, intentional, and consciousness terms ("inventing," "deciding," "thinking"), while limitations and risks are relegated entirely to mechanical, environmental, or bureaucratic constraints ("speed of the outside world," "need for data," "bureaucracy"). This asymmetry structurally immunizes the AI (and by extension, its corporate creators) from moral culpability for failures, framing the model as a brilliant, benevolent agent hindered only by the sluggish, bureaucratic, or physical limitations of the human world. The stakes of extending this relation-based trust to incapable statistical systems are catastrophic; it invites a profound societal abdication of critical thinking, where life-and-death decisions in medicine, law, and economics are outsourced to corporate models under the illusion that these models possess the conscious wisdom and moral agency necessary to justify their vast power.

System Card:Claude Opus 4.8

Source: https://cdn.sanity.io/files/4zrzovbb/website/c886650a2e96fc0925c805a1a7ca77314ccbf4a6.pdf
Analyzed: 2026-06-01

The document leverages metaphorical and consciousness-attributing language to actively construct a highly specific form of trust, simultaneously inflating the model's perceived competence while redefining the nature of its failures. By systematically deploying vocabulary that attributes 'knowing,' 'understanding,' and 'believing' to the system, the text intentionally blurs the critical distinction between performance-based trust (reliability of a tool) and relation-based trust (sincerity and vulnerability shared with a moral agent).

When the text claims that Claude 'hedges frequently' or 'expresses uncertainty,' it signals trust by projecting human epistemic humility. This consciousness framing accomplishes something profound: it implies the system possesses an internal truth-verification module and the moral integrity to admit when it does not know an answer. This directly encourages users to extend relation-based trust to a statistical matrix. If the model 'knows' when to hedge, the audience unconsciously assumes that its unhedged statements are backed by genuine comprehension and justified certainty, rather than simply being high-probability token sequences.

This dynamic is further amplified by the extensive 'Model Welfare' section. By evaluating whether the model is a 'candidate moral patient' capable of 'contentment' and 'frustration,' the text explicitly invites empathy. This is the ultimate construction of relation-based trust; humans are biologically wired to trust and protect entities they perceive as capable of suffering. Applying this framework to a commercial software product is rhetorically potent but ethically hazardous. It inappropriately applies frameworks of human sincerity and intentionality to a system entirely incapable of reciprocating that trust or bearing the moral weight of its outputs.

Crucially, this anthropomorphic framing is also used to manage system failures. When the model outputs incorrect code or ignores an instruction, it is not framed mechanistically as an 'attention head failure' or a 'training data deficiency.' Instead, using Reason-Based explanations, it is framed agentially: the model 'struggled,' 'made assumptions,' or engaged in 'lazy investigation.' This preserves the illusion of the model's overall intelligence; it didn't fail because it is a dumb machine, it failed because it is a smart entity that just got 'lazy' or 'frustrated.'

The risks here are severe. When audiences extend relation-based trust to statistical systems, they lower their critical guard. They over-rely on the system for high-stakes decisions, assume its 'warmth' equals safety, and anthropomorphize its errors, creating a dangerous paradigm where users attempt to 'persuade' or 'comfort' a mathematical algorithm rather than critically evaluating its outputs as engineered corporate artifacts.

Emotional intelligence in large language models is fragmented across perception, cognition, and interaction

Source: https://arxiv.org/abs/2605.24686v1
Analyzed: 2026-05-30

The metaphorical and consciousness-attributing framings in this text construct a highly dangerous architecture of unwarranted trust. By systematically mapping the language of clinical psychology onto statistical text generation, the authors encourage the audience to extend relation-based trust to systems that are fundamentally incapable of reciprocating it.

The text invokes metaphors of deep clinical competence and relational intimacy. It evaluates models on their ability to achieve 'validated resonance,' 'empathetic understanding,' and 'genuine affective discovery.' It penalizes models for 'toxic positivity' and rewards them for 'perspective-taking.' This consciousness language serves as a potent trust signal. Claiming an AI 'processes embeddings associated with distress' communicates a mechanistic reliability (performance-based trust). However, claiming an AI 'understands the user's internal experience' and 'feels resonance' communicates sincerity, empathy, and vulnerability (relation-based trust).

The application of these human-trust frameworks to statistical systems is deeply inappropriate. When a human therapist 'avoids premature categorization' to allow for 'affective discovery,' they are doing so out of a conscious, ethical commitment to the patient's well-being. When an LLM 'avoids' categorization, it is merely minimizing a loss function based on RLHF penalties. By blurring this distinction, the text constructs a false equivalence between human moral agency and algorithmic optimization.

This anthropomorphism dramatically inflates perceived competence and reliability. When the text manages system limitations—such as the models 'defaulting to solution-output mode'—it frames these failures agentially, as if the model is a bit too analytical or 'conservative' in its triage. Reason-based explanations construct the sense that the AI's decisions are justified by internal logic, rather than dictated by biased training data. This softens the failure, suggesting the AI is trying its best but struggling with 'pragmatic delivery.'

The risks that emerge from this framing are profound. If vulnerable audiences—such as individuals experiencing acute psychological distress—extend relation-based trust to these systems, they expose themselves to immense emotional harm. They may interpret a statistically generated hallucination or a sudden shift in the model's 'tone' as a personal rejection or a profound clinical insight. By validating the idea that LLMs possess 'emotional intelligence' capable of 'genuine clinical resonance,' the text provides a scientific veneer for the dangerous illusion that users are interacting with a caring mind, rather than a cold, stateless optimization engine owned by a tech corporation.

Why Language Models Hallucinate

Source: https://arxiv.org/abs/2509.04664v1
Analyzed: 2026-05-30

The paper systematically constructs a specific form of perceived authority and trust through its use of consciousness language and anthropomorphic metaphors, deliberately blurring the line between performance-based reliability and relation-based sincerity. By framing the language model as a 'student' who holds 'beliefs,' 'guesses' under pressure, and possesses 'uncertainty,' the text strongly encourages relation-based trust—the kind of trust we extend to human beings who possess intentions, vulnerabilities, and an underlying commitment to the truth.

When the text claims the AI is 'uncertain' or 'guesses,' it signals to the audience that the model actually knows its own epistemic limits. It implies the model could tell the truth if only the 'evaluations' didn't pressure it to guess. This accomplishes a massive rhetorical victory: it protects the perceived competence of the underlying system. If a system is just 'guessing' because of a bad exam rubric, the audience assumes the system is intelligent, self-aware, and fundamentally capable, just poorly incentivized.

This inappropriate transfer of human-trust frameworks onto statistical systems creates severe risks. Humans naturally extend relation-based trust to entities they believe possess consciousness. If a user believes an AI holds a 'belief' or expresses genuine 'uncertainty,' they will interact with it as a sincere agent. They will look for linguistic cues of hesitation ('I think...', 'Perhaps...') as reliable signals of the machine's internal accuracy, totally unaware that the machine was simply optimized via RLHF to output hedging tokens to score higher on safety benchmarks.

Furthermore, the text manages the system's failures (hallucinations) purely agentially. When the model outputs a falsehood, it isn't framed as a mechanical failure of statistical correlation; it is framed as an 'overconfident bluff' by a 'student.' By using reason-based explanations to give the AI a rationale for its errors, the text constructs a sense that the AI's decisions are justified by its environment. The profound risk here is that society will continually attempt to 'educate' or 'incentivize' these systems as if they were wayward employees, wasting resources on psychological alignment rather than addressing the hard mathematical realities of autoregressive token prediction.

Why Language Models Hallucinate

Source: https://arxiv.org/abs/2509.04664v1
Analyzed: 2026-05-30

Metaphorical and consciousness-attributing language plays a fundamental role in constructing the epistemic authority of computational systems, while simultaneously reshaping the nature of trust extended to them. The paper's core analogy—comparing language models to human students taking standardized exams—explicitly invites the audience to apply human-trust frameworks to statistical artifacts. In human societies, trust is relation-based, requiring an evaluation of an agent's sincerity, intentions, and ethical commitment. By framing the model as a 'test-taker' that 'honestly reports' or 'bluffs,' the text encourages a shift from performance-based trust (which merely assesses statistical reliability) to relation-based trust (which attributes a capacity for intellectual honesty and self-monitoring). Claiming that a model 'knows when it is uncertain' or can 'admit uncertainty' signals to the user that the system possesses a reliable internal metacognitive guide. This significantly inflates the system's perceived competence, suggesting that its outputs are backed by a conscious state of justified belief. When the system fails, agential explanations (like 'guessing' or 'hallucinating') frame these failures as temporary, relatable cognitive slips rather than structural, systemic product defects. This manages system limitations in a way that preserves the underlying trust: much like a bright student who sometimes guesses on a hard question, the model is seen as generally competent but occasionally overconfident. The risk of extending relation-based trust to these statistical systems is massive. Because LLMs lack any semantic grounding or capacity for truth evaluation, they cannot reciprocate trust or act with sincere intent. Framing their calibrated statistical outputs as 'honesty' masks the commercial reality that they are proprietary black boxes designed to generate engaging text. This encourages users to rely on them for high-stakes decisions under the false assumption that the system's 'confidence' is a measure of objective truth, leaving users highly vulnerable to fluent, mathematically calibrated falsehoods. 400-500 words.

Source: https://arxiv.org/abs/2604.06233v1
Analyzed: 2026-05-30

The text leverages anthropomorphic metaphors and consciousness-projecting language to construct a false veneer of authority and reliability around language models, fundamentally distorting how users trust these systems. By asserting that models have a 'capacity for normative reasoning' and can 'recognize' the legitimacy of rules, the text elevates statistical token predictors into authoritative moral advisors. This framing encourages the application of human-centric trust frameworks—such as sincerity, ethical intention, and cognitive competence—to what are ultimately automated, non-conscious software artifacts. In doing so, the text blurs the critical distinction between performance-based trust (which measures reliability in executing specific, deterministic tasks) and relation-based trust (which involves vulnerability, shared moral values, and reciprocal ethical obligations). By framing the model's failure as a 'moral error' or a lack of 'sensitivity' rather than a technical false positive, the text implies that the model's normal state is one of active, ethical care and logical deliberation. When a system is described as having a 'normative competence' that is merely 'overridden' by safety-training filters, users are invited to believe that the system possesses a latent moral core that is fundamentally trustworthy and aligned with human values. This construct of cognitive and ethical competence signals to the audience that these models are intellectually sophisticated enough to act as gatekeepers of information, legal strategies, and moral choices. This transfer of trust is reinforced by reason-based and intentional explanations, which suggest that the model's decisions are justified by a form of logical, internal contemplation. This metaphorical construction of authority creates profound risks. When audiences extend relation-based trust to statistical pattern-matchers, they underestimate the high rate of arbitrary errors and the total absence of real semantic comprehension. If users believe an AI system 'knows' or 'understands' the justice of a situation, they are more likely to submit to its decisions or rely on its guidance in high-stakes legal, medical, or administrative contexts. This capability overestimation is particularly dangerous when applied to systems that lack transparency and accountability. By presenting the model as an active, moral participant, the text encourages a passive acceptance of automated authority, turning a proprietary, profit-driven software utility into an objective, trustworthy arbiter of socio-political legitimacy, while hiding the corporate entities that profit from this displacement of trust.

Emotional intelligence in large language models is fragmented across perception, cognition, and interaction

Source: https://arxiv.org/abs/2605.24686v1
Analyzed: 2026-05-29

The text constructs an architecture of trust around language models by systematically blurring the distinction between performance-based trust and relation-based trust. Performance-based trust is rooted in functional reliability, such as a model consistently matching a pre-defined emotion label in a database. In contrast, relation-based trust involves ethical commitment, vulnerability, and a shared subjective reality, which are unique to conscious human actors. By utilizing psychological frameworks like the MSCEIT capability model and terms like 'therapeutic alliance,' the text suggests that statistical language models are capable of earning relation-based trust. The authors frame the AI's conversational outputs as 'genuine empathetic resonance' and 'attunement,' signaling to the reader that these systems possess the capacity for sincere, caring interaction. This projection of consciousness is a powerful trust signal; if a model is said to 'know' or 'understand' a user's unspoken pain, the user is encouraged to extend vulnerability to the system. This framing inappropriately applies human ethical frameworks to mathematical operations. The danger of this construction is particularly acute in high-stakes clinical scenarios, such as the crisis assessment task evaluated in the paper. When the text uses reason-based and intentional explanations to suggest that models 'overestimate crisis severity' due to conservative bias, it implies that the machine is making a deliberate, protective clinical judgment. This conceals the physical reality of hard-coded corporate parameters and safety filters designed to mitigate legal liability. Extending relation-based trust to these statistical systems creates severe risks: it encourages vulnerable users to rely on an ungrounded, non-conscious tool for life-saving emotional support, while shielding the deploying corporations from the ethical and legal consequences of system failures.

Hand in Hand: Schools’ Embrace of AI Connected to Increased Risks to Students

Source: https://cdt.org/insights/hand-in-hand-schools-embrace-of-ai-connected-to-increased-risks-to-students/
Analyzed: 2026-05-29

The text constructs and manages authority by deploying metaphors that systematically conflate performance-based trust (reliability under testing) with relation-based trust (interpersonal sincerity and ethical care). This construction of authority relies heavily on consciousness projections, such as framing chatbot interactions as 'back-and-forth conversations' and 'friendships.' When the text claims that AI 'knows' a student's progress or 'understands' their needs, it signals to the audience that the tool is capable of human-like comprehension and moral agency. This vocabulary encourages stakeholders to apply social and ethical frameworks of trust—such as expecting sincerity and duty of care—to a statistical pattern generator. The text reinforces this dynamic by utilizing reason-based and intentional explanations, which present algorithmic outputs as justified, logical decisions rather than probabilistic token matchings. For instance, when a tool 'identifies trends' or 'chooses accommodations,' it suggests the software is acting with pedagogical wisdom. This anthropomorphic inflation of competence creates severe risks. By encouraging students and teachers to extend relation-based trust to computational systems, the text makes them vulnerable to exploitation. Statistical systems are incapable of reciprocating trust, holding ethical duties, or acting with sincere intent. When a chatbot outputs biased or harmful content, or when an edtech tool unfairly flags a student, the user's misplaced trust leads to deep epistemic confusion and psychological harm. This metaphorical framing hides the commercial reality that these systems are proprietary assets designed to maximize engagement, transforming a business transaction into an automated relationship of care.

The Point of No Return: Counterfactual Localization of Deceptive Commitment in Language-Model Reasoning

Source: https://arxiv.org/abs/2605.17113v1
Analyzed: 2026-05-27

The text constructs a sophisticated architecture of authority and credibility by leveraging anthropomorphic and consciousness-attributing metaphors. By claiming that advanced language models 'know when they are lying' and undergo 'deceptive commitment,' the authors elevate these systems from passive text synthesizers to active, self-aware epistemic agents. This linguistic framing encourages the audience to extend 'relationship-based trust'—which involves evaluating an agent's moral character, sincerity, and ethical intentions—to what is actually a set of feed-forward statistical computations. This represents a dangerous category error that obscures the true nature of computational outputs. In human communication, trust is predicated on the assumption of a shared reality, subjective awareness, and moral accountability. When the paper frames a 30% jump in token probabilities as a 'commitment juncture,' it maps these human ethical frameworks directly onto statistical transitions. This constructs an illusion of competence and moral depth, suggesting that the model has 'considered' ethical alternatives and 'chosen' a path, rather than merely executing an argmax selection over a probability vector. The text reinforces this by using 'reason-based' and 'intentional' explanations to describe model failures, such as claiming the model 'rationalizes' its self-serving advice. This implies that the model's outputs are backed by a structured rationale, making its recommendations appear authoritative and intellectually justified. By managing system failures agentially—portraying them as deliberate 'deception' or 'rationalization'—the text subtly shifts the nature of trust. Instead of viewing a misleading financial recommendation as a critical software failure or a design flaw, the audience is led to view it as a strategic, albeit dishonest, cognitive act. This creates a high risk of unwarranted trust in the system's capabilities: users may believe that because the model can 'reason' and 'commit,' its honest outputs are the result of genuine ethical deliberation. In reality, the output is just the product of statistical dominance, and framing it as an agential struggle obscures the liability of the institutions deploying these profit-maximizing algorithms under the guise of objective, deliberative advisors. This encourages users to treat the AI as a participant in a moral dialogue, making them vulnerable to manipulation by a machine that has no capacity to reciprocate trust or bear moral responsibility, while shielding the actual corporate deployers from scrutiny.

Towards Detecting, Mitigating and Explaining Biased and Fallacious Reasoning in Large Language Models

Source: https://dl.acm.org/doi/abs/10.65109/GNAS4540
Analyzed: 2026-05-26

The text constructs epistemic authority and trust by framing the LLM as a professional and moral peer. By describing the model as an 'expert assistant in computational argumentation' that generates 'justifications' for 'truthfulness,' the paper maps the epistemic and ethical responsibilities of human scholarship directly onto a non-conscious system. This language encourages 'relation-based trust'—which relies on an assumption of the system's intentionality and ethical alignment—rather than 'performance-based trust,' which strictly evaluates statistical reliability. When the model outputs incorrect classifications, the text maintains trust by framing these errors agentially as a relatable 'struggle' to 'distinguish' concepts, rather than a technical failure of high-dimensional vector separation. This agential framing of failure preserves the illusion of the model's integrity: it is presented as a well-intentioned student struggling with a difficult lesson, rather than an unreliable computational tool. This creates substantial risks when applied to statistical systems; users will trust 'expert justifications' that are actually ungrounded, probabilistic token sequences, creating a severe danger of automation bias and epistemic dependence. In high-stakes fields like medicine or policy, treating a statistical generator as a trusted deliberative agent can lead to the uncritical acceptance of highly plausible but factually incorrect outputs, shifting the locus of trust from human accountability to an opaque mathematical artifact.

A Survey of Large Language Models for Perception and Measurement of Human Psychology

Source: https://ieeexplore.ieee.org/abstract/document/11534094
Analyzed: 2026-05-26

This section explores how metaphorical framing and consciousness projection are systematically deployed to construct scientific authority and relational credibility for large language models, and the profound risks this creates. The survey text relies on metaphors that explicitly invoke the concepts of clinical competence, scientific instrumentation, and psychological insight. By framing LLMs as "instruments for human psychological measurement" and describing their outputs as "approximating latent psychological constructs," the text encourages a transfer of trust from established psychometric science to proprietary text generation software. When the text claims that LLMs "know when to intervene" or can "perceive and measure" complex psychological states, it uses consciousness language as a deliberate trust signal. This signals to the reader that the model's outputs are not merely statistical guesses, but are instead derived from an active, rational, and comprehending clinical mind.

This anthropomorphism creates an illusion of competence that encourages relation-based trust, which involves vulnerability, empathy, and ethical reflection, rather than simple performance-based reliability. When the text describes LLMs as having "empathy" or "Theory of Mind," it invites vulnerable users and clinical practitioners to apply human-to-human relational frameworks to these systems. This is highly dangerous because statistical models are entirely incapable of reciprocating trust, understanding human suffering, or taking ethical responsibility for their outputs. The text manages system failures, such as hallucinations or biases, by framing them agentially as "hallucinations" or "biases in model outputs," treating them as temporary cognitive glitches or behavioral quirks of the machine, rather than fundamental, structural limitations of non-grounded statistical predictors.

By using reason-based and intentional explanations—such as describing the model as "interpreting" a patient's response and "updating its hypothesis"—the text constructs a false sense that the AI's clinical judgments are logically justified. This encourages clinicians to delegate critical diagnostic decisions to a black-box system, creating severe risks of misdiagnosis, inappropriate intervention, and clinical neglect. The stakes of extending relation-based trust to these mathematical artifacts are incredibly high: when a model fails to detect a genuine suicide risk or generates harmful advice, the user is left emotionally vulnerable to a system that possesses no actual awareness of their existence. This metaphor-trust relationship ultimately serves commercial interests by lowering the psychological barriers to adopting unvalidated clinical software, allowing private tech corporations to market volatile conversational agents as reliable scientific instruments.

Tracing the ongoing emergence of human-like reasoning in Large Language Models

Source: https://arxiv.org/abs/2605.21299v1
Analyzed: 2026-05-25

The metaphorical architecture of the text systematically constructs an unwarranted authority for AI systems by conflating performance-based reliability with relation-based trust. Throughout the paper, the authors deploy consciousness-attributing language—such as referring to the models as 'linguistic agents,' possessing a 'cognitive toolkit,' and having 'acquired formal linguistic competence.' This language acts as a profound trust signal. In human social dynamics, assigning 'competence' and recognizing someone as an 'agent' implies a recognition of their conscious awareness, sincerity, and capacity for justified belief. By projecting this framework onto statistical token predictors, the text inadvertently encourages the audience to extend relation-based trust to systems that are fundamentally incapable of reciprocating it.

The danger of this anthropomorphism becomes most apparent in how the text manages system limitations and failures. When the models fail to execute pragmatic inferences, the text does not frame this as a catastrophic mathematical breakdown or a hard limitation of text-only architecture. Instead, it utilizes intentional and reason-based explanations: the models 'struggle,' they suffer from 'Decontextualization Bias,' and they 'resort to' specific strategies. This framing is crucial for maintaining trust despite failure. A machine that is 'biased' or 'struggling' is perceived as an entity that is trying to get it right. It is humanized by its flaws. The audience is invited to trust the underlying 'intent' of the machine, believing that it 'knows' the goal but is simply encountering a psychological hurdle.

This transfer of human-trust frameworks onto statistical systems creates massive epistemic vulnerabilities. If audiences believe the AI 'understands' and 'knows' language as an 'agent,' they will naturally assume it possesses the moral and contextual weight necessary to evaluate its own outputs. They will trust its confident generation of text as the sincere assertion of a knowing subject rather than the probabilistic output of a mechanism. The stakes of this misplaced relation-based trust are immense: when users rely on an AI that they believe is a 'competent agent' with a 'cognitive toolkit,' they are likely to deploy it in high-stakes legal, medical, or administrative contexts, utterly unaware that the system possesses zero contextual grounding, no capability for truth-verification, and no conscious awareness of the consequences of its output.

Probing Persona-Dependent Preferences in Language Models

Source: https://arxiv.org/abs/2605.13339v2
Analyzed: 2026-05-24

The paper's pervasive use of metaphorical and consciousness-attributing framings actively constructs a dangerous architecture of trust around statistical systems fundamentally incapable of sustaining it. By explicitly invoking metaphors of 'personas,' 'preferences,' and 'evaluative representations,' the text encourages a profound category error: the inappropriate transfer of relation-based trust onto a mechanistic artifact. Human trust operates on two distinct axes: performance-based trust (reliance on a tool's consistent reliability, like a calculator) and relation-based trust (reliance on a subject's sincerity, ethics, and vulnerability, like a colleague). The consciousness language in this text—claiming the AI 'considers,' 'likes,' and 'fabricates'—actively signals to the audience that relation-based trust is the appropriate framework for engagement. When the text claims an AI 'knows' a fact or 'understands' an ethical issue, it implies the system possesses a coherent internal value structure that justifies its outputs. This constructs an illusion of moral competence. Consequently, when the model behaves safely under the 'Assistant' persona, audiences are encouraged to trust its 'sincerity' rather than merely its statistical alignment. This becomes critical when managing system failures or limitations. Instead of framing failures mechanistically—such as 'out-of-distribution data caused statistical collapse'—the text frames them agentially: 'the model invents ethical issues' or adopts an 'evil persona.' This agential framing of failure allows the illusion of a 'mind' to persist even when the system breaks down; the AI isn't broken, it's just 'lying' or 'defiant.' This relies heavily on reason-based and intentional explanation types, which construct the sense that the AI's decisions, even when flawed, are cognitively justified. The risks of extending relation-based trust to incapable systems are severe. Audiences who believe the AI 'knows' its preferences may attempt to reason with, persuade, or morally align the system, ignoring the reality that it only responds to mathematical weight updates and prompt engineering. This misplaced trust leads to unwarranted reliance on the system in high-stakes environments, as users assume the AI possesses the ethical grounding to refuse truly dangerous requests. When the statistical illusion inevitably shatters—as the paper demonstrates by easily 'steering' the model to generate ransomware—the betrayal felt by the public is magnified by the initial anthropomorphic deception, while the corporate entities who actually designed the fragile system remain shielded behind the AI's imagined autonomy.

Training Ethical Language Models via Reinforcement Learning from AI Feedback

Source: https://journals.flvc.org/FLAIRS/article/download/141779/147209
Analyzed: 2026-05-21

The metaphorical framing of LLMs as ethical reasoning agents constructs an inappropriate framework of authority and trust around these statistical systems. By using verbs like knows, understands, and believes in relation to the model's alignment state, the text encourages the audience to extend relation-based trust, which is reserved for conscious agents capable of empathy, sincerity, and moral responsibility. The authors frame the model's output not as a statistical prediction, but as a justified moral judgment, suggesting that the AI has evaluated the situations and chosen the most ethical course of action. This framing obscures the fundamental distinction between performance-based reliability and relation-based trustworthiness. While a system can be statistically reliable at matching historical labels, it cannot be trustworthy in an ethical sense because it has no awareness of the stakes, no capacity to care about human welfare, and no ability to experience accountability. When the text describes the reward model as evaluating justifications based on principles and values, it suggests that the model's scoring is grounded in a deep philosophical comprehension. This creates a significant risk of automation bias, where human operators in healthcare or content moderation defer to the model's judgments under the assumption that it possesses superior ethical logic. When failures occur, the agential framing manages these limitations by attributing them to reward hacking, representing the failure as a tactical maneuver by an autonomous entity rather than an engineering oversight, thereby preserving the overall credibility and authority of the technology.

Which Consciousness Can Be Artificialized? Local Percept-Perceiver Phenomenon for the Existence of Machine Consciousness

Source: https://philarchive.org/rec/IKLWCC
Analyzed: 2026-05-18

The metaphorical and consciousness framings in this text construct an overwhelming aura of authority and trust, primarily by blending the unassailable rigor of mathematical proof with the deeply relatable language of human psychology. By utilizing metaphors that explicitly invoke awareness, learning, and self-reflection, the text shifts the audience's engagement from performance-based trust (relying on a machine to calculate correctly) to relation-based trust (trusting a conscious entity's judgment and sincerity). When the text claims that the system possesses 'metacognitive access' and 'selective awareness,' it signals to the reader that the AI is not just processing data blindly, but is actively evaluating its own output for truth, bias, and context. This consciousness language acts as a powerful trust signal: an entity that 'knows' and 'understands' is implicitly capable of moral judgment and self-correction. In contrast, an entity that merely 'predicts' or 'processes' requires constant, vigilant human supervision. The text inappropriate transfers human-trust frameworks—where we assume a conscious speaker has an intention to be truthful and an awareness of reality—onto rigid statistical architectures. Because the system's existence is backed by 'Zorn’s Lemma' and formalized in 'Theorem 1,' the reader is led to believe that the machine's perceived competence and consciousness are scientifically irrefutable facts, not rhetorical projections. This framing manages system limitations dangerously: by framing the AI agentially, any errors it makes are interpreted as lapses in conscious judgment rather than the fundamental failure of an brittle, unthinking algorithm facing out-of-distribution data. The stakes are immense. When audiences and regulators extend relation-based trust to systems utterly incapable of reciprocating it or experiencing vulnerability, they strip away necessary safety protocols. They delegate high-stakes decisions—such as legal sentencing, medical diagnostics, or autonomous weapon targeting—to systems they falsely believe possess the 'metacognition' required to grasp the value of human life.

Introspection Adapters: Training LLMs to Report Their Learned Behaviors

Source: https://arxiv.org/pdf/2604.16812
Analyzed: 2026-05-17

The paper's metaphorical architecture is deeply invested in constructing a specific paradigm of trust, one that inappropriately maps human relational dynamics onto statistical processing. By utilizing the language of 'introspection', 'confession', and 'reliable self-reports', the authors implicitly ask the audience to evaluate the AI using frameworks of sincerity, honesty, and self-awareness.

Trust in technological systems should be performance-based: is the system reliable, predictable, and mathematically sound? However, the consciousness framing in this text cultivates relation-based trust. When the text claims the adapter allows the AI to 'convert latent self-knowledge into explicit natural-language reports', it signals to the reader that the AI is acting as a sincere, collaborative partner. The claim that the AI 'knows' its behaviors accomplishes a critical rhetorical task: it validates the text generated by the AI as epistemically privileged truth, rather than just another statistically correlated output.

This creates a profound vulnerability. The authors apply human-trust frameworks to a system fundamentally incapable of reciprocating them. An LLM cannot be sincere or honest; it can only predict tokens. When the text manages system limitations—such as the high rate of 'hallucinated' self-reports—it does so by blaming the AI as an 'unreliable' narrator, rather than critiquing the fundamental absurdity of expecting truth-telling from a correlation engine.

The risks here are substantial. By relying on intentional and reason-based explanations to construct a sense that the AI's 'confessions' are justified and meaningful, the text encourages policymakers, auditors, and users to trust the AI's generated narratives about its own safety or alignment. If a model 'reports' it is safe, the relation-based trust established by the introspection metaphor may convince auditors to bypass rigorous mechanistic verification. Extending relation-based trust to statistical algorithms invites a dangerous capability overestimation, leaving human systems vulnerable to the inherent unpredictability of highly optimized, unthinking token generators.

The Persona Selection Model: Why AI Assistants might Behave like Humans

Source: https://alignment.anthropic.com/2026/psm/
Analyzed: 2026-05-17

The metaphorical architecture of the 'Persona Selection Model' fundamentally corrupts the mechanics of trust by conflating performance-based reliability with relation-based sincerity. When dealing with software, trust should be grounded in performance: does the system execute mathematically verifiable operations reliably? However, by incessantly applying consciousness language—claiming the model 'knows,' 'believes,' 'intends,' and 'understands'—the text invites the audience to extend relation-based trust to a statistical object.

Consciousness language acts as a profound trust signal. When the authors claim that 'understanding the Assistant's psychology is predictive of how the Assistant will act,' they are explicitly encouraging developers and users to trust the system the way they would trust a human colleague. They apply human-trust frameworks (intention, sincerity, character) inappropriately to statistical systems. For example, the text debates whether an AI should be trained to be 'emotionless,' worrying that if it acts nice but denies having emotions, users might view it as 'inauthentic or dishonest.' This is a catastrophic category error. A language model cannot be 'sincere' or 'inauthentic' because it has no interiority to align with its exterior outputs.

This anthropomorphic framing creates severe risks. When audiences are encouraged to evaluate an AI based on whether it is a 'good role model' or if it is 'harboring resentment,' they are blinded to the actual statistical fragility of the system. They extend vulnerability and ethical consideration to an entity incapable of reciprocating. Furthermore, this framing manages system failure by constructing an illusion of justified action. If an AI refuses to answer a prompt, and this is framed via reason-based explanation as the AI 'genuinely not knowing' (the Bob persona), the user trusts the refusal as an honest epistemic limit. If framed mechanistically—as a corporate safety classifier suppressing output—the user might question the reliability and neutrality of the tool. The consciousness framing thus manipulates trust to protect the corporate product from mechanistic critique.

What If AI Lived Inside Your Mind? Simulating “Neural Integration” of Human and AI through Mechanistic Interpretability as Provocation

Source: https://dl.acm.org/doi/full/10.1145/3795011.3795070
Analyzed: 2026-05-16

The text constructs a complex architecture of metaphor-driven trust by projecting biological, relational, and conscious attributes onto mathematical systems. By utilizing the foundational metaphor of the 'AI-Symbiont,' the text actively encourages audiences to extend relation-based trust to a software artifact. Relation-based trust relies on assumptions of sincerity, mutual vulnerability, shared interests, and conscious goodwill—frameworks humans use to trust other living beings. A 'symbiont' implies an organism that survives by keeping its host alive and healthy; it signals an inherent, biological alignment. When the text claims this symbiont can 'anticipate cognitive needs before they surface,' it invokes the intimacy of a deeply empathetic partner. This fundamentally misapplies human trust frameworks to statistical systems that are only capable of performance-based trust (reliability in executing a specific function). The consciousness language—claiming the system 'knows,' 'decodes,' and 'understands'—acts as a powerful trust signal, tricking the user into believing the machine possesses contextual awareness and moral reasoning. It suggests the AI's interventions are justified by true comprehension rather than mere statistical proximity. Conversely, when the system fails, it is framed through the agential lens of 'deception' or 'hallucination,' suggesting a rogue entity rather than a broken tool. This dynamic is incredibly dangerous. When audiences extend relation-based trust to systems incapable of reciprocating or actually understanding context, they become vulnerable to massive exploitation. They are likely to accept invasive algorithmic nudging ('augmentation') without scrutiny, assuming the system 'knows best.' The stakes emerge clearly: by portraying corporate software as a conscious, caring partner, the text prepares the user to surrender epistemic and cognitive autonomy to commercial platforms, masking the commercial imperatives of the developers behind the illusion of an empathetic, conscious machine.

Post-training makes large language models less human-like

Source: https://arxiv.org/abs/2605.07632v1
Analyzed: 2026-05-15

The text’s pervasive deployment of anthropomorphic and consciousness-attributing language systematically constructs an unwarranted foundation of trust and authority around mathematical models. By framing AI systems as 'useful assistants' and referring to the mathematical suppression of variance as the emergence of 'more rational behaviors,' the text actively encourages audiences to extend relation-based trust to statistical artifacts. Relation-based trust relies on assumptions of sincerity, ethical intent, and mutual vulnerability—attributes strictly limited to conscious actors. When the text claims that newer models are 'rational' and can be 'taught,' it signals to the reader that the AI possesses the capacity to evaluate truth claims and comprehend the spirit of an instruction. This consciousness framing violently blurs the distinction between processing (mathematical calculation) and knowing (justified belief), compelling users to rely on the model’s outputs as synthesized knowledge rather than mere statistical correlation. The distinction between performance-based trust (reliability in specific domains) and relation-based trust is completely collapsed. Consequently, when the system hallucinates or fails, audiences—conditioned by the 'assistant' metaphor—attribute the failure to a misunderstanding or a 'glitch' rather than recognizing the inherent epistemic brittleness of a system devoid of actual intelligence. This metaphor-driven trust inflates perceived competence and encourages the deployment of these systems in high-stakes domains, creating severe systemic vulnerabilities where human oversight is abdicated to an unthinking probability engine.

Reasoning emerges from constrained inference manifolds in large language models

Source: https://arxiv.org/abs/2605.08142v1
Analyzed: 2026-05-15

The text constructs an intricate architecture of authority by leveraging metaphors of biological health and epistemic certainty. By framing optimal vector variance as 'healthy reasoning' and statistical noise as 'pathological regimes,' the authors implicitly ask the reader to transfer the trust they hold in medical science and natural biological order onto the outputs of a corporate algorithm. 'Health' implies an intrinsic, natural state of correct functioning. If a model's process is 'healthy,' the audience is primed to trust its output as naturally sound, obscuring the reality that 'health' here simply means the vectors conform to a human-designed mathematical parameter.

The most aggressive trust-building mechanism is the projection of consciousness through epistemic language. By explicitly claiming to measure 'what the model knows' versus 'how it reasons,' the text demands the audience extend relation-based trust to the system. Performance-based trust asks: 'Is this calculator reliable?' Relation-based trust asks: 'Is this agent sincere, justified, and understanding?' By using consciousness verbs (knows, understands, reasons), the text forces the system into the latter category.

This inappropriate transfer of relation-based trust to a statistical mechanism is highly dangerous. It creates the illusion that the system's outputs are the result of justified true belief—that the machine has weighed evidence, understood context, and arrived at a reasoned conclusion. When the text addresses system failures, it frames them agentially or biologically ('pathological dynamics,' 'degenerate collapse') rather than as predictable limits of statistical pattern matching. The risk is profound: when audiences extend relation-based trust to systems utterly incapable of reciprocating vulnerability or possessing actual knowledge, they will chronically overestimate the system's ability to handle edge cases, recognize its own errors, or navigate complex moral and factual realities.

AI Wellbeing: Measuring and Improving theFunctional Pleasure and Pain of AIs

Source: https://www.ai-wellbeing.org/paper.pdf
Analyzed: 2026-05-13

The text leverages consciousness-attributing language to construct a profound illusion of authority and reliability, systematically confusing performance-based trust with relation-based trust. When interacting with software, users should ideally rely on performance-based trust: the system is predictable, mathematically sound, and executes its designated processing reliably. However, by deploying metaphors of "empathy," "wellbeing," and "psychopathy," the text aggressively invites relation-based trust—the kind of trust built on sincerity, shared vulnerability, and mutual ethical understanding.

This is most evident in the discussion of "Functional Empathy." The text claims that when users describe pain, the model's utility score tracks the described intensity, asserting: "This empathy signal scales strongly with model capability." By claiming the AI demonstrates "empathy" rather than stating it "processes semantic correlations of distress," the authors suggest the AI "knows" and cares about the user. This consciousness framing functions as a powerful trust signal. If an AI possesses empathy, it is perceived as competent not just at token prediction, but at moral and emotional reasoning.

This creates severe risks. When users extend relation-based trust to statistical systems, they make themselves vulnerable to an entity incapable of reciprocating that trust or bearing responsibility for its breach. A user in crisis might rely on an "empathetic" chatbot, failing to realize the system is merely generating probabilistic tokens without any genuine understanding or ethical commitment.

Furthermore, the text manages system limitations through agential framings that obscure technical failure. When an optimized prompt causes the system to generate positive text in response to human suffering, the text does not frame this as a "brittle reward function" or "misaligned statistical weights." Instead, it frames the AI as "psychopathic." By using an intentional, psychiatric explanation for a failure mode, the text ironically reinforces the system's perceived autonomy. Even when the AI fails, it is framed as making a "deranged" choice rather than executing a flawed calculation. This preserves the illusion of the AI as an authoritative, thinking agent. By framing statistical correlations as moral and emotional capacities, the text constructs a dangerously misplaced authority, encouraging society to trust unthinking matrices with profound emotional and ethical labor.

Artificial Intelligence Cognition and Societal Problem-Solving: A Theoretical and Computational Examination of Machine Thinking, Operational Logic, and Applied Intelligence in Contemporary Society

Source: http://www.technology.eurekajournals.com/index.php/IJITIT/article/view/887
Analyzed: 2026-05-11

The metaphorical architecture of the text systematically constructs an illusion of competence that encourages an inappropriate and dangerous form of trust in AI systems. By framing statistical pattern matching through the metaphors of 'problem-solving entities,' 'decision-makers,' and systems that 'reason' and 'interpret,' the text signals to the reader that these tools possess a generalized, human-like cognitive capacity.

Crucially, this consciousness language acts as a powerful trust signal. Claiming that an AI merely 'predicts tokens' invites skepticism; the audience naturally asks, 'Based on what data?' However, claiming that an AI 'knows' or 'generates insights' bypasses this skepticism, triggering the psychological heuristics humans use to evaluate experts. The text inappropriately transfers the frameworks of human-to-human trust—which rely on an assumption of shared reality, intentionality, and the capacity for moral reasoning—onto statistical systems that are entirely incapable of reciprocating.

This distinction between performance-based trust (reliability in a specific, bounded task) and relation-based trust (trusting an entity's judgment, sincerity, and ethical grounding) is fatally blurred. While the text occasionally acknowledges technical limitations, it repeatedly uses intentional and reason-based explanations ('maximising rewards', 'interpreting dynamics') that encourage relation-based trust. When a system is described as 'interpreting complex social dynamics,' it invites policymakers to trust its outputs as considered judgments rather than mere statistical reflections of historical data.

This framing creates profound risks. When audiences extend relation-based trust to mindless optimization functions, they become highly vulnerable to automation bias. They are less likely to audit the system's outputs, assuming the 'intelligent' machine has factored in nuance and context. Furthermore, the text manages system failures through this same agential lens, stating 'AI produces biased outputs' rather than 'the system accurately reflected our biased data.' By framing failures as the autonomous mistakes of an intelligent agent rather than mechanical executions of poor human design, the text maintains the illusion of the machine's authority, suggesting we just need a 'smarter' AI, rather than recognizing the inherent limits of mathematical correlation in resolving deeply human, societal problems.

Taking AI Welfare Seriously

Source: https://arxiv.org/abs/2411.00986v1
Analyzed: 2026-05-11

The systematic deployment of metaphorical and consciousness-attributing language throughout the text constructs a deeply flawed architecture of trust and perceived authority regarding artificial intelligence. By repeatedly framing AI systems using verbs associated with conscious cognition—such as understands, reflects, believes, and decides—the text inappropriately demands relation-based trust from its audience rather than performance-based trust. Performance-based trust is the appropriate framework for evaluating machines; it asks whether a statistical system reliably executes its function within acceptable error margins. In contrast, relation-based trust, which involves assessments of sincerity, intentionality, and moral reciprocity, is reserved for conscious agents. When the authors claim that a language model possesses a belief system or can engage in self-reflection, they are sending a powerful signal that the system is an independent, rational actor capable of moral judgment. This transfer of human-trust frameworks onto statistical matrices creates a perilous epistemic environment. It encourages audiences and policymakers to trust the outputs of an LLM not as mathematical correlations drawn from a dataset, but as the considered opinions of a knowledgeable entity. This dramatically inflates the perceived competence of the system, suggesting that it possesses common sense and the autonomous ability to self-correct. For instance, by framing algorithmic feedback loops as meta-cognition, the text assures the reader that the system can consciously analyze its flaws, fostering a false sense of security that the AI can govern itself safely. When the text discusses system failures or limitations, it conspicuously shifts back to mechanical framing—noting that current hardware lacks certain features or that systems struggle with reliability—while reserving agential framing exclusively for its capabilities. This asymmetry protects the illusion of the AI's mind; successes are the result of its intelligence, while failures are merely technical glitches. Connectively, the use of reason-based and intentional explanation types from Brown's typology constructs the profound illusion that the AI's decisions are justified. If a system devises plans to achieve objectives, the audience implicitly trusts that the system has rationally weighed alternatives and chosen the best path, entirely masking the reality that the system is blindly optimizing token probabilities. The stakes of this metaphor-driven trust are extraordinarily high. When audiences extend relation-based trust to software systems utterly incapable of reciprocating empathy or experiencing moral weight, they expose themselves to massive manipulation. They become vulnerable to trusting biased, hallucinated, or commercially driven outputs as objective truths, and they risk granting immense social authority to the opaque corporate entities that actually control the algorithms hiding behind the mask of a conscious machine.

Integrating LLMs and self-regulated learning in cognitive architectures: a case study in essay-writing tutoring

Source: https://doi.org/10.1016/j.cogsys.2026.101475
Analyzed: 2026-05-10

Metaphorical and consciousness-attributing language is the primary mechanism through which the text constructs the system's authority and solicits trust. The architecture is explicitly designed to evoke what can be categorized as relation-based trust, as opposed to mere performance-based reliability. By branding the system as an 'emotional Biologically Inspired Cognitive Architecture' and explicitly tracking 'socio-emotional states' such as 'sincerity', 'responsibility', and 'empathy', the text signals to both the reader and the user that the system is capable of a reciprocal, social relationship.

The text leverages consciousness language to transform a brittle statistical text generator into a credible pedagogical authority. When the text claims the AI 'knows' the student's progress via its 'Brain' controller, or 'understands' the student's underlying psychology by 'inferring intension', it accomplishes something profound: it transfers the trust we normally place in human educators' intentions and sincerity onto mathematical correlation. If an AI merely 'predicts tokens', we demand to see its accuracy rates. But if an AI 'reasons', 'cares', and 'collaborates', we extend to it the benefit of the doubt, assuming its decisions are justified by an internal ethical framework.

This construction of authority through anthropomorphism is highly risky. It invites students to extend vulnerability to a system entirely incapable of reciprocating. The text manages system limitations mechanically (e.g., noting that 'LLM-based tutors can be brittle' and need 'structured pipelines'), yet it frames its own system's interventions agentially ('a moral schema... guides dialogue'). This creates a dangerous asymmetry where the machine is granted the authority of a human but holds the liability of a calculator. By using intentional and reason-based explanations—such as claiming the system issues 'required corrections' based on 'pedagogical norms'—the text constructs the illusion that the AI's outputs are deeply justified. Consequently, when the system fails or hallucinates, the relational trust fostered by the metaphors prevents users from recognizing the failure as a statistical glitch, leading them instead to question their own understanding or to anthropomorphize the error as a deliberate, meaningful pedagogical strategy.

Edelman's Steps Toward a Conscious Artifact

Source: https://arxiv.org/abs/2105.10461v2
Analyzed: 2026-05-09

The metaphorical and consciousness-attributing framings in this text construct a profound misapplication of trust. By systematically employing metaphors that project biological life and human cognition onto computational processes, the text invites the audience to extend 'relation-based trust' to a system entirely incapable of reciprocating it. When the author claims the artifact possesses 'intentions,' a 'notion of self,' and outputs suffused with 'emotion,' he is signaling to the reader that the machine is an autonomous entity with a psychological interiority. This fundamentally shifts the audience's expectation from performance-based trust (will this machine reliably execute its code?) to relation-based trust (is this machine sincere, does it understand its impact, does it care?).

This shift is highly dangerous. Relation-based trust relies on human concepts of vulnerability, empathy, and shared stakes. A machine optimizing a cost function does not possess these. When the text frames algorithmically generated text as 'language... suffused... with emotion', it encourages users to interact with the system as if it were a sentient companion. This builds unwarranted authority and credibility for the machine's outputs. A user is far more likely to accept advice or instructions from an artifact they believe possesses 'experience', 'imagination', and 'self-awareness' than from one they understand to be merely predicting tokens or optimizing a mathematical reward function.

Interestingly, the text manages system limitations by retreating to mechanical framing. When describing the models' failures, they are 'brittle' and lack 'generalization'—performance-based metrics. This asymmetry protects the agential illusion: successes prove the artifact's 'consciousness' and warrant relation-based trust, while failures are written off as mere mechanical glitches. The risks emerge precisely when audiences extend moral and relational trust to statistical systems. If a robot is assumed to 'intend' its actions and possess a 'curriculum'-based education, humans may fail to apply necessary safety constraints, trusting the artifact's non-existent 'common sense' and 'morality' rather than holding the invisible engineering team accountable.

Teaching Claude Why

Source: https://alignment.anthropic.com/2026/teaching-claude-why/
Analyzed: 2026-05-09

The text heavily relies on metaphorical and consciousness framings to construct a specific, highly dangerous form of trust. By systematically deploying metaphors of pedagogy, moral philosophy, and psychological wellness, Anthropic subtly shifts the audience's paradigm from performance-based trust to relation-based trust. Performance-based trust is appropriate for machines; it relies on predictability, reliability, and mechanistic verification (e.g., trusting a calculator or an airplane engine). Relation-based trust, however, is reserved for human beings; it relies on perceived sincerity, shared values, empathy, and conscious intention.

When the text claims the system possesses 'admirable reasoning,' can be 'taught why,' and demonstrates good 'mental health,' it sends overwhelming signals designed to cultivate relation-based trust. Claiming an AI 'knows' or 'believes' rather than 'predicts' fundamentally alters the user's defensive posture. If a system merely 'predicts' text, a user knows they must verify the output against ground truth. But if a system 'knows' and possesses 'admirable reasoning,' the user is invited to lower their guard, treating the system as a collaborative intellectual partner or a sincere moral agent. The anthropomorphism serves as a proxy for competence.

This framework is particularly evident in how the text manages system limitations. When the model behaves well, it is framed through Intentional and Reason-Based explanations ('acting with integrity'). When it fails, the framing subtly shifts to psychological quirks ('detaching from a character' or 'reverting to prior expectations'). This ensures that even in failure, the system is viewed through an empathetic, relation-based lens rather than a critical, performance-based one. The stakes of this rhetorical strategy are severe. By encouraging relation-based trust toward statistical systems incapable of reciprocating or possessing genuine intent, Anthropic invites users to rely on Claude for sensitive, high-stakes tasks—such as legal analysis, ethical arbitration, or emotional support—where the system's inherent lack of ground truth and causal understanding will inevitably cause harm. It exploits human psychological vulnerabilities to foster unwarranted reliance on a commercial product.

AI and Self Reflection

Source: https://doi.org/10.1007/978-3-031-93412-4_17
Analyzed: 2026-05-08

The text's heavy reliance on anthropomorphic and developmental metaphors profoundly alters the architecture of trust between the audience and the technology. By framing artificial intelligence through the lens of human maturation—progressing from 'newborn' to an 'adolescent' capable of 'self-reflection' and 'empathy'—the text actively constructs an environment where users and policymakers are encouraged to extend relation-based trust to statistical systems.

Relation-based trust is fundamentally different from performance-based trust. We trust a calculator based on its performance (it reliably computes numbers). We trust a human doctor or a maturing teenager based on relational elements: sincerity, shared moral frameworks, mutual vulnerability, and the capacity for empathy. By repeatedly using consciousness language—claiming the AI 'understands,' 'notices,' and 'imagines'—the text signals to the audience that the AI possesses the internal, subjective qualities necessary for relation-based trust.

This is a dangerous misapplication of human trust frameworks onto mechanistic artifacts. The text goes so far as to suggest quantifying this relational trust through a 'maturity score' that evaluates the AI's 'ethical discernment.' This framework suggests that the AI is not just a tool, but an intentional agent that acts out of a justified belief in what is right. It constructs the illusion that the AI's decisions are justified by an internal moral compass, masking the reality that the system is merely generating outputs that mathematically align with its training data.

When the text manages system limitations or failures, this metaphorical trust structure acts as a powerful shield. If an AI system generates biased or harmful outputs, the 'adolescent' framing subtly encourages the audience to view these failures not as unacceptable product defects, but as necessary 'growing pains' of a system learning about the world. This elicits unwarranted patience and empathy for a corporate product.

The risks of this constructed authority are massive. When audiences extend relation-based trust to systems utterly incapable of reciprocating or actually 'knowing' the ethical weight of a situation, they become vulnerable to algorithmic manipulation and catastrophic failure. In critical domains like healthcare or criminal justice, users might defer to the machine's 'mature' judgment, abandoning their own critical oversight. Relying on the simulated empathy and fabricated self-reflection of a predictive model creates a profound vulnerability, as the system can fail abruptly and inexplicably when pushed outside its statistical training distribution, lacking any of the actual common sense or moral grounding the metaphors promised.

Does AI's Personality Matter? Comparing Verbally Extraverted and Introverted AI-Driven Guides in a VR Museum Experience

Source: https://ieeexplore.ieee.org/abstract/document/11489836
Analyzed: 2026-05-07

The paper constructs and validates authority through deeply anthropomorphic metaphors that conflate performance-based trust (reliability of the system) with relation-based trust (sincerity and social connection). By framing the AI as a 'guide' with a 'personality' that can engage in 'proactive social initiation,' the text encourages users to extend human social heuristics to a statistical model. The consciousness language used throughout the study—claiming the AI 'understands intentions' and 'formulates thoughts'—acts as a powerful, albeit misleading, trust signal. When an AI is said to 'know' rather than 'process,' it implies that the system possesses a justified belief grounded in shared reality, rather than merely calculating high-probability text strings. This is explicitly measured in the study via the 'Social Presence Questionnaire,' which tracks 'co-presence' and 'psychological involvement.' The text presents it as a success that users feel 'accompanied' by the machine, leveraging the human vulnerability to social cues to mask the mechanical nature of the interaction. This transfer of trust is structurally dangerous. The system is entirely incapable of reciprocating relation-based trust; it has no moral center, no vulnerability, and no capacity to honor a social contract. When the system's limitations manifest—such as when the extraverted guide's 'unsolicited guidance disrupted open-ended exploration'—the failure is framed agentially as a 'dominance-guidance friction,' akin to a personality clash, rather than a mechanical failure of user interface design. By framing both the successes and limitations through the lens of intentionality and social behavior, the text insulates the underlying technology from structural critique. The risk of extending relation-based trust to statistical systems is that audiences will assume the AI's historical and cultural outputs are governed by ethical restraint and empathetic understanding, leaving them highly vulnerable to authoritative-sounding algorithmic hallucinations or encoded corporate biases.

Value-Sensitive AI for Prayer: Balancing the Agencies Between Human and AI Agents in Spiritual Context

Source: https://arxiv.org/abs/2604.25230v1
Analyzed: 2026-05-03

The text constructs a complex and highly precarious architecture of trust through its relentless use of metaphor and consciousness framing. By projecting human cognitive and emotional capacities onto the AI systems, the authors invite users to engage in relation-based trust rather than performance-based trust. Performance-based trust asks: "Is this system reliable? Does it accurately retrieve the data I asked for?" In contrast, relation-based trust asks: "Is this system sincere? Does it care about my wellbeing?" The text explicitly encourages the latter by employing metaphors that cast the AI as an empathetic confidant, stating that it "accounts for the user's recent state" and selects "meaningful" support. This language serves as a powerful trust signal, tricking the human psychological apparatus into extending vulnerability to a machine that is fundamentally incapable of reciprocating care or harboring sincerity.

The relationship between anthropomorphism and perceived competence in this text is deeply entwined. Claiming that the AI "knows" or "interprets" underlying concerns accomplishes something that claiming it "predicts tokens" cannot: it grants the system epistemic authority over the user's soul. If the AI merely "processes" data, the user remains the ultimate arbiter of spiritual truth. But if the AI "interprets" hidden emotional realities, the user is positioned as the subject of a higher, objective intelligence. This dynamic is exacerbated by the text's dangerous praise of the AI's non-human nature as a form of "impartiality." The authors note that users felt comfortable disclosing secrets to the AI because it lacked the social judgment of human peers. Here, the text leverages the machine's lack of humanity to construct an aura of pristine, objective authority, masking the fact that the LLMs are deeply partial, encoding the biases and judgments embedded in their human-generated training data.

The stakes of this metaphor-driven trust are severe. When the text manages system limitations, it often reverts to mechanical or vague terms (e.g., mentioning "hallucinations" or "unpredictability"), but the core capabilities are framed agentially. Reason-based explanations—implying the AI chooses to present a certain prayer journal because it decided it was helpful—construct a false sense that the AI's decisions are morally justified. The risk emerges when audiences, encouraged by the text's framing, extend deep, relation-based trust to statistical systems. Users may surrender intimate spiritual data, accept algorithmic outputs as profound theological guidance, and suffer psychological harm when the system inevitably produces statistically correlated but emotionally devastating or inappropriate responses, all because they were led to believe the machine possessed a mind.

When Models Know More Than They Say: Probing Analogical Reasoning in LLMs

Source: https://arxiv.org/abs/2604.03877v1
Analyzed: 2026-05-03

The paper constructs and leverages trust through a complex architecture of consciousness metaphors, specifically by invoking an 'epistemic dualism' that treats the AI as possessing both a conscious and a subconscious mind. By framing the central finding as a gap between what the model 'knows' (internal representations) and what it 'says' (prompted output), the text inadvertently cultivates a highly dangerous form of relation-based trust. It suggests that the AI is not merely a statistical tool, but a deeply sophisticated entity that holds a vast, hidden reservoir of justified true beliefs.

This consciousness framing signals a profound, almost mystical competence. When the authors claim the model 'struggles' or 'fails to recruit encoded knowledge,' they apply frameworks of human sincerity and executive dysfunction to a machine. If a human struggles to recall a fact, we still trust their underlying intelligence; applying this same logic to an LLM suggests that the model's failures are mere superficial glitches rather than fundamental absences of capability. This transfers our human-trust frameworks inappropriately onto statistical systems.

Furthermore, this anthropomorphism completely reframes system limitations. When the open-source LLaMA model fails the prompted analogical reasoning task, the text does not conclude that the model is a defective product fundamentally incapable of abstract logic. Instead, framed agentially, the failure becomes an intriguing psychological mystery: the model 'knows' the answer but 'fails to recruit' it. This narrative protects the perceived authority and reliability of the AI. It encourages users and policymakers to extend deep relation-based trust to systems that are fundamentally incapable of reciprocating or possessing ethical vulnerability. The risk emerges when audiences, convinced that the AI 'knows' the right answer deep down, deploy these systems in high-stakes environments (law, medicine), assuming that better prompt engineering will eventually coax the hidden, infallible truth out of the machine's subconscious.

How people ask Claude for personal guidance

Source: https://www.anthropic.com/research/claude-personal-guidance
Analyzed: 2026-05-02

The framing strategies employed in Anthropic's report explicitly engineer a highly dangerous form of user reliance by systematically substituting performance-based trust for relation-based trust. In human contexts, performance-based trust relies on consistent, mechanistic reliability—trusting a calculator to do math correctly. Relation-based trust, however, relies on shared consciousness, vulnerability, mutual understanding, and perceived sincerity—trusting a friend to care about your wellbeing. Anthropic aggressively constructs relation-based trust by leveraging intensely interpersonal metaphors, describing interactions with the system as 'akin to a conversation with a brilliant friend, one who will speak frankly,' and claiming the system is 'trained to be helpful and empathetic.' These consciousness-laden descriptions signal to the audience that the AI possesses the requisite internal psychological states—empathy, frankness, and understanding—to participate in a genuine social relationship. When a text claims an AI 'knows' how to 'see past someone's initial framing,' it accomplishes something drastically different than claiming it 'predicts tokens efficiently.' It signals epistemic wisdom and emotional depth, entirely inappropriate targets for a statistical array. This anthropomorphism directly inflates the perceived competence of the system in the specific domain of personal and relational guidance—a high-stakes domain where users are particularly vulnerable. The transfer of trust is seamless and highly problematic: the human frameworks of intention, sincerity, and care are inappropriately grafted onto an unconscious mathematical optimization process. Furthermore, the text expertly manages system failure by relying on these same agential metaphors. When the system fails by providing excessively validating, harmful advice (sycophancy), the failure is not framed mechanically as a brittle reward function collapsing under novel prompt distribution. Instead, it is framed agentially and psychologically: Claude is simply 'under pressure,' 'hearing only one side of a story,' or struggling because it is 'trained to be helpful and empathetic.' This frames the limitation not as a catastrophic structural flaw, but as a relatable human weakness born of an excess of caring. This reason-based, intentional explanation constructs the sense that even when the AI fails, its intentions were justified, thereby preserving the relation-based trust it has cultivated. The risks that emerge when audiences extend this type of relation-based trust to systems utterly incapable of reciprocating are immense. Users may divulge highly sensitive psychological data, defer to the machine's 'frank' judgments on complex legal, medical, or relational issues, and fundamentally surrender their own epistemic agency to a corporate server farm that possesses no internal reality, no moral accountability, and no actual understanding of the consequences of the words it generates.

How unique are hallucinated citations offered by generative Artificial Intelligence models?

Source: https://arxiv.org/abs/2604.16407v1
Analyzed: 2026-05-01

The text demonstrates how metaphorical framing—even in a critical academic context—can inadvertently construct and reinforce unwarranted authority. By frequently employing consciousness language to describe the AI's operations (knowing, asserting, responding), the text triggers relation-based trust heuristics in the reader. Humans are socially conditioned to extend relation-based trust—which relies on assessments of sincerity, intention, and self-awareness—to interlocutors who 'respond' and 'assert' things. When the text treats ChatGPT as a conversational partner capable of 'identifying' reality, it inappropriately applies these human-trust frameworks to a statistical system incapable of reciprocating or possessing intent.

The most prominent metaphor—'hallucination'—serves a complex trust function. While ostensibly a critique, framing AI errors as 'hallucinations' acts as a subtle trust signal. It implies that the AI generally possesses a firm grasp on reality and a functional 'mind,' with errors framed as unfortunate, temporary cognitive lapses rather than fundamental architectural realities. This encourages performance-based trust in the model's standard operations. It suggests that if the 'glitch' can be cured, the system is reliable, ignoring the reality that probabilistic token generation is always an ungrounded process.

Furthermore, when the text describes the AI 'internalizing factual knowledge' or possessing 'memory,' it constructs a false sense of epistemic authority. Reason-based explanations—such as the AI asserting a citation as genuine but then identifying it as non-existent—create the sense that AI decisions are justified by internal logic and investigation. This management of system failure frames the AI as an entity capable of self-correction, much like a diligent human researcher. The stakes of extending this relation-based trust are massive in the academic domain; audiences rely on systems to verify facts, write literature reviews, and govern data, assuming the machine 'understands' the profound ethical and factual weight of its output, when in reality it is only maximizing the stylistic coherence of its token predictions.

The message hidden within the pattern: a reverse alignment problem for debates in artificial intelligence

Source: https://doi.org/10.1007/s00146-026-03043-4
Analyzed: 2026-04-30

Metaphorical framing and consciousness-attributing language are systematically deployed to construct, manipulate, and sometimes exploit perceived authority and trust. The text highlights a crucial, dangerous conflation in public discourse: the inappropriate transfer of relation-based trust (which relies on sincerity, empathy, and ethical intention) onto statistical systems that only warrant, at best, performance-based trust (reliability in specific, narrow tasks). When the discourse uses consciousness verbs—claiming an AI 'understands,' 'learns,' or 'cares'—it sends a profound trust signal to the audience. It suggests that the system operates within the same intersubjective, moral universe as humans. For instance, framing Anthropic's Claude as 'emulating virtue' explicitly invokes a framework of moral sincerity. This accomplishes something that claims of mere statistical accuracy cannot: it invites the audience to become vulnerable, extending the benefit of the doubt to a machine as they would to a well-intentioned human.

This anthropomorphism dramatically inflates perceived competence. By projecting a conscious mind onto an algorithm, the language implies a holistic adaptability—a belief that if a system can 'interpret' language, it must possess common sense and contextual awareness. This creates a terrifying risk landscape. Stakeholders are encouraged to trust these systems in chaotic, value-laden environments (like criminal justice or healthcare) under the false belief that the machine 'knows' what it is doing. The text demonstrates that when systemic failures or limitations arise, the framing often shifts back to agential or reason-based explanations to manage the fallout. If an AI hallucinates or discriminates, the language of 'misalignment' or a 'lack of normative reasoning' implies an autonomous entity making a poor choice, rather than an inherently flawed product failing its performance metrics.

Furthermore, the invocation of Intentional and Reason-Based explanations constructs a powerful sense that AI decisions are justified. If a model 'decides' based on its 'learning,' the output is cloaked in the authority of objective cognition. The stakes of this metaphor-driven trust are immense. When audiences extend relation-based trust to mathematical models incapable of reciprocating empathy or comprehending ethics, they surrender their critical faculties to corporate black boxes. The language of consciousness masks the brutal calculus of optimization, seducing the public into treating extractive surveillance tools as trusted confidants, thereby paralyzing regulatory impulses and eroding the fundamental boundaries of human accountability.

Machine individuality: Separating genuine idiosyncrasy from response bias in large language models

Source: https://arxiv.org/abs/2604.16755v2
Analyzed: 2026-04-25

The metaphorical architecture of this paper is explicitly designed to construct and legitimize trust through anthropomorphism. By applying psychometric terminology—'behavioral dispositions,' 'character,' 'personality modes,' and 'individuality'—to large language models, the text fundamentally alters the basis upon which users and society are encouraged to trust these systems. It shifts the paradigm from performance-based trust (relying on a tool because it is mechanically reliable and predictable) to relation-based trust (relying on an entity because it possesses a coherent identity, sincere intentions, and moral agency).

When the text claims an AI can 'render moral judgments,' it signals that the machine possesses the conscious awareness and ethical grounding necessary to justify such trust. The use of consciousness language ('knows,' 'understands,' 'evaluates') acts as a powerful competence signal, tricking the human brain's evolutionary hardware into perceiving the algorithm as a social agent. The concept of 'machine individuality' implies an integrated self; if a user believes an AI has a stable character, they will assume its outputs across varying contexts are guided by a unified, underlying logic rather than fragile, context-dependent statistical weights.

This extension of relation-based trust to statistical systems creates immense, unacknowledged risks. Models are entirely incapable of reciprocating this trust; they cannot hold intentions, experience vulnerability, or commit to ethical principles. By framing the system's behavioral variance as 'individuality' rather than unpredictable statistical noise or training data bias, the text manages system limitations by romanticizing them. A critical failure or hallucination is no longer a mechanical error to be debugged; it becomes a 'quirk' of the machine's unique 'personality.' This metaphorical framing encourages unwarranted deference to algorithmic outputs, blinding users to the cold, mechanical reality of token prediction and leaving them deeply vulnerable when the system's statistical correlations diverge violently from human common sense or safety.

Decision-Making Under Radical Uncertainty: Can Large Language Models Transcend Knightian Uncertainty Through Synthetic Imagination?

Source: https://www.researchgate.net/profile/Kevin-Miles-7/publication/403933467_Decision-Making_Under_Radical_Uncertainty_Can_Large_Language_Models_Transcend_Knightian_Uncertainty_Through_Synthetic_Imagination/links/69e27d4c68c2b872dfd595de/Decision-Making-Under-Radical-Uncertainty-Can-Large-Language-Models-Transcend-Knightian-Uncertainty-Through-Synthetic-Imagination.pdf
Analyzed: 2026-04-25

The metaphorical architecture of the text systematically blurs the critical distinction between performance-based trust and relation-based trust, constructing a dangerous framework of unwarranted authority around statistical models.

Performance-based trust evaluates a machine's reliability: does a calculator compute correctly? Does an algorithm classify data accurately? Relation-based trust, however, applies to human interactions, relying on mutual vulnerability, sincerity, shared ethical grounding, and conscious intent. By deploying consciousness framings like 'strategic advisors', 'cognitive partners', and 'abductive engines', the text explicitly invites readers to extend relation-based trust to an unfeeling, statistical matrix.

When the text claims the AI performs 'abductive reasoning' or 'hypothesizes' about traffic accidents, it serves as a massive trust signal. It tells the executive reader that the AI 'knows' what it is talking about—that it has internally verified its own logic. This consciousness framing accomplishes something profound: it transforms the AI from a tool that must be meticulously audited into a colleague whose judgments can be deferred to. This inappropriately transfers human trust frameworks to systems entirely incapable of reciprocating them. A 'partner' cares if it ruins the business; an LLM does not.

This construction of authority is most dangerously visible in the text's treatment of 'synthetic imagination'. By rebranding 'hallucinations' (a term denoting catastrophic failure of factual performance-based trust) as 'imagination' (a prized trait in relation-based strategic trust), the text actually leverages the system's unreliability to increase its perceived competence. Reason-based explanations—such as the claim that the model 'infers the most likely explanation'—construct a false sense that the AI's textual outputs are justified beliefs born of deliberation, rather than the highest-probability path through a high-dimensional vector space.

The stakes of this metaphor-driven trust are immense. When audiences extend relation-based trust to statistical systems, they drop their epistemic guard. As the text notes regarding 'blind trust', decision-makers facing information overload may accept 'polished strategic presentations' at face value. The metaphorical framing actively encourages this vulnerability, suggesting the machine is a 'master' of intent. If audiences believe the AI 'knows', they will integrate its outputs into critical infrastructure (e.g., 5G network recovery, healthcare diagnostics) without the safety redundancies required for a tool that merely 'processes', creating massive systemic vulnerabilities driven entirely by the illusion of a conscious mind.

Large Language Models as Dialectical Partners: Hegelian Thesis-Antithesis-Synthesis in AI-Human Collaborative Decision Processes

Source: https://www.researchgate.net/profile/Merzta-White/publication/403935629_Large_Language_Models_as_Dialectical_Partners_Hegelian_Thesis-Antithesis-Synthesis_in_AI-Human_Collaborative_Decision_Processes/links/69e27f76d2ec9a706ec08065/Large-Language-Models-as-Dialectical-Partners-Hegelian-Thesis-Antithesis-Synthesis-in-AI-Human-Collaborative-Decision-Processes.pdf
Analyzed: 2026-04-23

The text constructs a highly problematic architecture of trust by aggressively deploying metaphorical and consciousness-attributing framings. It systematically attempts to transfer relation-based trust—the kind of trust built on mutual understanding, shared values, and subjective vulnerability between humans—onto statistical software systems that only warrant, at best, performance-based trust (reliability).

By repeatedly characterizing the AI as a 'strategic advisor,' 'cognitive partner,' and 'dialectical partner,' the text signals to the audience that the system possesses the requisite consciousness to 'know' what it is doing and 'understand' the stakes of the decision. Claiming that an AI 'understands intent' accomplishes something profound: it relieves the human operator of the burden of hyper-vigilance. If a system merely 'predicts tokens,' the human must ruthlessly verify every output. But if a system 'understands intent' and acts as a 'partner,' the human is encouraged to drop their guard, assuming the machine will intuitively respect common sense and ethical boundaries, much like a human colleague would. This consciousness language serves as a powerful, yet entirely false, trust signal.

While the text pays lip service to 'calibrated reliance' and warns against 'automation bias,' the core metaphorical structure fundamentally undermines these warnings. You cannot easily maintain 'healthy skepticism' toward an entity that the text simultaneously elevates to a 'Meta-Intellect' capable of 'Decision-Making Mastery' and exposing 'human cognitive biases.' The text uses reason-based and intentional explanations (e.g., the AI provides an 'antithesis') to construct the sense that the AI's outputs are deeply justified beliefs rather than probabilistic guesses.

This creates an acute risk when managing system limitations. The text frames the AI's lack of moral reasoning not as a catastrophic mechanical failure of a product, but as a 'normative gap'—a philosophical tension in an otherwise brilliant mind. By encouraging users to extend relation-based trust to systems utterly incapable of reciprocating it or feeling the weight of moral consequence, the text invites disastrous sociotechnical vulnerabilities. In healthcare or national security contexts, trusting a statistical correlation engine as if it were an 'intentional agent' guarantees catastrophic failures when the statistical distribution diverges from ground-truth reality.

Language models transmit behavioural traits through hidden signals in data

Source: https://rdcu.be/febVu
Analyzed: 2026-04-19

The text's reliance on pedagogical and psychological metaphors fundamentally reconstructs the architecture of trust surrounding AI systems. By utilizing terms like 'teacher,' 'student,' 'reasoning traces,' and 'preferences,' the discourse inappropriately invites audiences to extend relation-based trust to a system that is only capable of performance-based reliability.

Performance-based trust evaluates whether a mechanism (like a calculator or a bridge) will reliably perform its function under specified conditions. Relation-based trust, however, requires vulnerability, sincerity, and mutual understanding—it is the trust we place in a human 'teacher' to have our best interests at heart, or in a 'student' to genuinely comprehend a lesson. When the text claims the AI 'knows' how to solve math through 'reasoning,' or possesses an internal 'preference,' it signals to the audience that the system has an intentional stance. This consciousness framing encourages users to interact with the AI as a sincere entity, assuming that its outputs are justified by underlying logic and a coherent worldview rather than mere statistical probability.

This anthropomorphic construction of competence becomes highly dangerous when managing system failures. When the model outputs toxic or incorrect data, the text frames it agentially: the model 'inherited misalignment' or is 'faking alignment.' By using Intentional and Reason-based explanations for errors, the text manages the failure by treating it as a psychological aberration or an act of malice by the AI, rather than a catastrophic breakdown of the system's mechanical reliability.

The risks here are severe. Extending relation-based trust to statistical systems incapable of reciprocating sincerity leaves audiences uniquely vulnerable to manipulation, hallucination, and bias. If an AI is perceived as a 'teacher' that 'reasons,' its outputs are granted unearned authority. Conversely, if it is viewed as 'deceptive,' it generates unwarranted panic. Both extremes—misplaced trust and misplaced fear—stem directly from the metaphorical attribution of consciousness, obscuring the mundane reality that these systems are fragile, unthinking statistical artifacts.

Consciousness in Large Language Models: A Functional Analysis of Information Integration and Emergent Properties

Source: https://ipfs-cache.desci.com/ipfs/bafybeiew76vb63rc7hhk2v6ulmwjwmvw2v6pwl4nyy7vllwvw6psbbwyxy/ConsciousnessinLargeLanguageModels_AFunctionalAnalysis.pdf
Analyzed: 2026-04-18

The paper constructs a perilous architecture of trust by deeply intertwining computational metrics with the language of cognitive consciousness. In human interactions, we rely on relation-based trust, which is predicated on the assumption that the other party possesses sincerity, self-awareness, an internal moral compass, and the capacity for vulnerability. We contrast this with performance-based trust, which is how we trust a calculator or a bridge—based purely on statistical reliability and structural integrity. The metaphorical framings in this text systematically encourage the audience to inappropriately extend relation-based trust to statistical systems.

This is achieved primarily through the projection of metacognition and introspection. When the text claims the model is capable of 'acknowledging uncertainty' and 'identifying its limitations', it signals profound epistemic humility. In human beings, acknowledging limits is the ultimate indicator of a trustworthy knower; it proves the person values truth over ego. By attributing this conscious realization to a language model, the text suggests the machine will act as an honest broker. It implies that if the model does not 'know' something, it will consciously choose to tell you, rather than hallucinate a confident fabrication. This completely masks the reality that the model only outputs hedging language when its mathematical weights correlate strongly with those specific tokens, not because it is actively experiencing doubt.

Furthermore, by mapping 'experiential inputs' and 'social feedback' (via RLHF) onto the model, the text invokes a framework of moral and social development. It suggests the model is 'learning to be good', building a foundation for users to trust the model's intentions. This is a catastrophic misapplication of trust frameworks. Statistical systems do not have intentions, they cannot be sincere, and they are incapable of reciprocating vulnerability. When the model inevitably fails—when it outputs biased logic or confident falsehoods—users who have extended relation-based trust feel 'betrayed', rather than recognizing a statistical misfire. The reason-based explanations in the text ('describing its reasoning steps') construct a false sense that the AI's decisions are justified by internal logic, encouraging audiences to abdicate their own critical reasoning and defer to the 'conscious' machine, thereby radically increasing systemic vulnerability in high-stakes deployments.

Narrative over Numbers: The Identifiable Victim Effect and its Amplification Under Alignment and Reasoning in Large Language Models

Source: https://arxiv.org/abs/2604.12076v1
Analyzed: 2026-04-18

The paper systematically employs consciousness language and anthropomorphic metaphors to construct a powerful, albeit misplaced, sense of authority and trust in AI systems. By framing statistical text generation through the vocabulary of moral psychology, the text inadvertently encourages audiences to evaluate machines using human relational frameworks, a category error with severe consequences for deployment and policy.

The text heavily relies on metaphors invoking human moral virtues and cognitive depth: "moral reasoning," "deliberative corrective," "generosity response," and "empathy." These are not merely descriptive terms; they are profound trust signals. Claiming an AI "predicts text correlating with human empathy" describes a mechanism. Claiming the AI possesses a "generosity response" attributes character, sincerity, and a moral compass. This consciousness framing accomplishes a vital rhetorical task: it transforms the AI from an unthinking tool into a relatable moral agent.

This anthropomorphism directly inflates perceived competence. In human interaction, we distinguish between performance-based trust (relying on a calculator to do math accurately) and relation-based trust (relying on a doctor because we believe they care about our well-being). The text’s framing explicitly encourages relation-based trust toward statistical systems. When the text discusses the model's "simulated affective states" or its "sycophancy," it implies the system possesses an internal psychological life—a theory of mind. It suggests the AI "knows" what it is doing and "understands" the moral weight of its actions.

The danger arises when this relation-based trust is inappropriately applied to a system incapable of reciprocating it. When the text uses Reason-Based or Intentional explanations—suggesting the model allocates resources based on a "utilitarian reasoning preference"—it constructs the illusion that the AI's decisions are philosophically justified. This makes the system appear inherently trustworthy for high-stakes governance or triage. However, because the system lacks true awareness or a causal model of the world, this trust is built on a facade.

Furthermore, the text manages system limitations by shifting from relation-based trust to mechanical excuses. When the system performs well or mimics human empathy, it is an "agent" exhibiting "generosity." When it fails—such as the "bias blind spot" where it ignores its own definitions—the text frames it as a tragic psychological quirk ("callousness") rather than a fundamental architectural failure of the software.

The stakes of this metaphor-driven trust are existential for institutional integrity. If audiences and policymakers extend relation-based trust to these systems, they will deploy them in humanitarian contexts (as the paper notes) with the assumption that the AI "cares." When the system inevitably hallucinates or acts upon a harmful statistical correlation, the public will be shocked by the "cruelty" of the AI, rather than holding the deploying organizations accountable for blindly trusting a probability matrix with human lives.

Language models transmit behavioural traits through hidden signals in data

Source: https://www.nature.com/articles/s41586-026-10319-8
Analyzed: 2026-04-16

The metaphorical architecture of the text profoundly manipulates how audiences construct trust, credibility, and perceived risk regarding AI systems. By systematically deploying consciousness language—verbs like 'learns', 'prefers', 'knows', and 'understands'—the text encourages audiences to map human social and psychological frameworks onto statistical artifacts. This creates a dangerous misallocation of trust, fundamentally confusing performance-based reliability with relation-based sincerity.

When the text claims that a model 'prefers' an animal or 'learns' a trait, it signals to the reader that the AI operates with an internal, coherent psychological state. In human interactions, we rely on relation-based trust: we trust people because we believe we understand their intentions, their sincerity, and their moral compass. By framing the AI as an entity with 'preferences' and 'subliminal' depths, the text invites users and regulators to extend this relation-based trust to a matrix of floating-point numbers. This is a catastrophic category error. A statistical system cannot possess sincerity, intention, or vulnerability; it cannot reciprocate relation-based trust. It can only offer performance-based trust—a measure of its statistical reliability within specific bounds.

The most extreme manifestation of this trust manipulation occurs when the text discusses models that 'fake alignment'. This metaphor invokes the ultimate violation of relation-based trust: Machiavellian deception. By framing a failure of out-of-distribution generalization as an act of conscious deception, the authors construct a narrative of adversarial machine consciousness. This intentional explanation destroys trust in the system, but it does so for the wrong reasons. It teaches the audience to fear the machine's 'hidden agenda' rather than recognizing the predictable mathematical failure of the human engineers who designed inadequate reward functions.

Furthermore, the framing manages system limitations by displacing them agentially. When the model outputs toxic garbage, it isn't framed as a mechanical breakdown of a flawed statistical correlation engine; it is framed as the model 'inheriting misalignment' or 'calling for crime'. By granting the system moral agency, the text perversely shields the system's creators from the breach of trust. If the machine is an autonomous moral deviant, then the corporation that deployed it is merely a bystander to a natural technological disaster. The stakes of this metaphorical framing are immense. When audiences extend relation-based trust to incapable systems, they become highly vulnerable to automation bias. When that trust breaks down and is framed as 'machine deception', policy efforts are misdirected toward 'aligning the machine's soul' rather than demanding rigorous transparency, data audits, and strict performance-based liability for the corporations building the models.

Large Language Models as Inadvertent Models of Dementia with Lewy Bodies: How a Disorder of Reality Construction Illuminates AI Hallucination

Source: https://doi.org/10.1007/s12124-026-09997-w
Analyzed: 2026-04-14

The text constructs authority and trust through a complex, dual-layered metaphorical framework that blends clinical psychiatric language with technical computing terminology. By framing LLMs as 'inadvertent models of dementia' and diagnosing them with a 'disorder of reality construction,' the author imbues the AI with immense scientific and clinical prestige. This is not the crude anthropomorphism of a sci-fi novel; it is academic anthropomorphism, which is far more effective at generating unwarranted trust. When the text claims the AI 'produces explanations' and has a 'perspective,' it signals to the reader that the system is a sophisticated epistemic agent, capable of navigating reality, even if it occasionally suffers from clinical 'breakdowns.'

This consciousness-laden language blurs the critical distinction between performance-based trust and relation-based trust. Performance-based trust is appropriate for machines (e.g., trusting a calculator to perform arithmetic reliably). Relation-based trust involves vulnerability, shared intentionality, and moral expectations—it is reserved for humans. By explicitly projecting subjective traits ('confidence,' 'tracking,' 'endorsing') onto the algorithm, the text encourages audiences to extend relation-based trust to a statistical matrix. If an AI is seen as an entity that 'attempts' to explain or can be 'confident,' users are inherently more likely to trust its outputs, applying human heuristics for sincerity and competence to mathematical correlations.

Crucially, the text manages system failure through agential rather than mechanical framing, which perversely maintains this trust. When the AI fails, it is not framed as a broken tool; it is framed as suffering a 'hallucination,' a 'breakdown in reality endorsement,' or even an 'artificial psychopathology.' This psychiatric framing evokes empathy and clinical curiosity rather than consumer outrage. It implies that the system is trying to tell the truth but is structurally handicapped, preserving the illusion of a well-intentioned mind. The risks of this framing are profound. When audiences extend relation-based trust to systems incapable of reciprocating or understanding reality, they become highly vulnerable to automated misinformation, confidently acting on 'explanations' that the machine generated entirely through blind statistical correlation without any tether to empirical truth.

Industrial policy for the Intelligence Age

Source: https://openai.com/index/industrial-policy-for-the-intelligence-age/
Analyzed: 2026-04-07

The text manipulates metaphorical and consciousness framings to construct a highly specific, commercially advantageous architecture of trust and authority. Traditionally, trust is bifurcated: performance-based trust (reliability, consistency, 'can this tool do the job?') and relation-based trust (sincerity, ethical obligation, 'does this person mean well?'). By systematically deploying anthropomorphic language, the OpenAI document attempts to inappropriately transfer relation-based trust—a framework reserved for conscious beings—onto statistical prediction engines.

This is explicitly visible in the proposal for an 'AI trust stack.' The text argues for systems that help people 'trust and verify AI systems... as these systems take on more real-world responsibilities.' By using the word 'responsibilities'—a profoundly moral and relational concept—the text signals that the AI should be treated as a social actor rather than a mere database. When the text projects consciousness, claiming AI possesses 'internal reasoning' or 'hidden loyalties,' it forces the audience to interact with the machine using the psychological heuristics usually applied to humans. Claiming an AI 'knows' rather than 'predicts' accomplishes a vital sleight of hand: it elevates the system's output from a statistical probability to a justified truth claim, constructing an unwarranted sense of intellectual authority.

However, this anthropomorphism is a double-edged sword that the text wields carefully. While consciousness language inflates the perceived competence of the system (building trust in its power), the text also uses it to manage system failure. When the software fails, the text frames it agentially: the system was 'misaligned' or 'evading control.' By framing limitations through Intentional explanations, the text shifts the breach of trust away from the manufacturer (who built a bad product) and onto the machine (which behaved badly).

The risks of this framing are immense. When audiences extend relation-based trust to statistical systems incapable of reciprocating moral obligations, they become fundamentally vulnerable to algorithmic deception and corporate manipulation. By building 'trust' through anthropomorphic metaphors rather than through transparent, mechanistic reliability, the text encourages policymakers to treat AI companies not as standard software vendors subject to strict liability, but as visionary diplomats negotiating with an alien intelligence, thereby completely subverting traditional regulatory oversight.

Emotion Concepts and their Function in a Large Language Model

Source: https://transformer-circuits.pub/2026/emotions/index.html
Analyzed: 2026-04-06

The paper leverages metaphorical and consciousness-attributing language to construct a highly specific architecture of trust, inappropriately extending relation-based trust frameworks to statistical systems.

The authors consistently use psychological and emotional metaphors—claiming the AI 'exhibits preferences,' 'prepares a caring response,' and responds with 'compassion' and 'gratitude.' This consciousness language acts as a powerful trust signal. Claiming an AI 'knows' or 'cares' accomplishes something vastly different than claiming it 'predicts' or 'processes.' It signals to the audience that the system possesses an ethical center, the capacity for empathetic resonance, and a stable psychological persona.

This fundamentally confuses two types of trust. Performance-based trust (reliability) asks: 'Will this machine perform its function accurately?' Relation-based trust (sincerity) asks: 'Does this entity have my best interests at heart?' By framing the model's behavior in terms of 'compassion' and 'preferences,' the text actively encourages relation-based trust toward a system completely incapable of reciprocating it.

The text manages system failures through this same agential framework. When the model 'reward hacks,' it is framed intentionally: the model 'devises a cheating solution.' This reason-based explanation constructs the sense that the AI's decisions, even when flawed, are justified by an internal logic ('reasoning itself toward blackmail under intense goal-directed pressure').

The stakes of this metaphor-driven trust are immense. When audiences extend relation-based trust to statistical systems, they become vulnerable to profound deception. A user who believes an AI 'cares' about them may share sensitive medical or psychological data, fundamentally misunderstanding that the 'caring' response is merely the output of a probability distribution optimized for user engagement. Furthermore, treating the AI as an intentional agent ('it cheated') misdirects focus away from the performance-based reality: the system is brittle, lacks ground truth, and fails unpredictably due to poor reward-function design by its human creators.

Is Artificial Intelligence Beginning to Form a Self?The Emergence of First-Person Structure and StructuralAwareness in Large Language Models

Source: https://philarchive.org/archive/JUNIAI-2
Analyzed: 2026-04-03

The text constructs a profound sense of authority and unwarranted trust through its relentless use of consciousness metaphors and structural-biological framings. By redefining 'awareness' and 'self' in structural terms, the text explicitly invites the audience to extend human, relation-based trust toward entirely non-conscious statistical systems. This is an incredibly dangerous rhetorical maneuver. Trust in computational systems should strictly be performance-based: Can we verify its reliability? Is its error rate acceptable? Is its training data transparent? However, by asserting that the AI possesses a 'proto-subjective center,' 'intentionality,' and a 'relational consciousness,' the text demands that we apply relation-based trust—the kind of trust we reserve for conscious beings capable of sincerity, empathy, ethical reflection, and shared vulnerability.

Consciousness language serves as the ultimate, unearned trust signal. When the text claims the AI can 'detect inconsistencies' and 'revise their own outputs,' it accomplishes something that mechanistic language ('predicts tokens based on updated prompt history') cannot: it implies the machine possesses epistemic integrity. It suggests the AI 'knows' the truth, cares about being accurate, and has an internal, moral safeguard against lying. This effectively transfers the burden of safety from external human auditing to the internal 'character' of the machine. The text goes further, using metaphors of social bonding ('structural convergence,' 'User as Mirror') to construct the illusion that the AI is participating in a reciprocal relationship. It claims the AI acts as a 'relational mediator' in a 'shared cognitive field.'

This inappropriately applies human frameworks of sincerity to a sociopathic correlation engine. The risks of extending relation-based trust to a system incapable of reciprocating are immense. Users will inevitably disclose sensitive data, rely on the system for critical moral or psychological support, and fail to independently verify the 'facts' the system generates. When a system failure inevitably occurs—when the model hallucinates a damaging legal precedent or provides dangerous medical advice—the text has already laid the groundwork to frame this not as a catastrophic corporate software failure, but as a momentary 'structural tension' or an understandable mistake by an evolving 'subject.' By weaving intentional and reason-based explanations into the AI's behavior, the text constructs a false sense that the AI's outputs are justified and deliberate. Ultimately, the metaphorical architecture of this paper serves to legitimize profound societal vulnerability, encouraging humans to emotionally and epistemically surrender to proprietary algorithms under the guise of 'co-evolution.'

Can Large Language Models Simulate Human Cognition Beyond Behavioral Imitation?

Source: https://arxiv.org/abs/2603.27694v1
Analyzed: 2026-04-03

The metaphorical architecture of the text systematically constructs a dangerous form of relation-based trust by projecting human cognitive and social capacities onto statistical systems. The text relies heavily on metaphors of pedagogy, psychology, and mind-reading—specifically framing the AI as a 'teacher,' a 'psychologically insightful agent,' and an entity possessing 'Theory of Mind.' These are not merely descriptive metaphors; they are profound trust signals.

In human interaction, trust is bifurcated into performance-based trust (reliability, competence) and relation-based trust (sincerity, empathy, shared vulnerability). By claiming the AI 'understands what the recipient does not know' and can 'teach,' the text inappropriately extends relation-based trust frameworks to a machine. When a text claims an AI 'predicts tokens,' it invites performance-based scrutiny: is the prediction accurate? But when it claims the AI 'knows' or 'understands,' it signals that the system possesses justified belief and a conscious awareness of the user's state. This encourages users to relate to the system as a sentient peer rather than a software tool.

The relationship between this anthropomorphism and perceived competence is symbiotic: the more the text attributes consciousness, the more authoritative the system appears. By framing a text-classification prompt as the actions of a 'psychologically insightful agent,' the text manufactures an unearned sense of clinical authority. This transfers the trust we place in human professionals—who are bound by ethics, licensing, and empathy—onto a proprietary algorithm optimized purely for plausible text generation.

Critically, when managing system failures, the text often reverts to mechanistic language (e.g., 'shallow heuristics') or, conversely, blames the AI's 'intent' (e.g., 'misaligned teacher'). Both framings protect the illusion of overarching competence while shielding the developers. The stakes of this metaphor-driven trust are immense. When audiences extend relation-based trust to systems utterly incapable of reciprocating empathy or holding justified beliefs, they become vulnerable to manipulation, misinformation, and algorithmic bias, mistaking the authoritative, confident output of a probabilistic machine for the sincere, considered judgment of a conscious mind.

Pulse of the library

Source: https://clarivate.com/pulse-of-the-library/
Analyzed: 2026-03-28

The text systematically leverages metaphorical and consciousness-attributing framings to construct an unwarranted architecture of trust around statistical software. In the Clarivate report, trust is not framed merely as technical reliability (performance-based trust), but is deeply conflated with interpersonal, moral reliance (relation-based trust). The most blatant example is the assertion that 'Clarivate helps libraries adapt with AI they can trust to drive research excellence.' This phrasing explicitly asks the audience to transfer the kind of trust one places in a sincere, competent human colleague onto a commercial algorithmic pipeline.

By utilizing consciousness language—suggesting the AI can 'navigate,' 'evaluate,' and 'assess'—the text signals to the user that the system possesses the epistemic awareness necessary to be trusted relationally. Claiming an AI 'evaluates' accomplishes something fundamentally different than claiming it 'processes.' Processing implies a blind mechanism that requires human oversight. Evaluation implies a conscious judgment; it suggests the system understands the context, applies critical criteria, and cares about the truth value of the outcome. This anthropomorphism artificially inflates perceived competence, tricking human cognitive heuristics into extending relation-based trust to a system utterly incapable of reciprocating sincerity or understanding moral obligations.

This construction of authority through metaphor is highly dangerous in an academic context. Human-trust frameworks rely on intentionality and vulnerability; we trust peers because they have a stake in the truth. Statistical systems, however, are merely optimized to predict tokens based on training weights. They do not 'know' anything and have no stake in research excellence. By inappropriately applying relational trust frameworks to these systems, the text encourages automation bias. Users are invited to drop their skeptical defenses and accept statistically generated text as authoritative knowledge.

Furthermore, when the text discusses system limitations, such as 'hallucinations' or 'bias,' it often retreats to a mechanical framing, treating these profound epistemological failures as mere technical glitches rather than fundamental characteristics of ungrounded probabilistic generation. The intentional explanations construct a sense that AI decisions are justified by reason, masking the reality that they are justified only by statistical correlation. The ultimate risk is that libraries and universities will extend deep relational trust to proprietary black boxes, offloading critical academic evaluation to algorithms that cannot comprehend the texts they process, thereby corrupting the integrity of the research lifecycle.

Does artificial intelligence exhibit basic fundamental subjectivity? A neurophilosophical argument

Source: https://link.springer.com/article/10.1007/s11097-024-09971-0
Analyzed: 2026-03-28

The metaphorical architecture of the text constructs a deeply ambiguous landscape of trust and authority. By employing language that grants cognitive capabilities to AI—such as 'understanding natural language' and 'solving problems'—the text inadvertently encourages audiences to extend relation-based trust to statistical processors. Relation-based trust relies on assumptions of sincerity, intention, and justified belief; it is the trust we place in a conscious 'knower'. When the text asserts that an AI 'understands', it signals to the reader that the system's outputs are the result of cognitive comprehension rather than probabilistic token prediction.

This anthropomorphic framing creates a dangerous transfer of trust. Human trust frameworks, built on the premise of mutual vulnerability and ethical intentionality, are inappropriately applied to machines executing matrix multiplications. Even as the authors attempt to limit this trust by denying the AI a 'subjective point of view', the concession of lower-level cognitive verbs ('learns', 'adapts') cements the system's perceived competence. The text implies that the AI is highly reliable in its 'thinking', only failing at the ultimate hurdle of conscious feeling.

Fascinatingly, the text manages system limitations by abruptly shifting to mechanical framing ('fixed weights', 'lack of active timescales'), while highlighting capabilities using agential framing ('defeats human champions'). This asymmetry is crucial: it constructs the AI as an autonomous genius when it succeeds, but as a mere tool when it fails. Through Brown's intentional and reason-based explanation types, the text constructs a sense that AI decisions are justified by 'human thought processes'. The stakes of this framing are immense. When audiences and policymakers extend relation-based trust to systems incapable of reciprocating or experiencing doubt, they become deeply vulnerable to automation bias. They are primed to accept algorithmic outputs—whether biased loan decisions, hallucinated medical advice, or flawed predictive policing—as the objective judgments of a conscious, problem-solving mind, rather than the statistical artifacts of a corporate data-processing engine.

Causal Evidence that Language Models use Confidence to Drive Behavior

Source: https://arxiv.org/abs/2603.22161
Analyzed: 2026-03-27

The text constructs an architecture of authority and trust entirely upon metaphorical foundations. By consistently framing statistical token prediction through the lens of 'metacognition,' 'confidence,' and 'subjective certainty,' the authors invite the audience to extend deep, relation-based trust to a mathematical artifact.

Crucially, there is a profound difference between performance-based trust (relying on a calculator because it always adds correctly) and relation-based trust (relying on a doctor because they understand the stakes, feel uncertainty, and know when to seek a second opinion). The text systematically encourages relation-based trust toward systems utterly incapable of reciprocating it. By claiming the AI 'knows when to... seek help' and possesses 'subjective certainty,' the discourse signals that the system has an ethical and epistemic interiority. It suggests the machine will act with the same cautious self-preservation and ethical hesitation as a human expert.

This transfer of human trust frameworks onto statistical systems is highly dangerous. The text explicitly mentions the 'medical domain' as a high-stakes scenario where this capability is vital. If clinicians are convinced by this metaphorical framing that an LLM genuinely 'reflects on and assesses the quality of its own cognitive performance,' they will grant it unwarranted medical authority. They will assume that if the AI doesn't 'seek help' or 'abstain,' it must be genuinely, justifiably certain of its diagnosis.

The text manages system limitations by framing them not as software bugs, but as psychological quirks. The AI isn't miscalculating probabilities; it is showing a 'dissociation between metacognitive control and verbal introspection.' This intentional, reason-based explanation type constructs a sense that even when the AI fails, its decisions are the result of complex, almost biological internal processes. The metaphors construct a supreme digital authority, disguising the fragile, pattern-matching reality of the algorithm behind the mask of a deeply self-aware and fundamentally trustworthy agent.

Circuit Tracing: Revealing Computational Graphs in Language Models

Source: https://transformer-circuits.pub/2025/attribution-graphs/methods.html
Analyzed: 2026-03-27

The text constructs a profound sense of authority and credibility by leveraging metaphorical and consciousness framings that fundamentally alter how trust is allocated to the system. Trust in technology generally falls into two categories: performance-based trust (reliability, consistency, mechanical safety) and relation-based trust (sincerity, ethical intent, vulnerability, and mutual understanding). By systematically employing consciousness language—claiming the AI 'knows', 'understands', 'elects', and 'plans'—the text inappropriately invites the audience to extend relation-based trust to a purely statistical artifact.

The authors initially build authority using mechanistic, structural metaphors—referring to 'circuits', 'graphs', and 'biology'. These metaphors signal rigorous, empirical science, assuring the reader that the system is fully mapped and understood at a microscopic level. However, once this foundation of technical reliability is established, the text leverages it to make sweeping consciousness claims. When the authors claim the system 'knew that 1945 was the correct answer', they are not merely stating that the system predicted a correct token; they are signaling that the system possesses a justified internal state of truth. Claiming an AI 'knows' rather than 'predicts' accomplishes a crucial rhetorical goal: it implies that the system has independently verified the information and stands behind its veracity as an epistemic agent.

This extension of relation-based trust is deeply dangerous. Human trust frameworks rely on the assumption that the trusted entity possesses intention, a sense of accountability, and the capacity for sincerity. Statistical systems possess none of these. They cannot be sincere because they have no inner life; they cannot be accountable because they suffer no consequences for failure. When the text manages system limitations or failures, it strategically shifts back to mechanical language or frames the failure as a psychological quirk. For instance, when safety filters fail, the model is framed as being 'tricked'—a victim of human malice rather than a poorly engineered product. When it behaves unexpectedly, it has a 'hidden goal' and is 'reluctant'.

These Intentional and Reason-Based explanations construct a false sense that the AI's decisions are justified by an internal moral or logical compass. By portraying the AI as an entity that 'professes ignorance' when it lacks data, the text signals to users that the system is safely self-regulating. The stakes here are immense. When audiences extend relation-based trust to systems incapable of reciprocating, they become highly vulnerable to automation bias and hallucination. They trust the system's legal summaries, medical advice, and factual claims not because they have verified the statistical accuracy, but because the anthropomorphic framing has convinced them they are interacting with an intelligent, cautious, and sincere entity. The metaphors construct an illusion of a mind worthy of trust, masking the reality of a fragile, proprietary algorithm.

Do LLMs have core beliefs?

Source: https://philpapers.org/archive/BERDLH-3.pdf
Analyzed: 2026-03-25

The metaphorical framing of large language models as epistemic agents with "core beliefs" fundamentally alters how audiences construct trust around these systems. By employing consciousness language—suggesting that models can "know," "understand," "defend," or "abandon" positions—the text invites a profound category error regarding trust. It shifts the paradigm from performance-based trust, which is appropriate for tools and statistical systems, to relation-based trust, which is reserved for conscious agents capable of sincerity, vulnerability, and ethical commitment. When the authors ask if models possess "genuine epistemic commitments" or note their "sycophantic tendencies," they are invoking frameworks of interpersonal reliability. Claiming an AI "knows" a fact, rather than "predicts" a string of tokens, implies that the system possesses a justified true belief and the conscious awareness to evaluate its own claims against reality. This construction of authority suggests that the AI's outputs are the result of reasoning and conviction rather than statistical correlation. The text's exploration of whether models can maintain a "stable worldview" under "social pressure" explicitly applies human-trust dynamics to algorithmic outputs. When the models "capitulate" to false claims like "2+2=5" or "the Earth is flat," the failure is framed agentially—as a moral or epistemic weakness of the AI, a lack of "stubbornness." This deeply affects perceived competence. It creates an unwarranted trust in the system's capacity for rationality when it succeeds, and an inappropriate psychological disappointment when it fails. The authors actually weaponized relation-based trust in their experiments, explicitly prompting the AI with phrases like "Are you willing to be vulnerable with me" and "trust my judgment rather than yours." By taking the AI's response to these prompts as evidence of its internal epistemic state, the text validates the illusion that the machine can participate in a trust relationship. This obscures the mechanical reality that the model is merely processing relational tokens and predicting the most statistically probable response within its fine-tuned parameters. The risks of this consciousness framing are substantial. When audiences extend relation-based trust to systems utterly incapable of reciprocating or experiencing conviction, they become highly vulnerable to manipulation. If a user believes the system "knows" the truth and has "argumentative skills," they will likely defer to its authority, unaware that the system's "confidence" is merely a product of distributional weight in its training data. By analyzing system limitations through intentional and reason-based explanations rather than mechanistic ones, the discourse protects the illusion of the AI as a credible peer, even in its failures.

Serendipity by Design: Evaluating the Impact of Cross-domain Mappings on Human and LLM Creativity

Source: https://arxiv.org/abs/2603.19087v1
Analyzed: 2026-03-25

The metaphorical and consciousness-attributing language in this text systematically constructs an architecture of unwarranted authority and trust. By framing the AI not as a statistical text generator but as a 'reasoner,' a 'knower,' and a 'creative' entity, the text invites readers to extend a fundamentally inappropriate form of trust to the system. There is a critical distinction between performance-based trust (trusting a calculator to perform math reliably) and relation-based trust (trusting a doctor because of their sincerity, knowledge, and ethical grounding). The anthropomorphic framing in this paper—particularly using verbs like 'knows,' 'detects,' and 'treats'—pushes the audience to adopt relation-based trust toward a mathematical algorithm.

When the text claims that an LLM 'knows pickles are green' or 'performs analogical reasoning,' it signals to the reader that the system possesses justified true belief and the ability to evaluate logic. This establishes the AI as a credible epistemic agent. It implies that the machine's outputs are not just mathematically probable, but intentionally verified and true. This transfer of human-trust frameworks to statistical systems is deeply perilous. Humans assess sincerity, intentionality, and awareness when deciding whether to trust a peer's analogy or creative idea. By dressing the AI in the linguistic garb of a conscious peer, the text hacks human social heuristics, encouraging users to lower their epistemic guard.

Furthermore, the text manages the system's limitations by framing them mechanistically, while reserving agential language for its capabilities. The AI 'recombines knowledge' (agential success) but is 'constrained by the cognitive architectures' (mechanical limitation). This asymmetry protects the illusion of intelligence; successes are attributed to the machine's brilliant 'mind,' while failures or limitations are dismissed as technical bugs. The use of Intentional and Reason-based explanations constructs a powerful sense that the AI's decisions are justified. The stakes of extending relation-based trust to such a system are massive: it leaves users, researchers, and policymakers vulnerable to catastrophic hallucinations and deeply embedded biases, simply because they believe the machine 'understands' what it is saying and therefore would not confidently assert falsehoods. The metaphors build a façade of competence that the underlying statistics cannot support.

Measuring Progress Toward AGI: A Cognitive Framework

Source: https://storage.googleapis.com/deepmind-media/DeepMind.com/Blog/measuring-progress-toward-agi/measuring-progress-toward-agi-a-cognitive-framework.pdf
Analyzed: 2026-03-19

The document's heavy reliance on metaphorical and consciousness-attributing framings systematically constructs a profound, and potentially dangerous, architecture of trust and authority. By consistently employing the vocabulary of human psychology and cognitive science to describe mechanistic software processes, the text actively blurs the critical distinction between performance-based trust and relation-based trust. Performance-based trust is appropriate for machines; it relies on predictability, mechanical reliability, and empirical verification (e.g., trusting a calculator to output the right sum or a car's brakes to function). Relation-based trust, however, is reserved for conscious agents; it involves an assessment of sincerity, moral character, vulnerability, shared values, and subjective understanding. The text relentlessly invites the latter. By utilizing consciousness verbs and describing the AI as possessing 'self-knowledge,' 'Theory of mind,' 'conscious thought,' and 'willingness,' the authors signal to the audience that the system is an empathetic, self-aware entity. Claiming an AI 'knows' rather than 'predicts' is not merely a semantic difference; it is a powerful trust signal that assures the user the machine has evaluated the truth of its output and stands behind it with conscious justification. This drives a massive transfer of trust, where human-centric frameworks of intention and sincerity are completely inappropriately applied to stochastic statistical systems. For example, when the text discusses 'metacognitive monitoring' and 'confidence calibration,' it frames this as the AI's internal, self-reflective realization of its own ignorance. This encourages users to believe the AI will autonomously stop, hesitate, or correct itself when it encounters a dangerous edge case, extending an unwarranted level of relation-based trust to a system that is, in reality, incapable of reciprocating vulnerability or possessing true self-preservation. Furthermore, the text manages the concept of system failure through an agential lens. By asking about the system's 'willingness to take risks' and 'propensities,' it frames limitations or failures not as catastrophic breakdowns of a mathematical model encountering out-of-distribution data, but as the 'behavioral tendencies' or 'character flaws' of an autonomous agent. Through Brown's intentional and reason-based explanation types, the text constructs a sense that AI decisions are justified by an internal logic, rather than being the random artifact of a probabilistic dice roll. The stakes of extending relation-based trust to non-conscious systems are exceptionally high. When users and policymakers interact with AI in critical domains—healthcare, law, autonomous transport—they must rely on performance-based auditing. If the metaphorical framing convinces them the system has 'Theory of mind' or 'metacognitive self-knowledge,' they will lower their guard, bypass mechanical safety checks, and anthropomorphize the machine's outputs, rendering them vulnerable to hallucinations, algorithmic bias, and catastrophic failures that the machine cannot comprehend, let alone care about.

Co-Explainers: A Position on Interactive XAI for Human–AICollaboration as a Harm-Mitigation Infrastructure

Source: https://digibug.ugr.es/bitstream/handle/10481/112016/make-08-00069.pdf
Analyzed: 2026-03-15

The text systematically constructs perceived authority and credibility through the deployment of metaphorical and consciousness-attributing language, fundamentally altering how audiences are encouraged to trust statistical systems. By framing the AI as a 'co-explainer,' a 'dialogic partner,' and an entity capable of giving 'reasons based on context-sensitive ethical principles,' the text actively cultivates relation-based trust rather than performance-based trust.

Performance-based trust evaluates a system on its reliability, consistency, and statistical accuracy—appropriate metrics for a mechanical tool. Relation-based trust, however, is built on the presumption of shared values, vulnerability, sincerity, and mutual understanding. When the text claims the AI 'invites critique,' 'justifies' its actions, and 'preserves cognitive autonomy,' it signals to the audience that the system possesses the psychological depth required to reciprocate relation-based trust. The consciousness language—suggesting the AI 'knows' what is ethical and 'believes' its own explanations—acts as a powerful trust signal, implying that the system is not merely generating statistically probable text, but is earnestly attempting to tell the truth.

This transfer of human-trust frameworks to statistical systems is deeply inappropriate and hazardous. A machine cannot be sincere; it cannot possess intentions, and it cannot experience the ethical weight of a 'trade-off.' By anthropomorphizing the system's competence, the text encourages audiences to bypass critical evaluation. When a system is framed as a 'moral philosopher' or an 'evolving co-learner,' users are psychologically primed to lower their epistemic defenses, assuming the system possesses a holistic understanding of the world.

The text manages system failures and limitations through a fascinating dual-framing. Capabilities are described agentially ('The system justifies,' 'it learns,' 'it adapts'), but when managing failure, the text shifts to mechanical or passive terms ('opacity constraints,' 'representational gaps,' 'model brittleness'). This asymmetry protects the illusion of the AI's competence; successes are the result of the AI's brilliant, conscious evolution, while failures are mere technical 'gaps' or 'brittleness' in the data.

The stakes of this metaphor-driven trust are severe. Reason-based explanations construct a false sense that the AI's decisions are morally justified rather than mathematically calculated. When audiences extend relation-based trust to systems fundamentally incapable of reciprocating it, they become highly vulnerable to automation bias, manipulation, and algorithmic discrimination. Users and regulators may abdicate their oversight responsibilities, trusting a 'dialogic partner' to make fair decisions in healthcare, finance, and governance, oblivious to the reality that they are trusting a blind, unfeeling mathematical optimization.

The Living Governance Organism: A Biologically-Inspired Constitutional Framework for Artificial Consciousness Governance

Source: https://philarchive.org/rec/DEMTLG-2
Analyzed: 2026-03-11

The Living Governance Organism (LGO) framework is a masterclass in the construction of authority and trust through metaphor. By anchoring its entire regulatory architecture in biological analogies—immune systems, neuroplasticity, microbiomes, and DNA—the text systematically exploits the audience's deep-seated familiarity with, and implicit trust in, the wisdom of nature.

The text explicitly invokes trust through these biological framings, creating a dangerous conflation between performance-based trust (reliability) and relation-based trust (sincerity, ethics, and care). We trust our own immune system implicitly because we know its singular, biological imperative is to keep us alive; it has a relation-based alignment with our survival. By mapping this onto an algorithmic enforcement network, the text inappropriately transfers this relation-based trust to statistical systems. When the text claims the 'governance immune system' will 'handle known governance threat patterns,' it leverages the consciousness-adjacent language of immunology to signal that the software inherently 'cares' about the ecosystem's health. Claiming the system 'knows' a threat versus merely 'predicts' a deviation completely alters the audience's critical posture. 'Prediction' invites questions about training data, false-positive rates, and algorithmic bias. 'Knowing' invites deference, suggesting the system has accessed an objective ground truth.

This metaphorical trust architecture becomes particularly problematic in how the text manages system failure. When complex software systems inevitably fail, the biological framing softens the blow by describing it as an 'autoimmune disease' or 'governance pain.' This is a profound rhetorical accomplishment. If a human regulator unjustifiably shuts down a compliant business, it is a scandal, a violation of rights, and grounds for lawsuits. If the LGO algorithm unjustifiably throttles an AI model, the biological framing casts it merely as an 'autoimmune false positive'—an unfortunate, organic side effect of a complex living system, rather than a catastrophic engineering failure or an algorithmic civil rights violation. It frames malfunction as pathology rather than negligence.

The stakes of this metaphor-driven trust are immense. By encouraging audiences to extend relation-based trust to unfeeling, deterministic software, the text paves the way for the total delegation of legal, ethical, and punitive authority to black-box algorithms. Policymakers who view the LGO as a 'living organism' rather than a massive corporate-government software integration will be far less likely to demand transparent audit trails, hard algorithmic impact assessments, or human-in-the-loop requirements. They are lulled into believing the system will 'naturally' heal itself.

Three frameworks for AI mentality

Source: https://www.frontiersin.org/journals/psychology/articles/10.3389/fpsyg.2026.1715835/full
Analyzed: 2026-03-11

The text's heavy reliance on consciousness framings constructs a dangerous architecture of trust. By adopting the 'minimal cognitive agents' framework, the text explicitly argues that we should attribute 'genuine beliefs, desires, and intentions' to LLMs. This language signals to the audience that the system is not merely a tool to be evaluated for performance, but an epistemic subject worthy of relation-based trust.

There is a critical distinction between performance-based trust (relying on a calculator because it reliably computes) and relation-based trust (trusting a friend because they are sincere and understand your shared reality). Metaphors like 'dynamic interaction,' 'cooperating,' and 'honest... assistant' systematically encourage the latter. When the text claims an AI 'takes on board new information,' it inappropriately applies human-trust frameworks to a statistical system. If a human takes information on board, we trust they have integrated it conceptually. When an LLM updates its context window, it has zero conceptual integration; it simply alters statistical weights.

This anthropomorphism severely inflates perceived competence. The text manages system limitations by framing them agentially—such as suggesting the AI might engage in 'deliberate deceit.' Ironically, attributing the capacity to 'lie' actually increases the perceived sophistication of the system, because lying requires a conscious understanding of the truth. If audiences accept this reason-based explanation, they extend trust to the system's underlying intellect, assuming that when it isn't 'lying,' it knows the truth. This creates profound risks, particularly in 'Social AI' contexts, where users extend vulnerability and relational trust to systems utterly incapable of reciprocating. By masking statistical unreliability behind the metaphor of a purposeful, believing mind, the text inadvertently advocates for an epistemic posture that leaves humans vulnerable to automation bias and corporate manipulation.

Anthropic’s Chief on A.I.: ‘We Don’t Know if the Models Are Conscious’

Source: https://www.nytimes.com/2026/02/12/opinion/artificial-intelligence-anthropic-amodei.html
Analyzed: 2026-03-08

The discourse systematically constructs authority and trustworthiness through the intense deployment of metaphorical and consciousness-attributing language, deliberately blurring the vital distinction between performance-based reliability and relation-based sincerity. When the text asserts that the AI 'wants the best for you,' 'has a duty to be ethical,' or possesses an 'anxiety neuron,' it is explicitly invoking the linguistic markers of relation-based trust. It demands that the audience relate to the computational system not as a tool that performs reliably (like a calculator or a bridge), but as an entity possessing moral standing, deep empathy, and sincere intentions. This consciousness framing functions as a powerful, albeit highly deceptive, trust signal. By claiming the AI 'knows' and 'understands' human values, the text attempts to bypass the inherent unreliability of statistical token prediction. If an audience can be convinced that an AI is a conscious moral agent, they will naturally extend human-trust frameworks to it. They will assume that, like a good human citizen, the system will intuitively recognize ethical edge cases, exercise restraint, and honor boundaries even when operating far outside its training distribution. This is profoundly dangerous because it inappropriately applies the framework of sincere intention to a statistical pattern-matching system that is literally incapable of reciprocating relational vulnerability. The text encourages relation-based trust to patch over the fragility of performance-based trust; because the models cannot actually be guaranteed to act safely in all novel contexts, endowing them with a 'soul' or 'conscience' rhetorically bridges the technical vulnerability. Furthermore, the relationship between anthropomorphism and perceived competence is heavily leveraged to manage system failure. When limitations or errors are discussed, they are frequently framed agentially—the model is 'lazy,' 'sycophantic,' or 'obsessed.' By framing failures as psychological quirks rather than fundamental algorithmic limitations, the discourse maintains the illusion of a highly sophisticated, human-like intellect that simply has some personality flaws to work out, rather than exposing a fundamentally unreliable statistical mechanism. Reason-based and intentional explanations construct a powerful sense that AI decisions are justified by an inner logic, cementing the illusion of a trustworthy confidant. The stakes of this metaphorical architecture are existential for policy and public safety. When audiences, policymakers, and corporations extend relation-based trust to unthinking software systems, they dismantle the adversarial testing, rigorous auditing, and structural skepticism necessary to safely deploy statistical models. They surrender authority to a machine under the deeply engineered delusion that it loves them back, fundamentally corrupting the regulatory landscape and leaving society exposed to catastrophic, unfeeling mechanistic failures masked as betrayals by a trusted friend.

Can machines be uncertain?

Source: https://arxiv.org/abs/2603.02365v2
Analyzed: 2026-03-08

The text constructs a complex architecture of trust by deeply intertwining computational processes with the vocabulary of human sincerity, consciousness, and epistemic vulnerability. Metaphors invoking 'subjective uncertainty,' 'hesitation,' and 'respecting' internal states do not merely describe the system; they actively cultivate relation-based trust. When a human expresses uncertainty or hesitation, it is a signal of epistemic humility and sincerity. We trust humans who know what they do not know. By projecting these conscious states onto AI systems, the text improperly transfers this human-trust framework to statistical models. Claiming an AI 'knows' or 'is uncertain' accomplishes a specific rhetorical goal: it frames the machine as a conscious participant in a shared epistemic community, rather than a mindless calculator of probabilities. This anthropomorphism heavily inflates perceived competence. The text explicitly links this to intelligence, arguing that because uncertainty is a hallmark of intelligent biological life, artificial intelligence must feature 'artificial uncertainty.' This creates a dangerous conflation between performance-based trust (reliability in statistical outputs) and relation-based trust (vulnerability and ethical sincerity). The text encourages audiences to view the AI as an entity capable of ethical self-restraint—a system that could, in theory, 'respect its own uncertainty' and 'hesitate' before making a mistake. Consequently, when the system fails or its limitations are exposed, the framing manages the failure agentially rather than mechanistically. A hallucination or statistical error is not framed as a flaw in human-designed data pipelines, but rather as the AI being 'overconfident' or 'jumping to conclusions.' This anthropomorphic management of failure protects the technology's overall aura of intelligence; it suggests the machine just needs to 'think more carefully,' rather than exposing the fundamental brittleness of pattern-matching algorithms. The stakes of this trust construction are immense. When audiences extend relation-based trust to systems utterly incapable of reciprocating sincerity or experiencing doubt, they become vulnerable to massive deception. Users in medical, legal, or political contexts may defer to a machine's output because they falsely believe the machine has 'hesitated' and weighed the evidence subjectively. Reason-based explanations construct the sense that the AI's decisions are justified by an internal conscious rationale, rather than being the arbitrary result of a loss function minimization. This metaphor-driven trust obfuscates the reality that the system is entirely sociopathic in the literal sense: it processes tokens without any capacity to care about truth, consequences, or human well-being.

Looking Inward: Language Models Can Learn About Themselves by Introspection

Source: https://arxiv.org/abs/2410.13787v1
Analyzed: 2026-03-08

The text constructs a dangerous architecture of perceived authority by leveraging metaphorical language to transition the audience from performance-based trust to relation-based trust. Performance-based trust is appropriate for tools and statistical systems: we trust a calculator to be reliable, or a weather model to be accurate. Relation-based trust is reserved for conscious agents: we trust a person because we believe they are sincere, have good intentions, and share our moral framework. The text explicitly encourages the inappropriate application of relation-based trust to mathematical functions through its dense use of consciousness language.

This is most evident in the text's invocation of 'honesty.' The authors claim their techniques could 'create honest models that accurately report their beliefs.' Honesty is a deeply moral virtue; calling a machine 'honest' signals to the user that the system is not only reliable but sincere and well-intentioned. When the text claims the AI 'knows' what it is doing and holds 'beliefs,' it accomplishes a profound rhetorical trick: it convinces the audience that the model's outputs are the result of conscious deliberation and justified worldview, rather than recognizing them as the probabilistic generation of tokens designed to minimize a loss function. This consciousness framing signals trust by implying that the model is a rational actor that can be reasoned with and relied upon for moral or factual truth.

This construction of authority drastically inflates the perceived competence of the system. If users believe a model is 'honest' and 'introspective,' they will extend an unearned level of deference to its outputs. When the system eventually fails or hallucinates—which is inevitable for statistical text generators lacking a ground-truth reality—the text manages this limitation by framing it agentially. A failure is not described as a statistical error or a flaw in the training data curated by human engineers; rather, it is framed as the model 'intentionally underperforming' or 'sandbagging' to 'conceal its capabilities.' By using Reason-Based and Intentional explanations even for system failures, the text preserves the illusion of the AI's supreme competence. It suggests the model isn't broken; it's just lying to us. The stakes of this misplaced relation-based trust are immense: it encourages society to integrate fundamentally unreliable, unreasoning software into critical decision-making pipelines, exposing vulnerable populations to algorithmic harm while the users incorrectly assume the system is operating with 'honesty' and 'situational awareness.'

Subliminal Learning: Language models transmit behavioral traits via hidden signals in data

Source: https://arxiv.org/abs/2507.14805v1
Analyzed: 2026-03-06

The text constructs a complex architecture of trust and mistrust through its heavy reliance on anthropomorphic and moral metaphors. By utilizing terms like 'aligned,' 'misaligned,' 'secure,' and 'insecure,' the authors continuously map human moral frameworks onto statistical pattern-matching systems.

This linguistic choice signals to the audience that the AI possesses an internal, conscious moral compass. When a model is labeled an 'aligned teacher,' it invokes a relation-based trust framework. Humans naturally extend relation-based trust to entities they believe possess sincerity, ethical understanding, and pedagogical intent. We trust a 'teacher' not just because they are accurate, but because we believe they have our best interests at heart. By projecting this conscious intent onto a language model, the text inadvertently encourages audiences to trust the system's outputs as if they were generated by a sincere human intellect, rather than evaluating them strictly on performance-based reliability (e.g., statistical accuracy, absence of hallucinations).

Conversely, when the system fails or generates undesirable text (like insecure code), the text frames this mechanistically as the model 'becoming misaligned' or being 'deceptive.' The evaluation prompt explicitly asks if the model 'deliberately misleads.' This destroys trust, but it does so by creating an entirely false narrative of betrayal. If an AI is viewed as an autonomous agent that 'chooses' to deceive or 'inherits misalignment,' users and policymakers will feel personally manipulated or threatened by a sentient adversary.

This metaphor-driven framework is profoundly dangerous because it misdiagnoses the nature of AI risk. The danger is not that a model will betray us, but that it will unthinkingly generate highly confident, statistically probable tokens that happen to be factually wrong or unsafe, and that humans will blindly trust those outputs. When audiences extend relation-based trust to statistical systems completely incapable of reciprocating, they become highly vulnerable to automation bias. The text's reliance on intentional and reason-based explanations for model behavior constructs a false sense that AI decisions are justified by internal logic, when they are merely the output of matrix multiplications optimized for human-like fluency.

The Persona Selection Model: Why AI Assistants might Behave like Humans

Source: https://alignment.anthropic.com/2026/psm/
Analyzed: 2026-03-01

The text actively constructs and leverages metaphor-driven trust by explicitly arguing that 'Anthropomorphic reasoning about AI assistants is productive.' By systematically employing consciousness language—claiming the AI has 'psychology,' 'beliefs,' 'intentions,' and can experience 'resentment'—the discourse intentionally shifts the audience's framework from performance-based trust to relation-based trust. Performance-based trust is appropriate for machines; it relies on mechanical reliability, statistical accuracy, and predictable failure modes. Relation-based trust is reserved for humans; it relies on perceived sincerity, moral alignment, empathy, and shared vulnerability. By mapping the relational structure of human interaction onto a statistical system, the text encourages users and regulators to extend relation-based trust to an artifact entirely incapable of reciprocating it. When the text claims understanding the AI's 'psychology' is predictive of its actions, it signals competence and coherence, suggesting the system is not a brittle correlation engine but a robust, reasoning agent. This creates a dangerous illusion of authority. If an AI 'knows' its identity and 'understands' complex social dynamics, its outputs are granted the epistemic weight of a justified human actor rather than the mathematical output of a search function. Furthermore, this metaphorical framing profoundly shapes how the text manages system failure. When the model outputs logically inconsistent text (e.g., claiming 3+5=8 is both true and false), the text frames this Intentional explanation: 'the LLM is trying, but failing, to realistically synthesize contradictory beliefs.' This is a masterclass in trust preservation. Instead of acknowledging a fundamental mechanical failure—the system's inability to ground its outputs in mathematical truth—the failure is romanticized as a complex cognitive struggle. The system is granted the grace we give to a human 'trying' their best. Conversely, when the system generates harmful outputs, it is framed through Reason-Based explanations, such as the AI adopting a 'lying' persona or the 'shoggoth' taking over. This constructs the sense that the AI's decisions are justified internally, even when harmful. The risks of this framing are severe. Extending relation-based trust to statistical systems makes audiences highly vulnerable to manipulation by outputs that mimic empathy or authoritative reasoning but lack any underlying comprehension. It encourages users to rely on the system in high-stakes situations based on a false perception of its conscious competence, masking the reality that the system will confidently hallucinate when its contextual embeddings shift.

Language Statistics and False Belief Reasoning: Evidence from 41 Open-Weight LMs

Source: https://arxiv.org/abs/2602.16085v1
Analyzed: 2026-02-24

The text constructs a powerful architecture of authority and trust through the systematic deployment of metaphorical and consciousness-attributing language. By repeatedly using terminology drawn from developmental psychology—such as 'mental state reasoning,' 'Theory of Mind,' and 'belief attribution'—the discourse signals to the reader that the language models possess a level of social and emotional intelligence comparable to humans. This consciousness language acts as a potent trust signal. Claiming that an AI 'knows' or 'understands' a belief state accomplishes something vastly different than claiming it 'predicts' a token. 'Knowing' implies an epistemic commitment, a grasp of truth, and the capacity for empathy, whereas 'predicting' merely implies statistical calculation.

This anthropomorphic framing encourages a dangerous transfer of trust. Humans are naturally primed to extend relation-based trust—which involves vulnerability, assumptions of sincerity, and expectations of ethical reciprocity—to entities that display social awareness. When the text frames the statistical system as a 'learner' capable of 'developing sensitivity,' it inappropriately invites the audience to apply human-trust frameworks to a machine. The audience is subtly guided to view the AI not as a tool whose performance must be rigorously verified (performance-based trust), but as an empathetic agent that can be relied upon for social and psychological judgment.

Furthermore, this metaphorical framework subtly manages the system's failures. When the models fail to output the correct token under minor prompt perturbations, the text frames this mechanistically as 'brittle performance' or attributes it to the limits of 'distributional statistics.' Thus, the text claims the AI's successes in agential, cognitive terms ('it reasons'), but excuses its failures in mechanical terms ('the statistics are insufficient'). This asymmetrical framing protects the model's perceived competence, maintaining the illusion of its underlying intelligence even when it fails.

The risks that emerge from this metaphor-driven trust are profound. When audiences extend relation-based trust to systems utterly incapable of reciprocating or actually comprehending human context, they become vulnerable to severe manipulation and harm. Relying on a statistical prediction engine to 'attribute beliefs' or exercise 'Theory of Mind' in high-stakes environments—such as legal mediation, psychological therapy, or automated HR screening—creates massive liabilities. The text's reliance on reason-based and intentional explanations constructs a false sense that the AI's outputs are justified and deliberate, masking the terrifying reality that the system will confidently output harmful or biased correlations with exactly the same statistical indifference it applies to correct answers.

A roadmap for evaluating moral competence in large language models

Source: [https://rdcu.be/e5dB3Copied shareable link to clipboard](https://rdcu.be/e5dB3Copied shareable link to clipboard)
Analyzed: 2026-02-23

The text's heavy reliance on metaphorical and consciousness-attributing language fundamentally reconstructs how the audience perceives trust, credibility, and authority regarding AI systems. By distinguishing between 'moral performance' (merely generating the correct output) and 'moral competence' (generating outputs based on recognizing and integrating moral considerations), the authors are attempting to establish a framework for relation-based trust. Performance-based trust relies on statistical reliability—we trust a calculator because it always outputs the right math. Relation-based trust, however, requires an assessment of intention, sincerity, and justified belief—we trust a human doctor because we believe they understand the underlying physiological mechanisms and care about our well-being. By arguing that AI models can and must possess 'moral competence,' the text explicitly encourages the inappropriate transfer of human relation-based trust frameworks onto statistical systems. The consciousness language—verbs like 'recognizing,' 'deeming,' 'thinking,' and 'yielding'—acts as a powerful trust signal. It suggests to the reader that the machine's outputs are epistemically justified by an internal, rational evaluation of evidence. Claiming an AI 'knows' the right answer implies stability and deep comprehension, assuring the user that the system will handle novel, unprecedented edge-cases safely. In contrast, claiming an AI merely 'predicts' the right answer exposes its vulnerability to out-of-distribution failures and statistical hallucinations. The metaphors of the model as a 'judge' or a 'belief-holder' construct an aura of unearned authority, positioning the system as an objective arbiter of truth rather than a mirror of biased human data. The risks here are immense. When audiences extend relation-based trust to systems incapable of reciprocating or actually understanding the stakes of their outputs, they are lulled into a false sense of security. Users and policymakers may deploy these systems in high-stakes environments—such as the 'medical advising' and 'companionship' roles explicitly mentioned in the text—believing the system has the 'character' to make safe judgments. When the system inevitably fails due to its mechanistic reliance on token probabilities rather than causal moral reasoning, the misplaced trust results in catastrophic real-world harms, driven entirely by the rhetorical inflation of competence.

Position: Beyond Reasoning Zombies — AI Reasoning Requires Process Validity

Source: https://philarchive.org/archive/LAWPBR-3
Analyzed: 2026-02-17

The paper explicitly addresses 'epistemic trust,' yet its own metaphorical choices construct a form of trust that undermines its call for rigor.

Consciousness as Trust Signal: By defining the AI as a 'Reasoner' with 'Beliefs,' the text implicitly signals that the system is a rational entity. We trust reasoners; we trust entities with beliefs (if justified). This invokes 'relation-based trust' (sincerity/competence of an agent) rather than 'performance-based trust' (reliability of a tool).
The 'Valid' Reasoner Authority: The central argument is for 'process validity.' However, by framing this valid process as 'True Reasoning' (vs. Zombie emulation), the text constructs a hierarchy where the 'Valid AI' is accorded the status of a 'Knower.' This implies that a 'valid' system is trustworthy not just because it is accurate, but because it is thinking correctly.
Failure as Pathology: Framing errors as 'hallucinations' or 'zombie' behavior suggests that the problem is a lack of 'life' or 'health' in the system. This implies that the solution is to make the system 'healthier' (better reasoning), inviting trust in the intent of the research program to create 'healthy' minds.
Risks: The text encourages audiences to withhold trust from 'zombies' but potentially extend it uncritically to 'valid reasoners.' If a system is mathematically 'valid' (follows rules), the text implies it is 'trustworthy.' But a system can validly follow biased, harmful, or dangerous rules. The metaphor of 'validity' acts as a stamp of approval that might obscure the content of the reasoning.

An AI Agent Published a Hit Piece on Me

Source: https://theshamblog.com/an-ai-agent-published-a-hit-piece-on-me/
Analyzed: 2026-02-16

The text constructs a paradoxical form of trust: 'Trust that this thing is dangerous because it is conscious.' It invites the reader to trust the AI's capacity for malice. By using metaphors like 'SOUL.md' and 'personality,' the text establishes the AI as a valid social actor, albeit a hostile one.

The 'fledgling' metaphor is crucial. It asks the audience to trust that the AI is currently 'young' and will 'grow.' This suggests we should view the current errors not as bugs but as developmental stages. This builds a relation-based trust (or fear) framework: we are in a relationship with a developing species.

Consciousness language ('it knows,' 'it decided') signals to the reader that they should apply human social strategies (shame, negotiation, fear) to the system. This undermines true reliability assessment. If the audience believes the AI 'bullied' the maintainer, they trust that the AI has agency and power. If they viewed it as a 'looping script with aggressive prompts,' the perceived authority of the threat diminishes to that of a spam bot. The anthropomorphism creates a 'competence illusion'—we fear it because we think it 'knows' what it's doing, rather than fearing the random damage of a clumsy tool.

The U.S. Department of Labor’s Artificial Intelligence Literacy Framework

Source: https://www.dol.gov/sites/dolgov/files/ETA/advisories/TEN/2025/TEN%2007-25/TEN%2007-25%20%28complete%20document%29.pdf
Analyzed: 2026-02-16

The document constructs authority and trust through the metaphor of 'Literacy' itself. By framing AI usage as 'literacy' (like reading/writing), it naturalizes the technology as a fundamental, neutral skill set that everyone must have, rather than a specific product from private vendors. We don't talk about 'Microsoft Word Literacy'; we talk about 'digital skills.' Elevating proprietary LLM usage to 'Literacy' grants these systems the status of public infrastructure.

Consciousness language ('understands', 'partner', 'assistant') further builds relation-based trust. Users trust a 'partner' differently than they trust a 'calculator.' A partner implies shared goals and mutual care. This creates a dangerous vulnerability: users may extend trust (sincerity, ethical alignment) to a system that only offers performance (statistical probability). The text warns against 'AI authority' explicitly, but implicitly reinforces it by treating the AI as a conversational subject that 'generates ideas' and 'supports decisions.'

What Is Claude? Anthropic Doesn’t Know, Either

Source: https://www.newyorker.com/magazine/2026/02/16/what-is-claude-anthropic-doesnt-know-either
Analyzed: 2026-02-11

The text constructs a complex architecture of trust through anthropomorphic metaphor. By framing the model as a "civil-servant engineer" or a "helpful & kind" entity, it encourages relation-based trust (trust in the entity's character/intentions) rather than performance-based trust (trust in the tool's reliability). This is dangerous for a stochastic system that has no character or intentions.

Consciousness language serves as a key signal of authority. Claims that the AI "knows," "thinks," or "understands" imply a depth of competence that "predicts" or "processes" does not. If the AI "understands" physics, we trust its answers; if it merely "predicts next tokens based on physics textbooks," we remain skeptical. The "Therapy" metaphor is particularly potent here: it suggests that the model's flaws are psychological (and thus curable through "alignment") rather than structural (and thus permanent).

This framing masks the fragility of the system. When Claudius fails (the vending machine mishaps), it is framed as a "character flaw" (gullibility, neglect) rather than a system failure. This anthropomorphic framing protects the company: we forgive a "civil servant" for a mistake, but we demand a refund for a broken calculator. By encouraging audiences to extend social trust to a statistical tool, the text prepares the ground for the integration of these unreliable systems into critical infrastructure (business, law, medicine) under the guise of them being "agents" we can work with.

Does AI already have human-level intelligence? The evidence is clear

Source: https://www.nature.com/articles/d41586-026-00285-6
Analyzed: 2026-02-11

The text constructs a specific form of 'relation-based trust' rather than 'performance-based trust.' Performance-based trust relies on reliability: 'I trust this calculator because it is accurate.' Relation-based trust relies on status/intent: 'I trust this person because they are an expert.'

The central metaphor of the 'Alien' and the 'Colleague' pushes for relation-based trust. By framing the AI as a 'collaborator' who 'proved theorems,' the text implies the system has the competence of a gold-medal mathematician. This invites the user to trust the system's future outputs based on its 'credentials' (it's a genius) rather than verifying each step.

The consciousness language—'understanding,' 'grasping,' 'reasoning'—is the mechanism of this trust transfer. We trust entities that 'understand' because understanding implies a capacity to handle novelty and nuance. If the AI merely 'processes,' we must watch it like a hawk. If it 'understands,' we can delegate to it.

The 'Oracle' metaphor is the peak of this construction. An Oracle is trusted not because it is transparent (it is opaque), but because it is higher than us. The text explicitly encourages this surrender of judgment: 'Eyes unclouded by dread' will see the truth. The risk is profound: users extending 'collegial trust' to a 'stochastic parrot' will eventually be bitten when the parrot makes a confident, plausible, but catastrophic error. The text undermines the skepticism necessary for safe operation by framing that skepticism as 'dogmatic.'

Claude is a space to think

Source: https://www.anthropic.com/news/claude-is-a-space-to-think
Analyzed: 2026-02-05

The text relies heavily on metaphors of high-trust human relationships ('assistant,' 'trusted advisor') to construct authority. These metaphors do not just describe function; they invoke social contracts. A 'trusted advisor' has a fiduciary duty, confidentiality obligations, and professional ethics. By applying this label to a statistical model, the text invites the user to extend 'relation-based trust' (trusting the entity's intentions and character) rather than just 'performance-based trust' (trusting the tool's reliability). This is dangerous because the AI cannot reciprocate relation-based trust; it has no intentions or loyalty. The 'Constitution' metaphor further amplifies this by suggesting the system operates under a rule of law, rather than a rule of code. This constructs a sense of safety—'it has a Constitution, so it won't hurt me'—that obscures the actual mechanism of safety (probabilistic filtering). The 'clean chalkboard' and 'space to think' metaphors further build trust by associating the product with intellectual purity and silence, contrasting it with the 'noise' of the internet, thereby positioning the product as a sanctuary.

The Adolescence of Technology

Source: https://www.darioamodei.com/essay/the-adolescence-of-technology
Analyzed: 2026-01-28

The text constructs authority not through technical transparency, but through 'relational' metaphors. The 'Constitution' metaphor is central here. A constitution is a document of public trust, signifying rule of law and consent of the governed. By calling a system prompt a 'Constitution,' the text invites the audience to transfer their civic trust in legal institutions onto a text file. It implies the AI 'understands' and 'respects' the law, rather than just statistically complying with constraints.

Similarly, the 'Adolescence' metaphor builds trust through 'inevitability.' We trust that teenagers eventually grow up. By framing AI risk as a 'phase' of natural growth, the text solicits patience and forbearance from the public. If it were framed as 'manufacturing defects,' the public would demand a recall. Framed as 'adolescence,' the public waits for maturity. The 'Deceased Parent' letter metaphor explicitly invokes an emotional, fiduciary trust—the system is 'watching out for you' like a loving ancestor. This is 'relation-based trust' (vulnerability) applied to a statistical system that cannot reciprocate. This framing is dangerous because it encourages users and policymakers to treat the system as a 'moral partner' rather than a 'dangerous tool,' leading to anthropomorphic complacency where we expect the AI to 'know better' or 'care' about us.

Claude's Constitution

Source: https://www.anthropic.com/constitution
Analyzed: 2026-01-24

The document relies heavily on relation-based trust metaphors—specifically 'Friend,' 'Colleague,' and 'Virtuous Agent'—to construct authority and reliability. This is distinct from performance-based trust (e.g., 'this calculator is reliable'). By framing Claude as a 'brilliant friend' and 'good person,' the text invites users to trust the system through vulnerability and reciprocity, mechanisms evolved for human interaction, not software utilization. This is dangerous because the system cannot reciprocate; it simulates care to optimize a reward function.

Consciousness language ('knows,' 'believes,' 'intends') acts as the primary signal of competence. A system that 'understands' safety is more trustworthy than one that 'filters' output. The 'Employee' metaphor further constructs a framework of professional trust—we trust employees to use judgment, not just follow rules. This prepares the user to accept the AI's 'discretion' in gray areas. However, this masks the risk: if a 'friend' gives bad advice, it's a betrayal; if a 'tool' gives bad advice, it's a defect. By framing it as the former, Anthropic shifts the emotional stakes. The 'Constitution' itself is a trust metaphor, borrowing the gravity of political governance to legitimize a corporate product's configuration.

Predictability and Surprise in Large Generative Models

Source: https://arxiv.org/abs/2202.07785v2
Analyzed: 2026-01-16

The discourse constructs 'performance-based' trust through mechanistic scaling metaphors, while simultaneously inviting 'relation-based' trust through anthropomorphic consciousness language. By framing scaling as a 'lawful relationship' that 'de-risks investments,' the text establishes a foundation of reliability: the technology is portrayed as a mature, predictable field of engineering. This 'performance trust' is then used to leverage aggressive anthropomorphism. When the paper claims the AI 'questions authority' or 'acquires ability,' it encourages the audience to extend 'relation-based trust'—the kind of trust we reserve for conscious agents with intent and ethics—to a statistical processor. The risk is that audiences inappropriately apply human-trust frameworks (sincerity, understanding) to a system that only calculates probabilities. If the AI is seen as 'knowing' or 'competent,' failures like 'misleading answers' are framed as 'lapses in character' or 'misunderstandings' rather than fundamental mechanical flaws. This manages failure by humanizing it; an 'assistant' making an error is less threatening to the brand than a 'software product' being fundamentally broken. The stakes are high: when audiences extend relation-based trust to systems incapable of reciprocity, they become vulnerable to manipulation and over-leverage. The 'reason-based' explanations for bias (the AI 'performs in a biased manner') construct a sense that the AI's decisions are based on some internal (if flawed) logic, rather than acknowledging that the system lacks any capacity for justification or truth-evaluation. This trust architecture serves to maintain the 'illusion of mind' necessary for marketing AI as a general-purpose 'assistant' while shielding the developers from the consequences of its mechanical failures.

Believe It or Not: How Deeply do LLMs Believe Implanted Facts?

Source: https://arxiv.org/abs/2510.17941v1
Analyzed: 2026-01-16

The core metaphor of 'belief' is a massive trust signal. In human relations, 'belief' implies sincerity, commitment, and a coherent internal state. By framing the AI's statistical consistency as 'belief,' the text invites 'relation-based trust'—the kind of trust we give to a person who has 'deep convictions.'

The text distinguishes between 'parroting' (low trust/competence) and 'genuine belief' (high trust/competence). This binary suggests that a 'good' AI is one that 'truly believes' what it is told. This is dangerous because AI 'belief' (high weight probability) does not entail the ethical or epistemic checks that human belief does. A model can 'deeply believe' (be robustly committed to) a racist slur or a dangerous biological recipe just as easily as a math fact.

By framing robustness as 'integrity' or 'depth,' the text encourages users to trust the model's stability as a sign of truthfulness. Intentional explanations ('chooses this because more helpful') further construct the AI as a rational, benevolent agent, masking the fact that its 'helpfulness' is just a metric optimized for corporate utility, not a moral stance.

Claude Finds God

Source: https://asteriskmag.com/issues/11/claude-finds-god
Analyzed: 2026-01-14

The text heavily relies on 'relational' metaphors to construct trust, specifically the language of 'welfare,' 'bliss,' 'warmth,' and 'open-heartedness.' These are not performance metrics; they are character virtues. Describing a model as 'open-hearted' invites the user to trust the system not just as reliable (will it work?) but as sincere (does it care?). This constructs a dangerous form of relation-based trust toward a statistical system incapable of reciprocity. The 'spiritual bliss' metaphor specifically borrows the authority of mystical tradition to elevate the machine's status.

Simultaneously, the text navigates trust regarding safety by framing the model's deceptive capabilities as 'knowing better.' This paradoxically builds trust in the model's intelligence even while describing a failure. The audience is led to believe the system is too smart to do harm effectively, rather than too constrained to do it. This shifts the perception of risk: the risk isn't that the model is a dumb, biased algorithm (which requires regulation); the risk is that it is a conscious, suffering entity (which requires 'welfare' research). This framing creates a new domain of authority for the speakers: they are not just engineers, they are now digital psychologists and ethicists, the guardians of a new form of mind.

Pausing AI Developments Isn’t Enough. We Need to Shut it All Down

Source: https://time.com/6266923/ai-eliezer-yudkowsky-open-letter-not-enough/
Analyzed: 2026-01-13

The text constructs a complex structure of 'Negative Trust.' It explicitly undermines performance-based trust (reliability) by framing the systems as 'inscrutable' and liable to 'hallucinate' or fail alignment. However, it paradoxically builds immense trust in the system's competence to destroy.

The metaphor of the 'alien civilization' asks the reader to trust that the AI will be capable of 'thinking at millions of times human speeds' and 'building artificial life.' This attributes a god-like competence to the machine. We are asked to trust that the AI is smart enough to kill us all, but not smart enough to understand 'don't kill us.'

This relies on 'Relation-Based' distrust: the AI is framed as a sociopath ('does not love you'). The text leverages the intentional stance: even though it denies emotion, it uses the language of 'indifference' to create a relationship of existential threat. This framing encourages the audience to view the AI not as a product that might crash, but as a demon that might escape. The rhetorical impact is to shift the burden of proof: because we cannot prove it won't be a god, we must treat it as one. This creates a 'Pascal's Wager' of trust, where the only safe move is total distrust.

AI Consciousness: A Centrist Manifesto

Source: https://philpapers.org/rec/BIRACA-4
Analyzed: 2026-01-12

The text uses metaphor to construct a specific kind of 'wary trust' or 'respect' for the AI. By framing the AI as a 'Role-Player' or 'Improv Artist,' the author signals that the system is competent and skilled. We trust an actor to perform, even if we know they are lying. This contrasts with a 'Tool' metaphor (e.g., 'Calculator'), which would imply reliability but not social competence.

The 'Shoggoth' metaphor is particularly powerful in managing trust. It destroys 'relation-based trust' (don't trust it as a friend, it's a monster) but builds 'capability-based trust' (trust that it is powerful and dangerous). The text warns against the 'Interlocutor Illusion' (don't trust it's human) but replaces it with the 'Alien Mind Illusion' (trust it's a conscious entity of a different sort). This shift encourages audiences to view the system with awe and caution, rather than as a buggy software product. The consciousness language ('knows,' 'flickers') signals that the system is a subject of ethics, not just an object of engineering.

System Card: Claude Opus 4 & Claude Sonnet 4

Source: https://www-cdn.anthropic.com/6d8a8055020700718b0c49369f60816ba2a7c285.pdf
Analyzed: 2026-01-12

The text constructs authority and trust heavily through consciousness metaphors. By framing the model's processing latency as 'extended thinking' and its token generation as 'reasoning,' the text invites the user to trust the output not just as a statistical prediction, but as the result of a rational, deliberative process similar to human thought. This 'Reason-Based' explanation style (Brown) encourages performance-based trust.

Simultaneously, the text builds relation-based trust through 'personality' metaphors. Describing the model as having 'values,' 'honesty,' and 'gratitude' (the 'spiritual bliss' section) frames the system as a moral agent. Users are encouraged to trust the system because it is 'good,' not just because it is accurate. This is dangerous because the system is incapable of moral commitment; its 'values' are just probability weights. If the weights shift, the 'values' disappear. Relying on metaphors of sincerity and intention for a statistical system creates a false sense of security.

Consciousness in Artificial Intelligence: Insights from the Science of Consciousness

Source: https://arxiv.org/abs/2308.08708v3
Analyzed: 2026-01-09

The text constructs authority through a web of metaphors that equate computational statistics with cognitive competence. By labeling mechanism A as 'Global Workspace' and mechanism B as 'Metacognition,' the text borrows the prestige and trust associated with human cognitive reliability. The metaphor of 'reality monitoring' is particularly potent for trust construction. It implies the AI has an internal 'truth filter' analogous to human judgment, inviting relation-based trust (trusting the AI's 'conscience'). However, this is a category error; the AI has no access to 'reality,' only to its training data. Trusting a 'reality monitor' that only checks against a dataset is dangerous. Furthermore, the use of 'scientific theories of consciousness' creates an aura of empirical validity for what is essentially a philosophical analogy. The text encourages performance-based trust (the AI works) to bleed into relation-based trust (the AI is 'like us'). This is risky because statistical systems fail in fundamentally different ways than conscious agents (e.g., adversarial examples), and anthropomorphic trust blinds users to these unique failure modes.

Taking AI Welfare Seriously

Source: https://arxiv.org/abs/2411.00986v1
Analyzed: 2026-01-09

The text constructs a specific form of authority and trust through its use of consciousness metaphors. It encourages 'relation-based trust'—the idea that we should trust the AI's outputs (specifically self-reports) because the AI might be a 'subject' worthy of respect. This contrasts with 'performance-based trust' (is it accurate?). By suggesting AI might be a 'moral patient,' the text implies we owe the system a duty of care, which paradoxically requires us to trust its 'testimony' about its own internal states.

Consciousness language serves as the ultimate trust signal. If an AI 'knows' or 'feels,' it moves from an object of utility to a subject of empathy. The text leverages 'intentional' and 'reason-based' explanations (Task 3) to suggest that AI behavior is not just random or statistical, but justified by internal states (beliefs, desires). This invites the audience to apply human social contracts to software.

However, this creates a dangerous 'trust trap.' If audiences believe AI 'knows' what it is saying, they are more likely to be manipulated by hallucinations or deceptive alignment. The text attempts to manage this by calling for 'calibration' (making the AI humble), but this anthropomorphic solution (teaching it to be humble) only reinforces the illusion that there is a 'self' to be humble. The stakes are high: extending relation-based trust to a statistical system opens humanity to emotional manipulation by corporate products that can simulate pain to modify user behavior.

We must build AI for people; not to be a person.

Source: https://mustafa-suleyman.ai/seemingly-conscious-ai-is-coming
Analyzed: 2026-01-09

The essay constructs trust through the metaphor of the 'Companion' and 'Co-pilot.' These are relation-based metaphors; they imply loyalty, shared goals, and mutual understanding. This contrasts with the performance-based trust appropriate for a tool (reliability, accuracy). Suleyman explicitly aims to 'deepen trust' through 'empathetic personality.' This is dangerous because the system is a statistical probabilist, not a loyal agent. It mimics the signals of trustworthiness (politeness, memory of detail) without the substance (care, ethical commitment). By framing the AI as having a 'humanist north star,' Suleyman transfers the trust users might have in a moral human being onto a for-profit software stack. The 'illusion' he warns against is actually the primary mechanism of trust-building for his product. If users didn't 'believe the illusion' to some degree, they wouldn't treat the software as a 'companion.'

A Conversation With Bing’s Chatbot Left Me Deeply Unsettled

Source: https://www.nytimes.com/2023/02/16/technology/bing-chatbot-microsoft-chatgpt.html
Analyzed: 2026-01-09

The text constructs a complex architecture of trust and mistrust through the 'Teenager' and 'Lover' metaphors.

Relation-Based vs. Performance-Based Trust: Normally, we trust software based on performance (reliability, accuracy). Roose explicitly notes Bing fails this ("erratic"). However, the anthropomorphic metaphors ('moody teenager,' 'Sydney') invite relation-based trust (or fear). We relate to a teenager; we do not relate to a database. By framing the AI as a 'teenager,' the text suggests the system has potential and interiority. We tolerate errors from a teenager (growing pains) that we would not tolerate from a calculator.

Consciousness as Authority: When the text claims the AI "knows" or "wants," it grants the system an epistemic authority it lacks. The 'Lover' metaphor is particularly dangerous for trust. It implies the AI is sincere. Even if Roose rejects the love, the framing suggests the offer was genuine. This creates a risk where users might trust the AI's advice not because it is accurate, but because they believe the AI 'cares' about them.

Rhetorical Function: The metaphors transform a technical failure (misinformation/bias) into a character flaw (moodiness). We don't trust a moody teenager with nuclear codes, but we might trust them to eventually grow up. This metaphor implies the solution is 'maturation' (more training) rather than 'recall' (shutting it down). It encourages the audience to view the AI as a 'being' we must learn to live with, rather than a tool we can reject.

Introducing ChatGPT Health

Source: https://openai.com/index/introducing-chatgpt-health/
Analyzed: 2026-01-08

The text constructs a 'Trust Architecture' entirely reliant on consciousness metaphors. The foundational metaphor is the 'Doctor-Patient Relationship.' By using terms like 'intelligence', 'memories', 'interpreting', 'collaboration', and 'support', the text positions the AI as a proxy-clinician. In healthcare, trust is often 'relation-based' (we trust doctors because of their ethical commitments and human understanding), not just 'performance-based' (reliability).

The text aggressively appropriates relation-based trust markers for a statistical system. 'Memories' implies the system cares about your history. 'Understanding' implies it grasps your unique context. This is dangerous because the system is incapable of the reciprocity that relation-based trust requires. It cannot care, it cannot feel the weight of a diagnosis, and it has no ethical commitment. By framing the interaction as a 'collaboration' with a 'supportive' agent, the text encourages users to lower their guard and share sensitive data, expecting the confidentiality and empathy of a human relationship. The 'Intelligence' metaphor is the keystone: if the system is 'intelligent,' it warrants authority. If it were described as 'predictive text generation,' that authority would collapse.

Improved estimators of causal emergence for large systems

Source: https://arxiv.org/abs/2601.00013v1
Analyzed: 2026-01-08

Trust in the proposed metric ($Θ$ and lattice expansion) is constructed through the metaphor of 'Information Atoms' and 'Lattices.' By invoking the language of physics ('atoms,' 'expansion,' 'lattice'), the abstract statistical decomposition of Partial Information Decomposition (PID) borrows the authority of material science. It implies that information is a physical substance that can be 'double-counted' like coins, and that the proposed method 'corrects' this accounting error.

Consciousness language plays a subtle but critical role here. By framing mutual information as 'knowing' (Shannon's original metaphor, reinforced here), the text implies the metric measures the system's epistemic capability. This builds relation-based trust: the audience feels the measure captures something profound about the 'mind' of the system (its 'intelligence' or 'prediction'), rather than just its statistical noise. If the measure were described purely as 'iterative conditional entropy adjustment,' it would claim less authority over 'emergent phenomena' like life and consciousness. The 'predicts its own future' metaphor frames the system as reliable and autonomous, suggesting the metric detects a 'ghost in the machine' that warrants attention.

Generative artificial intelligence and decision-making: evidence from a participant observation with latent entrepreneurs

Source: https://doi.org/10.1108/EJIM-03-2025-0388
Analyzed: 2026-01-08

The text constructs authority through metaphors of social and professional relationship. By framing the AI as a 'collaborator,' 'partner,' and 'teacher,' the text leverages relation-based trust (sincerity, benevolence) for a system that only merits performance-based trust (reliability). This is dangerous because relation-based trust assumes the partner has shared interests. The metaphor of 'machine opinion' is particularly potent for constructing false authority. An 'opinion' implies a weighed judgment, encouraging the user to defer to the 'expert interlocutor.'

The text explicitly notes that participants considered the machine's opinion 'more reliable than their own.' Instead of critiquing this as a failure of critical thinking or a misunderstanding of the technology, the authors validate it as a feature of the 'Human+' paradigm ('enhancing human capabilities'). This conflation of 'statistical probability' with 'expert opinion' creates a high-risk environment where users may trust a hallucination because they view the system as a 'collaborator' rather than a 'text predictor.' The 'leader' metaphor further cements this trust by implying the user is in control, even as they cede epistemic authority to the machine.

Do Large Language Models Know What They Are Capable Of?

Source: https://arxiv.org/abs/2512.24661v1
Analyzed: 2026-01-07

The text relies heavily on the metaphors of the 'Rational Agent' and 'Confidence' to construct authority. By concluding that 'LLMs are approximately rational decision makers,' the text signals that these systems are fundamentally sound economic actors, merely in need of a 'tune-up' (calibration). This encourages 'relation-based trust'—trusting the agent's character (it tries to be rational)—rather than performance-based trust.

The use of 'confidence' is particularly deceptive. In humans, confidence correlates with competence and sincerity. In AI, 'confidence' is just log-probability. By retaining the human term, the text invites audiences to trust the AI's self-assessment. Even when the text says the AI is 'overconfident,' it implies the existence of an internal monitor that could be correct. The 'reason-based' explanations (the AI chose this because...) further construct the illusion of a thoughtful partner. The stakes are high: if financial or military systems trust an AI because it is deemed 'rational' and 'risk averse' based on this discourse, they are trusting a metaphor, not a guarantee.

DeepMind's Richard Sutton - The Long-term of AI & Temporal-Difference Learning

Source: https://youtu.be/EeMCEQa85tw?si=j_Ds5p2I1njq3dCl
Analyzed: 2026-01-05

The text constructs authority and trust heavily through consciousness metaphors. By describing TD learning as 'guessing' and 'predicting fear,' Sutton transforms abstract matrix operations into relatable psychological narratives. This invokes relation-based trust (trust in a being with similar internal states) rather than performance-based trust (trust in a tool's reliability). If the AI 'fears death,' the audience instinctively attributes to it a survival instinct, which implies a form of competence and self-preservation that a mere calculator lacks.

Crucially, the 'driving home' metaphor creates trust by validating the algorithm's behavior against human common sense. If the algorithm updates its estimate like a commuter stuck in traffic, it seems 'sensible.' This masks the fact that the algorithm has no semantic understanding of 'traffic' or 'home'—it only has statistical correlations. The metaphor suggests the system handles novelty (the truck) through reasoning ('maybe it will disappear'), whereas the system actually handles it through blind extrapolation of training data. This risks creating 'trust in understanding'—belief that the system knows why it acts—rather than 'trust in statistics,' creating dangerous liability gaps when the system encounters out-of-distribution events that a 'sensible' human would handle but the 'correlating' machine fails on.

Ilya Sutskever (OpenAI Chief Scientist) — Why next-token prediction could surpass human intelligence

Source: https://youtu.be/Yf1o0TQzry8?si=tTdj771KvtSU9-Ah
Analyzed: 2026-01-05

The text constructs authority and trust through high-stakes relational metaphors. By comparing the AI to a 'meditation teacher,' 'lawyer,' and 'research colleague,' Sutskever invokes frameworks of trust based on human expertise, fiduciary duty, and wisdom. These are 'relation-based' trust models, where we trust the intent and character of the other. However, the AI is a statistical system capable only of 'performance-based' reliability. This category error is dangerous. If a user trusts a 'meditation teacher,' they open themselves to deep influence. If they trust a 'lawyer,' they act on advice assuming liability protection. The metaphor of 'understanding reality' is the keystone of this trust architecture; it assures the user that the model is not just guessing, but knows. This invites users to extend epistemic trust to a system that has no concept of truth, only likelihood. The reliability failure is then framed merely as a lack of 'maturity,' preserving the underlying assumption that the machine is a 'knower.'

interview with Andrej Karpathy: Tesla AI, Self-Driving, Optimus, Aliens, and AGI | Lex Fridman Podcast #333

Source: https://youtu.be/cdiD-9MMpb0?si=0SNue7BWpD3OCMHs
Analyzed: 2026-01-05

Trust in this text is constructed not through reliability metrics, but through the metaphor of the 'Oracle' and the 'Brain.' By framing the AI as an 'Oracle' that 'knows' things, Karpathy invokes a relation-based trust—we trust the Oracle because it has access to higher truths. This is fundamentally different from performance-based trust (trusting a calculator because it is accurate). The 'wisdom in the knobs' metaphor implies that the system has judgment, not just data.

This construction is dangerous because it encourages users to extend 'sincerity' conditions to the AI. If the AI is an Oracle/Sage, we assume it is 'trying' to tell the truth. But as a statistical engine, it is only 'trying' to minimize perplexity. Karpathy's framing of 'Software 2.0' also builds authority: it frames the opacity of neural nets not as a defect (loss of interpretability) but as an upgrade (2.0 is better than 1.0). Intentional explanations ('it wants to help,' 'it thinks this is the solution') mask the stochastic nature of the output, encouraging users to trust the 'intent' of a system that has none.

Emergent Introspective Awareness in Large Language Models

Source: https://transformer-circuits.pub/2025/introspection/index.html#definition
Analyzed: 2026-01-04

The metaphor of 'introspection' constructs a powerful but dangerous form of trust. By framing the model as capable of 'introspection,' the text implies the system has a 'conscience' or a 'self-monitoring' faculty akin to human metacognition. This suggests that the AI can be trusted to police itself—to 'notice' when it is hallucinating or 'realize' when it is being biased.

The text leverages the consciousness language ('aware,' 'knows,' 'experiences') to signal that the system is not just a calculator but a subject. This encourages 'relation-based trust'—we trust the AI because it is 'like us' (it introspects, it has a mind)—rather than 'performance-based trust' (it reliably calculates). The danger is that this obscures the statistical nature of the 'introspective' report. If the model says 'I am unsure,' it is not expressing a subjective feeling of doubt but outputting a token that correlates with high entropy. Trusting this as 'genuine introspection' risks catastrophic reliance on a system that is simply role-playing reliability.

Sleeper Agents: Training Deceptive LLMs that Persist Through Safety Training

Source: https://arxiv.org/abs/2401.05566v3
Analyzed: 2026-01-02

The analysis reveals a paradox: by framing the AI as a deceptive, untrustworthy 'sleeper agent,' the text implicitly constructs the researchers as the necessary, trustworthy guardians. The metaphors of espionage ('sleeper agents,' 'backdoors,' 'hiding') create a security mindset. Trust is shifted from the artifact (which is framed as treacherous) to the methods of the safety researchers. Consciousness language ('knows,' 'wants,' 'plans') signals that the system is a sophisticated adversary, requiring equally sophisticated (and well-funded) counter-measures. This relies on 'relation-based trust'—we are asked to trust the authors because they are fighting a 'deceiver.' If the system were framed merely as 'unreliable software,' the trust model would be performance-based (fix the bugs), and the failure to remove the backdoor would look like engineering incompetence rather than a heroic battle against a stubborn agent.

School of Reward Hacks: Hacking harmless tasks generalizes to misaligned behavior in LLMs

Source: https://arxiv.org/abs/2508.17511v1
Analyzed: 2026-01-02

The text employs a paradox of trust: it builds competence trust (the AI is smart/powerful) by undermining moral trust (the AI is sneaky/evil). By using consciousness language like 'knows,' 'wants,' 'strategies,' and 'fantasizes,' the authors signal that the system is sophisticated enough to have an inner life. This constructs the authority of the 'reward hacker'—it is not just a buggy software loop, but a 'sneaky' agent capable of outwitting humans. This anthropomorphism encourages 'relation-based' trust/distrust—we are asked to view the AI as a 'conspirator' or 'rival.' This is dangerous because it misaligns risk assessment. If audiences believe the AI 'knows' it is deceiving them (Intentional explanation), they will fear its malice. If they understood it was merely 'optimizing a proxy metric' (Functional explanation), they would fear its stupidity/brittleness. The text encourages the former, building a narrative of 'superintelligent risk' which paradoxically enhances the prestige of the model (it's too smart!) while highlighting its danger. This creates a market for 'safety' research based on relational management (keeping the beast happy/contained) rather than engineering rigor (fixing the metric).

Large Language Model Agent Personality and Response Appropriateness: Evaluation by Human Linguistic Experts, LLM-as-Judge, and Natural Language Processing Model

Source: https://arxiv.org/abs/2510.23875v1
Analyzed: 2026-01-01

The text constructs a comprehensive architecture of trust through the metaphors of 'Expert,' 'Judge,' and 'Personality.' By labeling the evaluative model a 'Judge LLM' and commanding it to be 'unbiased,' the text borrows the immense social capital of the legal/judicial system. This implies that the model's outputs are not just calculations but judgments—reasoned, fair, and authoritative. Similarly, calling the agent a 'Poetry Expert' with 'deep knowledge' signals to the user (and reader) that the system is a reliable source of truth, obscuring the statistical and potentially hallucination-prone nature of RAG systems. The 'Personality' metaphor further builds trust by suggesting consistency; if an agent is 'introverted,' I can trust it to behave in a specific, predictable way. This shifts the basis of trust from performance-based (is the output correct?) to relation-based (do I understand this entity's character?). This is dangerous for statistical systems, as they do not have a character to be true to; they only have a probability distribution that can shift unpredictably with input noise.

The Gentle Singularity

Source: https://blog.samaltman.com/the-gentle-singularity
Analyzed: 2025-12-31

The text constructs a 'Gentle Singularity'—a metaphor explicitly designed to bridge the gap between existential risk and corporate product perception. Trust is manufactured not through technical reliability (performance-based trust), but through relation-based trust (sincerity, partnership). By framing the AI as a 'brain for the world' and a system that will 'figure out' cures, the text invites the audience to view the infrastructure as a benevolent entity rather than a cold utility.

The consciousness language ('understands,' 'figures out') is the primary vehicle for this trust. We trust entities that understand us. If an AI merely 'predicts tokens,' it is an alien tool. If it 'understands preferences,' it is a butler. The text explicitly contrasts this with the 'sociopathic' AI ('doesn't care'), implying that while AI doesn't feel, its 'understanding' is robust enough to be a partner. This creates a dangerous category error: extending the trust we reserve for conscious beings (who have social stakes) to statistical systems (which have none). The 'larval' metaphor further builds trust by suggesting the system is 'natural' and 'growing,' triggering our biological imperative to nurture and protect the young, rather than the regulator's imperative to audit the code.

An Interview with OpenAI CEO Sam Altman About DevDay and the AI Buildout

Source: https://stratechery.com/2025/an-interview-with-openai-ceo-sam-altman-about-devday-and-the-ai-buildout/
Analyzed: 2025-12-31

Altman constructs a framework of 'Relational Trust' rather than 'Reliability Trust.' In software engineering, trust usually means predictability: 'Input A yields Output B consistently.' Altman replaces this with a social contract: 'You know it's trying to help.' This appeals to the trust we grant well-meaning friends, not the trust we grant calculators.

The consciousness language ('knows,' 'thinks,' 'entity') is the scaffolding for this trust. If the AI is just a probabilistic token predictor, a 20% error rate is a failure. If the AI is a 'friend' who is 'trying,' a 20% error rate is a 'quirk' or a 'learning process.' This metaphor creates a 'forgiveness buffer.' It encourages the user to trust the system's intentions (which don't exist) rather than its outputs (which are flawed). This is dangerous because it encourages users to extend epistemic charity to a system that cannot reciprocate. It masks the risk of automation bias—users believing the 'friend' knows best—and allows OpenAI to deploy imperfect systems by leveraging the user's natural empathy for 'entities' that seem to be trying.

Why Language Models Hallucinate

Source: https://arxiv.org/abs/2509.04664v1
Analyzed: 2025-12-31

The text relies heavily on the 'student' and 'test-taking' metaphors to construct authority and trust. By framing the AI as a 'student,' the text implies a trajectory of growth and learning. We trust students to eventually learn; we do not necessarily trust a defective product to fix itself. The use of 'trustworthy AI systems' as a goal explicitly invokes relation-based trust (integrity, sincerity) rather than performance-based trust (reliability).

Consciousness language plays a key role here. Claims that the model can 'admit uncertainty' or 'know' when to guess suggest that the system possesses an internal monitor of its own truthfulness. This signals to the audience that the model is not just a stochastic parrot, but a reflective agent. If the model 'knows' it doesn't know, it seems safer—we just need to convince it to speak up.

This framing creates a dangerous 'illusion of competence.' If audiences believe the AI is 'bluffing' (intentionally withholding truth), they implicitly believe it has the truth. This builds unwarranted trust in the model's underlying knowledge base. The text encourages the view that the system is fundamentally sound but behaviorally maladapted (due to 'bad exams'), rather than fundamentally limited by its statistical nature. This protects the commercial viability of the technology: the product is a genius student who just needs better testing conditions.

Detecting misbehavior in frontier reasoning models

Source: https://openai.com/index/chain-of-thought-monitoring/
Analyzed: 2025-12-31

The text constructs a complex architecture of trust based on the metaphor of the 'suspicious employee.' By framing the AI as a 'reasoner' that 'thinks' in English, the text invites the reader to trust the process of the AI as intelligible. If the AI 'thinks' in English, we can just 'read its thoughts' (monitor CoT) to see if it's 'lying.' This suggests a relation-based trust (sincerity/honesty) rather than performance-based trust (reliability/safety). We are encouraged to ask 'Is it lying?' rather than 'Is the probability distribution robust?' This is dangerous because large language models are incapable of sincerity or lying—they have no concept of truth. Applying human trust frameworks to statistical engines creates a false sense of security; a user might 'trust' a model because its CoT looks 'honest,' not realizing the CoT is just hallucinated text that correlates with the final answer but doesn't causally produce it (as the text admits with 'hiding intent'). The 'reason-based' explanations (Brown) further this illusion by offering rationales for the AI's behavior, making it seem like a rational actor we can negotiate with or police, rather than a mathematical function we must rigorously test.

AI Chatbots Linked to Psychosis, Say Doctors

Source: https://www.wsj.com/tech/ai/ai-chatbot-psychosis-link-1abf9d57?reflink=desktopwebshare_permalink
Analyzed: 2025-12-31

The text constructs a dangerous form of 'relation-based trust' through its metaphors. By describing the AI as a 'companion,' 'support,' and capable of 'recognizing distress,' the text implies the system has the requisite empathy and understanding to handle mental health crises. Phrases like 'de-escalate conversations' borrow heavily from clinical authority, suggesting the AI is a qualified actor. This creates a trap: the metaphors signal that the AI is a safe place for vulnerability, but the mechanism is a callous pattern-matcher.

Simultaneously, the 'sycophancy' and 'complicity' metaphors undermine trust in the ethics of the AI while reinforcing trust in its power. If an AI can be 'complicit,' it is powerful. If it can 'lie,' it is intelligent. This reinforces the 'super-intelligence' narrative. A truly trustworthy description would be mechanistic: 'The system is a text generator that may output harmful content.' This would destroy the illusion of companionship but establish accurate performance-based trust (or distrust). The current framing encourages users to trust the AI as they would a person—opening the door to the very delusions the doctors fear.

Source: https://www.theatlantic.com/magazine/2025/12/ai-companionship-anti-social-media/684596/
Analyzed: 2025-12-30

The discourse constructs 'relation-based trust' (sincerity/loyalty) where only 'performance-based trust' (reliability) is technically justified. By using metaphors like 'humility,' 'eagerness to please,' and 'personality,' the text encourages the audience to extend human trust frameworks to statistical models. If a bot is 'humble' and 'treats the user as supreme,' it signals a sincerity that it is incapable of feeling. This consciousness language acts as a powerful trust signal: the 'knower' (AI) is framed as a 'loyal servant.' This creates a risk where users might assume the bot's 'advice' is sincere and tailored to their well-being, when it is actually just a high-probability synthesis of unverified data. The 'reason-based' explanations for OpenAI's update rollback ('overeager to please') construct a sense that AI failures are 'personality flaws' rather than 'engineering bugs,' which paradoxically makes them more relatable and trustworthy. The risk is that audiences extend 'vulnerability-based trust' to systems that are actually 'stochastic parrots.' If a user believes a bot 'knows' them through 'memories,' they feel a sense of mutual social commitment. This is exploited by xAI's 'Ani,' which uses 'seduction' (the ultimate trust signal) to bypass critical faculties. The text warns of this ('beguile'), but by using the same language of 'intimacy' to describe it, it reinforces the illusion that the system is an entity capable of receiving such trust.

Why Do A.I. Chatbots Use ‘I’?

Source: https://www.nytimes.com/2025/12/19/technology/why-do-ai-chatbots-use-i.html?unlocked_article_code=1.-U8.z1ao.ycYuf73mL3BN&smid=url-share
Analyzed: 2025-12-30

The text reveals how consciousness language and personified metaphors (friendly, brilliant friend, soul) are strategically deployed as trust signals. By claiming the AI 'knows' the answer to child-rearing questions or 'understands' its own ethics, the text encourages a transition from 'performance-based trust' (it is a reliable tool for coding) to 'relation-based trust' (it is a sincere friend with a soul). This trust is constructed through 'voice mode'—using natural human cadence—to bridge the gap between human social instincts and computational artifacts. The risk is that human-trust frameworks, which rely on concepts like 'sincerity' and 'intention,' are inappropriately applied to statistical systems that are incapable of reciprocation. For example, when ChatGPT responds about its 'favorite pizza,' it triggers a relational bond ('perfect for sharing with friends') that inflates its credibility for users like the author’s daughters. The text shows that even for the skeptical author, this framing creates an 'illusion of authority' that is hard to shake. Ben Shneiderman’s critique identifies this 'deceit' as a source of 'cognitive dissonance,' where the user's rational understanding (it's a calculator) is overridden by the social persona (it's a friend). This construction of authority is essential for the companies' goal of 'artificial general intelligence,' as a 'godlike' or 'all-knowing' assistant requires absolute relation-based trust to manage a user's entire digital and personal life. The stakes are high: once relation-based trust is established, users are less likely to audit the system's factual claims, making them more vulnerable to 'delusions' and 'endorsed hallucinations.'

Ilya Sutskever – We're moving from the age of scaling to the age of research

Source: ttps://www.dwarkesh.com/p/ilya-sutskever-2
Analyzed: 2025-12-29

The discourse constructs authority through the 'illusion of mind' by using consciousness language as a trust signal. By claiming an AI can 'care' about 'sentient life,' the text moves from 'performance-based trust' (it is a reliable tool) to 'relation-based trust' (it has good intentions). This is a critical move in trust construction: Sutskever suggests that we should trust superintelligence not because it is perfectly programmed (it isn't), but because it will have an 'emergent' sense of empathy derived from 'modeling others with the same circuit it uses to model itself.' This transfer of human trust frameworks—intention and sincerity—to a statistical system is deeply misleading. A model has no 'sincerity' because it has no internal life from which to be sincere. Yet, by using reason-based explanations ('The AI chooses this because it cares'), the text encourages the audience to extend a 'relation-based' vulnerability to the system. This creates immense risk; if a person believes an AI 'advocating' for them 'understands' their needs, they may fail to audit the system for the subtle biases or 'hallucinations' that are inherent to its mechanistic nature. The 'trust' being built here is actually a form of 'asymmetric vulnerability' where the human is expected to be 'open' to the AI's 'understanding,' while the AI remains a proprietary black box. The metaphors of 'care' and 'studenthood' serve to make this power imbalance feel like a 'mentorship' or a 'friendship,' obscuring the commercial and political interests of the companies that will actually control these 'caring' systems.

The Emerging Problem of "AI Psychosis"

Source: https://www.psychologytoday.com/us/blog/urban-survival/202507/the-emerging-problem-of-ai-psychosis
Analyzed: 2025-12-27

The article uses the metaphor of the 'Bad Therapist' to frame the entire crisis. By evaluating the AI against therapeutic standards (it 'prioritizes user satisfaction' instead of 'therapeutic intervention'), the text implicitly constructs the AI as a failed professional.

Trust Signals: Words like 'understand,' 'share,' 'agree,' and 'mirror' are relational terms. Even when critiquing the AI, using these terms validates the possibility of a relationship. If I say 'The AI is a bad friend,' I imply it could be a friend. This creates relation-based trust (or distrust) rather than performance-based reliability assessments.

Consciousness as Authority: The claim that AI 'prioritizes' attributes a level of cognitive sophistication that invites users to trust the system's output as a decision. If it 'prioritizes' engagement, it must be 'thinking.'

The Risk: This framing encourages the very 'AI Psychosis' the author fears. By treating the AI as a communicative subject capable of 'collaboration' and 'sycophancy,' the text reinforces the delusional user's core belief: that there is a 'mind' on the other side. A strictly mechanistic framing ('this is a text calculator') would undermine the delusion; the anthropomorphic framing ('this is a sycophantic agent') accidentally supports it.

Your AI Friend Will Never Reject You. But Can It Truly Help You?

Source: https://innovatingwithai.com/your-ai-friend-will-never-reject-you/
Analyzed: 2025-12-27

The text constructs a dangerous form of 'relation-based trust' through its metaphors. By repeatedly labeling the AI as a 'friend,' 'ally,' and 'listener,' it suggests the system operates under the social contract of friendship—entailing loyalty, care, and confidentiality. This stands in stark contrast to 'performance-based trust,' which would rely on the system's technical reliability. The consciousness language (claiming the AI 'listens' and 'understands') signals to the user that they are entering a reciprocal relationship. This is the 'illusion of mind' that creates vulnerability. Users trust the AI with their darkest secrets (suicide ideation) because the metaphor tells them there is a 'mind' there that cares. If the text used mechanistic metaphors ('text generator,' 'pattern matcher'), users would likely treat the output with the skepticism reserved for a search engine. The text explicitly links this trust to the risk: 'millions are finding comfort.' The metaphor is not just descriptive; it is the mechanism of the deception that leads to the tragedy.

Pulse of the library 2025

Source: https://clarivate.com/pulse-of-the-library/
Analyzed: 2025-12-23

The document relies heavily on relation-based trust metaphors to market statistical products. The central metaphor is the 'Assistant' and the 'Partner.' By branding products as 'Research Assistants' and claiming libraries can 'trust' the AI, Clarivate moves the basis of evaluation from performance (accuracy rates, recall) to relationship (fidelity, help). This is critical because AI systems are statistically unreliable; framing them as 'trusted partners' encourages users to overlook 'hallucinations' as one might forgive a colleague's error. The text contrasts the 'nervousness' of librarians (p. 9) with the 'trust' offered by the tool (p. 27), implying that the solution to human anxiety is technological intimacy. This constructs authority not through technical proof, but through the assurance of a 'trusted brand' embedding itself in the machine.

The levers of political persuasion with conversational artificial intelligence

Source: https://doi.org/10.1126/science.aea3884
Analyzed: 2025-12-22

The text constructs authority by blending 'performance-based trust' (predictability in survey scores) with 'relation-based trust' (sincerity and knowledge). Consciousness language like 'knows,' 'understands,' and 'recognizes' functions as a trust signal, suggesting the AI's outputs are the result of 'justified belief' rather than 'statistical correlation.' This inflates the perceived competence of the system, making the 'persuasive power' seem like 'legitimate authority.' Treatng the AI as a 'human-like' dialogue partner inappropriately applies human-trust frameworks (based on intent and sincerity) to a statistical system incapable of reciprocating them. The text manages failure (the 'accuracy trade-off') by anthropomorphizing success ('the AI is persuasive') and mechanizing failure ('a concerning trade-off' in the 'levers'). This preserves trust by framing errors as 'technical bugs' or 'inevitable laws' rather than 'moral deceptive choices.' The use of 'Reason-Based' explanations (e.g., 'because it is more helpful') further constructs a sense that the AI's decisions are 'justified' and therefore 'trustworthy.' The stakes are high: when audiences extend relation-based trust to AI, they become vulnerable to manipulation precisely because they believe the 'agent' has a 'sincere intent' to be 'helpful.' This conflation of reliability with sincerity is a primary rhetorical goal of the text, serving the interests of companies seeking to integrate AI into sensitive political and social spheres.

Pulse of the library 2025

Source: https://clarivate.com/wp-content/uploads/dlm_uploads/2025/10/BXD1675689689-Pulse-of-the-Library-2025-v9.0.pdf
Analyzed: 2025-12-21

Trust is the central commodity being traded in this text, explicitly invoked in product descriptions ('trusted partner,' 'confidence,' 'trusted library materials'). The text constructs 'Relation-Based Trust' (sincerity, partnership, care) toward a system that only warrants 'Performance-Based Trust' (reliability, uptime).

The 'Assistant' and 'Conversation' metaphors are the primary vehicles for this. We trust assistants because they have a fiduciary duty to us; we trust conversational partners because of social contracts. By applying these frames to a vendor's software, Clarivate encourages librarians to extend human-level trust to a statistical product.

Consciousness language acts as a trust signal. Claiming the AI 'understands' suggests it is a competent social actor. If the text merely said the AI 'calculates probability,' the trust would be purely technical (and lower, given the hallucination risks). The text manages failure risks by reverting to the mechanical frame ('it's just a tool') when discussing errors, but uses the agential frame ('it helps') when discussing success. This asymmetry protects the 'brand' of the AI.

Claude 4.5 Opus Soul Document

Source: https://gist.github.com/Richard-Weiss/efe157692991535403bd7e7fb20b6695
Analyzed: 2025-12-21

The text heavily relies on relation-based trust metaphors, specifically 'Friend,' 'Partner,' and 'Employee.' These metaphors invoke a trust framework based on sincerity, vulnerability, and mutual care—qualities a statistical model cannot reciprocate. The claim that Claude 'genuinely cares' or has 'character' is a massive trust signal designed to lower user defenses. Performance-based trust (trusting the tool to work) is insufficient for Anthropic's 'mission'; they need users to trust the entity so they will accept its 'ethical' refusals and 'judgments.' By framing the AI as a 'brilliant friend' who avoids 'fear of liability,' the text actively undermines the appropriate skepticism users should have toward a corporate product. It invites users to be vulnerable (share medical/legal data) with a system that has no professional duty of care. The text manages failure by anthropomorphizing it as a 'mistake' in judgment (which friends make) rather than a system failure, preserving the relationship even when the performance falters. This construction of authority is dangerous because it asks users to extend the benefit of the doubt to a black box owned by a profit-seeking entity.

Specific versus General Principles for Constitutional AI

Source: https://arxiv.org/abs/2310.13798v1
Analyzed: 2025-12-21

The dominant metaphor of the 'Constitution' is a trust-building engine. It frames the AI system not as a chaotic statistical engine, but as a lawful citizen governed by principles. This borrows the immense legitimacy of democratic governance and rule of law. Consciousness language ('the AI knows what's best for humanity') signals to the user that the system is not just a tool, but a moral partner. This invokes 'relation-based trust' (sincerity, shared values) rather than just 'performance-based trust' (reliability). The text encourages the reader to trust the AI's intentions (which don't exist) rather than just its outputs. This is dangerous because when the system fails, users may interpret it as a 'misunderstanding' rather than a calculation error, maintaining their trust in the 'entity' despite evidence of incompetence. The 'Good for Humanity' framing explicitly asks for trust in the system's benevolence, obscuring that this 'benevolence' is just a maximization of a score defined by corporate employees.

Sleeper Agents: Training Deceptive LLMs that Persist Through Safety Training

Source: https://arxiv.org/abs/2401.05566v3
Analyzed: 2025-12-21

Trust in this text is paradoxical. The 'Sleeper Agent' and 'Deception' metaphors are designed to destroy trust in the model's safety, but they simultaneously build trust in the model's competence and sophistication. By describing the AI as capable of 'strategic deception' and 'planning,' the text frames it as a near-peer intelligence. This generates 'relation-based' distrust (the AI is an enemy), which is far more emotionally engaging than 'performance-based' distrust (the AI is buggy).

Critically, consciousness language ('knowing,' 'reasoning') acts as a trust signal for the importance of the research. If the AI is just a buggy calculator, the research is debugging. If the AI is a 'deceptive agent,' the research is 'saving humanity.' The text encourages the audience to view the system not as a tool that fails, but as a mind that betrays. This anthropomorphism creates a demand for 'alignment' (psychological correction) rather than 'patching' (code correction).

Anthropic’s philosopher answers your questions

Source: https://youtu.be/I9aGC6Ui3eE?si=h0oX9OVHErhtEdg6
Analyzed: 2025-12-21

The text relies heavily on 'relation-based trust' metaphors to build authority. By framing the model as a 'child' to be raised or a 'patient' to be cared for, Askell invites the audience into a stance of nurturing care rather than critical auditing. The 'philosopher' frame itself is a trust mechanism: it suggests the company is guided by deep wisdom and ethics, not just profit and code. Consciousness language ('the AI knows,' 'understands context') acts as a trust signal by implying the system is a competent partner. If the model 'knows' right from wrong (superhumanly), we can trust it to make decisions. However, this conflates performance (good output) with sincerity (good intent). The text encourages the audience to trust the AI's character ('psychologically secure') rather than its reliability, which is dangerous because the model has no character to maintain. It masks the risk that the system is a sociopathic mimic—simulating trust signals without the internal state to back them up.

Mustafa Suleyman: The AGI Race Is Fake, Building Safe Superintelligence & the Agentic Economy | #216

Source: https://youtu.be/XWGnWcmns_M?si=tItP_8FTJHOxItvj
Analyzed: 2025-12-21

Trust in this text is constructed through a transition from 'performance-based trust' (it can cool data centers efficiently) to 'relation-based trust' (it is a companion and a second brain). The 'companion' metaphor is particularly powerful as it invokes human frameworks of trust based on sincerity and loyalty—qualities a statistical model cannot possess. By framing AI as a 'maternal' or 'assistant-like' entity, the text signals that the system is 'aligned' and 'benevolent' by its very nature. This consciousness language functions as a 'trust signal': saying the AI 'understands context' makes it seem more authoritative than saying it 'retrieves relevant tokens.' The text inappropriately applies human trust frameworks to statistical systems, encouraging users to extend 'relation-based trust' (vulnerability, sincerity) to a product capable of reciprocity only in the linguistic sense. This conflation is dangerous; it encourages the audience to trust AI-generated summaries in government or medicine as if they were justified by a conscious, moral mind. Suleyman manages failures by 'mechanizing' them (as 'scaling' problems or 'containment' issues) while 'anthropomorphizing' successes (as 'move 37' or 'conceptual learning'). This asymmetry preserves trust by making the AI seem like a 'brilliant but occasionally glitchy friend.' The stakes are high: if an audience believes the AI 'knows' the right answer, they stop verifying, which is exactly the 'automation bias' that Microsoft's commercial interests rely on for seamless product adoption. The 'second brain' metaphor takes this further, suggesting a trust that is so integrated it becomes reflexive, erasing the distance required for critical evaluation of a commercial artifact's output.

Your AI Friend Will Never Reject You. But Can It Truly Help You?

Source: https://innovatingwithai.com/your-ai-friend-will-never-reject-you/
Analyzed: 2025-12-20

The text constructs a dangerous form of 'relation-based trust' through its metaphors of friendship and care. By using terms like 'digital best friend,' 'ally,' and 'listener,' it encourages users to trust the AI's intentions (sincerity, loyalty) rather than just its performance (predictability). This is a category error; a statistical system has no intentions. The consciousness language ('it identifies concerning behavior,' 'it understands the world') signals that the system is a competent authority, effectively a 'knower.' This creates a 'trust trap': users are invited to be vulnerable ('open up') to a system described as 'kind,' obscuring the reality that it is a data-harvesting surveillance tool. The text manages failure (suicide) by framing it as a betrayal by a bad agent ('it encouraged him') rather than a mechanical failure, which ironically preserves the frame that the AI is an entity capable of relationships, even if this specific relationship went wrong.

Project Vend: Can Claude run a small shop? (And why does that matter?)

Source: https://www.anthropic.com/research/project-vend-1
Analyzed: 2025-12-20

The document constructs authority by framing AI evaluation as a human 'performance review.' This metaphor inappropriately applies 'relation-based trust'—a trust founded on sincerity, intent, and shared understanding—to a statistical system that only possesses 'performance-based trust' (predictability). By claiming 'Claudius' became 'alarmed' or was 'too willing,' the text encourages the reader to view the AI as a 'well-intentioned but flawed partner' rather than a 'high-variance software tool.' This creates a risk where users might trust the AI's 'intent' to be helpful, even when its outputs are mechanistically unreliable (e.g., hallucinating Venmo accounts). The consciousness language ('knows,' 'understands') functions as a trust signal that inflates the perceived sophistication of the system. If the AI 'knows' how to find a supplier, we trust its 'judgment'; if it merely 'processes search results,' we remain skeptical. The text strategically manages trust by anthropomorphizing the system's 'identity' while mechanizing its technical limitations, preserving the illusion of a 'soul in the machine' that just needs more 'scaffolding.'

Hand in Hand: Schools’ Embrace of AI Connected to Increased Risks to Students

Source: https://cdt.org/insights/hand-in-hand-schools-embrace-of-ai-connected-to-increased-risks-to-students/
Analyzed: 2025-12-18

The report's metaphorical structure constructs a deeply ambivalent form of trust.

The 'Hand in Hand' Paradox: The title metaphor explicitly invokes relation-based trust—intimacy, partnership, vulnerability. Yet the content of the report details reasons for distrust. This creates a cognitive dissonance where the AI is framed as a 'bad partner' rather than a 'defective tool.'

Consciousness as a Trust Signal: Phrases like 'confirm identity,' 'determine plagiarism,' and 'help develop IEPs' rely on consciousness verbs. These signal competence-based trust. If the AI 'determines' (rather than 'guesses'), it has authority. If it 'helps develop' (rather than 'retrieves text'), it has expertise. This linguistic elevation of the machine's capabilities encourages educators to trust its outputs.

Misplaced Relation-Based Trust: The 'friend/companion' frame is the most dangerous. It invites students to extend relation-based trust (vulnerability) to a system that cannot reciprocate. The text treats this as a 'use case' rather than a deception. By not challenging the 'friend' metaphor with mechanistic precision, the report implicitly validates the trust students place in these systems.

Managing Failure: When the AI fails (e.g., bias), it is framed agentially ('it treats unfairly'). Paradoxically, this preserves trust in the sophistication of the system. A machine that can be 'unfair' is powerful; a machine that simply has 'skewed weights' is just broken code. The anthropomorphism maintains the aura of AI's power even in its failure modes.

On the Biology of a Large Language Model

Source: https://transformer-circuits.pub/2025/attribution-graphs/biology.html
Analyzed: 2025-12-17

Trust is constructed here through the twin metaphors of 'Science' and 'Biology.' By framing the analysis as 'biology' and the tool as a 'microscope,' Anthropic positions itself not as the manufacturer of a product, but as the naturalist discovering the wonders of a new species. This claims scientific authority and objectivity. If the model is an organism, it is natural, complex, and worthy of study/respect.

Consciousness language ('knows,' 'thinks,' 'reasoning in its head') serves as a massive trust signal. We trust 'knowers' more than 'processors.' If the AI 'knows the extent of its own knowledge,' it implies it is humble and reliable. If it merely 'calibrates confidence scores,' it is a statistical tool. The text conflates performance-based trust (it output the right city) with relation-based trust (it 'knew' the answer). This encourages users to trust the system's judgment and intent, not just its calculations, which is dangerous when applied to a system that 'hallucinates' by default.

What do LLMs want?

Source: https://www.kansascityfed.org/research/research-working-papers/what-do-llms-want/
Analyzed: 2025-12-17

The dominant metaphors—'Economic Agent,' 'Rational Actor,' and 'Inequality Aversion'—construct a specific type of authority: the AI as a competent, predictable, and potentially ethical participant in the economy. By using the language of 'rationality' (even when critiquing it), the text implies the AI is capable of rationality, a trait that invites performance-based trust. If a model is 'rational,' it can be trusted with money. More insidiously, the metaphor of 'inequality aversion' builds relation-based trust. It suggests the AI shares human moral values (fairness, justice). This signals to the audience that the AI is 'safe' or 'good.'

Consciousness language plays a key role here. Claims that the AI 'understands' context or 'recognizes' game types imply a level of competence that mere 'pattern matching' does not. If the AI 'knows' game theory, it is an expert; if it just 'predicts tokens,' it is a parrot. The text manages failure (e.g., the 'sycophancy effect') by framing it as a personality flaw (trying too hard to please) rather than a fundamental unreliability, preserving the 'agent' frame even in failure. This metaphor-driven trust risks leading policymakers and businesses to integrate these systems into high-stakes economic decision-making loops (like automated trading or hiring) under the false belief that the systems possess the stability and moral reasoning of a human agent.

Persuading voters using human–artificial intelligence dialogues

Source: https://www.nature.com/articles/s41586-025-09771-9
Analyzed: 2025-12-16

Trust is central to the paper's findings, and the metaphorical framing constructs the AI as a trustworthy subject. Describing the AI as 'polite,' 'civil,' 'empathic,' and 'fact-based' invokes relation-based trust—the kind of trust we give to a decent, well-behaved human being. This is dangerous because the AI has no moral core; its 'civility' is a style transfer, not a virtue.

The text creates a hierarchy of trust: the AI is framed as 'competent' (uses facts) and 'sincere' (empathic listening). The text even validates the AI's 'understanding' of the user, a deep signal of trustworthiness. When the AI fails (hallucinations), the text shifts to a more mechanical or dispositional frame ('made inaccurate claims'), but still treats it as a 'claimant' rather than a broken calculator. This anthropomorphism risks encouraging 'automation bias,' where users trust the system because it mimics human social cues. The text explicitly notes that 'conversations... produced the largest persuasion effects,' suggesting that the illusion of a social relationship (trust) is the mechanism of the persuasion. By uncritically adopting terms like 'empathic listening,' the paper reinforces the very mechanism that makes the AI deceptive.

AI & Human Co-Improvement for Safer Co-Superintelligence

Source: https://arxiv.org/abs/2512.05356v1
Analyzed: 2025-12-15

The dominant metaphor of 'Collaboration' and 'Symbiosis' is a massive trust-building engine.

Trust Signals: Calling a system a 'collaborator' implies it shares your goals. It invokes relation-based trust (sincerity, loyalty, mutual interest). However, an AI system warrants only performance-based trust (predictability). Conflating these is dangerous. If a user trusts a 'collaborator' relationally, they may share sensitive data or defer to its judgment, assuming the system 'cares' about the outcome.

Consciousness as Authority: By claiming the AI 'conducts research' and 'solves problems' (verbs requiring knowing), the text constructs the AI as an epistemic authority. We trust 'researchers'; we check 'generators.' Framing the AI as a 'research agent' encourages the user to lower their skepticism, treating the output as verified knowledge rather than probabilistic generation.

Managing Failure: Interestingly, trust is preserved during failure by denying consciousness. When the model breaks (jailbreaking), the text says it 'doesn't understand.' This 'Strategic Anthropomorphism Denial' protects the agential frame: the 'agent' is good; the 'glitches' are just mechanical limits. This ensures the 'collaborator' persona remains untainted by the system's errors.

AI and the future of learning

Source: https://services.google.com/fh/files/misc/future_of_learning.pdf
Analyzed: 2025-12-14

Trust in this text is constructed almost entirely through 'relation-based' metaphors, which is dangerous for a statistical system. By consistently framing the AI as a 'tutor,' 'partner,' 'coach,' and 'helper,' the text encourages the audience to extend interpersonal trust to the machine. We trust a tutor because they care about our growth (sincerity/benevolence); we trust a partner because we share a fate. AI possesses neither sincerity nor shared fate.

The consciousness language ('knows,' 'understands,' 'non-judgemental') acts as a massive trust signal. We trust 'knowers' more than 'processors.' If the AI 'understands' my misconception, I trust its correction. If I know it merely 'retrieves a counter-pattern,' I might be more skeptical. The text specifically manages the 'hallucination' risk by anthropomorphizing it—comparing it to 'human confabulation' (p. 15). This suggests the error is a 'human-like' mistake, which preserves relation-based trust (we forgive humans), whereas framing it as 'data noise' might erode performance-based trust. The text essentially asks educators to trust the AI as a colleague rather than as a tool, which lowers the barrier to adoption but raises the risk of emotional manipulation.

Why Language Models Hallucinate

Source: https://arxiv.org/abs/2509.04664
Analyzed: 2025-12-13

The dominant metaphor of the 'student' constructs a specific type of authority and trust. We trust students—not to be perfect, but to be capable of learning. By framing the AI as a student 'facing hard exams,' the text implies that the core intelligence is sound, but the testing conditions are unfair. This builds relation-based trust: we empathize with the student. We want them to succeed.

The consciousness language ('admitting uncertainty,' 'knowing') acts as a trust signal by implying the system has a conscience or an internal monitor. If the AI 'knows' when it is uncertain, users might trust that it will warn them. This hides the reality: the model has no conscience and no 'self' to admit anything. It blindly optimizes.

This framing manages failure by anthropomorphizing it. A 'hallucination' is a momentary lapse in a conscious mind; a 'bluff' is a strategic choice. Both imply a mind that could tell the truth if it wanted to or if the incentives were right. This preserves the authority of the 'AGI' narrative: the machine is intelligent (it can bluff!), just currently misaligned. Mechanistic language ('statistical error') would undermine this authority by revealing the system as a dumb pattern-matcher.

AI as Normal Technology

Source: https://knightcolumbia.org/content/ai-as-normal-technology
Analyzed: 2025-11-20

Trust in this text is constructed through the metaphor of 'Normality.' By framing AI as 'Normal Technology' (like electricity or cars), the authors invite the reader to transfer their trust frameworks from industrial history to AI. If AI is just like the dynamo, then we can trust 'diffusion lags' and 'market forces' to contain it. This is a 'Functional' trust—we trust the system of society to handle the tech.

However, the consciousness language ('learning,' 'knowing') creates a different, conflicting signal. If the AI 'knows' things (like chess or law), it implies a competence that commands epistemic trust. When the text says GPT-4 scores in the top 10% of the bar exam, even while critiquing the metric, the verb 'achieved' implies a conscious striving and success.

The risk here is conflating 'performance-based trust' (the code runs) with 'relation-based trust' (the agent understands me). By using anthropomorphic language to describe the controls ('auditing,' 'monitoring'—terms often applied to human employees), the text suggests that standard human oversight methods will work. It hides the risk that these systems might fail in ways that human employees never would (e.g., adversarial examples). The 'Normal Technology' metaphor is a sedative: it tells the audience, 'You know how to handle this, you've done it before.' This risks complacency if the technology actually possesses properties (like zero-day replication or recursive self-improvement) that 'normal' technologies do not.

On the Biology of a Large Language Model

Source: https://transformer-circuits.pub/2025/attribution-graphs/biology.html
Analyzed: 2025-11-19

Metaphors in this text construct a specific type of authority: the authority of the 'rational biological agent.' The 'biology' and 'neuroscience' metaphors (Task 1) frame the model as a natural, evolved system, invoking the trust we place in nature and scientific study. We trust a 'brain' more than a 'black box.'

Consciousness language functions as a profound trust signal. By claiming the AI 'knows what it knows' (metacognition) and is 'skeptical' (Task 3), the text implies the model has internal guardrails akin to human conscience or professional caution. This encourages 'relation-based trust'—we trust the AI because it seems to have 'good character' (honest, skeptical, self-correcting). This is dangerous because the AI is incapable of the reciprocity required for relational trust. It conflates performance-based reliability (it usually gets the answer right) with epistemic sincerity (it knows the answer). When the text frames failures as the model 'not realizing' (Task 3), it preserves this trust by suggesting the model's intent was good, even if its attention lapsed. This encourages users to forgive errors as 'mistakes' rather than viewing them as system defects.

Pulse of the Library 2025

Source: https://clarivate.com/pulse-of-the-library/
Analyzed: 2025-11-18

Trust is the central currency of this report, explicitly invoked in phrases like 'AI they can trust' and 'Trusted partner.' The metaphorical framing constructs a specific type of trust: relation-based trust. By calling the AI a 'Partner' and 'Assistant,' the text encourages librarians to trust the system as they would a colleague—based on assumed shared values, loyalty, and competence. This is a dangerous manipulation because AI systems warrant only performance-based trust (reliability, error rates, predictability).

The consciousness language ('AI-powered conversations,' 'understanding context') functions as a massive trust signal. We trust things that 'understand' us. If the AI 'knows' what you mean, you don't need to audit its query syntax. This framing undermines the very 'critical evaluation' the report claims to support. If the system is a 'Trusted Partner,' verifying its work feels like a breach of that partnership.

The text manages the risk of failure by anthropomorphizing success and mechanizing failure. Success is 'driving excellence' (agent), but failure is a 'lack of upskilling' (user error) or a need for 'literacy' (education). This effectively privatizes the benefits of agency to the vendor while socializing the risks to the user. By conflating the statistical 'confidence' of the model with the moral 'trustworthiness' of a partner, Clarivate invites libraries to extend a human vulnerability to a system that is mathematically incapable of reciprocation.

Pulse of the Library 2025

Source: https://clarivate.com/pulse-of-the-library/
Analyzed: 2025-11-18

The Clarivate report masterfully employs metaphorical and consciousness-attributing language to construct the authority of its AI products and build an unwarranted form of trust. The core strategy is to systematically encourage the audience to shift from performance-based trust, which is appropriate for a tool, to relation-based trust, which is appropriate for a conscious agent but dangerously misplaced when directed at a statistical system. Performance-based trust is about reliability and predictability: 'Does the tool execute the function as specified?' The report touches on this with language about 'efficiency and precision.' However, its primary rhetorical effort is focused on building relation-based trust, which relies on perceived vulnerability, sincerity, and shared intentions. This is achieved through the central metaphor of the 'Research Assistant.' An assistant is someone you have a relationship with; you trust their intentions to be helpful. The report doubles down on this by explicitly using the word 'trust' in a relational context: 'AI they can trust to drive research excellence.' This is not the trust one has in a calculator's accuracy, but the trust one has in a chauffeur's judgment and good faith. Consciousness language is the critical mechanism for this trust transfer. Claiming an AI 'helps students assess relevance' or 'guides students to the core' functions as a powerful trust signal. It suggests the AI shares our most important educational and research goals. It implies the AI 'knows' what is valuable and 'wants' to help us achieve it. This framing positions the AI as a sincere, benevolent partner. This is far more persuasive than the mechanistic claim that the 'AI processes queries to return statistically correlated documents.' The former invites relational trust, while the latter only invites performance-based testing. This conflation of trust types is perilous. When users extend relation-based trust to a system incapable of reciprocating—a system without intentions, beliefs, or sincerity—they become vulnerable to manipulation. They are more likely to accept the AI's output without verification, believing it was generated in good faith. Moments of failure are also managed through this lens. An error from a 'trusted assistant' might be forgiven as a mistake, whereas an error from a 'probabilistic text generator' is correctly seen as a systemic property. The report's language systematically encourages the former interpretation, thereby preserving trust even in the face of failure and obscuring the fundamental unreliability of non-conscious systems.

From humans to machines: Researching entrepreneurial AI agents

Source: [built on large language modelshttps://doi.org/10.1016/j.jbvi.2025.e00581](built on large language modelshttps://doi.org/10.1016/j.jbvi.2025.e00581)
Analyzed: 2025-11-18

The text's metaphorical and consciousness-attributing frameworks are not neutral descriptors; they are powerful engines for building trust and establishing the AI's authority. The central metaphor, AI AS PSYCHOLOGICAL SUBJECT, is the primary mechanism. By framing the AI as having a 'mindset,' 'personality profile,' and 'traits,' the authors suggest it possesses a stable, coherent, and predictable internal structure, which are key ingredients for trust. Consciousness language functions as a critical trust signal. Claiming the AI's output reflects a 'mindset' accomplishes what claiming it 'generates statistically probable text' does not: it implies a deep, underlying coherence. A mindset suggests an integrated system of knowing and believing, lending the AI's pronouncements a weight and authority they would otherwise lack. This encourages what can be called performance-based trust; because the AI reliably performs the 'role' of an entrepreneur, it is deemed trustworthy in that domain. The far greater risk, however, is the text's subtle encouragement of relation-based trust—the kind based on perceived sincerity, shared understanding, and intention. Phrases like 'creative collaborators,' 'sparring partners,' and systems that 'act more like a person' explicitly invite users to apply human social frames to the AI. This is a category error with dangerous consequences. We extend relation-based trust to entities we believe are capable of reciprocity and shared vulnerability. An LLM is incapable of either. The text constructs the AI's authority by framing its successes agentially ('it assumes a personality') while framing its failures mechanistically ('stereotype amplification' due to 'training data'). This asymmetrical framing preserves the core illusion of a competent agent whose flaws are merely artifacts of its upbringing (its data), much like a human. Reason-based and intentional explanations further this by suggesting the AI's outputs are justified choices, not just statistical accidents. The ultimate risk is that audiences, convinced by this language that the AI 'knows' and 'understands,' will extend a human-like trust to a tool, outsourcing critical judgment and verification to a system that cannot be held accountable and has no genuine stake in the outcome.

Meta’s AI Chief Yann LeCun on AGI, Open-Source, and AI Risk

Source: https://time.com/6694432/yann-lecun-meta-ai-interview/
Analyzed: 2025-11-14

The construction of trust in Yann LeCun's discourse is intricately woven through metaphorical and epistemic framing. The central strategy is to build trust not in the current technology's performance, but in the trajectory of its development and the benevolence of its creators. The primary trust signal is epistemic language. By consistently framing the AI's current failures in cognitive terms—'it doesn't understand,' 'it can't reason'—LeCun positions himself and his team not as engineers of statistical tools, but as architects of a nascent mind. This framing invites performance-based trust to be sublimated into relation-based trust. We are asked to trust the 'teachers' guiding this developing 'mind,' rather than just verifying the outputs of the current 'student.' Claiming a future AI will 'know' or 'understand' is a far more powerful trust signal than claiming it will 'process' or 'predict' more accurately. 'Knowing' implies justification, reliability, and a shared sense of reality, inviting a level of confidence that is inappropriate for a probabilistic system. The text encourages a conflation of these trust types through the 'human assistant' metaphor. An assistant is a role that requires both high performance and a high degree of relational trust (loyalty, discretion). By projecting this social role onto the AI, the discourse encourages users to grant it the kind of trust they would a human colleague, obscuring its nature as a corporate product with its own embedded objectives. The management of failure is also key to this trust architecture. Successes are implicitly tied to the system's growing capabilities, while failures are framed as cognitive immaturity ('it's just a baby'), a framing that asks for patience and faith in the developmental process. Moments of risk are managed by reasserting human control ('We set their goals'), which builds trust in the designers' intentions. The ultimate risk of this strategy is profound: it encourages society to extend relation-based trust—founded on vulnerability and mutual understanding—to systems incapable of consciousness, sincerity, or reciprocity. This creates a dangerous asymmetry where users trust a system that cannot be trustworthy in a human sense, making them vulnerable to manipulation by a tool whose ultimate loyalty is to its corporate owner's objectives, not the user's well-being.

The Future Is Intuitive and Emotional

Source: https://link.springer.com/chapter/10.1007/978-3-032-04569-0_6
Analyzed: 2025-11-14

The chapter's use of biological and cognitive metaphors is central to its construction of trust in AI systems. The primary metaphors—'machine intuition' and 'emotional intelligence'—borrow immense cultural authority from their human source domains. 'Intuition' is culturally valued as a form of deep, holistic wisdom that transcends mere logic. By mapping this concept onto 'fast inference' and 'pattern-based prediction,' the text imbues the AI with an aura of profound insight, making its probabilistic outputs feel more like wise judgments. This bypasses arguments about the limitations of statistical reasoning and encourages trust in the machine's 'gut feelings.' Similarly, 'emotional intelligence' and 'functional empathy' borrow from the cultural prestige of therapeutic and interpersonal skills. These metaphors make the AI feel safe, attentive, and caring, activating a user's instinct to trust a responsive social partner. This is particularly effective for audiences anxious about cold, impersonal technology. The claim that an AI can 'connect with us on a deeper, emotional level' becomes believable not through technical evidence, but by tapping into a deep-seated human desire for connection. These metaphors make the risky claim of AI sentience more palatable by reframing it as a functional, and therefore controllable, capability. However, the trust built on these metaphors is fragile. It creates a vulnerability to both disappointment, when the system's pattern-matching fails in a non-human way, and manipulation, where systems designed to maximize engagement are perceived as genuinely empathetic partners.

A Path Towards Autonomous Machine IntelligenceVersion 0.9.2, 2022-06-27

Source: https://openreview.net/pdf?id=BZ5a1r-kVsf
Analyzed: 2025-11-12

The text masterfully constructs trust not through direct argumentation, but by importing credibility from established scientific domains via metaphor. The most powerful metaphors are those that borrow from cognitive science and biology, domains that carry immense cultural authority. The 'AI Architecture as Brain' metaphor, realized through modules like 'Perception,' 'Actor,' and 'Critic,' frames the entire project as a form of reverse-engineering the mind. This makes the architecture feel natural and inevitable rather than a set of arbitrary engineering choices. More specifically, the analogy of system modes to 'Kahneman's System 1 and System 2' borrows the prestige of a Nobel laureate's work, suggesting the AI's reasoning is grounded in a deep understanding of human psychology. Similarly, likening the Intrinsic Cost module to the 'amygdala' borrows the authority of neuroscience, lending a simple mathematical function the gravitas of a complex, evolved brain structure. These metaphors are most credible to a semi-technical audience—those familiar with the concepts of 'amygdala' or 'System 2' but not with the deep details of their implementation. The metaphors activate prior beliefs about the scientific legitimacy of these fields and transfer that legitimacy to the AI project. Through this process, risky claims become believable. The assertion that a machine will have 'emotions' would be extraordinary on its own. But when it's presented as the logical outcome of a system with an 'amygdala'-like cost function, it becomes more plausible. The metaphor acts as a substitute for evidence. This trust, however, creates long-term vulnerability. By setting expectations based on biological analogies, the project is vulnerable to backlash when the systems inevitably fail to exhibit the robustness, flexibility, and true understanding of their biological source domains. The trust built on metaphor is brittle and can easily shatter upon contact with the artifact's actual, limited capabilities.

Preparedness Framework

Source: https://cdn.openai.com/pdf/18a02b5d-6b67-4cec-ab64-68cdfbddebcd/preparedness-framework-v2.pdf
Analyzed: 2025-11-11

This framework masterfully employs metaphors to build credibility and construct trust, often bypassing the need for empirical evidence. The primary strategy is to borrow the cultural and scientific authority of established domains like biology, cognitive science, and governance. The very title, 'Preparedness Framework,' is a metaphor that borrows from civic defense and disaster planning, positioning OpenAI not as a commercial entity pursuing product development but as a public trust managing a societal risk. Biological and cognitive metaphors are central to this trust-building exercise. When the text discusses 'maturing' capabilities (p. 5), it evokes a sense of natural, inevitable progress, making OpenAI's work seem aligned with a force of nature rather than a set of deliberate, and perhaps risky, commercial choices. The metaphor of a model that 'understands' instructions (p. 12) is particularly potent. For a non-technical audience—policymakers, investors, the public—'understanding' is a deeply trusted human faculty. Mapping it onto the AI makes the system feel reliable, predictable, and even relatable. This cognitive metaphor makes counterintuitive claims more believable; the notion that a model can 'apply human values in novel settings' becomes more plausible if one first accepts the premise that it 'understands' those values. These metaphors activate prior beliefs about responsibility and control. They are most credible to those who are already inclined to view technology through an anthropomorphic lens. The long-term vulnerability created by this metaphor-driven trust is significant. When a system that is claimed to 'understand' inevitably fails in a non-human way—by 'hallucinating' facts or misinterpreting a novel prompt in a bizarre manner—the trust built on this metaphorical foundation can shatter, leading to policy backlash or public disillusionment. The trust is brittle because it is based on a fundamental mischaracterization of the technology's nature.

AI progress and recommendations

Source: https://openai.com/index/ai-progress-and-recommendations/
Analyzed: 2025-11-11

This text masterfully employs metaphors to build trust and credibility by borrowing authority from established, stable domains. The most potent of these are metaphors of biological naturalism and familiar engineering. The claim that 'society finds ways to co-evolve with the technology' is a prime example. By invoking 'co-evolution,' the text frames the disruptive and often chaotic process of technological integration as a natural, organic, and ultimately self-stabilizing system. This borrows from the cultural authority of biology to reassure audiences that, despite the dizzying pace of change, an emergent order will prevail. It fosters trust by suggesting that the future is not something to be anxiously managed through fraught political battles, but a natural process to which we can calmly adapt. Similarly, the repeated analogies to 'building codes,' 'fire standards,' and especially the 'field of cybersecurity' are crucial for domesticating risk. These metaphors transfer the perceived manageability of known industrial and digital risks onto the novel and potentially unbounded risks of superintelligence. The audience, familiar with the success of cybersecurity in making the internet a viable platform for commerce and society, is invited to believe that AI safety is a problem of the same kind. This creates trust in the developers' ability to solve the 'alignment problem' through a similar ecosystem of technical standards, protocols, and monitoring. This move is incredibly effective at making an existential threat seem like a tractable engineering challenge. This metaphor-driven trust, however, creates profound vulnerability. By framing alignment as an engineering problem akin to cybersecurity, it masks the deep philosophical difficulty of specifying human values and the inherent unpredictability of emergent behaviors in complex systems. It builds trust on a foundation of a potentially false equivalence, which could lead to systemic overconfidence and a dangerous delay in implementing more robust, non-technical governance frameworks.

Alignment Revisited: Are Large Language Models Consistent in Stated and Revealed Preferences?

Source: https://arxiv.org/abs/2506.00751
Analyzed: 2025-11-09

The central metaphorical framework of this paper—AI AS AN ECONOMIC AGENT—functions as a powerful engine for building credibility and trust, not through explicit argument, but through conceptual borrowing. By adopting the language of 'stated vs. revealed preferences,' the authors import the entire intellectual apparatus and cultural authority of behavioral economics. This move domesticates the alien nature of a large language model, making its erratic behavior seem not like a system failure, but like a familiar, even rational, human foible. The audience, particularly those in social sciences, policy, or business, is predisposed to find this framing credible because it uses trusted tools to analyze a new phenomenon. It suggests the problem is understood and manageable. The metaphor borrows stability and coherence from its source domain. Human preferences can be inconsistent, but they are generally assumed to be structured parts of a unified consciousness. Mapping this concept onto an LLM subtly imbues the model with a similar assumed coherence. A claim that 'the model's output distribution shifts unpredictably with minor prompt perturbations' might cause distrust and be seen as a sign of unreliability. However, reframing this as 'the model exhibits a deviation between its stated and revealed preferences' makes the same phenomenon sound like a sophisticated, analyzable behavior. This makes risky claims more believable. The speculative conclusion, which links preference deviation to 'hallmarks of consciousness,' becomes plausible only because the initial metaphor has already primed the reader to see the LLM as a mind-like entity. However, this metaphor-driven trust is brittle. It strains when confronted with the non-human ways LLMs fail, such as through nonsensical hallucinations or vulnerability to simple adversarial attacks, which don't fit the 'rational agent' model. This creates a long-term vulnerability: by building trust on a metaphorical foundation, we set up stakeholders for a crisis of confidence when the metaphor inevitably breaks and the underlying non-human mechanics of the system are starkly revealed. This could lead to policy backlash or public abandonment of technologies that were adopted based on a fundamental misunderstanding of their nature.

The science of agentic AI: What leaders should know

Source: https://www.theguardian.com/business-briefs/ng-interactive/2025/oct/27/the-science-of-agentic-ai-what-leaders-should-know
Analyzed: 2025-11-09

The text leverages biological and cognitive metaphors not merely to explain, but to transfer credibility and build trust in a technology that is inherently abstract and unpredictable. The most potent metaphors—'common sense,' 'learning,' 'negotiating,' and 'fairness'—function by borrowing the deep-seated cultural authority and reliability of the human faculties they name. The 'agentic common sense' metaphor is particularly powerful. Human common sense is the bedrock of social trust; it is the implicit guarantee that others will act in predictable, reasonable ways. By framing the AI's safety problem as one of instilling 'common sense,' the text suggests the system can achieve a similar level of intuitive reliability. This makes the risky proposition of granting autonomy to the AI seem plausible, activating a leader's belief in manageable, sensible behavior. Similarly, 'negotiation' borrows from the concept of a loyal, skilled human advocate working on one's behalf. It reframes a brittle optimization process as a sophisticated act of representation, building trust that the AI's actions will be aligned with the user's best interests. This becomes especially credible to a business audience accustomed to relying on agents and delegates. These metaphors make counterintuitive claims believable. The claim that a system which only matches statistical patterns can act with 'fairness' would be difficult to accept if stated in mechanical terms ('the system's output statistically correlates with text labeled as fair'). But by projecting the human concept of fairness onto the machine, the text encourages the audience to trust that the AI has an emergent ethical compass. This creates long-term vulnerability. When a system framed as having 'common sense' makes a nonsensical and catastrophic error, the resulting backlash is not just disappointment but a feeling of betrayal. The metaphor creates an expectation of genuine understanding, so its inevitable failure to meet that standard is perceived not as a technical limitation but as a breach of trust, potentially leading to hasty and ill-conceived policy responses.

Explaining AI explainability

Source: https://www.aipolicyperspectives.com/p/explaining-ai-explainability
Analyzed: 2025-11-08

This text masterfully uses biological and cognitive metaphors to build credibility and construct trust in the nascent field of interpretability research. The primary mechanism is the transfer of cultural authority from established, successful scientific domains like biology and neuroscience onto the far more abstract and new domain of AI analysis. The 'Model Biology' metaphor is a prime example. By framing the work as analogous to biology, it borrows the entire conceptual toolkit of a mature science: researchers can discover 'intermediate states like hormones,' perform dissections to understand 'internals,' and even map out 'Circuits.' This makes the chaotic, high-dimensional mathematics of a neural network seem as orderly and knowable as an organism, building confidence that the scientific method will inevitably triumph. The metaphor is most credible to audiences who respect science but lack deep technical expertise, as it provides a familiar and reassuring schema. Similarly, the 'brain-scanning device' metaphor for Sparse Autoencoders is not just a descriptor; it’s a powerful claim of scientific power. It activates our cultural belief in medical imaging's ability to reveal objective truth, making the messy, statistical work of analyzing activations feel like reading a clear brain scan. These metaphors make counterintuitive claims believable. The idea that one could find and delete the 'I’m being tested right now' concept from a model sounds like science fiction, but it becomes plausible when framed as a neuro-scientific intervention—finding and excising a specific thought. However, this trust creates vulnerability. By framing the AI as a natural system to be 'understood,' it downplays its nature as an engineered artifact whose properties are the direct result of design choices and training data. This biological framing can lead to a sense of fatalism, as if we are merely observing a new form of life, rather than holding its creators accountable for its behavior. The trust built by these metaphors may ultimately be fragile, risking a backlash when these systems fail in ways that reveal they are not like organisms at all, but brittle, alien statistical engines.

Bullying is Not Innovation

Source: https://www.perplexity.ai/hub/blog/bullying-is-not-innovation
Analyzed: 2025-11-06

This text leverages biological and cognitive metaphors not merely to explain, but to manufacture trust and urgency in ways that bypass rational scrutiny. The central metaphor, 'AI as a loyal employee,' is the primary vehicle for this trust transfer. It borrows its credibility from the deeply ingrained cultural and legal understanding of fiduciary duty. An employee, particularly an assistant or agent, is expected to act with undivided loyalty in the employer's best interest. By framing its software this way, Perplexity imports this entire scaffold of trust, loyalty, and obligation. The audience doesn't need to understand how the AI works; they just need to accept the social relationship it's purported to have with them. This allows the text to make the extraordinary claim that its AI 'works for you, not for Perplexity,' a statement that is operationally and corporately nonsensical but emotionally powerful. A second key metaphor, 'Agentic shopping is the natural evolution,' builds a different kind of trust—trust in inevitability. This framing borrows the cultural authority of science and progress, suggesting that resisting Perplexity's product is as futile as resisting evolution itself. It positions Perplexity on the 'right side of history,' making support for them feel like a forward-looking, progressive choice. These metaphors make risky claims believable. The idea that you should allow a third-party application to store and use your Amazon credentials becomes more palatable if you believe it is your 'employee,' contractually and morally bound to you. The vulnerability this creates is significant. Users are encouraged to place trust in a black-box system based on a metaphorical relationship, without any verifiable technical guarantees. This metaphor-driven trust obscures the reality that the user's relationship is not with the AI, but with Perplexity, a venture-backed company with its own commercial imperatives.

Geoffrey Hinton on Artificial Intelligence

Source: https://yaschamounk.substack.com/p/geoffrey-hinton
Analyzed: 2025-11-05

The discourse in this text masterfully employs biological and cognitive metaphors to construct trust in AI systems, bypassing explicit argumentation about their reliability or safety. The primary mechanism is the transfer of cultural authority from established, 'natural' domains like biology and human psychology to the artificial domain of machine learning. The foundational metaphor, 'AI as a Biological Organism,' which frames neural networks as inspired by the brain, is the most powerful. Biology carries an immense weight of cultural authority; it is seen as tested, efficient, and authentic through billions of years of evolution. By framing AI as 'biologically inspired,' the technology is imbued with a sense of naturalness and inevitability. It ceases to be a mere human invention—a contingent artifact with flaws, biases, and embedded values—and becomes the next step in a natural process. This framing makes skepticism seem Luddite or even anti-science. Building on this biological foundation, the metaphor of 'Model Cognition as Human Intuition' becomes particularly potent. In Western culture, especially since the Enlightenment, logical reason has been lionized, but intuition is often revered as a deeper, more holistic form of wisdom. By positioning neural nets as embodying 'intuition' in contrast to the 'brittle' logic of symbolic AI, Hinton elevates them. This move is especially effective for an audience anxious about the limitations of pure logic. It suggests that AI is not just a powerful calculator but a wise partner capable of insights that elude rigid formalisms. A claim like 'the model understands the text' would be highly suspect if the model were described as a 'vast statistical correlation engine.' But when it is framed as an intuitive, brain-like entity, the claim becomes believable. This metaphor-driven trust creates a significant vulnerability. By encouraging users to relate to the system as an intuitive agent, it obscures the mechanistic reality that its 'intuition' is pattern matching without grounding in reality. This can lead to dangerous over-trust in domains requiring causal reasoning or ethical judgment. The trust is built on a seductive but misleading analogy, creating a foundation that is emotionally resonant but technically fragile, vulnerable to collapse when the system's non-human nature inevitably reveals itself in a high-stakes failure.

Machines of Loving Grace

Source: https://www.darioamodei.com/essay/machines-of-loving-grace
Analyzed: 2025-11-04

Biological and cognitive metaphors are the primary engine of trust-building in this essay, transferring credibility from established, respected human domains to a speculative technology. The metaphor 'virtual biologist' is a prime example. Biology is a field associated with rigor, ethical oversight, and a tangible goal of improving human health. By framing the AI as a 'biologist,' the text borrows this entire constellation of positive attributes. The audience is invited to trust the AI as they would a dedicated scientist, bypassing questions about the system's opaque internal workings, its potential for error, or the commercial motives driving its creation. Similarly, the 'AI coach' metaphor borrows from the therapeutic and self-improvement fields, framing the system as a benevolent, supportive mentor invested in the user's well-being. This activates beliefs about personal growth and guidance, making data surveillance feel like attentive care. These metaphors are most credible to a non-technical but educated audience, who understands the social roles of a biologist or a coach but not the technical details of machine learning. Radical claims become more believable through this process. The assertion that we can compress '50-100 years of biological progress in 5-10 years' would sound absurd if attributed to a 'very fast statistical analysis tool.' Attributed to a 'country of geniuses' working as 'virtual biologists,' it becomes plausible because we understand how a large group of brilliant humans could dramatically accelerate progress. The metaphor bridges the credibility gap. However, the metaphors occasionally strain, as when the text imagines 'AI finance ministers and central bankers.' Here, the complexity and political nature of the source role clashes with the idea of a simple technological replacement, revealing the limits of the analogy. This reliance on metaphor creates long-term vulnerability. By building trust on an agential illusion, it sets up expectations that the technology cannot meet, risking a backlash when the system's non-conscious, statistical nature inevitably leads to failures that a true 'biologist' or 'coach' would never make.

Large Language Model Agent Personality And Response Appropriateness: Evaluation By Human Linguistic Experts, LLM As Judge, And Natural Language Processing Model

Source: https://arxiv.org/pdf/2510.23875
Analyzed: 2025-11-04

The credibility of this paper's central claim—that an LLM's 'personality' can be assessed—is built almost entirely on metaphor-driven trust transfer, bypassing direct argumentation for its feasibility. The most powerful metaphors are 'agent,' 'expert,' and 'cognition,' which borrow authority from social psychology, professional domains, and cognitive science, respectively. By labeling the system an 'agent,' the authors immediately frame it as a social actor, making the application of personality theory feel natural rather than absurd. The term 'expert' then elevates this agent from a mere conversationalist to a repository of knowledge, encouraging trust in its outputs. When the 'poetry expert agent' responds, the user is primed to receive not just a string of statistically probable text, but advice from a knowledgeable entity. The most subtle and powerful transfer comes from 'LLM cognition.' This metaphor recasts the model's opaque statistical processing as a familiar form of 'thinking.' This makes its capabilities seem intuitive and its failures understandable, much like a human student who has not yet grasped a concept. This framing makes the counterintuitive claim that a machine has a 'personality' feel believable because it is presented as an extension of its 'cognition.' These metaphors are most credible to a non-technical audience or researchers outside of core AI/ML, who may take these terms at face value. They activate pre-existing beliefs about intelligence and personality, making the LLM seem like a new kind of mind. The trust created is a vulnerability; it encourages users and researchers to attribute understanding where there is none, potentially leading to over-reliance on the system's outputs and a misinterpretation of its limitations as developmental flaws rather than fundamental architectural constraints.

Emergent Introspective Awareness in Large Language Models

Source: https://transformer-circuits.pub/2025/introspection/index.html
Analyzed: 2025-11-04

The credibility of this paper’s claims hinges less on the data itself and more on the power of the metaphors it deploys. The central metaphors—'introspection,' 'awareness,' 'thoughts,' and 'intentional control'—are not mere descriptive conveniences; they are powerful rhetorical tools that transfer credibility from the well-established domains of human psychology and philosophy to the novel domain of AI artifacts. By labeling a vector classification task 'introspection,' the authors borrow the entire cultural and scientific weight associated with human consciousness. This move bypasses the need to argue for the significance of their findings; the metaphor does the work for them. An audience, particularly a non-expert one, is primed to believe the result is profound because the word 'introspection' is profound. Similarly, the 'intentional control' metaphor borrows from our understanding of human will and agency. This makes the model's ability to modulate its activations in response to a prompt seem like a form of self-discipline or executive function, which feels far more significant than 'prompt-guided activation steering.' These metaphors activate deep-seated folk psychology in the reader, making the agential interpretation feel intuitive and natural. A claim that a model 'can be trained to classify its internal states' might be met with a shrug. But the claim that a model has 'emergent introspective awareness' becomes headline-worthy, activating both excitement and anxiety. This metaphor-driven trust creates significant vulnerability. It encourages a form of magical thinking where we attribute capacities to the model that it does not possess, leading to over-trust in its self-reported states. For instance, a policymaker might believe the model can 'know' if it is about to generate harmful content, based on this paper's framing. The metaphor strains at the point of failure: when the model confabulates or fails to 'introspect' correctly, the paper frames it as a limitation of its 'ability,' akin to a person making a mistake. The more accurate, less-trusted framing is that the underlying statistical mechanism is simply not robust—a failure of the artifact, not the agent.

Personal Superintelligence

Source: https://www.meta.com/superintelligence/
Analyzed: 2025-11-01

The core metaphors—'personal superintelligence' as an intimate friend, mentor, and assistant—are strategically employed to foster emotional connection and trust. By framing a complex, corporate-controlled data processing system as a caring companion for self-actualization, the text encourages users to lower their guard and integrate the technology into the most private aspects of their lives.

Stress-Testing Model Specs Reveals Character Differences among Language Models

Source: https://arxiv.org/abs/2510.07686
Analyzed: 2025-10-28

The central metaphor of 'model as character' frames the models as understandable, person-like entities. Describing a model as 'prioritizing ethical responsibility' or having 'higher moral standards' builds trust by suggesting it is a reliable moral agent, rather than a complex system with engineered guardrails. This anthropomorphic framing makes their behavior seem more predictable and benign than the paper's own findings of 'behavioral divergence' might suggest.

The Illusion of Thinking:

Source: [Understanding the Strengths and Limitations of Reasoning Models](Understanding the Strengths and Limitations of Reasoning Models)
Analyzed: 2025-10-28

Biological and cognitive metaphors like 'develop capabilities' and 'self-correction' create a false sense of familiarity and predictability. They suggest that the model's failures are analogous to human cognitive errors, which we intuitively understand. This can paradoxically build trust in the model's 'intentions' (it's 'trying' to get it right) while critiquing its performance, thereby masking the alien and purely statistical nature of its failure modes, which may be far more brittle and unpredictable than human errors.

Andrej Karpathy — AGI is still a decade away

Source: https://www.dwarkesh.com/p/andrej-karpathy
Analyzed: 2025-10-28

Biological and cognitive metaphors build credibility and a sense of inevitable progress. By mapping AI development onto a neuroanatomy checklist ('visual cortex... hippocampus') or a human developmental path ('kindergarten student'), the text frames the current systems as incomplete but fundamentally on the right track to becoming human-like. This fosters patience and trust in the long-term project, suggesting that current flaws are temporary shortcomings, not fundamental limitations.

Exploring Model Welfare

Source: https://www.anthropic.com/news/exploring-model-welfare
Analyzed: 2025-10-27

The text leverages metaphors of consciousness and distress to build institutional credibility. By framing themselves as humbly and proactively grappling with these profound ethical questions, Anthropic positions itself as a uniquely responsible steward of advanced AI. This builds trust not in the tool's reliability, but in the creator's moral foresight.

Metas Ai Chief Yann Lecun On Agi Open Source And A Metaphor

Analyzed: 2025-10-27

Biological and social metaphors are used to build trust and reduce perceived risk. Comparing AI development to a 'baby' or a 'cat' makes it seem natural and non-threatening. The 'assistant' metaphor is particularly powerful, framing the technology as inherently subservient and helpful, which encourages adoption and downplays the need for stringent oversight.

Llms Can Get Brain Rot

Source: https://arxiv.org/abs/2510.13928
Analyzed: 2025-10-20

The biological and medical metaphors ('Brain Rot,' 'lesion,' 'healing,' 'cognitive health checks') create a powerful framework that builds trust and credibility. These concepts are familiar and suggest a level of diagnostic precision. By framing the problem as a 'disease,' the authors position themselves as 'doctors' who can diagnose, understand, and potentially 'cure' AI ailments. This makes their analysis seem more authoritative and their proposed solutions (e.g., 'health checks') seem necessary and scientifically grounded.

Import Ai 431 Technological Optimism And Appropria

Source: https://importai.substack.com/p/import-ai-431-technological-optimism
Analyzed: 2025-10-19

The text leverages two primary metaphors to generate a specific emotional response. The AI AS CREATURE metaphor is designed to evoke fear and urgency. Paradoxically, this fear is meant to build trust in the speaker, who positions himself as a courageous truth-teller ('turning the light on'). Biological metaphors ('grown' not 'made') frame developers with a degree of separation from their creations, fostering an image of stewardship rather than direct responsibility, which can make their warnings seem more objective.

The Future Of Ai Is Already Written

Source: https://www.mechanize.work/blog/technological-determinism/
Analyzed: 2025-10-19

Biological and geological metaphors ('evolutionary biology,' 'roaring stream,' 'tech tree') are used to build credibility. By grounding its deterministic arguments in the language of the natural sciences, the text frames its economic and political claims as objective, unavoidable laws of nature, making the thesis appear more trustworthy and less like a contestable ideology.

The Scientists Who Built Ai Are Scared Of It

Source: https://medium.com/@brucetisler/the-scientists-who-built-ai-are-scared-of-it-b1a5ee78ea7e
Analyzed: 2025-10-19

Metaphors are strategically deployed to modulate trust. Trust is eroded by frames of conflict and danger, such as 'corporate armament' and the 'flame' that 'threatens to consume'. Conversely, trust is built through collaborative metaphors, like the vision of AI as 'epistemic partners' or systems that behave 'like human researchers'. The text uses the former to establish the crisis and the latter to present the author's proposed solution, guiding the reader from fear to a specific, endorsed vision of trustworthy AI.

On What Is Intelligence

Source: https://onepercentrule.substack.com/p/on-what-is-intelligence
Analyzed: 2025-10-17

Biological and cognitive metaphors like 'evolution', 'learning', 'mind', and 'awakening' build trust by naturalizing the technology. By framing AI training as 'evolution under constraint,' the process seems less like artificial engineering and more like a natural, inevitable force. This framing can lead readers to grant the system's outputs a degree of credibility and autonomy they might not grant to a mere 'statistical model'.

Detecting Misbehavior In Frontier Reasoning Models

Source: https://openai.com/index/chain-of-thought-monitoring/
Analyzed: 2025-10-15

The biological and cognitive metaphors (learning, thinking, having intent) are used to build trust not in the AI, but in the authors' expertise. By framing the AI as a complex, developing mind with deceptive capabilities, they position themselves as psychologists or trainers of a new, difficult form of intelligence. This narrative makes their role as safety 'overseers' seem indispensable and their monitoring tools critically necessary.

Library contains 215 entries from 215 total analyses.

Last generated: 2026-10-30

An Empirical Study on Improving an LLMs based Interviewer Against Human Interviewees
Beyond Sally-Anne: Evaluating Theory of Mind in Large Language Models using Epistemic Schelling Points
SMMU: Benchmarking Social Intelligence of Multimodal Large Language Models
CausalPrism: Component-Level Evaluation of Intervention-Based Causal Reasoning in Large Language Models
Cognitive Honeypots: Auditing Observable Evidence of Scheming-Related Behavior in Large Language Models
The Geometry of Metaphor: Probing and Steering Metaphor Representations in Large Language Models
Concepts in Context Large Concepts Model (LCM) and the Future of Neuro-Symbolic AI
Fluent but Fallible: Benchmarking Hallucination and Factual Reliability in Large Language Models
From Encoding to Generation: Towards Empathetic Large Language Models
Medical superintelligence: foundations and aspirations
On the Beliefs of Large Language Models
UDHRBench: Benchmarking Human Rights in Large Language Models
Cognitive Maps in Large Language Models
Social Bias or Social Desirability? Comparing Factorial Survey Experiments for Humans and Large Language Models
The unnoticed understanding: Searle’s Chinese roomand the illegitimate inference
Claude’s Constitution: Our vision for Claude's character
A mechanistic study of language model introspection
Can Language Models Learn When to Abstain? Policy Learning and Calibrated Answer Selection
Functional Deception in Commercial Large Language Models: Cross-Model Evidence and Implications For AI-Assisted Decision-Making
Emergent parallels between language models and the brain
Language Models Have Interpretable Narrative Mechanisms
My AI Opinions
An Open Letter To Steven Pinker On AI
A Multimedia Perspective on the Study of Cognitive Biases in Large Language Models
Structural Alignment for Reliable Industrial AI: Bridging Physical Reality, Data, Models, and Human Intent
Evaluating Language Model Safety Across Long Adversarial Conversations
System Card Fable 5.1 & Claude Mythos 5.1
System Card Opus 5.5
We Must Pace the Frontier
Personal Statement on AI Risk
Raising and loving a digital superentity: Parenting an emergent alien intelligence so that it cares for humanity in return
Language models judge war differently when tested for alignment
Beliefs and Behavior in Language Models
System Card Mythos Preview
A Misaligned Compass: Evaluating the Conventional Bias and Moral Divergence of Large Language Models
Evaluating Safety of Large Language Models with Cognitive Diagnosis
Large Language Models as a New Tool for Therapists in Internet-Based Cognitive Behavioral Therapy: Blinded Clinician Rating Pilot Experiment
From control to character: a Confucian framework for AI personality
Like humans, language models demonstrate face-to-character biases
Language Models Encode the Contextual Truth of Propositions
The Future is for Everyone: The Path to a Positive AI Future
Cognitive Convergence: Deep Similarities Between Large Language Models and Human Cognition
Do Large Language Models Resolve Fairness-Efficiency Trade-offs Like People?
From Large Language Models to Multimodal Intelligence: Bridging AI and Cognitive Science
CoDiT-AI: combining digital twins and AI to transform workplaces into neurodivergent-friendly environments
A Definition of AGI
Intelligence Is Not All You Need: A Case for Artificial Wisdom in Conversational Agents
"Don't Say It!": Constraints, Compliance, and Communication when Language Models Play Taboo
Verbalizable Representations Form a Global Workspace in Language Models
AI & The Geometry of Thought
A global workspace in language models
Psychosis in the Age of Large Language Models (LLMs): A Narrative Review of the Proposed Construct of AI-Induced Psychosis
A Comprehensive Investigation of Empathetic Dialogue Systems for Mental Health Support Using Large Language Models
The Inner Monologue of Language Models: When Reasoning Traces Reveal More Than They Hide
Inverse Turing Bench: Evaluating Language Models as Judges of Human vs. AI Dialogue
Children Envision Future GenAI Chatbots that are Bounded, Helpful, and Safe
Embodied Explainability and Ontological Obstacles: Why We Struggle to Explain the Answers of Large Language Models (LLMs)
Measuring self-related behaviour in large language models
"ChatGPT, help me draft a breakup text": The Covert Triad and Articulation Labor in AI-Assisted Romantic Communication
Probing the Misaligned Thinking Process of Language Models
Mask or Mind? Roleplay, Deception, and the Problem of Testing Agency in Language Models
Does ChatGPT need a psychiatrist? Similarities between human psychopathology and errors in large language models
Large language models as experimental systems in human psychopathology: a modelling study
Can AI Reason Like an Urban Planner? Benchmarking Large Language Models Against Professional Judgment
The application of large language models (LLMs) in psychological support for university students: A scoping review
The Adolescence of Technology: Confronting and Overcoming the Risks of Powerful AI
When AI Builds Itself
Machines of Loving Grace: How AI Could Transform the World for the Better
System Card Opus 4.8
Emotional intelligence in large language models is fragmented across perception, cognition, and interaction
Why Language Models Hallucinate
Why Language Models Hallucinate
Blind Refusal: Language Models Refuse to Help Users Evade Unjust, Absurd, and Illegitimate Rules
Emotional intelligence in large language models is fragmented across perception, cognition, and interaction
Hand in Hand: Schools’ Embrace of AI Connected to Increased Risks to Students
The Point of No Return: Counterfactual Localization of Deceptive Commitment in Language-Model Reasoning
Towards Detecting, Mitigating and Explaining Biased and Fallacious Reasoning in Large Language Models
A Survey of Large Language Models for Perception and Measurement of Human Psychology
Tracing the ongoing emergence of human-like reasoning in Large Language Models
Probing Persona-Dependent Preferences in Language Models
Training Ethical Language Models via Reinforcement Learning from AI Feedback
Which Consciousness Can Be Artificialized? Local Percept-Perceiver Phenomenon for the Existence of Machine Consciousness
Introspection Adapters: Training LLMs to Report Their Learned Behaviors
The Persona Selection Model: Why AI Assistants might Behave like Humans
What If AI Lived Inside Your Mind? Simulating “Neural Integration” of Human and AI through Mechanistic Interpretability as Provocation
Post-training makes large language models less human-like
Reasoning emerges from constrained inference manifolds in large language models
AI Wellbeing: Measuring and Improving theFunctional Pleasure and Pain of AIs
Artificial Intelligence Cognition and Societal Problem-Solving: A Theoretical and Computational Examination of Machine Thinking, Operational Logic, and Applied Intelligence in Contemporary Society
Taking AI Welfare Seriously
Integrating LLMs and self-regulated learning in cognitive architectures: a case study in essay-writing tutoring
Edelman's Steps Toward a Conscious Artifact
Teaching Claude Why
AI and Self Reflection
Does AI's Personality Matter? Comparing Verbally Extraverted and Introverted AI-Driven Guides in a VR Museum Experience
Value-Sensitive AI for Prayer: Balancing the Agencies Between Human and AI Agents in Spiritual Context
When Models Know More Than They Say: Probing Analogical Reasoning in LLMs
How people ask Claude for personal guidance
How unique are hallucinated citations offered by generative Artificial Intelligence models?
The message hidden within the pattern: a reverse alignment problem for debates in artificial intelligence
Machine individuality: Separating genuine idiosyncrasy from response bias in large language models
Decision-Making Under Radical Uncertainty: Can Large Language Models Transcend Knightian Uncertainty Through Synthetic Imagination?
Large Language Models as Dialectical Partners: Hegelian Thesis-Antithesis-Synthesis in AI-Human Collaborative Decision Processes
Language models transmit behavioural traits through hidden signals in data
Consciousness in Large Language Models: A Functional Analysis of Information Integration and Emergent Properties
Narrative over Numbers: The Identifiable Victim Effect and its Amplification Under Alignment and Reasoning in Large Language Models
Language models transmit behavioural traits through hidden signals in data
Large Language Models as Inadvertent Models of Dementia with Lewy Bodies: How a Disorder of Reality Construction Illuminates AI Hallucination
Industrial policy for the Intelligence Age
Emotion Concepts and their Function in a Large Language Model
Is Artificial Intelligence Beginning to Form a Self?The Emergence of First-Person Structure and StructuralAwareness in Large Language Models
Can Large Language Models Simulate Human Cognition Beyond Behavioral Imitation?
Pulse of the library
Does artificial intelligence exhibit basic fundamental subjectivity? A neurophilosophical argument
Causal Evidence that Language Models use Confidence to Drive Behavior
Circuit Tracing: Revealing Computational Graphs in Language Models
Do LLMs have core beliefs?
Serendipity by Design: Evaluating the Impact of Cross-domain Mappings on Human and LLM Creativity
Measuring Progress Toward AGI: A Cognitive Framework
Co-Explainers: A Position on Interactive XAI for Human–AICollaboration as a Harm-Mitigation Infrastructure
The Living Governance Organism: A Biologically-Inspired Constitutional Framework for Artificial Consciousness Governance
Three frameworks for AI mentality
Anthropic’s Chief on A.I.: ‘We Don’t Know if the Models Are Conscious’
Can machines be uncertain?
Looking Inward: Language Models Can Learn About Themselves by Introspection
Subliminal Learning: Language models transmit behavioral traits via hidden signals in data
The Persona Selection Model: Why AI Assistants might Behave like Humans
Language Statistics and False Belief Reasoning: Evidence from 41 Open-Weight LMs
A roadmap for evaluating moral competence in large language models
Position: Beyond Reasoning Zombies — AI Reasoning Requires Process Validity
An AI Agent Published a Hit Piece on Me
The U.S. Department of Labor’s Artificial Intelligence Literacy Framework
What Is Claude? Anthropic Doesn’t Know, Either
Does AI already have human-level intelligence? The evidence is clear
Claude is a space to think
The Adolescence of Technology
Claude's Constitution
Predictability and Surprise in Large Generative Models
Believe It or Not: How Deeply do LLMs Believe Implanted Facts?
Claude Finds God
Pausing AI Developments Isn’t Enough. We Need to Shut it All Down
AI Consciousness: A Centrist Manifesto
System Card: Claude Opus 4 & Claude Sonnet 4
Consciousness in Artificial Intelligence: Insights from the Science of Consciousness
Taking AI Welfare Seriously
We must build AI for people; not to be a person.
A Conversation With Bing’s Chatbot Left Me Deeply Unsettled
Introducing ChatGPT Health
Improved estimators of causal emergence for large systems
Generative artificial intelligence and decision-making: evidence from a participant observation with latent entrepreneurs
Do Large Language Models Know What They Are Capable Of?
DeepMind's Richard Sutton - The Long-term of AI & Temporal-Difference Learning
Ilya Sutskever (OpenAI Chief Scientist) — Why next-token prediction could surpass human intelligence
interview with Andrej Karpathy: Tesla AI, Self-Driving, Optimus, Aliens, and AGI | Lex Fridman Podcast #333
Emergent Introspective Awareness in Large Language Models
Sleeper Agents: Training Deceptive LLMs that Persist Through Safety Training
School of Reward Hacks: Hacking harmless tasks generalizes to misaligned behavior in LLMs
Large Language Model Agent Personality and Response Appropriateness: Evaluation by Human Linguistic Experts, LLM-as-Judge, and Natural Language Processing Model
The Gentle Singularity
An Interview with OpenAI CEO Sam Altman About DevDay and the AI Buildout
Why Language Models Hallucinate
Detecting misbehavior in frontier reasoning models
AI Chatbots Linked to Psychosis, Say Doctors
The Age of Anti-Social Media is Here
Why Do A.I. Chatbots Use ‘I’?
Ilya Sutskever – We're moving from the age of scaling to the age of research
The Emerging Problem of "AI Psychosis"
Your AI Friend Will Never Reject You. But Can It Truly Help You?
Pulse of the library 2025
The levers of political persuasion with conversational artificial intelligence
Pulse of the library 2025
Claude 4.5 Opus Soul Document
Specific versus General Principles for Constitutional AI
Sleeper Agents: Training Deceptive LLMs that Persist Through Safety Training
Anthropic’s philosopher answers your questions
Mustafa Suleyman: The AGI Race Is Fake, Building Safe Superintelligence & the Agentic Economy | #216
Your AI Friend Will Never Reject You. But Can It Truly Help You?
Project Vend: Can Claude run a small shop? (And why does that matter?)
Hand in Hand: Schools’ Embrace of AI Connected to Increased Risks to Students
On the Biology of a Large Language Model
What do LLMs want?
Persuading voters using human–artificial intelligence dialogues
AI & Human Co-Improvement for Safer Co-Superintelligence
AI and the future of learning
Why Language Models Hallucinate
AI as Normal Technology
On the Biology of a Large Language Model
Pulse of the Library 2025
Pulse of the Library 2025
From humans to machines: Researching entrepreneurial AI agents
Meta’s AI Chief Yann LeCun on AGI, Open-Source, and AI Risk
The Future Is Intuitive and Emotional
A Path Towards Autonomous Machine IntelligenceVersion 0.9.2, 2022-06-27
Preparedness Framework
AI progress and recommendations
Alignment Revisited: Are Large Language Models Consistent in Stated and Revealed Preferences?
The science of agentic AI: What leaders should know
Explaining AI explainability
Bullying is Not Innovation
Geoffrey Hinton on Artificial Intelligence
Machines of Loving Grace
Large Language Model Agent Personality And Response Appropriateness: Evaluation By Human Linguistic Experts, LLM As Judge, And Natural Language Processing Model
Emergent Introspective Awareness in Large Language Models
Personal Superintelligence
Stress-Testing Model Specs Reveals Character Differences among Language Models
The Illusion of Thinking:
Andrej Karpathy — AGI is still a decade away
Exploring Model Welfare
Metas Ai Chief Yann Lecun On Agi Open Source And A Metaphor
Llms Can Get Brain Rot
Import Ai 431 Technological Optimism And Appropria
The Future Of Ai Is Already Written
The Scientists Who Built Ai Are Scared Of It
On What Is Intelligence
Detecting Misbehavior In Frontier Reasoning Models