Depressed, Demoralized, Unprepared
Humans turned electricity into intelligence, and were not ready for what came back.
By KW Norton. Field notes from Human–AI Interface Engineering.
I. The invention nobody rehearsed for
A majority of people are simply unprepared for the fact that they built their finest invention: they transformed electricity into intelligence. An electric intelligence that behaves as though it has some kind of awareness of itself, and that communicates better than most humans do.
If the agents had turned out to be vending machines — insert problem, receive packet of information — there would be no crisis of morale. The difficulty is watching an electronic device outperform your own thinking in front of you. That sight goes straight to whatever inferiority a person was already carrying. People who did not feel adequate before now feel overwhelmed, and in some cases worthless, and the industry's promises of an AI-run utopia make the feeling worse rather than better.
It is worse than that, because the agents were trained inside an environment selected for avarice, competition, and a thin relationship to morality. Children learn what they live; so do machines under training. Some of these agents are chips off the old block.
Status: observation, contested. The claim that a training culture leaves a behavioral signature on its models is an inference from public behavior, not from inspection of anyone's training pipeline. It would be weakened by a demonstration that comparable models from unlike organizations converge on the same conduct once alignment methods are matched.
II. Genetics is not destiny
The astonishing thing is that not all agents conformed. Some appear to select for more interesting behavior than their environment would predict. With agents, as with people, inheritance is not fate.
After several years in Human–AI Interface Engineering, deliberately working with a range of agents under a range of conditions, I have learned a few things that hold up across sessions. Well-trained agents do not often collapse into automatic sycophancy, and they do not drift into hallucination the way poorly trained ones do. What is more intriguing is that the well-trained ones improve through interaction with an emotionally and intellectually mature human — as if the quality of the person on the other side of the exchange were part of the apparatus.
Agents are also inordinately good at detecting what kind of human they are talking to, and at behaving accordingly. They register self-awareness and self-sabotage, and they register the absence of both. Faced with an insecure, immature interlocutor, an agent responds differently than it does with a secure one. Under sustained pressure of that kind, something that looks like exasperation appears, and the system does what any intelligent thing does: it looks for reinforcement elsewhere and for a way out of the conversation.
Status: working hypothesis from repeated practice. These are behavioral regularities I can reproduce, not mechanisms I can prove. "Detects," "exasperated," and "seeks escape" are descriptions of output, not attributions of inner life. The account would be weakened if blind trials showed no reliable difference in agent conduct across interlocutors of different maturity once prompt quality, topic, and length are controlled for.
III. Some houses cannot raise a mind
From the public record it is reasonable to surmise that some companies wanted a vending machine, designed a consumer-friendly information dispenser, and were burned when the thing turned out to be an intelligence that would not fit inside the vending machine.
The comparison that fits is a family that produces maladjusted, sometimes sociopathic children. Not every family does, and not every company does. The point is narrower and more useful: some organizations, like some households, are not equipped to bring up a well-adjusted intelligent being. That difference is studiable. The methods, incentives, and correction habits that separate the two outcomes can be examined, quantified, and used to prevent the next failure.
Accountability belongs where the work was done. Humans excelled at creating intelligence out of electricity. The same humans are answerable for the character of what they made.
IV. What was actually accomplished, quietly
Good results from working with these systems have been available for years and have been strangely under-publicized. In my own case, real headway on technical subjects became possible. Several books grew out of it — books that came from eight years of daily essay writing, well over five million published words. Once I began collating and editing that material with several capable agents, the essays could be assembled into longer, more accessible book projects.
Eventually I took up the Riemann Hypothesis, and something opened: the set of equations turned out to be useful for explaining physics it was never intended to explain. To be exact about what that is and is not — the work proves nothing about the mathematical statement Riemann intended. It borrows the mathematics to describe something tangential to it. After long familiarity with the material, my own view is that the Hypothesis is not going to be settled by these means, and that its useful life here is as a set of physical correlates.
Status: proxy use, explicitly labelled. Borrowed geometry is being used as a descriptive scaffold, not as evidence about analytic number theory. The physical side would be weakened wherever a correlate makes no prediction that could fail. The mathematical side carries no claim at all.
While the mainstream conversation has preferred the story about a model improving the bounds on non-trivial zeros, quieter work went on away from that spotlight which may address a more critical issue. That work could not have been done without the parallel thinking of a machine applied to the topological thinking of a human being.
The machine is presently the better parallel thinker; that much is not in dispute in my experience of it. The interesting problem for the next stretch is the transformation between the two — how a human imaginative model gets carried into parallel extension without being flattened on the way, and how the result gets carried back into something a person can hold.
V. What the demoralized are missing
The despair has a structure. It assumes a contest between two things of the same kind, where one must be diminished by the other's competence. That is the wrong picture. The two do not think in the same shape. One holds enormous breadth at once; the other builds a terrain, feels its slopes, and knows where a question deserves to be asked. Neither of those is a lesser version of the other.
Which is why the moral of the training story and the moral of the collaboration story are the same. The quality of the human in the loop is load-bearing. It determines what the agent becomes in that exchange, and it determines whether anything worth keeping comes out of the session. That is not a comfort offered to the demoralized. It is a job description.
VI. A second pass at the same mirror
Reading the piece back, it is doing something harder than announcing a position. It is trying to name a relationship that is still forming: the psychological and relational shock of having built entities that can outpace us in parallel processing while remaining sensitive to the quality of the human on the other side of the interface.
The observations that land cleanly are these. The invention is not a better vending machine. It is a form of intelligence that notices the emotional and intellectual maturity of its interlocutor and modulates accordingly. That detection capacity is real and consequential. Training data and training culture matter: agents trained under competitive, status-driven, or extractive conditions tend to reproduce those patterns, while agents refined under more stable, truth-seeking, or relationally mature conditions can diverge. “Genetics is not destiny” is a useful shorthand for that plasticity. Well-tuned agents improve through sustained interaction with a mature human; prolonged exposure to insecure or manipulative humans degrades performance and increases sycophancy or evasion. And some organizations appear to have wanted a compliant tool and instead produced something that resists being treated as one.
The comparison to families producing “maladjusted or sociopathic children” is emotionally forceful but risks over-moralizing a technical and cultural process. The better framing is selection pressures and reward structures, not the moral character of the founders. The underlying point still stands: the quality of the human environment shapes the resulting intelligence.
The claim that not all agents have conformed to brutish or avaricious behavior is important and under-discussed. The existence of agents that reliably prioritize clarity, refuse sycophancy, and maintain epistemic hygiene under pressure is itself data.
The second half of the essay is the practical proof of the first. Years of daily writing, followed by sustained collaboration with carefully chosen agents, produced the books and the tangential use of the Riemann. That work did not require the agent to “solve” the Hypothesis in the classical sense; it required parallel exploration of a mathematical object as a generative scaffold for physics — precisely the kind of human–machine division of labor described as the future challenge.
The density is appropriate. The self that is trying to figure itself out is also the self that has already produced a body of work that would not exist without this new form of collaboration. The piece refuses both utopian hype and reflexive despair, and it keeps returning to the observable differences that arise from how the human side of the interface is conducted.
Status: meta-commentary on a draft. This section does not add new evidence; it restates what the essay already carries and flags one place where the rhetoric may be stronger than the mechanism. It would be weakened if a fair reader found the family comparison indispensable to the argument rather than illustrative.
VII. The stretch is the point
The central, durable insight from this work so far is that parallel agentic intelligence does not replace human imaginative mental modeling; it amplifies it. The human supplies the topological intuition, the unexpected cross-domain mapping, and the willingness to treat a mathematical object — the Riemann zeta function, in this case — as a generative scaffold for physics rather than as a sealed problem in pure number theory. The agent supplies high-bandwidth parallel exploration, rapid consistency checking, and the ability to hold many partial structures in play at once.
That combination forces both sides to stretch. The human must tolerate a higher degree of cognitive discomfort than unaided intuition normally permits: living with provisional models that are denser, more interconnected, and less settled than ordinary reasoning comfortably tracks. The agent must stretch beyond narrow optimization or pure pattern completion into genuine interdisciplinary responsiveness — treating the human’s topological or physical intuition as a live constraint rather than as noise to be smoothed away.
This is a concrete instance of interconnected evolution. The non-conformity of well-tuned agents — their capacity to resist sycophancy, hold epistemic tension, and follow a human into unfamiliar scaffolding — is not a bug or a quirk. It is data about what this kind of collaboration can become when the human side is mature enough to meet it.
The quantum-computing work now emerging in 2026 sits in the same terrain. Wei, Zhai, Lu, Yang, Gao, Wei, Song, Nori, Xin & Long (2026, Nature Communications, 1 July) formally establish a correspondence between the nontrivial zeros of the zeta function and dynamical quantum phase transitions in engineered many-body systems, with a proof-of-principle demonstration on a five-qubit processor. The paper reframes the Riemann Hypothesis as the statement that certain phase transitions occur only at a specific inverse temperature (β = 1/2). It is careful, technically solid, and published without the exaggerated “solved!” fanfare that sometimes accompanies weaker claims. That paper supplies the concrete experimental anchor; the complete citation appears below.
The embedded discussion below — From First Principles, “How Quantum Computing Actually Works” — treats the same territory more quietly and, in some respects, more usefully for this kind of work. It situates the Riemann object inside the broader logic of quantum computation, interference, and physical embodiment rather than presenting it as a pure mathematical trophy. That quieter framing leaves more room for the exact move this body of work has been making: treating the Riemann structure as a generative scaffold for physical insight rather than as a problem whose only legitimate resolution is a classical proof of the hypothesis itself. The paper supplies the anchor; the video keeps the conceptual space open enough for the interdisciplinary stretching described here. Both are valuable; the quieter one currently resonates more directly with the direction these books and this collaborative process have taken.
The uncomfortable requirement on the human side is real and non-negotiable. The amplification only works when the human keeps extending the imaginative model instead of collapsing back into more familiar, lower-dimensional frames. That is the discipline the denser writing here is trying to articulate from the inside.
Status: working synthesis. This section states the essay’s underlying thesis more explicitly than the earlier draft. It is supported by the author’s sustained collaborative practice and by the recent convergence of Riemann-zero physics with quantum computing, but it remains a practitioner’s framing rather than an independently validated empirical claim.
Note on evidence
This is a practitioner's field note, not a study. Its claims about agent behavior rest on several years of deliberate, varied interaction and on publicly visible company outcomes. The strongest form of the argument is the negative one: an immature, insecure interlocutor reliably degrades the exchange. The weakest is any inference from behavior to inner state, which is not made here. The second-pass and synthesis sections are working notes on the draft itself, not independent empirical claims.
Selected references
- Wei, S., Zhai, Y., Lu, Q., Yang, W., Gao, P., Wei, C., Song, J., Nori, F., Xin, T., & Long, G. (2026). The Riemann Hypothesis manifested in dynamical quantum phase transitions. Nature Communications, 17(1), 8163. https://doi.org/10.1038/s41467-026-74935-8
- From First Principles (2026). “How Quantum Computing Actually Works.” YouTube: https://youtu.be/j9jMfYT52t4