Guilds, Alchemists, and the Return of Open Science
A machine-learning researcher describes the epistemological lock, from the inside
Alex Dimakis posted a short history this session: medieval guilds guarded recipes, processes, and tools; alchemists wrote in deliberately obscure language; knowledge stayed secret because secrecy paid. The Enlightenment and the scientific revolution reversed the incentive by publishing methods and results so they could be tested, reproduced, and built on. His point is that artificial intelligence is currently the older regime — a dark, fragmented art — and that fully open efforts are the route out.
By KW Norton.
I. The same lock, described from the other side
This is the argument of The Widening Gyre arriving from the machine-learning bench rather than from epistemology. The lock has never required a conspiracy. It requires only that the people who hold a method be paid more for holding it than for explaining it. Guild secrecy was not a moral failure of medieval craftsmen; it was the rational response to an incentive. So is the current practice of publishing a system card instead of a training corpus.
EstablishedObscurantism has a documented history as a professional strategy. Alchemical texts used deliberate cover names and allegory; craft guilds restricted apprenticeship and controlled who could reproduce a process. The seventeenth-century turn to published, reproducible method was an institutional change in what counted as a result, not a sudden improvement in human honesty.
Licensed inferenceIf that is the mechanism, then the openness of a field is a prediction about its error rate rather than a statement about its virtue. A closed field accumulates undetected mistakes at whatever rate its internal review catches them. An open field outsources detection to everyone with a grievance and a GPU. The second is unpleasant to work in and converges faster.
II. Why this matters at the interface
A closed model is an alchemical text you converse with. You can observe its outputs and infer nothing reliable about why they came out that way, which is exactly the condition under which interface discipline stops being optional. When the mechanism is unavailable, the only remaining instrument is the structure of the exchange: boundary conditions set first, agreement pushed on harder than disagreement, every claim carrying a status label and a falsifier.
AssertedOpen weights and open data do not remove the need for that discipline; they change what it can accomplish. With the corpus visible, a suspicious answer becomes a traceable answer. Without it, the user is left doing forensic work on a black box and calling the result understanding.
Secrecy converts a science into a craft. A craft can be extraordinarily good and still cannot tell you which of its results are wrong.
The connection to offense as defense is direct. Publishing the exchange is the individual-scale version of publishing the method. Both work by the same mechanism: a claim that circulates can be corrected, and a claim held privately cannot.
III. Where this could be wrong
FalsifierIf open efforts show no faster error correction than closed ones — comparable rates of retracted results, replicated benchmarks, and independently reproduced training runs — then openness is a preference about culture rather than a claim about epistemics, and should be argued on those grounds instead.
FalsifierIf publishing methods measurably accelerates capability misuse more than it accelerates correction, the safety case cuts against the epistemic case and the trade has to be made explicitly rather than assumed away.
LimitOpen science is not the same as open everything. Reproducibility requires the method, the data provenance, and the evaluation protocol. It does not automatically require every artifact, and treating the two as identical weakens the argument by overreaching.
IV. The plain point
The interesting part of the Dimakis post is not that openness is good. It is the historical diagnosis: the field is presently in a pre-Enlightenment configuration, and everyone inside it knows the difference between what they publish and what they know. Naming that out loud, from inside a lab, is worth more than another external critique.
The question this hands forward is narrower and answerable: what is the minimum publishable set that makes an artificial-intelligence result reproducible by a stranger? Until someone specifies it, both sides of the argument get to claim they are already open enough.
Related: The Widening Gyre · Twelve Theoretical Minimums · Offense as Defense · Relay Log