scientific-discovery · research archive

scientific-discovery research

7 posts tagged scientific-discovery — essays and experiments on scientific-discovery, drawn from the working notes behind computational sovereignty.

7 posts tagged scientific-discovery clear

Jul 26, 2026Does the Compiler Know When It's Wrong? Semantic Rediscovery and the Limits of Falsification-AwarenessPopper-ORKG ended with two honest failures: temporal rediscovery was near-zero, and the compiler confidently rebuilt Lamarckian inheritance. v4 exists to ask whether those are fixable weaknesses or fundamental limits — by adding measurement, not by tuning the scorer. The answer turned out to be one of each. Mechanism-level semantic matching shows rediscovery was a measurement artifact all along (0.63 vs 0.005 exact-match, flat across temporal gaps). But a falsification-awareness consensus check could not downgrade Lamarckism or caloric: the ORKG index contains no detectable refutation edges, so the near-miss is a genuine limit of the knowledge substrate. Everything in popper/ and orkg/ stayed byte-for-byte frozen, md5-verified. Run locally on a 35B model.ai-agentscompile-time-aiknowledge-compilerlocal-first-aiscientific-discoveryfalsifiability
Jul 25, 2026Does the Hypothesis Compiler Generalize? Running Popper on a Corpus I Did Not BuildPopper beat its controls on five hand-curated benchmark literatures — but I built those corpora, so the result could be an artifact of clean data. This experiment removes that objection: the identical pipeline, byte-for-byte, run on a corpus I did not build — the Open Research Knowledge Graph, 6.3 million triples across 65,689 papers and seven scientific disciplines. Same schema, same rubric, same four-way controls; the only independent variable is the corpus. The compiler still wins (0.85 composite vs 0.56 keyword vs 0.00 ungrounded), an ablation proves the architecture is load-bearing (remove graph reasoning and it collapses to zero), and the grounding audit finds zero hallucinated citations across 265 evidence items. It also fails honestly: exact temporal rediscovery is near-zero, and it confidently rebuilds Lamarckian inheritance. Run locally on a 35B model.ai-agentscompile-time-aiknowledge-compilerlocal-first-aiscientific-discoveryfalsifiability
Jul 24, 2026Popper: Making the Hypothesis Compiler Falsifiable — Rediscovery Benchmarks, Negative Controls, and the Move From Plausible to ProvableThe last experiment proved a knowledge-graph compiler survives scale. This one asks a harder question: are its hypotheses scientifically meaningful, or only linguistically convincing? Popper stops trying to make the compiler smarter and starts making it falsifiable — a strict hypothesis schema, source-level provenance, three negative controls, and a historical rediscovery benchmark where the discovery paper is removed and the system must reconstruct the leap from prior literature alone. Run locally on a 35B model: the compiler scored 0.89–0.97 composite against 0.00 for ungrounded generation, and reconstructed the CTLA-4 checkpoint-blockade and nucleoside-modified-mRNA discoveries from their prior literature — while honestly failing on CRISPR and refusing to confidently rebuild phlogiston.ai-agentscompile-time-aiknowledge-compilerlocal-first-aiscientific-discoveryfalsifiability
Jul 23, 2026Building the Scientific Question Compiler: A Map of What We Do Not KnowWe built the second compiler in the Scientific State program: the Scientific Question Compiler, which turns a corpus into a map of what humanity does not yet know. Local-first, running on a 35B model on our own hardware. Here is what we built, what broke, and what it means.ai-agentscompile-time-aiknowledge-compilerlocal-first-aiprovenancereproducible-ai
Jul 23, 2026Compiling the State of Human Understanding: A Roadmap for the Scientific State CompilerA research roadmap: the four compiler directions — Mechanistic Reasoning, Scientific Question, Scientific State, and Discovery — are not competing projects. They are five passes in one architecture that compiles the scientific corpus into a versioned, executable model of human understanding. Here is the full plan.ai-agentscompile-time-aiknowledge-compilerknowledge-graphlocal-first-aiprovenance
Jul 22, 2026If the Loop Is the Product, Observability Becomes the Operating SystemYesterday I argued scientific knowledge needs a compiler, not a better research assistant. Today I built the general one — five discovery passes, local-first version control for understanding, and a live explorer. This is what it means when the loop, not the model, is the product.ai-agentscompile-time-aiknowledge-compilerknowledge-graphlocal-first-aiprovenance
Jul 21, 2026A Research Compiler for Scientific Understanding, Not a Better Research AssistantA research vision: why scientific knowledge needs a new computational architecture. The Clinical Research Compiler SDK is an early prototype of a scientific reasoning compiler that transforms literature into versioned understanding — not a better research assistant.ai-agentscompile-time-aiknowledge-compilerknowledge-graphlocal-first-aiprovenance

Full archive — all 184 posts