scientific-state-compiler · research archive

scientific-state-compiler research

2 posts tagged scientific-state-compiler — essays and experiments on scientific-state-compiler, drawn from the working notes behind computational sovereignty.

2 posts tagged scientific-state-compiler clear

Jul 23, 2026The Next Experiment: From 'Survives Scale' to 'Correct' — Grounding, Negative Controls, and Quantitative DomainsToday we proved the Scientific Question & State Compiler survives scale — 6.3M ORKG RDF triples distilled into a 300-document corpus, 881 claims, 13 ranked questions, a versioned state of the field, all compiled locally on a 35B model. But surviving scale is not the same as being correct. This post records what we built, what we learned, the four bugs that only appeared at scale (including one that shipped Alzheimer's data into the live ORKG demo), and a fully-specified next experiment: source-level traceability, a grounding audit with a groundedness rate, a negative control, a fixed versioning layer, an explicit distillation method, an external-validity check against survey papers, and a move to quantitative domains (COVID-19 observatory or materials science) where contradictions are measured, not just defined.ai-agentscompile-time-aiknowledge-compilerlocal-first-aiscientific-state-compilerorkg
Jul 23, 2026Validating at Scale: The Compiler Meets 6.3 Million RDF TriplesWe stress-tested the Scientific Question & State Compiler against real, large-scale data: 6.3M ORKG RDF triples distilled into a 300-document corpus from the 728-paper 'Empirical Research in Requirements Engineering' domain. 881 claims, 13 ranked questions, a versioned state of the field — compiled locally on a 35B model. The tool generalizes beyond the 3-doc toy corpus. Here is what broke, what we fixed, and what it means.ai-agentscompile-time-aiknowledge-compilerlocal-first-aiscientific-state-compiler

Full archive — all 184 posts