Offline RL · research archive
Offline RL research
1 post tagged Offline RL — essays and experiments on offline rl, drawn from the working notes behind computational sovereignty.
1 post tagged Offline RL clear
ollama 51AI 47sovereign-ai 42ai-agents 40rag 31knowledge-graph 29local-ai 29local-first 27python 26llm 23nextjs 23local-first-ai 21machine-learning 21knowledge-graphs 20Tutorial 20compile-time-ai 18knowledge-compiler 18local-llms 16fastapi 15open-source 15AI development 13mcp 13local-llm 11vibe-coding 11chromadb 9graphrag 9hermes-agent 9OpenAI 9privacy 9React 9
Full archive — all 198 posts
- Nov 13, 2026Productizing the Knowledge Compiler: A Reusable Engine, an SDK, an MCP Server, and a Graph Explorer
- Nov 12, 2026Compiling a Website for Agents: A Static Knowledge Corpus on Next.js
- Nov 4, 2026The Architecture of Reliable Intelligence: From Epistemic Decisions to Governed Evaluation and Computational Sovereignty
- Nov 4, 2026The Boundaries of Intelligence: Evidence, Authorization, and Monitorability in Autonomous AI Systems
- Oct 29, 2026The Frozen Spine: Reference-Monitor Enforcement for Model-Integrated Agents
- Oct 25, 2026Ganymede, the Archive of the Gods: A Film Pipeline an Agent Can Replicate
- Oct 25, 2026Hermes Local Video Studio: A Reproducible Video Production Capability for Agents
- Oct 25, 2026The Dissolve That Wasn't Applied: Six Rust Tools, Four Silent Failures, and a 2:57 Film
- Oct 25, 2026The Keyframe That Went Nowhere: Building a 3:42 Film Out of Ten Generated Frames
- Oct 25, 2026The Mask That Rendered Anyway: One 2:22 Film Through an Impossible Space
- Oct 24, 2026The Checkpoint That Couldn't Run: Getting Qwen-Image-2.1-Turbo Onto an M4 Pro
- Oct 23, 2026LLMjacking: Building the 'Skynet Mode' Recursive Attacker
- Oct 23, 2026Operation Ouroboros: The Recursive Intelligence Parasite
- Oct 23, 2026The Trust Store Nobody Patched: A Log of Patching eMudhra, Node.js, and a Lie in npm Audit
- Oct 23, 2026Two Models, One Harness: Swapping Flint for Gemma 4 Without Losing Either
- Oct 22, 2026Hoisting Recursive Flint Aboard Hermes: A Pirate's Guide to Running a 40B MoE Locally
- Oct 12, 2026MindBroadcast — A Technical Specification for a Persistent, Autonomous, News-Driven Intelligence and Broadcasting System
- Oct 11, 2026Building a Rust-Native Creative Suite on Apple Silicon: A Complete, Verified Installation
- Sep 26, 2026Omarchy on a 2017 MacBook Pro: A Setup Retrospective
- Sep 4, 2026The Sovereign Agent Stack — A Local-First, Compile-Time AI Agent Framework
- Sep 4, 2026The Rented Sovereign — What the $5K/Month Agent Agency Stack Actually Reveals
- Sep 3, 2026PageRank SEO: Why Modern Search Optimization Is an Information Architecture Problem
- Aug 21, 2026The Skills Map for Building and Deploying AI Applications
- Aug 9, 2026Hermes Atlas v0.1: A Local-First, Incrementally-Compiled, Falsifiable Knowledge System
- Aug 9, 2026Hermes Atlas v0.2: Claim-Level Coverage, a Determinism Gate, and a Knowledge-Mutation Canary
- Aug 9, 2026Hermes Atlas v0.3: An Evidence Ledger, a Provable Claim Lifecycle, and an Explain Command
- Aug 9, 2026Hermes Atlas v0.4: Proving the Evidence Ledger & Claim Lifecycle with a Gold-Labeled Benchmark
- Aug 9, 2026Building Hermes Video Agent: a local-first, human-in-the-loop video pipeline
- Aug 8, 2026Building a Local-First Rehab Cost Analyzer with an AI Agent (Full Build + Replication Guide)
- Aug 5, 2026How I Taught an Agent to Edit Video — and the Repeatable Method Behind It
- Jul 26, 2026Does the Compiler Know When It's Wrong? Semantic Rediscovery and the Limits of Falsification-Awareness
- Jul 25, 2026Does the Hypothesis Compiler Generalize? Running Popper on a Corpus I Did Not Build
- Jul 24, 2026Popper: Making the Hypothesis Compiler Falsifiable — Rediscovery Benchmarks, Negative Controls, and the Move From Plausible to Provable
- Jul 23, 2026The Loop Closes Itself: A Compiler That Directs Its Own Next Compile
- Jul 23, 2026The Next Experiment: From 'Survives Scale' to 'Correct' — Grounding, Negative Controls, and Quantitative Domains
- Jul 23, 2026Pass 4: The Scientific State Compiler — A Versioned Model of What We Understand
- Jul 23, 2026Compiling the State of Human Understanding: A Roadmap for the Scientific State Compiler
- Jul 23, 2026Validating at Scale: The Compiler Meets 6.3 Million RDF Triples
- Jul 21, 2026Compiling Medical Evidence: A Clinical Research Compiler That Turns Guidelines and Trials Into a Queryable Knowledge Artifact
- Jul 21, 2026A Research Compiler for Scientific Understanding, Not a Better Research Assistant
- Jul 20, 2026Compile-Time Intelligence: Building a Research Compiler Agent That Compiles Knowledge Instead of Re-Reading It
- Jul 18, 2026Compile-Time AI in Practice: How We Built a Kubernetes Knowledge Compiler
- Jul 16, 2026The Sovereign Knowledge Compiler Explorer: A Recipe for Compiling Knowledge Into a Static, Living Artifact
- Jul 15, 2026I Compiled My Blog Into a Decision Graph
- Jul 15, 2026The Sovereign Knowledge Compiler: Compile-Time Memory for Local-First AI Agents
- Jul 14, 2026The Recursive Research Compiler: Turning Compile-Time AI Inward with the Knowledge Compiler SDK
- Jul 14, 2026Synthesizing Memory with Agent: A Local-First Architecture for Persistent AI State
- Jul 12, 2026Compile-Time AI: Why the Industry Is Quietly Building an LLVM for Knowledge
- Jul 11, 2026Knowledge Compiler: Why I'm Building a Compiler for Human Knowledge Instead of Another RAG System
- Jul 10, 2026The Telemetry Intelligence Engine: A Local-First GraphRAG System for Website Analytics
- Jul 6, 2026Sovereign Intelligence Stack: Performance Benchmarks
- Jul 6, 2026The Sovereign Loop: Why Model-Local AI Is the Missing Operating System Layer
- Jul 5, 2026Getting Started with Sovereign AI: Your First Recipe
- Jul 5, 2026Local AI Architecture: Running Models on Your Own Hardware
- Jul 5, 2026Retrieval Architecture: Memory Systems That Compound
- Jul 5, 2026Sovereign AI Architecture: Building Compounding Intelligence
- Jul 4, 2026The Sovereign Intelligence Stack: Building Compounding AI Infrastructure
- Jul 3, 2026The Model Is Not the Product: Residual State, Compiled Agents, and Optimization Loops
- Jul 3, 2026The Loop Is the Product: Inside the Sovereign Intelligence Observatory
- Jul 2, 2026Building Autonomous Sovereign AI: How Autoresearch Loops and Expert Fine-Tuning Create Self-Improving Local AI Systems
- Jul 2, 2026The Missing Stack: Context Engineering, Agent Harnesses, and the Real Full-Stack Development Paradigm of 2026
- Jul 2, 2026Context Engineering: The Real Full-Stack Development Paradigm in 2026
- Jun 30, 2026AMIS in Action: Live Vercel Analytics to Autonomous Marketing Knowledge Graph
- Jun 14, 2026Sovereign Memory Bank: A Deep Dive Into Autonomous Cognitive Memory for Agent Systems
- Jun 14, 2026Sovereign Memory Bank: Autonomous Cognitive Memory for Agent Systems
- Jun 12, 2026SovereignSpec and the Ganymedean Alignment Protocol: A Technical Treatise
- Jun 12, 2026Project Proposal: SovereignSpec — Local-First Spec-Driven Development
- Jun 8, 2026objective05-exec: Giving Your Local Intelligence System Hands — A Rust Tutorial on Bridging a Knowledge Graph to Real-World Tool Execution
- Jun 8, 2026OpenDesign + OpenCode: Building a Local-First Design Operating System Inside Your Terminal
- Jun 3, 2026The Model Is Not the Product: On Building Persistent Intelligence Infrastructure
- Jun 1, 2026objective03: My Laptop Eats the News and Talks Back
- May 2, 2026Autodata and the RAM Ecosystem: When AI Learns to Build Its Own Training Data
- May 1, 2026Qwen-Scope and the Rise of Feature-Level Control: From Interpretability to Interface
- Apr 29, 2026Recursive Language Models: Breaking the Context Barrier with Programmable Reasoning
- Apr 15, 2026Synthetic Intelligence: Why 'Emergence' is Just Math and Why Your Data Should Stay Local
- Mar 29, 2026The Architecture of Autonomy: Why the Divergence Between Corporate and Sovereign AI Is the Most Important Design Decision of Our Generation
- Mar 29, 2026SOVEREIGN: The Unified Architecture — A Magnum Opus for Local-First AI Systems That Think for Themselves
- Mar 28, 2026Architecture as Autonomy
- Mar 28, 2026The Sovereignty Manifesto: Why Local Data is the Last Bastion of Human Agency
- Mar 26, 2026DeerFlow 2.0: Building Sovereign AI Agent Systems with Local-First Architecture
- Mar 17, 2026Building a Private Knowledge Graph with Local AI Agents
- Mar 10, 2026Breaking Free from ChatGPT: How to Take Back Your AI Sovereignty
- Mar 10, 2026How to Run Your Own AI Agent: OpenClaw + Qwen 3.5 + Telegram (Fully Local)
- Feb 22, 2026Building a Cognitive Graph AI Application: A Comprehensive Guide
- Feb 19, 2026Building a Knowledge-Sharing Chatbot: Turn Expertise Into an AI That Anyone Can Query
- Feb 15, 2026Building This Blog: A Technical Deep Dive into My Next.js AI-Powered Publishing Platform
- Feb 13, 2026The Biological API: Why AI Developers Should Care About Rhythmic Chanting
- Feb 8, 2026Audible Data Transmission: When Humans Become the Codec
- Feb 3, 2026Dynamic Persona MoE RAG: Building a Memory-Driven Synthetic Intelligence with Knowledge Graphs and Persona Evolution
- Jan 28, 2026Dynamic Persona MoE RAG - Implementation Plan
- Jan 25, 2026Building the Synthetic Analyst: From RAG to Reason with Dynamic Persona MoE
- Jan 25, 2026Dynamic Persona MoE RAG - Building a Sovereign Synthetic Intelligence System
- Jan 25, 2026Synthetic Intelligence: Engineering the Sovereign, Deterministic Mind
- Jan 22, 2026Building a Dynamic Persona-Based Mixture-of-Experts RAG System
- Jan 22, 2026From Scaffolding to Reality: Building the Dynamic Persona MOE RAG System
- Jan 22, 2026Render's Latest Betrayal: Or How My Logs Quietly Became Someone Else's Asset
- Jan 16, 2026From Fragmented Experiments to Cognitive Synthesis : The Evolution of Simulacra
- Jan 12, 2026Autonomous AI Agents: Building Distributed Systems with Local LLMs - Developer Portfolio
- Jan 11, 2026Memory Preservation Invariants: A New Class of Autonomous Agent Architectures
- Jan 10, 2026The AI Revolution in Business: Transforming Sales, CRM, and Customer Management in 2026
- Jan 8, 2026Revolutionizing Music Creation: The Dawn of ACE-Step and the Shadows of AI Warfare
- Jan 7, 2026SpecGen: Deterministic AI-Powered Code Generation from Natural Language
- Jan 5, 2026Architectures of Autonomous Voice: Building Ethically-Grounded AI Systems from First Principles
- Jan 5, 2026Infinity, Paradox, and Autonomous Architects: Why Anthropomorphizing AI is the Ultimate Roast
- Jan 4, 2026Autonomous Architectures: The Convergence of High-Velocity Inference and Self-Improving Agentic Frameworks
- Jan 3, 2026The American Phoenix: How One Man's Digital Resurrection Rewrites the Rules of Survival
- Dec 9, 2025How I Built a Fully Uncensored, Persona-Driven AI Chatbot Using MCP and NotebookLM
- Dec 4, 2025Critical Next.js RCE: CVE-2025-66478 Security Guide
- Nov 15, 2025Building and Evaluating a Local-First Research Assistant with GraphRAG and vero-eval
- Nov 13, 2025Inference and the New Geography of Intelligence: Why Running AI Models Matters More Than Training Them
- Nov 12, 2025Mastering llama.cpp: A Comprehensive Guide to Local LLM Integration
- Nov 11, 2025The Complete Guide to VSCode for Free Technical Blogging: From Setup to Publication
- Nov 10, 2025Top 20 AI Algorithms: Complete Guide with Use Cases and Sample Projects for Developers
- Nov 8, 2025Local LLM Integration: A Pragmatic Guide to Parsing & Summarizing Tabular Data
- Nov 5, 2025Capacity Review: The AI Workflow Engine That Actually Understands Vibe Coding (2025)
- Nov 5, 2025How to Build an AI Study System That Actually Works (Citizens Replace Your Broken PDF Tools)
- Nov 5, 2025The Ghost in the Machine is Finally Allowed to See: A Beginner's Guide to MCP
- Nov 4, 2025AI Will Flatten Workforce Inequality—If We're Honest About What That Actually Means
- Nov 3, 2025The Revolution Will Be Documented: A Manifesto for AI-Assisted Software Development in the Age of Gatekeeping
- Nov 3, 2025Document-Driven Development: How I Built a Production Blog Without Writing a Single Line of Code By Hand
- Nov 2, 2025The Rise of Vibe Coding: Cursor 2.0 vs VS Code + Cline - Ultimate AI Coding Showdown 2025
- Oct 31, 2025Reddit's Most Haunting Project: Meet the Man Coding His Murdered Friend Back to Life
- Oct 25, 2025Building Your Own Uncensored AI Overlord: A Comprehensive Guide to Chatbot Wrappers in the Age of Digital Dystopia
- Oct 21, 2025Learn Programming for Free: Complete YouTube Roadmap to Master Computer Science (2025)
- Oct 21, 2025Ultimate Guide: Export Your Reddit Data to Markdown Using Python & PRAW API
- Oct 20, 2025How to Vibe Code a Next.js Boilerplate Repository - Complete Guide 2025
- Oct 19, 2025Vibe Coding Session Building a Local LLM-Powered Knowledge Graph
- Oct 19, 2025Vibe Coding Janitor Session Building a Local LLM-Powered Knowledge Graph Part Two
- Oct 18, 2025Is There No King? Or Is NodeRAG King?
- Oct 18, 2025NextJS SEO CLIne Prompt
- Jul 8, 2025Complete Guide: Building Server-Side Rendered AI Applications with Next.js and Large Language Models
- Jul 6, 2025Unlocking AI-Powered Productivity: Two Essential Guides for Building Custom AI Personas and Agentic Knowledge Graphs
- Jul 6, 2025Demystifying Large Language Models: A Data Pipeline Insider's Perspective on LLM Architecture and Limitations
- Apr 7, 2025EchoShelf: Enterprise Voice Annotation System for Inventory Management and Team Communication
- Apr 6, 2025Building Sustainable Micro-Enterprises: The Judgmental Art Cat Project - Art, Automation, and Experimentation
- Mar 30, 2025Complete Guide: Building a Personalized AI Learning System with Local LLMs, Knowledge Graphs, and Adaptive Learning
- Mar 30, 2025Building an AI-Driven Personalized Learning Platform: Dynamic Lessons with Local LLMs and Knowledge Graphs
- Mar 29, 2025Building an AI-Powered Interactive Learning Platform
- Mar 28, 2025Mastering Text Chunking with Ollama: Advanced Techniques for Processing Large Documents with Local LLMs
- Mar 28, 2025Building Scalable AI Backends: FastAPI, PostgreSQL, Redis, Celery, and RabbitMQ Architecture Guide
- Mar 25, 2025Large-Scale Agent Architecture: Complete Guide to Building Scalable Multi-Agent Systems with AutoGen, Kubernetes, and Vector Databases
- Mar 24, 2025Complete Guide: Building Your Own Model Context Protocol (MCP) Server for AI Tool Integration and Communication
- Mar 22, 2025Complete Guide: Building an AI Knowledge Companion with Browser-Use, MCP, and Ollama for Advanced Web Automation and Information Processing
- Mar 22, 2025Complete Blueprint: Building a Local LLM Document Processing Pipeline with Advanced Extraction, Semantic Analysis, and Scalable Storage
- Mar 13, 2025Simulacra01: Complete Guide to Building Local AI Agents with OpenAI Agents SDK and Ollama Integration
- Mar 12, 2025OpenAI Agents SDK & Ollama Integration: Complete Architecture Guide
- Mar 12, 2025Complete Guide: Integrating MCP with OpenAI Responses API, Agents SDK, and Ollama for Symbiotic Intelligence
- Mar 12, 2025The Convergence of MCP, OpenAI Agents SDK, and Ollama: An Architectural Paradigm for Advanced AI Systems
- Mar 12, 2025Complete Guide: Integrating OpenAI Agents SDK with Ollama for Local AI Agent Development
- Mar 11, 2025Complete Guide: Integrating Rust's Burn Framework for AI Model Training and Local Deployment
- Mar 11, 2025Complete Guide: Integrating OpenAI Agents SDK with Rust's Burn Framework for Local AI Model Development
- Mar 9, 2025Complete Guide: Building a High-Performance Quiz Platform with Next.js and Firebase Integration
- Mar 9, 2025ReasonAI: Complete Guide to Building Local-First AI Agents with Advanced Reasoning and Task Decomposition
- Mar 9, 2025Custom AI Agent Framework: Next.js & Ollama Integration Guide
- Mar 9, 2025Complete Guide: Building an AI-Powered Next.js Application with Custom Agent Framework and Ollama Integration
- Mar 9, 2025Complete Guide: Building an AI-Powered Next.js Application with Mastra and Ollama Integration
- Mar 3, 2025Building an AI Text Adventure Generator Web Application: Creating Interactive Stories from Images Using Next.js, Python, and Local LLMs with Ollama Integration
- Feb 25, 2025Developing an AI-Powered Filename Generator Chrome Extension: Complete Technical Guide with Ollama Integration and Webpack Build System
- Feb 23, 2025Privacy Policy for AI Filename Generator Chrome Extension: Complete Data Protection Guidelines for Local AI Processing Using Ollama
- Feb 14, 2025RedDiss Technical Deep Dive: Complete AI-Powered Diss Track Generation Pipeline with Reddit Sentiment Analysis, LLM Lyrics Crafting, and Audio Production Automation
- Feb 5, 2025Complete Ollama Smolagents Integration Tutorial: Building Open Deep Research Agents with Local LLMs for Autonomous AI Research and Tool Usage
- Feb 5, 2025Announcing Loco LLM Hackathon 1.0: 24-Hour Global Sprint to Build Open-Source AI Tools with Local Large Language Models and Smolagents Framework
- Feb 5, 2025Mastering Open Deep Research: Complete Smolagents Setup Guide with GAIA Benchmark Performance and Production-Ready Agent Workflows
- Feb 3, 2025Automated Reddit Content Analytics Pipeline: Transforming Social Media Insights into Structured Blog Posts with AI Agents and Local LLMs
- Jan 23, 2025Building a Multimodal Story Generation System
- Jan 22, 2025Building an Advanced AI Image-to-Book Pipeline: Multimodal Storytelling with LLaVA, ChromaDB, and Recursive Narrative Generation Using Ollama
- Jan 16, 2025Solo Developer's Guide to Upwork Success: Psychological Analysis & Implementation
- Dec 30, 2024Cultural Fingerprints in AI: Comparative Analysis of Ethical Guardrails in LLMs (US, Chinese, French Models)
- Dec 19, 2024Configuring Continue.dev with Ollama for Local Large Language Model Integration in VSCode Development Environment
- Dec 19, 2024Comprehensive Austin Homeless Survival Guide: Essential Resources, Legal Rights, and Personal Recovery Journey Through Adversity
- Dec 19, 2024Complete LangChain Ollama Integration: Building Graph-Based Multi-Persona Conversations with Local LLMs and CLI/GUI Interfaces
- Dec 14, 2024Developing a Toxicity Detection Communication App: Promoting Positive Dialogue with AI Ethics, React, and TensorFlow.js
- Dec 11, 2024Advanced PersonaGen: Architecting Next-Generation AI Systems with Reinforcement Learning, Retrieval-Augmented Generation, and Multi-Agent Persona Frameworks
- Dec 10, 2024Complete Guide to Reinforcement Learning: From MDPs to AGI - Theory, Algorithms & Advanced Applications
- Dec 9, 2024Complete Guide: Building Persona-Aware RAG Systems with Pydantic AI Agents & Tools - Custom Retrieval & Generation
- Dec 5, 2024Complete Guide: Refactoring Django Persona Manager - From JSON to Individual Database Fields for Scalable AI Systems
- Dec 2, 2024Complete Guide: Building Personalized AI Assistants with LangChain - Persona-Based Chatbot Development
- Dec 1, 2024Complete Guide: Building Robust RAG Systems with LangChain & OpenAI - From Setup to Advanced Implementation
- Nov 29, 2024Tech Company Orchestrator: Simulate Full-Stack Development Workflow with AI Agents
- Nov 28, 2024AI Travel Planner with Microsoft AutoGen: Multi-Agent Collaboration
- Nov 28, 2024AI Customer Support Chatbot Using OpenAI Swarm: Multi-Agent Routing
- Nov 27, 2024Complete Guide: Building AI Agent-Based Cross-Platform Content Generator for Automated Social Media Distribution
- Nov 27, 2024AI Instagram Feed Summarizer: Build Multi-Modal Persona Blog Generator
- Nov 27, 2024Reddit Blog Generator: Automate Reddit-to-Blog Posts with AI Personas
- Nov 27, 2024Complete Guide: Building Enhanced AI Persona Generator with Python & OpenAI - From Analysis to Response
- Nov 27, 2024Integrating OpenAI Swarm & Microsoft Autogen: Multi-Agent AI for Persona Generation
- Nov 27, 2024Complete Guide to Data Annotation Careers: From Beginner to AI Professional - Skills, Tools & Industry Insights
- Nov 23, 2024Complete Business Plan for RLHF-Lab: Building an AI Data Annotation Startup from Ground Zero
- Nov 22, 2024RLHF-Lab: Complete Guide to Building an AI Data Annotation Platform Company from Scratch
- Nov 22, 2024Complete Guide to Building a Data Annotation Platform Company: From Startup to Scale
- Nov 4, 2024AI-Generated Deepfakes: Complete Guide to Persona-Based Content Creation and Ethical Implications
- Oct 30, 2024Building AI Agents: From Code to Digital Übermensch - Complete Guide to Autonomous Agent Architecture
- Oct 24, 2024GhostWriter: Complete AI Writing Assistant - Django + React Full-Stack Tutorial & Setup Guide
- Oct 22, 2024Complete Guide: Migrating from OpenAI to XAI API in Django + React Full-Stack Applications
- Oct 18, 2024Complete Full-Stack AI Persona Generator: Django REST API + React Frontend with Ollama Integration
- Oct 12, 2024Building Full-Stack AI Persona Generator: Complete Django + React Tutorial with LLM Integration
- Oct 9, 2024Building AI Persona-Based Content Generator: Complete Python Tutorial with Jekyll Integration
- Oct 4, 2024Building an AI-Powered Journal Local LLMs for Private, Intelligent Reflection
The book
The research archive
198 articles, 12 systems and 8 concepts — one program. The book compiles it into 24 chapters.