Skip to main content

Dimension 5: The Operating System

The first four dimensions operate inside the terminal. The fifth dimension breaks out of it.

Recap: Four Dimensions Inside the Terminal

All four dimensions live inside the terminal. Agents read files, write code, run commands. Powerful — but blind to everything outside the terminal window.

Dimension 5: Agent Sees the OS

An agent in dimension 5 can:

The Capability Layer: Kernel CLI

Kernel CLI is a standalone, cross-platform binary that provides raw OS observation, control, and machine telemetry. Start by proving the current machine instead of assuming that every desktop session exposes the same features:
Kernel CLI prefers app data, system metadata, windows, accessibility, and target handles before OCR, screenshots, and coordinates. Pixel workflows stay available for custom-rendered or inaccessible UI; they are a fallback, not a mandatory first step. See the canonical Kernel CLI overview, workflows, and reference.

The Harness Layer: niia observe/control

Kernel CLI is raw capability. niia wraps it with physical harnessing.

Why Structured State Comes First

Structured state carries roles, values, enabled state, identifiers, and available actions. That usually gives an agent a more precise decision surface than pixels alone. When the UI has no useful semantic surface, Kernel CLI can still read rendered text or capture visual evidence.

In connector.json

Phase 1: Code in terminal (Dimension 1-4). Phase 2: Check CI in browser, merge PR (Dimension 5). Phase 3: Notify team in Slack (Dimension 5). One pipeline. Terminal + OS. Code + UI. All declarative.

The Five Dimensions

Safety by Design

Dimension 5 is the most powerful and the most dangerous. That’s why it has the strongest harness:
See Physical Harnessing: OTP and Policy for why this matters.