Data systems, MLOps & security
Pipelines, schemas, provenance, observability, access control and the security posture of an AI-native plant. 234 pages
Accessible visualization ensures that color-vision differences, low vision, and non-visual access do not exclude readers from the data.
Apache Arrow defines a standard columnar layout in memory so systems share data without serialization, and process it with vectorized speed.
Every external message is a validated, versioned document; the contract is the durable interface that lets the plant evolve without breaking the parties bound to it.
Fusion codes are only as accurate as the atomic, molecular, and nuclear data they consume: cross-sections, rates, and decay data underpin every result.
An append-only, tamper-evident record links every action back through the proposals, checks, and approvals that produced it.
An append-only, cryptographically chained log records every external action and every material quantity's origin, so any claim the plant makes is reconstructable.
Authentication proves who you are; authorization decides what you may do. They are distinct steps, and confusing them creates real vulnerabilities.
Mutual TLS proves who is calling, scoped RBAC decides what they may do, and every external actor is treated as untrusted until cryptographically identified.
Avro pairs compact binary data with an explicit schema, and a schema registry governs how those schemas may change across a streaming pipeline.
A high-fanout balanced tree that stores all data in the leaves and links them for range scans, standard in databases and filesystems.
Batch processing handles bounded data on a schedule; stream processing handles unbounded data continuously as it arrives.
Predicting an experiment's outcome before the data is seen is the strongest validation test, immune to unconscious tuning.
The typed contracts that define every copilot tool call — arguments, ranges, side-effect flags — and reject anything malformed before it runs.
Branch prediction guesses the outcome and target of a branch so a pipeline can keep fetching instead of stalling for the decision.
The direct-energy converter turns the kinetic energy of escaping charged particles into electricity without a thermal cycle.
The expander is the flaring region beyond each plug where the escaping plasma spreads out along widening field lines.
MetroVolt is the burner packaged for data centers, delivering the tandem-mirror generator as an on-site power source.
Cache coherence keeps every core's cached copy of shared data consistent, an invisible service with real performance consequences.
A cache holds recently used data close to the processor; associativity decides how freely a memory block may be placed within it.
Small, fast memory close to the processor that holds recently used data to hide slow main-memory access.
Discovery is how users find the right dataset among many; it depends on good metadata, indexing, and a searchable catalog.
Estimating the effect of an action from data requires assumptions that go beyond the data; making them explicit is the whole discipline.
Change data capture streams every insert, update, and delete from a source database so downstream systems stay synchronized in near real time.
A checksum is a small value computed from data to detect accidental corruption during storage or transfer.
A checksum is a short fingerprint of data that lets anyone detect corruption or confirm that bytes are exactly what they should be.
Grouping data points so that members of a group are more similar to each other than to points in other groups.
How Kronos places data across access tiers so active pulses are fast to reach while the full history stays affordable to keep.
Observables can be measured simultaneously with definite values only if they commute; non-commuting observables obey an uncertainty relation.
Presenting analyses and data to regulators in a form that is complete, checkable, and honest about what is known and unknown.
Predictive operations begin with dense, reliable sensing; the value of the models depends entirely on the quality of the data feeding them.
Linking several views of the same data so a selection in one updates the others turns a set of charts into a single instrument.
Every copilot request, reasoning trace, citation, proposal, and authorization decision is retained immutably so any output can be reconstructed and reviewed.
One fabric serves both machines under a shared schema, so features, models, and lineage transfer between the breeder and the burner.
Estimating how a model will generalize when data are scarce, correlated, and grouped by shot.
The current-sharing temperature marks where a superconductor starts to share current with its copper matrix, and temperature margin to it is the key health metric.
L7 hardens the single external door with zero-trust identity, strict segmentation, and physics-limited authority, so no external compromise can drive the machine unsafely.
A data acquisition system turns physical quantities into timestamped digital data, and its timing and integrity determine what control and analysis can achieve.
Data assimilation blends an imperfect model forecast with imperfect measurements to produce a state estimate better than either alone.
Data assimilation blends a physical model with streaming observations to track a system's state, and ML sharpens every part of the loop.
Expanding scarce, imbalanced datasets with transformations and synthetic examples, without inventing physics.
A data catalog is an organized inventory of an organization's datasets with their descriptions, owners, schemas, and quality, making data findable and understandable.
A data contract is an explicit, enforced agreement between a data producer and its consumers about schema, semantics, quality, and change policy.
Hardware that physically allows data to flow in only one direction, so telemetry can leave a protected zone while no command can enter.
Data discovery is how people locate and evaluate datasets through search, ranking, and metadata signals rather than by knowing where to look.
Getting classical data into a quantum state is a modeling decision with deep consequences for capacity, cost, and whether any speedup survives.
How telemetry is progressively filtered and promoted from raw edge streams to curated foundation datasets along the pipeline.
Shared, self-describing data formats let simulations, diagnostics, and analysis tools exchange results without loss or ambiguity.
Data governance is the set of policies, roles, and controls that define who may use which data, for what purpose, and to what standard.
Ingestion is how data enters a system; the main choices are push versus pull, batch versus continuous, and full versus incremental.
A data lake stores raw data of any format at scale, deferring structure until the data is read rather than imposing it on write.
Data leakage lets information unavailable at prediction time slip into training, inflating scores that collapse in production.
Lineage records the full ancestry of every feature — which channels, calibrations, and transforms produced it — so any twin decision can be traced to raw bytes.
Every signal, feature, model, and decision carries provenance — so the plant can prove, after the fact, exactly what any action was based on.
Data observability is the practice of continuously measuring the health of data and pipelines to catch problems before they spread.
Data parallelism applies the same operation to many data elements simultaneously, the dominant pattern in scientific computing and deep learning.
An automated sequence of steps that moves and transforms data from sources to a usable form.
The ingestion layer turns raw, messy sensor streams into clean, aligned, validated data the twin can trust.
A data pipeline moves and transforms data through defined stages; provenance records where every value came from.
The unglamorous work of collecting, cleaning, aligning, and labeling data that determines whether any model succeeds.
A data pipeline is the ordered set of stages that move raw measurements into forms that people and models can use reliably.
Governance defines who may collect, use, and retain data and under what rules; privacy is the discipline of honoring those limits.
The recorded history of how a dataset was produced: its sources, the code that transformed it, and the parameters used.
Knowing where data came from and every transformation it passed through is what lets you trust, debug, and correct any analysis built on it.
Every result must know where its data came from and which version it used, or reproducibility and trust both break down.
Provenance records the complete lineage of a simulation result, so any number can be traced to the exact code, inputs, and environment that produced it.
Common formats and identifiers that make the lineage of data portable, machine-readable, and durable across tools and time.
Data quality is measured across dimensions like accuracy and completeness; validation enforces them by testing data as it flows.
Data re-uploading feeds the input into a circuit multiple times, interleaved with trainable layers, letting even a single qubit approximate rich functions.
Storing raw data lets a twin be re-run later with better models, extracting new insight from old operation.
Shared data schemas define a common language for plasma state so independently developed codes can exchange information without custom translation.
A way of organizing data in memory to support efficient access and modification.
Data versioning applies the discipline of source control to datasets and models so any result can be traced to the exact inputs that produced it.
Every training set is content-addressed and traceable: which raw pulses, which transforms, and which labels produced it, so any model can be reproduced from its data.
A warehouse stores structured, schema-on-write data for analytics; a lake stores raw, schema-on-read data of any type. Each fits a different need.
A data warehouse is a structured, query-optimized store that holds cleaned, conformed data organized for analysis and reporting.
Automated checks that catch bad data before it reaches analyses, so conclusions rest on inputs that have been validated.
Data-quality validation checks data against explicit expectations for completeness, validity, and consistency, catching problems before they reach consumers.
Choosing which visual channel represents which variable is the central decision in visualization, governed by how accurately people read each channel.
An organized collection of data with a system for efficient storage, query, and update.
A dataframe is a labeled, columnar table abstraction that makes filtering, grouping, and transforming tabular data expressive and fast.
A dataset card documents a dataset's contents, origin, intended use, and limitations so others can decide whether and how to use it responsibly.
Direct energy conversion recovers charged-particle energy on biased collector grids; L1 modulates grid voltages to match the escaping-ion spectrum.
The multi-modal direct-energy-conversion train — TWDEC, ultra-high-field MHD, thermionics — is instrumented so the fabric tracks conversion of escaping particles.
A digital twin is a model kept in step with a real system by live data, used to monitor, predict, and test changes before making them.
Mapping high-dimensional data to fewer dimensions while preserving its important structure.
Direct memory access lets peripherals move data to and from memory without the processor copying every byte, freeing it for other work.
A registry holds the authoritative definitions of every channel, feature, and document, so the whole fabric agrees on what each number means.
The written record that lets a result be understood, checked, and defended long after the run that produced it.
Undocumented code and data are only half delivered; the record of what something does and why is part of the work, not an extra.
Edge data collection gathers, filters, and buffers data near its source, sending only what matters upstream over constrained and unreliable links.
Encrypting stored data protects it when the storage medium is lost, stolen, or accessed outside the running system's controls.
Encrypting data as it moves across networks prevents eavesdropping and tampering by anyone who can observe or intercept the traffic.
Extract-Transform-Load and Extract-Load-Transform differ in whether data is reshaped before or after it lands in the destination store.
Every event conforms to a versioned, registered schema so producers and consumers evolve independently without silent corruption.
An expectation value is the average measurement outcome of an observable, computed as a simple inner product or trace.
Findable, Accessible, Interoperable, Reusable: four principles for research data that make it genuinely useful to others and machines.
Feedback compares output to reference and acts on the difference, reshaping a system's dynamics through the closed-loop gain.
A FIFO buffer stores data in first-in, first-out order, decoupling a producer and consumer that operate at different rates.
How Layer 6 draws from L1-L5 and where it deliberately holds no authority — the contract that lets observability be everywhere while control stays concentrated.
Every control decision is traceable from actuator command back through the model, its inputs, and the code and data versions that produced it - a complete, replayable chain.
No method, however sophisticated, extracts truth from flawed inputs; the quality of a result is capped by the quality of its data.
Coupling a system to an ancilla and measuring the ancilla realizes measurements richer than any projective observable.
Ghost cells are local copies of neighbors' boundary data; the halo exchange refreshes them each step so stencil updates need no per-cell communication.
Granting a model authority over a machine requires a recorded, multi-party approval quorum — never a single click — with distinct sign-offs for the breeder and burner.
Every side-effecting proposal from L5 passes through L4 orchestration, which checks envelope, authority, and rate limits before anything reaches L1.
Tamper-resistant hardware that generates, stores, and uses cryptographic keys without ever exposing them to the software using them.
The four burner physics gates are encoded as hard checks in the pipeline, so no model can be trained, validated, documented, or promoted into implying a capability the physics deni
Storage tiers match data to media by how often and how fast it must be accessed, keeping frequent data fast and rare data durable.
Automation runs the loops; humans hold ultimate authority. Roles, permissions, and the actions reserved for people are defined explicitly, not left implicit.
Actions above a defined authority threshold pause until the right qualified human approves, with the request, context, and decision all recorded.
Audit records are written to an append-only, hash-chained store so any alteration or deletion is cryptographically detectable after the fact.
In-situ analysis processes simulation data while it is still in memory, avoiding the cost of writing full fields to disk for later study.
A prepared, rehearsed process for handling security incidents that limits damage and speeds recovery when, not if, something goes wrong.
A standing third-party replication and adversarial-audit program.
CPUs overlap the stages of successive instructions in a pipeline, raising throughput; hazards and mispredicted branches stall it.
Interaction turns a static figure into an instrument, letting a user ask questions of data through selection, filtering, and drill-down.
A reading is only as trustworthy as its calibration record; this interface carries the traceable provenance every layer checks before acting.
Interlocks sometimes must be bypassed for maintenance; doing so safely requires authority, a second person, a scope, a time limit, and an audit record.
Estimating values between known data points by fitting a function that passes through them.
Inverse UQ infers uncertain model parameters from observed data, returning distributions that reflect what the data can and cannot pin down.
A clustering algorithm that partitions data into k groups by iteratively minimizing distance to cluster centers.
K-means partitions data into k clusters by alternately assigning points to the nearest center and recomputing centers.
Partition points into k groups by alternating between assigning points to nearest centers and recomputing those centers.
The Data Fabric turns raw analog plasma telemetry into pristine, governed, AI-ready features for both machines, with lineage from feedthrough to feature store.
The lakehouse adds warehouse-grade transactions, schema, and governance to low-cost lake storage, aiming to serve both raw and curated workloads from one layer.
When data exceeds memory or frame budgets, level-of-detail and multiresolution methods keep visualization interactive and honest.
Leakage is population escaping the computational subspace into higher levels; seepage is its return, and both break the assumptions of standard error correction.
Loop shaping designs a controller by directly molding the open-loop frequency response to meet performance and robustness specifications.
L7 closes the loop from condition monitoring to spares, scheduling, and teleoperated intervention, so maintenance is planned from physics rather than the calendar.
The medallion architecture organizes a data lake into bronze, silver, and gold layers, refining raw data into curated, consumption-ready tables in stages.
Metadata is data about data; a catalog makes datasets discoverable by recording what they are, where they live, and how they relate.
Strict governance ensures every datum carries correct, complete metadata — machine, channel, calibration, quality, version — so nothing is orphaned.
ML metadata is the structured record connecting datasets, executions, and artifacts into a queryable graph of how every model came to be.
MLOps at Kronos is the disciplined pipeline that carries a model from L0 training to a validated, revertible artifact allowed to influence the two machines.
Read-first, strongly authenticated mobile and tablet views that let on-call engineers triage from anywhere without weakening the control room's authority.
Every deployable model ships a card stating its purpose, validated envelope, metrics, and known limits — an honest, machine-readable statement of what it can and cannot do.
Deployed models degrade as the world changes; monitoring detects data and concept drift so models can be retrained in time.
Each model artifact carries a full provenance chain — data, code, seed, environment, and parent model — so any deployed controller can be reconstructed and audited exactly.
A twin that was accurate can drift as the machine ages; Kronos monitors drift continuously and triggers recalibration before it degrades control.
Requiring two or more independent proofs of identity so that stealing any single credential is not enough to gain access.
NetCDF stores array-oriented scientific data with named dimensions, coordinate variables, and standardized metadata conventions.
How Kronos ingests, processes, and version-pins evaluated nuclear data so every neutronics run is reproducible and auditable.
In non-uniform memory access systems, a core reaches its local memory faster than memory attached to another socket, so data placement affects speed.
Object storage keeps data as immutable objects with metadata in a flat namespace, scaling to enormous capacity with simple access.
A system is observable if its full internal state can be reconstructed from the outputs over a finite time interval.
Whether the twin can infer the internal state from external diagnostics is a precise property - observability - that governs where estimates are trustworthy.
A one-class SVM learns a boundary that encloses normal data, treating outside points as anomalies.
Making methods, data, and intentions public before results are known guards against selective reporting and lets others check the work.
Operational technology and information technology face different threats, priorities, and constraints, so the same security playbook cannot serve both.
Hiding communication behind useful work is a core scaling technique: start a transfer, compute on independent data, then finish the transfer.
A p-value is the probability of data at least as extreme as observed, assuming the null hypothesis is true.
Partitioning and bucketing physically organize a dataset so queries read less data and joins avoid shuffling, at the cost of careful key choice.
Partitioning splits a dataset into pieces along a key so that queries touch less data and work spreads across machines.
Authorized simulated attacks that test defenses in practice, revealing what real adversaries could actually accomplish.
A color map should map data to color so that equal data steps look equal, and so that structure comes from the data, not the palette.
Structures that preserve every previous version after an update, allowing queries against any point in their history.
Cyber defenses are moot if an attacker can walk up to the hardware, so protecting the physical machines is part of security, not separate from it.
Pipeline parallelism streams data through a chain of stages, each running on its own processor, so all stages work concurrently on different items.
Proper orthogonal decomposition extracts an optimal linear basis from data, and Galerkin projection evolves the equations within it.
Human preference data is collected with the same lineage rigor as machine data — who judged, on what, when — so RLHF rests on an auditable, versioned foundation.
A linear method that finds orthogonal directions of greatest variance to compress or explain data.
Laws that give people rights over their personal data and impose obligations on those who collect it, shaping how systems must be built.
Affinity pins processes and threads to specific cores and memory so the operating system cannot migrate them and break data locality.
Structured, versioned prompt templates that fix each copilot's role, constraints, tool contract, and output schema — so behavior is reproducible and testable.
Recording the complete lineage of data and results so that any output can be traced back to its origins and every change is accountable.
Provenance records the full history of a result: which codes, versions, inputs, and machines produced it, so any number can be traced to its origin.
An append-only audit trail records every decision the AI stack informed and the data behind it, giving the fabric a defensible history.
The system of certificates and authorities that lets parties trust which public key belongs to whom, enabling encryption and signatures at scale.
Purple blocks carry plant-level intent, regulatory constraint, and the audit trail — the layer that decides what the machine should do and proves what it did.
A calibration pipeline is the ordered set of automated experiments that turn a cold, uncharacterized chip into a device with accurate gates.
Read-only memory holds fixed data that persists without power and can also implement any combinational function as a lookup table.
Logging must capture high-rate control and diagnostic data without disturbing the real-time loop it observes, preserving both timing and integrity.
Live data is optimized for low latency and short horizons; archival data is optimized for durability, completeness, and long-term readability.
L7 provides regulators a read-only, provenance-complete feed of the plant's byproduct-material activity, generated from the same ledger operations use.
The ability to obtain the same results by re-running an analysis with the same data and methods.
A result no one else can reproduce is a claim, not a finding; open data and code turn claims into verifiable science.
Making results repeatable and auditable, the standard that separates credible work from a lucky run.
A reproducible pipeline lets anyone with the inputs regenerate a result exactly, through pinned environments, versioned data, and automated execution.
Copilots ground every claim by retrieving from the L2 data fabric — shot histories, design documents, fault records — rather than relying on parametric memory.
Sampled-data systems mix a continuous plant with a discrete controller, requiring analysis of sampling, holds, and aliasing together.
Schema evolution lets a dataset's structure change over time without breaking the readers and writers that depend on it.
Schemas change over a machine's life; compatibility rules let old and new events coexist without breaking replay or in-flight procedures.
A schema defines a dataset's structure and types; a data contract makes that definition a binding agreement between producer and consumer.
Choosing a data format is a trade among self-description, performance, portability, and how long the data must remain readable.
Building security into a system from the first architecture decision is cheaper and more effective than bolting it on afterward.
Letting authorized people reach systems from afar without opening a door for attackers requires strong authentication, encryption, and tight scoping.
IT/OT separation, airgaps, unidirectional data diodes, and full decision-audit lineage.
Records of who did what and when are the raw material for detecting attacks, investigating incidents, and establishing accountability.
Collecting and correlating logs and events across a system reveals attacks that no single source would show on its own.
Simulation programs generate vast, structured outputs that must be organized, described, and pruned so results stay findable and reproducible.
Every deployed artifact carries a complete bill of materials and verifiable build provenance, so what runs on the plant is traceable to reviewed source.
A declarative language for querying and manipulating data in relational databases.
The workhorse connections: sub-microsecond-sampled data streaming up the fabric to feed monitoring, the twin, and the copilots.
A data story leads a reader through evidence to a conclusion, using structure and emphasis without distorting what the data says.
Streaming systems process an unbounded sequence of records continuously, producing results with low latency as data arrives.
Components, firmware, and dependencies are verified for provenance before they enter the plant, because a tampered part defeats every runtime control downstream.
Synthetic data is artificially generated to resemble real data, used when real examples are scarce, sensitive, or missing important cases.
t-SNE is a nonlinear method that maps high-dimensional data to 2-D or 3-D, preserving local neighborhoods for visualization.
Channel and feature schemas evolve as the machines mature; versioning ties every archived datum to the exact definitions in force when it was taken.
More than sixty analog telemetry ports carry raw plasma and machine state out of the vessel into the acquisition chain, sampled below the microsecond.
Prediction error splits into a part from wrong assumptions and a part from sensitivity to data; reducing one tends to raise the other.
The datapath is the collection of registers, ALU, and interconnect that performs a processor's data operations, steered by the control unit.
The feedback cycle in which operating data improves the next design, and design assumptions are tested against what the plant actually does.
A software pipeline carries a fusion design from parametric study to fabrication data to live plant control.
Kronos organizes its design physics as a suite of independent, reproducible analyses, each versioned, provenance-tracked, and regenerable from its inputs.
The analyses, records, and traceability a regulator needs are assembled into one growing, auditable package as the design matures.
The Nelder-Mead simplex method minimizes a function by moving and reshaping a geometric simplex of points, using only function values.
An open data record deposits the data behind published results in a persistent archive so others can inspect, verify, and reuse it.
A vector database indexes embeddings of shots, diagnostics, and documents so copilots retrieve the most relevant context by meaning, not keyword.
Relying on secrecy of design as your protection is fragile; real security must hold even when the attacker knows how the system works.
A structured database records every shot's configuration, outcome, and links to its telemetry, the human-and-machine index into the archive.
Transport Layer Security is the standard protocol that encrypts and authenticates most network traffic, the padlock behind secure connections.
The uncertainty principle sets a hard lower bound on the product of the spreads of two non-commuting observables.
A single authenticated gateway mediates every external interaction with the plant, translating outside requests into governed L1-L6 actions and never exposing control internals.
Data indexed in time order, analyzed to find trends, cycles, and to forecast future values.
Time-series databases are built for timestamped, append-heavy data, optimizing ingestion, time-range queries, retention, and downsampling.
A hierarchical data structure of nodes with a root and branching children, enabling fast ordered operations.
A twin coupled to a plant is a cyber-physical system; its data paths and any control authority must be secured against tampering.
A twin is a long-lived asset that must be versioned, audited, and maintained across the whole life of the machine it represents.
Semantic retrieval over embedded design documents, shot summaries, and fault records, with metadata filters that scope results to a machine and confidentiality tier.
Restructuring computation so a processor performs one operation on many data elements at once.
Three separate gates: solving the equations right, choosing the right equations, and satisfying an external authority that both were done.
Recording exactly what was done, by whom, and when turns a computation from an unrepeatable event into an auditable, recoverable record.
Data versioning tracks changes to datasets over time so any past state can be identified, retrieved, and reproduced exactly.
Strain, temperature, and vibration telemetry across the CrMoNbV vessel and carbon-fiber cocoon feed continuous structural-health monitoring.
Visual analytics couples interactive visualization with computation so a human and an algorithm can reason about data together.
A visualization pipeline transforms raw data through filtering, mapping, and rendering into images that reveal structure honestly.
Animation and small multiples both show change over time; each has strengths, and the choice depends on the comparison the viewer must make.
The von Neumann architecture stores program instructions and data in the same memory, fetched and executed in a repeating cycle.
A dashboard's usefulness rests on the data path behind it: how live values arrive, update, and stay trustworthy in the browser.
Weighted essentially non-oscillatory schemes achieve high order on smooth data while avoiding oscillations near discontinuities by adaptively weighting candidate stencils.
Multiplying a whole state by a phase changes no measurement outcome, so physical states are rays and global phase is discarded.
Workflow managers describe a computation as a graph of dependent tasks and orchestrate their execution, retries, and data flow across a cluster.
Workflow orchestration coordinates multi-step data and model pipelines, running tasks in dependency order with scheduling, retries, and observability.