Preprint
Technical Note

This version is not peer-reviewed.

A V1–V4 Diagnostic Protocol for SORT-AI Structural Assessment: From AI-Fabric Observation to Scenario-Class Evidence Interfaces

Submitted:

31 May 2026

Posted:

02 June 2026

You are already at the latest version

Abstract
This Technical Note formalizes the public diagnostic protocol by which an observed AI-fabric condition is translated into a SORT-AI structural assessment case. The protocol defines a repeatable path from observation through V1 , V2 , V3 , and V4 to Application identity, Scenario Class, Metric Set, Regime Classification, and Evidence Interface. It occupies the methodological position between the canonical SORT-AI Domain Paper, which defines the architectural hierarchy and diagnostic grammar, and the Core-3 kernel-damping evidence note, which defines the downstream reproducible risk-transition protocol. The contribution is fivefold: a public assessment grammar; a formal assessment-case object that anchors the diagnostic movement; an Evidence Compatibility Predicate connecting the case to downstream evidence; a public mathematical interface SAI → ĴAI → P̂κ ( ĴAI ) → RAI ( ∆ ) ; and an explicit public versus implementation-specific boundary. A compact AI.04 illustration instantiates the diagnostic movement at the public grammar level. The note does not claim production validation, benchmark superiority, vendor telemetry analysis, runtime implementation, a new MOCK version, or structural necessity of SORT, and it does not disclose implementation-specific operator selection, telemetry mapping, scoring, weighting, thresholds, intervention playbooks, or production integration architecture.
Keywords: 
;  ;  ;  ;  ;  ;  ;  ;  ;  

1. Introduction

Advanced AI systems are increasingly deployed as coupled execution fabrics rather than isolated models. In such fabrics, model execution, accelerator allocation, serving logic, scheduling, orchestration, memory management, runtime policy, and evidence surfaces interact across multiple layers. Component-local indicators remain necessary, but they do not determine by themselves whether the composed system remains structurally coherent. This limitation is already visible in large-scale distributed systems, where tail effects, resource sharing, straggler behaviour, and warehouse-scale coordination can dominate aggregate behaviour even when individual components remain within nominal operating bounds [6,7,8,9,10,21].
Recent AI-serving architectures reinforce this point. Paged-attention memory management, distributed serving, prefill/decoding disaggregation, and related inference-system designs show that system-level behaviour depends on interactions among model structure, memory paths, batching, routing, scheduling, and runtime execution constraints [17,18,19,20]. Industry-scale engineering reports likewise indicate that tail-utilization effects, inference-performance constraints, and deployment-level execution dynamics cannot be reduced to isolated model capability or accelerator-local metrics alone [13,14,15]. In parallel, the foundation-model and benchmark literature documents both the rapid growth of model capability and the limits of model-centric evaluation when deployed behaviour depends on context, orchestration, runtime conditions, and evaluation–deployment mismatch [24,25,26,27,28,29,30].
The canonical SORT-AI Domain Paper defines the architectural layer for such analysis: Domain, Cluster, Application, V 1 V 4 diagnostic grammar, Scenario Class, Metric Set, and Regime Classification [1]. The Core-3 kernel-damping evidence note defines a downstream reproducibility protocol for declared structural risk transitions in AI.01, AI.04, and AI.13 [2]. The present Technical Note occupies the methodological position between these two artefacts. It does not restate the SORT-AI domain architecture, and it does not introduce a second evidence protocol. Its purpose is to formalize the diagnostic movement through which an observed AI-fabric condition is translated into a structurally assessable SORT-AI case.
The contribution is a public V 1 V 4 diagnostic protocol that maps an AI-fabric observation to Application identity, Scenario Class, Metric Set, Regime Classification, and Evidence Interface. In compact form, the assessment chain is given in Eq. 10. This chain is the public methodological object of the note. It specifies how a structural diagnosis becomes an assessable case while keeping implementation-specific operator selection, telemetry mapping, scoring functions, weighting logic, intervention playbooks, and production assessment procedures outside the public protocol.
The intended manuscript class is therefore a Technical Note or Methodological Companion Note. The reading order of the three artefacts is
Canonical Domain Paper Present Technical Note Core - 3 Evidence Note .
The first artefact defines the architecture, the present note formalizes the diagnostic protocol, and the third artefact defines the reproducible evidence interface.

1.1. Claim Boundary

This note claims a public diagnostic grammar, an analysis-layer interface, a methodological bridge, a structural assessment path, and an Application-to-Scenario-to-Evidence transition. It claims that SORT-AI Applications can be treated as assessable regime spaces once an observed AI-fabric condition has been ordered through V 1 V 4 and anchored to Scenario Class, Metric Set, and Regime Classification.
The note does not claim production validation, benchmark superiority, vendor telemetry analysis, runtime implementation, a new MOCK version, a production assessment engine, structural necessity of SORT, or disclosure of implementation-specific operator selection, scoring, weighting, telemetry mapping, or intervention logic. The boundary is methodological: the note discloses the public assessment grammar, not the implementation-specific assessment engine.

1.2. Evaluation Frame and Reader Contract

Because the note sits between two SORT-AI artefacts and uses terminology imported from the canonical Domain Paper, its evaluation frame should be explicit. Table 1 states that frame. The purpose is to fix the analytical level of the manuscript for reviewer accessibility while preserving the positive methodological contribution.

1.3. What is New in This Technical Note

The present note is neither a restatement of the canonical Domain Paper nor a duplicate of the Core-3 Kernel-Damping Evidence Note. It introduces a distinct set of public methodological elements that connect those two artefacts at the analysis layer. Table 2 summarizes these elements and identifies where they are developed in the note.
The note can be read independently as a public protocol description: the diagnostic and assessment grammar developed in Section 4, Section 5, Section 6 and Section 7 is functionally self-contained at the analysis layer, while the canonical Domain Paper [1] and the Core-3 Evidence Note [2] remain the upstream architectural reference and downstream evidence reference, respectively. The evaluation object of this note is the completeness and traceability of the public assessment grammar.

1.4. Structure of This Note

Section 2 positions the note relative to the canonical SORT-AI Domain Paper and the Core-3 Evidence Note. Section 3 distinguishes structural diagnostics from structural assessment. Section 4 defines the V 1 V 4 diagnostic grammar. Section 5 formalizes the transition from AI-fabric observation to assessment case. Section 6 and Section 7 define Applications as assessable regime spaces and specify Scenario Classes, Metric Sets, and Regime Classification. Section 8 describes the Evidence Interface and its compatibility with the existing kernel-damping protocol. Section 9 presents the abstract public mathematical interface. Section 10 gives a compact AI.04 worked mini-example. Section 11 states the public versus implementation-specific boundary. Section 12 discusses the relevance of structural assessment for AI fabrics, Section 13 states the limitations, and Section 14 concludes the note.

2. Position Relative to the Canonical SORT-AI Domain Paper and the Core-3 Evidence Note

The present note is positioned between two SORT-AI artefacts with distinct methodological roles. The canonical SORT-AI Domain Paper defines the architectural hierarchy of the AI domain, including Domain, Cluster, Application, V 1 V 4 , Scenario Class, Metric Set, and Regime Classification [1]. The Core-3 Kernel-Damping Evidence Note defines a reproducible downstream evidence protocol for declared structural risk transitions in the Core-3 applications [2]. The present note defines the public transition protocol between these two layers: how an observed AI-fabric condition becomes a structurally assessable case.
The purpose of the present note is therefore narrower: it formalizes how a V 1 V 4 diagnostic reading becomes a structural assessment case. In this sense, it is a Technical Note and Methodological Companion Note. It is not a second domain paper, because it does not redefine the SORT-AI application catalogue or cluster structure. It is also not a second evidence note, because it does not re-derive the kernel-damping protocol or reproduce the Core-3 calculations. Its role is to define the public diagnostic movement connecting architecture and evidence.
The intended reading order is
Canonical SORT - AI Domain Paper Present Technical Note Core - 3 Evidence Note .
The separation of roles is summarized in Table 3. The Domain Paper supplies the architecture, the present Technical Note supplies the V 1 V 4 assessment protocol, and the Core-3 Evidence Note supplies the downstream reproducibility interface. The three artefacts are therefore sequential but not redundant.
Figure 1. Position of the present Technical Note in the SORT-AI publication sequence. The canonical SORT-AI Domain Paper supplies the architecture and diagnostic grammar; the Core-3 Kernel-Damping Evidence Note supplies the reproducible evidence interface; the present V1–V4 Diagnostic Protocol formalizes the public assessment path that connects them.
Figure 1. Position of the present Technical Note in the SORT-AI publication sequence. The canonical SORT-AI Domain Paper supplies the architecture and diagnostic grammar; the Core-3 Kernel-Damping Evidence Note supplies the reproducible evidence interface; the present V1–V4 Diagnostic Protocol formalizes the public assessment path that connects them.
Preprints 216257 g001

2.1. Imported Terms

The note imports several terms from the canonical Domain Paper. Table 4 fixes their meaning within the present protocol so that the assessment grammar can be read without reconstructing the full upstream architecture.

3. Structural Diagnostics Versus Structural Assessment

Structural diagnostics and structural assessment are sequential but distinct operations. Structural diagnostics identify the problem form within the SORT-AI architecture. Structural assessment then makes that identified condition testable under a declared Scenario Class, Metric Set, Regime Classification, and Evidence Interface.
Diagnostics therefore answers the question: what kind of structural condition is present? Assessment answers the subsequent question: can that condition be made structurally assessable under a declared scenario, metric, and regime? Assessment presupposes diagnosis; without diagnostic anchoring, an assessment case lacks structural identity within the domain architecture. Related asymmetries appear in systems reliability, site reliability engineering, machine-learning evaluation, and reproducibility research, where failure classification, measurement design, and evaluability remain distinct tasks [16,22,23,39].
In SORT-AI, the distinction can be written schematically as
Diagnostics identification of a structural problem form ,
whereas
Assessment structured evaluation of scenario , metric , and regime behaviour .
The V 1 V 4 diagnostic grammar introduced in Section 4 is the operative bridge between these two levels. It orders the diagnostic movement from observed phenomenon to structural coupling, effect space, and decision surface. Only after this movement has fixed the structural reading can the condition be assigned to an Application identity, Scenario Class, Metric Set, Regime Classification, and Evidence Interface.

4. The V1–V4 Diagnostic Grammar

The V 1 V 4 grammar is the operative diagnostic ordering convention used in this note. It is an epistemic ordering for assessment preparation, not a mechanistic causal chain, not a dynamical model, and not a production diagnostic algorithm. Its function is to order an observed condition so that the condition can be translated into an assessment case [1].
The grammar is invariant in form and domain-specific in content. In the AI domain, V 1 identifies the observed structural phenomenon, V 2 identifies the structural cause or coupling relation, V 3 identifies the structural effect space, and V 4 identifies the decision or utilization surface. The reading order is therefore V 1 V 2 V 3 V 4 . Distributed tracing and observability systems can expose parts of the V 1 observation surface, but they do not by themselves determine the structural coupling or regime classification [12,16]. Benchmark and model-evaluation literature can contribute to V 3 - and V 4 -type readings when the assessed object is a model or evaluation regime, but deployment-level assessment requires an additional structural step from observed behaviour to application-specific regime classification [30,31,32].
The reading order is
V 1 V 2 V 3 V 4 .
Each step contributes a distinct interpretive layer. V 1 states what is visible. V 2 identifies the structural relation that makes the observation intelligible. V 3 locates the resulting condition in an effect space. V 4 determines what becomes assessable, actionable, or decision-relevant.
Table 5. The V1–V4 diagnostic grammar. Each dimension answers a distinct diagnostic question and contributes a distinct interpretive layer; the four dimensions together order the reading of a structural condition.
Table 5. The V1–V4 diagnostic grammar. Each dimension answers a distinct diagnostic question and contributes a distinct interpretive layer; the four dimensions together order the reading of a structural condition.
Dim. Object Diagnostic question Output
V 1 Observed structural phenomenon What is visible at the system level? Phenomenon statement
V 2 Structural cause or coupling What relation produces or organizes the observed condition? Coupling hypothesis
V 3 Structural effect space What structural state class appears once the coupling is read? Effect-space reading
V 4 Decision or utilization surface What becomes assessable, actionable, or decision-relevant? Assessment class
The four dimensions can be expressed functionally at the public assessment level as
V 1 ( S AI ) = observed phenomenon ,
V 2 ( S AI ) = structural coupling relation ,
V 3 ( S AI ) = effect - space projection ,
and
V 4 ( S AI ) = decision or utilization surface .
Here, S AI denotes the structured AI-system state as observed at the public assessment level. Equations 69 do not define an executable transformation. They define the diagnostic roles required before a condition can be assigned to an Application and then refined into Scenario Class, Metric Set, and Regime Classification.
V 1 is the observation layer. It records the visible system-level condition without yet assigning a structural cause. Examples include rising cost per useful output, degraded effective capacity, unstable tail latency, increasing retry volume, benchmark–deployment divergence, or an auditability gap. V 1 is therefore not equivalent to raw telemetry; it is the statement of the phenomenon to be assessed.
V 2 is the structural-coupling layer. It asks what relation organizes the observed condition. In an AI fabric, this relation may involve scheduler–runtime interaction, accelerator placement, memory-path coupling, orchestration feedback, retry logic, policy enforcement, agentic tool-use loops, or evidence-surface fragmentation. V 2 is the step at which the diagnosis moves beyond local observation toward structural explanation.
V 3 is the effect-space layer. It identifies the class of structural effects that appears once the coupling relation has been read. Examples include control-coherence loss, retry amplification, interconnect-induced capacity loss, agentic divergence, evaluation–deployment projection mismatch, or evidence incompleteness. V 3 prepares the transition from diagnostic description to application-level classification.
V 4 is the decision or utilization surface. It specifies what becomes assessable after the condition has been read structurally. This may include whether the condition is a Core, Boundary, or Overlap regime; whether it requires an evidence interface; whether it affects architectural decisions, governance readiness, or runtime-control interpretation; and whether the condition can be connected to a declared Metric Set for reproducible analysis.
The V1–V4 grammar therefore functions as the operative bridge between structural diagnostics and structural assessment. Diagnostics begins with an observed phenomenon and a structural reading. Assessment begins once that reading can be anchored to Application identity, Scenario Class, Metric Set, Regime Classification, and Evidence Interface.

5. From AI-Fabric Observation to Assessment Case

The V 1 V 4 reading becomes useful for structural assessment only when it is anchored to the domain architecture. The transition from observation to assessment case therefore requires the observed AI-fabric condition to be assigned an Application identity, refined into a Scenario Class, associated with a Metric Set, classified into a Regime, and connected to an Evidence Interface. This transition is the public assessment path formalized in the present note.
This distinction is important because modern AI-fabric observations are distributed across several layers. The relevant observation surface may include distributed traces, service-level signals, runtime logs, model-serving telemetry, memory-management behaviour, scheduler decisions, tool-use traces, and evidence artefacts. Existing observability and site-reliability practices expose parts of this surface [12,16]; production ML and LLM-serving systems further show that model behaviour, runtime infrastructure, and deployment context must be considered jointly [17,20,21]. The present protocol does not replace these observation systems. It specifies how their signals are structurally ordered before assessment.
The full assessment chain is
Observation V 1 V 2 V 3 V 4 Application identity Scenario Class Metric Set Regime Classification Evidence Interface .
Equation 10 is the operational definition of a SORT-AI structural assessment case at the public methodological level. The first segment, from Observation to V 4 , is diagnostic. The second segment, from Application identity to Evidence Interface, is assessment-oriented.
Application identity is fixed during the V1–V4 reading. A Scenario Class does not introduce a new Application; it specifies a typed manifestation of an existing Application under declared structural conditions. A Metric Set then identifies the observable or derived indicators through which the Scenario Class becomes assessable. Regime Classification places the Scenario Class within the internal regime space of the Application, and the Evidence Interface determines whether the resulting case can be connected to a reproducible downstream evidence protocol.
The chain (10) can be summarized as a single formal object. A SORT-AI structural assessment case is the tuple
A case = S AI , V 1 , V 2 , V 3 , V 4 , A j , C j , M j , ρ j , E j .
The components in Eq. (11) are declared at the public analysis layer only; the tuple is an interpretive object, not an executable specification. Their public roles are summarized in Table 6.
Figure 2. Full V1–V4 assessment chain. An AI-fabric observation is first read through the V1–V4 diagnostic grammar, then anchored to an Application identity, refined into a Scenario Class with declared Metric Set and Regime Classification, and finally connected to a downstream Evidence Interface.
Figure 2. Full V1–V4 assessment chain. An AI-fabric observation is first read through the V1–V4 diagnostic grammar, then anchored to an Application identity, refined into a Scenario Class with declared Metric Set and Regime Classification, and finally connected to a downstream Evidence Interface.
Preprints 216257 g002

5.1. Notation

The formal objects used in the protocol are collected in Table 7. The table is intended to make the public grammar inspectable as a methodological object. It does not add implementation-specific operator selection, telemetry mapping, scoring, weighting, thresholding, or intervention logic.

6. Applications as Assessable Regime Spaces

In SORT-AI, an Application is a recurrent structural problem form within a Cluster [1]. It is not a software application, customer deployment, business use case, or isolated incident. The present note treats an Application as an assessable regime space: a structured domain in which Core, Boundary, and Overlap regimes can be distinguished.
This distinction is necessary because an observed condition can belong to the same Application while appearing through different Scenario Classes. A runtime-control condition, for example, may appear as a Core AI.04 condition, as a Boundary condition near an operational threshold, or as an Overlap condition involving infrastructure or agentic coupling. The Application remains the structural problem form; the Scenario Class specifies its assessable manifestation.
The internal regime space of an Application can be written as
S ( A j ) = S j core S j boundary S j overlap .
Here S ( A j ) is the public regime space of Application A j : the family of Scenario Classes available under one Application identity. The three subfamilies are not asserted to be ontologically disjoint; instead, the regime label of a Scenario Class is fixed by the classification function
ρ ( C j ) { core , boundary , overlap } .
Core regimes express the central structural mode of the Application. Boundary regimes describe limit cases near capacity, control, context, validity, or evidence boundaries. Overlap regimes identify mixed conditions in which two Applications interact within a single Scenario Class; treating Overlap as a classification output rather than as a hard set partition leaves room for the discovery-signal role discussed below.
This interpretation preserves the stability of the Application layer. Overlap does not automatically imply that a new Application has been discovered. A candidate Application requires recurrence, a stable metric signature, independent diagnostic relevance, and V1–V4 readability. Overlaps are therefore not taxonomy failures. They are discovery signals that may expose cross-application coupling points while leaving the existing Application identity intact.
The Core-3 Applications used throughout this note illustrate the distinction. AI.01 addresses interconnect and infrastructure coupling [3]. AI.04 addresses runtime-control coherence [4]. AI.13 addresses semantic and agentic coupling [5]. These Applications are not use cases. They are structurally distinct problem forms that may each contain Core, Boundary, and Overlap Scenario Classes. Recent work on tool use, reasoning-and-acting workflows, and multi-agent systems motivates the agentic surface on which AI.13 operates, but does not replace the Application-level distinction used here [34,35,36,37].
Table 8. Inner structure of an Application. The Application identity is preserved across its Scenario Classes; the Regime Classification situates each Scenario Class within the Application’s internal regime space.
Table 8. Inner structure of an Application. The Application identity is preserved across its Scenario Classes; the Regime Classification situates each Scenario Class within the Application’s internal regime space.
Layer Role
Application identity Fixed recurrent structural problem form within a Cluster.
Scenario Class Typed manifestation of the Application under a specific structural condition.
Metric Set Declared observable or derived indicators through which the Scenario Class becomes assessable.
Regime Classification Core, Boundary, or Overlap placement within the Application’s internal regime space.

7. Scenario Classes, Metric Sets, and Regime Classification

Once an Application has been identified, the assessment case must be refined at the scenario level. A Scenario Class specifies a typed manifestation of the Application. A Metric Set declares the indicator family through which the scenario can be read at the public layer [38,39]. A Regime Classification then assigns the scenario to a Core, Boundary, or Overlap regime, in the sense defined by the classifier of Eq. (15).
This structure prevents two common reductions. A Scenario Class is not a new Application, and a Metric Set is not a complete production telemetry map. The Scenario Class specifies the internal manifestation of an Application, while the Metric Set specifies the public indicator family required to make that manifestation assessable.
Two methodological points follow. First, Overlap regimes are not taxonomy failures: they are discovery signals that may expose cross-application coupling points without by themselves triggering a new Application identity, since the candidate-application criteria of Section 6 continue to apply. Second, Metric-set design is constrained by broader limitations of model and benchmark evaluation under deployment, which motivates the careful separation between the public indicator family of a Metric Set and any implementation-specific computation of those indicators [23,30].
Table 9. Regime types within the inner regime space of a SORT-AI Application. Counts of typical Scenario Classes are illustrative and depend on the application; see [2] for the Core-3 instantiation.
Table 9. Regime types within the inner regime space of a SORT-AI Application. Counts of typical Scenario Classes are illustrative and depend on the application; see [2] for the Core-3 instantiation.
Regime type Reading
Core Central manifestation; expresses the application’s axis-defining structural mode.
Boundary Limit case approaching capacity, control, context, SLA, structural, or validity boundaries.
Overlap Mixed regime in which two Applications interact within a single Scenario Class.

7.1. Formal Definitions

The verbal definitions above can be stated as analysis-layer relations. None of the following objects discloses operator selection, scoring logic, weighting, telemetry mapping, or production thresholds; each defines only a public structural relation.

Scenario-Class membership.

A Scenario Class is a typed manifestation inside the regime space of its Application:
C j S ( A j ) .

Regime classification.

The regime label of a Scenario Class is assigned under its declared Metric Set:
ρ j = ρ C j , M j { core , boundary , overlap } .
Eq. (15) treats Core, Boundary, and Overlap as classification outputs rather than as ontological categories, consistent with Section 6. The classifier ρ is treated at the public layer as an axiomatically declared regime-assignment map. Its implementation-specific decision logic is outside the public protocol and is not required for the assessment-case signature. The public role of ρ is to state whether a Scenario Class is read as Core, Boundary, or Overlap within the Application regime space.

Metric Set as declared indicator family.

A Metric Set is a declared family of indicators attached to a Scenario Class:
M j = { m 1 , m 2 , , m n } j .
The members m i are public or derived indicators; their concrete construction is implementation-specific and is not part of this note.

Metric observation vector.

Evaluating the indicators on the structured AI-fabric state yields the metric observation vector:
x j ( S AI ) = m 1 ( S AI ) , m 2 ( S AI ) , , m n ( S AI ) .
The map S AI m i ( S AI ) is declared at the public analysis layer only; this note neither specifies how individual indicators are computed in a deployed system nor how raw telemetry is transformed into S AI .

Public risk transformation.

Each indicator value is converted into a risk representation by a public transformation
r i = T i m i ( S AI ) , T i T public .
The public transformation family contains three role-defining transformations:
T public = { T risk , T health , T overhead } , T risk ( x ) = x , T health ( x ) = 1 x , T overhead ( x ) = x 1 .
The family T public defines public transformation roles within the assessment protocol. It does not specify deployment-specific telemetry mappings and does not exhaust the transformations that may be used inside an implementation-specific assessment engine. Its role is limited to the public conversion of an observation into an assessable structural case.
Boundary statement. Metric Sets do not expose telemetry mappings. They declare the public indicator role by which a Scenario Class becomes assessable. The transformation T i converts an indicator into a risk representation only at the public analysis layer; it does not constitute a scoring function, weighting rule, or threshold definition.

8. Evidence Interfaces and Kernel-Damping Compatibility

The Evidence Interface connects a structurally assessed Scenario Class to a downstream reproducibility protocol [2]. It is not an evidence-generating mechanism inside the present note. Its purpose is to state whether a Scenario Class with a declared Metric Set is compatible with a downstream evidence protocol, such as the Core-3 kernel-damping protocol.
The compatibility relation is expressed by the predicate χ E . This predicate is syntactic and methodological, not empirical. It states whether the assessment case is sufficiently structured to be passed to the downstream evidence interface; it does not certify production validity, benchmark performance, operational reliability, or empirical sufficiency. Computational reproducibility statements about the evidence protocol belong to [2] and follow established reproducibility, FAIR, software-citation, and artefact-evaluation principles [38,39,40,41,42,43,44,45,46]; this note neither reproduces them nor extends them.
The verbal compatibility statement above can be expressed as a predicate at the public analysis layer. For a Scenario Class C j with declared Metric Set M j , define the Evidence Compatibility Predicate
χ E ( C j ) = 1 m i M j : r i ( 0 ) , r i ( 1 ) is declared and admissible .
A baseline/comparison risk pair is admissible at the public layer when both entries are declared before interpretation, belong to the same metric family, are finite, and have a non-zero positive baseline wherever a quotient is used. This admissibility condition is a public protocol condition. It does not imply that the selected metrics are empirically sufficient for a production assessment.
The following quantities are used only as interface signatures of the downstream Core-3 protocol. They are not re-derived here and do not define a second evidence method. Their role is to show the type of downstream object to which a compatibility-checked Scenario Class can be connected.
r i ( 0 ) r i ( 1 ) ( declared risk pair per metric )
κ i = r i ( 1 ) r i ( 0 ) ( damping quotient )
κ σ 0 ( ξ i ) = exp ( σ 0 ξ i ) 2 2 ( Gaussian kernel form )
ξ i = 2 ln κ i σ 0 ( implied structure mode )
C V j = s ξ , j ξ ¯ j ( scenario - level coefficient of variation )
The coefficient of variation C V j is read at the scenario level as a coherence indicator over the implied structure modes associated with a declared Metric Set. In the present note, this reading remains at the public interface level. It does not assert production success, operational improvement, or benchmark superiority.

9. Public Mathematical Interface

The public mathematical interface summarizes the assessment grammar without disclosing implementation-specific operator chains. At the public layer, an AI-system state is represented as a structured input S AI , read through an abstract coupling chain J ^ AI , projected through a kernel-modulated public projection P ^ κ , and interpreted as a structural deviation field R AI ( Δ ) .
This interface is intentionally abstract. It is sufficient to state the public assessment grammar, but it is not a customer-specific operator instantiation, telemetry map, scoring function, or intervention procedure.
The public chain is
S AI J ^ AI P ^ κ ( J ^ AI ) R AI ( Δ ) .
Here, S AI denotes the structured AI-system state at the public assessment level. J ^ AI denotes an abstract operator coupling chain. P ^ κ ( J ^ AI ) denotes the kernel-modulated structural projection of that coupling chain. R AI ( Δ ) denotes the resulting structural deviation or risk field. The chain in Eq. 26 is compatible with standard operator-theoretic and matrix-analytic settings [54,55], but the present note does not derive, extend, or depend on those foundations as a new mathematical result.
Table 10. Public mathematical interface objects in the chain of Eq. 26. Each object is declared at the public abstract level; concrete operator selection, telemetry mapping, weighting, scoring, and intervention logic remain outside the scope of this note.
Table 10. Public mathematical interface objects in the chain of Eq. 26. Each object is declared at the public abstract level; concrete operator selection, telemetry mapping, weighting, scoring, and intervention logic remain outside the scope of this note.
Object Public meaning
S AI Structured AI-system state.
J ^ AI Abstract operator coupling chain.
P ^ κ ( J ^ AI ) Kernel-modulated structural projection of the abstract coupling chain.
R AI ( Δ ) Structural deviation or risk field.
The interface in Eq. 26 is deliberately abstract. It identifies the public mathematical roles required by the assessment protocol, but it does not disclose the implementation-specific operator instantiation. In particular, the customer-specific form
J ^ AI customer = O ^ i O ^ j O ^ k
is not specified in this note. Equation 27 is shown only to mark the boundary between the public formal interface and a non-disclosed implementation-specific assessment layer. No weighting logic, scoring function, telemetry mapping, production threshold, or intervention rule is defined here.
This boundary is essential for the manuscript’s role. The note formalizes a public diagnostic and assessment grammar. It does not publish an operational assessment engine. The same distinction is restated in Section 11, where the public versus implementation-specific boundary is summarized explicitly.
The public chain in Eq. (26) connects to the assessment objects of Section 5, Section 6 and Section 7 by the public reading
R AI ( Δ ) C j , M j , ρ j , E j .
The symbol ⇝ denotes an interpretive public assessment reading. It is not a deterministic inference rule, not an executable mapping, and not a production diagnostic procedure.

10. Worked Mini-Example: AI.04 Runtime Control Coherence

AI.04 Runtime Control Coherence is used as a compact worked mini-example because it illustrates the diagnostic movement from observation to assessability without requiring implementation-specific disclosure [4]. The selected Scenario Class is AI.04.C2, Retry Amplification. The example instantiates the assessment chain at the public grammar level only.
The purpose of the example is to show how an observed runtime-control condition is ordered through V 1 V 4 , anchored to an Application identity, refined into a Scenario Class, associated with a declared Metric Set, assigned a Regime Classification, and connected to the Evidence Interface. It does not define a production diagnostic engine. As an alternative overlap reading, the same movement can be read through AI.04.O1, Control plus Infrastructure Coupling. The background is operationally motivated by tail-latency and straggler effects, cross-layer tracing, end-to-end placement of control decisions, and current LLM-serving control surfaces [6,11,12,17,20]. These references motivate the observation surface; they do not define a vendor-specific system or a production measurement claim.
The diagnostic movement is summarized in Table 11. The table should be read as an assessment-chain trace, not as an implementation recipe.
The example shows why the V1–V4 grammar is not merely descriptive. At V 1 , the condition is visible as a system-level phenomenon. At V 2 , the observation is anchored to a structural coupling relation. At V 3 , the condition is placed in an effect space. At V 4 , the condition becomes decision-relevant. Only then can it be assigned to an Application identity, refined into a Scenario Class, associated with a Metric Set, classified as a Core or Overlap regime, and connected to the Evidence Interface.
Specializing the assessment-case tuple of Eq. (11) to this illustration gives
A AI . 04 . C 2 = S AI , V 1 AI . 04 , V 2 AI . 04 , V 3 AI . 04 , V 4 AI . 04 , A AI . 04 , C AI . 04 . C 2 , M AI . 04 . C 2 , ρ core , E AI . 04 . C 2 .
Eq. (29) instantiates the public components only. The metric list inside M AI . 04 . C 2 , the operator instantiation underlying J ^ AI , and any telemetry mapping that would make x j ( S AI ) executable on a deployed system are not disclosed.
The example remains public by construction. It identifies the structural path from observation to assessability, but it does not define a production diagnostic engine. Concrete operator instantiations are governed by the boundary stated in Section 9 and summarized in Section 11.

11. Public Scope and Implementation-Specific Boundary

The present note discloses the public assessment grammar of SORT-AI, not an implementation-specific assessment engine. This boundary is methodological: it identifies the level at which the protocol can be stated publicly while keeping concrete assessment execution outside the scope of the note.
The public layer consists of the diagnostic and assessment structure developed in the preceding sections: V 1 V 4 , Application identity, Scenario Class, Metric Set, Regime Classification, the abstract public mathematical chain in Eq. 26, and the Evidence Interface. This layer makes the method inspectable as a public structural assessment grammar.
The implementation-specific layer consists of operator selection, telemetry mapping, weighting logic, scoring functions, production thresholds, intervention playbooks, and integration architecture. These elements depend on the concrete operational context and are not required to state the public diagnostic protocol. The public versus implementation-specific split is also consistent with AI risk-management and governance practice, where evidence interfaces and traceability requirements can be specified without disclosing the internal implementation logic of the operating organization [47,48,49].
Table 12. Public scope and implementation-specific boundary of the present Technical Note. The note discloses the public diagnostic and assessment grammar; concrete implementation logic remains outside its scope.
Table 12. Public scope and implementation-specific boundary of the present Technical Note. The note discloses the public diagnostic and assessment grammar; concrete implementation logic remains outside its scope.
Public in this note Not disclosed in this note
V1–V4 grammar Implementation-specific operator chains
Application / Scenario / Metric / Regime hierarchy Customer telemetry mapping
Abstract risk-transition interface Scoring functions
Kernel-damping Evidence Interface, referenced only Weighting logic
AI.04 illustrative assessment path Production thresholds
Claim boundary Intervention playbooks
Public mathematical chain in Eq. 26 Production integration architecture
Figure 3. Public versus implementation-specific boundary of the SORT-AI assessment protocol. The present Technical Note formalizes the public assessment grammar, including V1–V4 diagnostic reading, Application-to-Scenario structuring, Metric Set declaration, Regime Classification, and Evidence Interface linkage. Implementation-specific operator selection, telemetry mapping, scoring, weighting, thresholds, intervention playbooks, and production integration remain outside the public scope of this note.
Figure 3. Public versus implementation-specific boundary of the SORT-AI assessment protocol. The present Technical Note formalizes the public assessment grammar, including V1–V4 diagnostic reading, Application-to-Scenario structuring, Metric Set declaration, Regime Classification, and Evidence Interface linkage. Implementation-specific operator selection, telemetry mapping, scoring, weighting, thresholds, intervention playbooks, and production integration remain outside the public scope of this note.
Preprints 216257 g003
This boundary is essential for the role of the note. The public protocol must be explicit enough to define the structural assessment path, but it must not collapse into a deployment manual, scoring system, or production assessment engine. The result is a public methodological interface: inspectable enough to support scientific discussion while remaining distinct from implementation-specific operational logic.

12. Discussion: Why Structural Assessment Matters for AI Fabrics

AI fabrics are composed execution structures. Their behaviour is distributed across model execution, serving infrastructure, schedulers, orchestrators, runtime control, memory paths, tool chains, policy surfaces, and evidence artefacts. Local metrics, tracing, and observability remain necessary, but they do not by themselves determine whether the composed fabric remains structurally coherent [12,16]. The V 1 V 4 protocol addresses this gap by specifying how an observed condition is structurally read before it is converted into an assessment case.
Treating Applications as assessable regime spaces is the key methodological step. A condition is not collapsed into model quality, infrastructure failure, or an undifferentiated operational incident. Instead, it is assigned to an Application identity, refined into a Scenario Class, associated with a declared Metric Set, and placed within a Core, Boundary, or Overlap regime. This makes cross-layer conditions readable while preserving the distinction between model-centric evaluation and structural assessment [27,30,33].
Boundary and Overlap regimes are particularly important for AI fabrics. Boundary regimes identify conditions near capacity, control, context, SLA, structural, or validity limits. Overlap regimes identify cross-application coupling points where one Application is insufficient to describe the condition alone. In both cases, the assessment protocol renders the condition as an architectural and evidence-relevant state rather than as an isolated anomaly.
The decision relevance of structural assessment extends beyond engineering. Technical states increasingly need to be translated into evidence interfaces and decision surfaces compatible with governance and risk-management frameworks [47,48,49,50,51]. Related work on dangerous-capability and extreme-risk evaluation likewise shows that deployed AI behaviour must be reconstructable, inspectable, and assessable under explicit conditions [52,53]. The present protocol does not prescribe the correct intervention. It makes the assessment input legible.
The relation between the present protocol and neighbouring frameworks is one of complementarity rather than replacement. Each framework continues to address its own concern; SORT-AI provides the public structural reading that connects observed signals to an assessment case and, where applicable, to a downstream Evidence Interface. This relation is summarized in Table 13.
The role of SORT-AI structural assessment is therefore specific and technically useful. It does not replace observability, tracing, benchmarking, governance frameworks, or production monitoring. It defines a public grammar through which their signals can be read as structured assessment cases when behaviour emerges from cross-layer composition.

13. Limitations

The present note has a deliberately narrow scope. It formalizes a public diagnostic protocol and assessment grammar; it does not report a deployed system, production experiment, benchmark comparison, or vendor telemetry study.
First, the protocol is not a production validation of SORT-AI and is not a benchmark or performance comparison. It describes how an AI-fabric observation can be translated into a structural assessment case, but it does not demonstrate deployment performance, operational reliability, or production effectiveness, and it does not claim that SORT-AI outperforms existing observability systems, tracing systems, benchmarks, runtime platforms, or governance frameworks. Its contribution is methodological: the public assessment grammar and its interface to reproducible evidence protocols.
Second, the note does not disclose a runtime implementation, a commercial assessment engine, or a new MOCK version. No implementation-specific operator chain, customer telemetry mapping, weighting function, scoring procedure, production threshold, intervention playbook, or production integration architecture is provided. MOCK v4 remains outside the present methodological contribution and is not treated here as an execution engine. The public versus implementation-specific boundary is stated explicitly in Section 11.
Third, kernel-damping compatibility is referenced, not re-derived. The Core-3 kernel-damping evidence note defines the downstream reproducible evidence protocol [2]; the present note only specifies how a structurally assessed Scenario Class with a declared Metric Set can connect to such an Evidence Interface. Reproducibility statements about the kernel-damping protocol belong to that evidence note and are not duplicated here. The note likewise does not claim structural necessity of SORT for AI-fabric analysis: it defines a public SORT-AI protocol for structural assessment and states the conditions under which a case can be made assessable within that protocol.

14. Conclusion

This Technical Note formalizes the public assessment path through which an observed AI-fabric condition becomes a structured SORT-AI assessment case. Its contribution is neither a new domain architecture nor a second evidence protocol. It is the diagnostic bridge between the canonical SORT-AI Domain Paper and the Core-3 Kernel-Damping Evidence Note: the former supplies the architectural grammar, the latter supplies the reproducible evidence interface, and the present note specifies the public movement between them.
Concretely, the note defines the public assessment path summarized in Eq. 10. The path specifies how a structural condition becomes assessable without reducing an Application to a use case, without collapsing Scenario Classes into new Applications, and without disclosing implementation-specific operator selection, telemetry mapping, weighting logic, scoring functions, thresholds, or intervention playbooks.
The note therefore clarifies why SORT-AI is technically useful beyond the naming of recurrent structural problem forms. It provides a repeatable public path from AI-fabric observation to structured assessment while preserving the distinction between public assessment grammar and implementation-specific assessment execution. Together, the canonical Domain Paper, the present V 1 V 4 Diagnostic Protocol, and the Core-3 Evidence Note define an architecture, a public assessment protocol, and a reproducible evidence interface.

Author Contributions

The author is the sole contributor to this manuscript and was responsible for conceptualization, methodology, formal analysis, manuscript drafting, and final editing.

Funding

This research received no external funding.

Data Availability Statement

This Technical Note formalizes a public diagnostic protocol and does not depend on empirical data, vendor telemetry, or benchmark measurements. The companion canonical SORT-AI Domain Paper [1] and the Core-3 Kernel-Damping Evidence Note [2] provide the architectural reference and the reproducible evidence interface, respectively. The reproducibility scope of the present note is limited to the public diagnostic grammar and assessment chain described above.

Acknowledgments

The author acknowledges the use of standard scientific software for document preparation and consistency checking.

Conflicts of Interest

The author declares no conflict of interest.

Use of Artificial Intelligence

Large language models were used as editorial aids for language refinement, structural editing, and formatting. All scientific content, including the conceptual structure, mathematical definitions, diagnostic formulations, and theoretical claims, was produced and verified by the author, who takes full responsibility for the content of this manuscript.

References

  1. Wegener, G. H. SORT-AI: Domain Architecture and Structural Diagnostics for Advanced AI Systems (Version 4). MDPI Prepr. 2026. [Google Scholar] [CrossRef]
  2. Wegener, G. H. A Reproducible Kernel-Damping Evidence Protocol for SORT-AI Core-3 Structural Coupling Regimes. MDPI Prepr. 2026. [Google Scholar] [CrossRef]
  3. Wegener, G. H. SORT-AI: Interconnect Stability and Cost per Performance in Large-Scale AI Infrastructure. MDPI Prepr. 2026. [Google Scholar] [CrossRef]
  4. Wegener, G. H. SORT-AI: Runtime Control Coherence in Large-Scale AI Systems — Structural Causes of Cost, Instability, and Non-Determinism Beyond Interconnect Failures. MDPI Prepr. 2026. [Google Scholar] [CrossRef]
  5. Wegener, G. H. SORT-AI: Agentic System Stability in Large-Scale AI Systems — Structural Causes of Cost, Instability, and Non-Determinism in Multi-Agent and Tool-Using Workflows. MDPI Prepr. 2026. [Google Scholar] [CrossRef]
  6. Dean, J.; Barroso, L. A. The Tail at Scale. Commun. ACM 2013, 56(2), 74–80. [Google Scholar] [CrossRef]
  7. Barroso, L. A.; Hölzle, U.; Ranganathan, P. The Datacenter as a Computer: Designing Warehouse-Scale Machines, 3rd ed.; Morgan & Claypool, 2018. [Google Scholar] [CrossRef]
  8. Ananthanarayanan, G.; Ghodsi, A.; Shenker, S.; Stoica, I. Effective Straggler Mitigation: Attack of the Clones. Proceedings of the 10th USENIX Symposium on Networked Systems Design and Implementation (NSDI) 2013, 185–198. Available online: http://usenix.org/conference/nsdi13.
  9. Jouppi, N. P.; Young, C.; Patil, N.; Patterson, D.; et al. In-Datacenter Performance Analysis of a Tensor Processing Unit. In Proceedings of the 44th Annual International Symposium on Computer Architecture (ISCA); 2017; pp. 1–12. [Google Scholar] [CrossRef]
  10. Verma, A.; Pedrosa, L.; Korupolu, M.; Oppenheimer, D.; Tune, E.; Wilkes, J. Large-Scale Cluster Management at Google with Borg. Proceedings of the 10th European Conference on Computer Systems (EuroSys) 2015. [Google Scholar] [CrossRef]
  11. Saltzer, J. H.; Reed, D. P.; Clark, D. D. End-to-End Arguments in System Design. ACM Trans. Comput. Syst. 1984, 2(4), 277–288. [Google Scholar] [CrossRef]
  12. Sigelman, B. H.; Barroso, L. A.; Burrows, M.; Stephenson, P.; et al. Dapper, a Large-Scale Distributed Systems Tracing Infrastructure. Google Technical Report. 2010. Available online: http://research.google/pub/pub36356.
  13. Jeon, M.; Venkataraman, S.; Phanishayee, A.; Qian, J.; Xiao, W.; Yang, F. Analysis of Large-Scale Multi-Tenant GPU Clusters for DNN Training Workloads. Proceedings of the 2019 USENIX Annual Technical Conference 2019, 947–960. Available online: http://usenix.org/conference/atc19.
  14. Meta Engineering. Taming Tail Utilization of Ads Inference at Meta Scale. Meta Engineering Blog. 2024. Available online: http://engineering.fb.com/2024/10/30.
  15. Databricks Engineering. LLM Inference Performance Engineering: Best Practices. Databricks Engineering Blog. 2024. Available online: http://databricks.com/blog/llm-inference-performance-engineering-best-practices.
  16. Beyer, B.; Jones, C.; Petoff, J.; Murphy, N. R. Site Reliability Engineering: How Google Runs Production Systems; O’Reilly Media, 2016; ISBN 978-1-491-92912-4. [Google Scholar]
  17. Kwon, W.; Li, Z.; Zhuang, S.; Sheng, Y.; et al. Efficient Memory Management for Large Language Model Serving with PagedAttention. In Proceedings of the 29th ACM Symposium on Operating Systems Principles (SOSP), 2023. [Google Scholar] [CrossRef]
  18. Patel, P.; Choukse, E.; Zhang, C.; Goiri, Í.; et al. Splitwise: Efficient Generative LLM Inference Using Phase Splitting. In Proceedings of the 51st International Symposium on Computer Architecture (ISCA), 2024. [Google Scholar] [CrossRef]
  19. Zhong, Y.; Liu, S.; Chen, J.; Hu, J.; et al. DistServe: Disaggregating Prefill and Decoding for Goodput-Optimized Large Language Model Serving. In Proceedings of the 18th USENIX Symposium on Operating Systems Design and Implementation (OSDI), 2024; Available online: http://usenix.org/conference/osdi24.
  20. Yu, G.-I.; Jeong, J. S.; Kim, G.-W.; Kim, S.; Chun, B.-G. Orca: A Distributed Serving System for Transformer-Based Generative Models. In Proceedings of the 16th USENIX Symposium on Operating Systems Design and Implementation (OSDI), 2022; pp. 521–538. Available online: http://usenix.org/conference/osdi22.
  21. Sculley, D.; Holt, G.; Golovin, D.; Davydov, E.; Phillips, T.; Ebner, D.; Chaudhary, V.; Young, M.; Crespo, J.-F.; Dennison, D. Hidden Technical Debt in Machine Learning Systems. Advances in Neural Information Processing Systems 28 (NeurIPS) 2015. [Google Scholar]
  22. Henderson, P.; Islam, R.; Bachman, P.; Pineau, J.; Precup, D.; Meger, D. Deep Reinforcement Learning That Matters. In Proceedings of the 32nd AAAI Conference on Artificial Intelligence (AAAI), 2018. [Google Scholar] [CrossRef]
  23. Hutchinson, B.; Rostamzadeh, N.; Greer, C.; Heller, K.; Prabhakaran, V. Evaluation Gaps in Machine Learning Practice. In Proceedings of the 2022 ACM Conference on Fairness, Accountability, and Transparency (FAccT), 2022. [Google Scholar] [CrossRef]
  24. Vaswani, A.; Shazeer, N.; Parmar, N.; Uszkoreit, J.; Jones, L.; Gomez, A. N.; Kaiser, L.; Polosukhin, I. Attention Is All You Need. Advances in Neural Information Processing Systems 30 (NeurIPS) 2017. [Google Scholar]
  25. Brown, T. B.; Mann, B.; Ryder, N.; Subbiah, M.; et al. Language Models Are Few-Shot Learners. Advances in Neural Information Processing Systems 33 (NeurIPS) 2020. [Google Scholar]
  26. Dubey, A.; Jauhri, A.; Pandey, A.; Kadian, A.; et al. The Llama 3 Herd of Models. arXiv 2024, arXiv:2407.21783. [Google Scholar] [CrossRef]
  27. Bommasani, R.; Hudson, D. A.; Adeli, E.; Altman, R.; et al. On the Opportunities and Risks of Foundation Models. arXiv 2021, arXiv:2108.07258. [Google Scholar] [CrossRef]
  28. Wei, J.; Tay, Y.; Bommasani, R.; Raffel, C.; et al. Emergent Abilities of Large Language Models. Trans. Mach. Learn. Res. (TMLR) 2022, arXiv:2206.07682. [Google Scholar]
  29. Schaeffer, R.; Miranda, B.; Koyejo, S. Are Emergent Abilities of Large Language Models a Mirage? Adv. Neural Inf. Process. Syst. 36 (NeurIPS) 2023, arXiv:2304.15004. [Google Scholar]
  30. Kapoor, S.; Widder, D. G.; Ensmenger, N.; Narayanan, A. Can We Trust AI Benchmarks? An Interdisciplinary Review of Current Issues in AI Evaluation. arXiv 2025, arXiv:2502.06559. [Google Scholar] [CrossRef]
  31. Liang, P.; Bommasani, R.; Lee, T.; Tsipras, D.; et al. Holistic Evaluation of Language Models. Trans. Mach. Learn. Res. (TMLR) 2023, arXiv:2211.09110. [Google Scholar]
  32. Mitchell, M.; Wu, S.; Zaldivar, A.; Barnes, P.; Vasserman, L.; Hutchinson, B.; Spitzer, E.; Raji, I. D.; Gebru, T. Model Cards for Model Reporting. Proceedings of the Conference on Fairness, Accountability, and Transparency (FAT*) 2019, 220–229. [Google Scholar] [CrossRef]
  33. Maslej, N.; Fattorini, L.; Perrault, R.; et al. The AI Index 2025 Annual Report; Stanford Institute for Human-Centered Artificial Intelligence, 2025. [Google Scholar]
  34. Yao, S.; Zhao, J.; Yu, D.; Du, N.; Shafran, I.; Narasimhan, K.; Cao, Y. ReAct: Synergizing Reasoning and Acting in Language Models. International Conference on Learning Representations (ICLR), 2023; Available online: http://openreview.net/forum?id=WE_vluYUL-X.
  35. Schick, T.; Dwivedi-Yu, J.; Dessì, R.; Raileanu, R.; et al. Toolformer: Language Models Can Teach Themselves to Use Tools. Adv. Neural Inf. Process. Syst. 36 (NeurIPS) 2023, arXiv:2302.04761. [Google Scholar]
  36. Wang, G.; Xie, Y.; Jiang, Y.; Mandlekar, A.; Xiao, C.; Zhu, Y.; Fan, L.; Anandkumar, A. Voyager: An Open-Ended Embodied Agent with Large Language Models. arXiv 2023, arXiv:2305.16291. [Google Scholar] [CrossRef]
  37. Park, J. S.; O’Brien, J. C.; Cai, C. J.; Morris, M. R.; Liang, P.; Bernstein, M. S. Generative Agents: Interactive Simulacra of Human Behavior. In Proceedings of the 36th Annual ACM Symposium on User Interface Software and Technology (UIST), 2023. [Google Scholar] [CrossRef]
  38. Wilkinson, M. D.; Dumontier, M.; Aalbersberg, I. J.; Appleton, G.; et al. The FAIR Guiding Principles for Scientific Data Management and Stewardship. Sci. Data 2016, 3(1), 160018. [Google Scholar] [CrossRef]
  39. Stodden, V.; McNutt, M.; Bailey, D. H.; Deelman, E.; Gil, Y.; Hanson, B.; Heroux, M. A.; Ioannidis, J. P. A.; Taufer, M. Enhancing Reproducibility for Computational Methods. Science 2016, 354(6317), 1240–1241. [Google Scholar] [CrossRef]
  40. Sandve, G. K.; Nekrutenko, A.; Taylor, J.; Hovig, E. Ten Simple Rules for Reproducible Computational Research. PLoS Comput. Biol. 2013, 9(10), e1003285. [Google Scholar] [CrossRef] [PubMed]
  41. Smith, A. M.; Katz, D. S.; Niemeyer, K. E. FORCE11 Software Citation Working Group Software Citation Principles. PeerJ Comput. Sci. 2016, 2, e86. [Google Scholar] [CrossRef]
  42. Peng, R. D. Reproducible Research in Computational Science. Science 2011, 334(6060), 1226–1227. [Google Scholar] [CrossRef]
  43. Donoho, D. L. An Invitation to Reproducible Computational Research. Biostatistics 2010, 11(3), 385–388. [Google Scholar] [CrossRef]
  44. National Academies of Sciences; Engineering; and Medicine. Reproducibility and Replicability in Science; The National Academies Press: Washington, DC, 2019. [Google Scholar] [CrossRef]
  45. Association for Computing Machinery. Artifact Review and Badging (Version 1.1). ACM Policy Document. 2020. Available online: http://acm.org/publications/policies/artifact-review-and-badging-current.
  46. Katz, D. S.; Gruenpeter, M.; Honeyman, T. Taking a Fresh Look at FAIR for Research Software. Patterns 2021, 2(3), 100222. [Google Scholar] [CrossRef]
  47. National Institute of Standards and Technology. Artificial Intelligence Risk Management Framework (AI RMF 1.0); NIST AI 100-1; 2023; pp. 100–1. [CrossRef]
  48. National Institute of Standards and Technology. Artificial Intelligence Risk Management Framework: Generative Artificial Intelligence Profile; NIST AI 600-1; 2024; pp. 600–1. [CrossRef]
  49. European Parliament and Council of the European Union. Regulation (EU) 2024/1689 laying down harmonised rules on artificial intelligence (Artificial Intelligence Act). Official Journal of the European Union. 2024. L 2024/1689. Available online: http://eur-lex.europa.eu/eli/reg/2024/1689.
  50. Bengio, Y.; Clare, S.; Prunkl, C.; Murray, M.; et al. International AI Safety Report 2026; Department for Science, Innovation and Technology (DSIT), 2026. [Google Scholar]
  51. Anderljung, M.; Barnhart, J.; Korinek, A.; Leung, J.; O’Keefe, C.; Whittlestone, J.; et al. Frontier AI Regulation: Managing Emerging Risks to Public Safety. arXiv 2023, arXiv:2307.03718. [Google Scholar] [CrossRef]
  52. Shevlane, T.; Farquhar, S.; Garfinkel, B.; Phuong, M.; et al. Model Evaluation for Extreme Risks. arXiv 2023, arXiv:2305.15324. [Google Scholar] [CrossRef]
  53. Phuong, M.; Aitchison, M.; Catt, E.; Cogan, S.; et al. Evaluating Frontier Models for Dangerous Capabilities. arXiv 2024, arXiv:2403.13793. [Google Scholar] [CrossRef]
  54. Kato, T. Perturbation Theory for Linear Operators, Reprint of 1980 ed.; Springer-Verlag, 1995; ISBN 978-3-540-58661-6. [Google Scholar]
  55. Bhatia, R. Matrix Analysis; Springer, 1997; ISBN 978-0-387-94846-1. [Google Scholar]
Table 1. Reader contract for the present Technical Note. The left column states the analytical objects the note provides and on which it should be evaluated; the right column states the readings the note is not making.
Table 1. Reader contract for the present Technical Note. The left column states the analytical objects the note provides and on which it should be evaluated; the right column states the readings the note is not making.
Evaluate this note as Do not evaluate it as
A public methodological protocol A production benchmark
A structural assessment grammar A runtime implementation
A diagnostic-to-evidence interface A vendor telemetry study
An analysis-layer formalization A complete assessment engine
A methodological companion note A new domain paper
Table 2. New methodological elements introduced in this Technical Note. Each element is a public analysis-layer construct; none discloses implementation-specific operator selection, telemetry mapping, scoring, weighting, thresholds, or intervention logic.
Table 2. New methodological elements introduced in this Technical Note. Each element is a public analysis-layer construct; none discloses implementation-specific operator selection, telemetry mapping, scoring, weighting, thresholds, or intervention logic.
New element Contribution
Diagnostics versus Assessment distinction (Section 3) Separates identifying a structural problem form from making it assessable.
Assessment-case tuple (Section 5) Defines the public assessment object as a single formal tuple.
Application regime space (Section 6) Treats Applications as assessable Core, Boundary, and Overlap spaces.
Metric Set and risk transformation layer (Section 7) Connects Scenario Classes to declared indicators and public transformation roles.
Evidence Compatibility Predicate (Section 8) Defines when a Scenario Class can connect to the downstream evidence interface.
Public mathematical interface (Section 9) Separates public assessment reading from implementation-specific execution.
Table 3. Roles of the three artefacts in the present SORT-AI publication sequence. Each artefact has a distinct methodological role and a distinct boundary.
Table 3. Roles of the three artefacts in the present SORT-AI publication sequence. Each artefact has a distinct methodological role and a distinct boundary.
Artefact Role
Canonical SORT-AI Domain Paper [1] Defines Domain, Cluster, Application, V1–V4, Scenario Class, Metric Set, and Regime Classification as the canonical Level-0 structural assessment architecture for SORT-AI.
Core-3 Kernel-Damping Evidence Note [2] Defines a reproducible risk-transition protocol with declared inputs, risk transformations, κ , ξ , C V , classification bands, and reproduction manifest.
Present Technical Note Defines how a V1–V4 diagnosis becomes a structural assessment case with Application identity, Scenario Class, Metric Set, Regime Classification, and Evidence Interface.
Table 4. Imported SORT-AI terms used in the present note. The right column states the public meaning required to read the note; the canonical Domain Paper [1] provides the full architectural definitions.
Table 4. Imported SORT-AI terms used in the present note. The right column states the public meaning required to read the note; the canonical Domain Paper [1] provides the full architectural definitions.
Term Meaning in this note
Domain AI-fabric problem space under SORT-AI.
Cluster Structural regime class within the domain.
Application Recurrent structural problem form, not a software application or deployment-specific use case.
Scenario Class Typed manifestation inside an Application’s regime space.
Metric Set Declared family of indicators attached to a Scenario Class.
Regime Classification Assignment of a Scenario Class as Core, Boundary, or Overlap.
Evidence Interface Compatibility boundary to the downstream reproducibility protocol.
Level-0 Structural assessment layer before implementation-specific telemetry, scoring, and intervention logic.
Table 6. Components of a SORT-AI structural assessment case. Each entry of A case is a public analysis-layer object; concrete operator selection, telemetry mapping, and scoring logic are not part of the tuple and remain outside the scope of this note.
Table 6. Components of a SORT-AI structural assessment case. Each entry of A case is a public analysis-layer object; concrete operator selection, telemetry mapping, and scoring logic are not part of the tuple and remain outside the scope of this note.
Symbol Public meaning
S AI Structured AI-fabric state under observation.
V 1 , V 2 , V 3 , V 4 V1–V4 diagnostic reading of S AI (Section 4).
A j Application identity within the SORT-AI domain.
C j Scenario Class within Application A j .
M j Declared Metric Set attached to C j .
ρ j Regime classification of C j under M j (Core, Boundary, or Overlap).
E j Evidence Interface (Section 8) to which C j is compatible.
Table 7. Consolidated notation used in this Technical Note. Symbols are introduced in the sections indicated and are listed here as a reference.
Table 7. Consolidated notation used in this Technical Note. Symbols are introduced in the sections indicated and are listed here as a reference.
Symbol Meaning Defined in
S AI Structured AI-fabric state under observation. Section 4, Eq. (11)
V 1 , V 2 , V 3 , V 4 Diagnostic-grammar dimensions: phenomenon, coupling, effect space, decision surface. Section 4, Eqs. (6)–(9)
A j Application identity within the SORT-AI domain. Section 6
C j Scenario Class within Application A j . Section 6, Eq. (14)
M j Declared Metric Set attached to C j . Section 7, Eq. (16)
ρ j Regime label of C j (Core, Boundary, Overlap). Section 6, Eq. (15)
E j Evidence Interface attached to C j . Section 8
χ E Evidence Compatibility Predicate. Section 8, Eq. (20)
κ , ξ , C V Damping quotient, structure mode, scenario-level coefficient of variation (referenced from [2]). Section 8, Eqs. (22)–(25)
J ^ AI Abstract operator coupling chain (public role only). Section 9, Eq. (26)
P ^ κ Kernel-modulated structural projection (public role only). Section 9, Eq. (26)
R AI ( Δ ) Structural deviation or risk field. Section 9, Eq. (26)
Interpretive public assessment reading (not deterministic mapping). Section 9, Eq. (28)
Table 11. AI.04 worked mini-example: assessment-chain trace for AI.04.C2 Retry Amplification. The trace illustrates the public diagnostic movement; no implementation-specific operator selection, telemetry mapping, weighting, scoring, or intervention logic is disclosed.
Table 11. AI.04 worked mini-example: assessment-chain trace for AI.04.C2 Retry Amplification. The trace illustrates the public diagnostic movement; no implementation-specific operator selection, telemetry mapping, weighting, scoring, or intervention logic is disclosed.
Step Reading
V 1 Rising cost, retry amplification, or reduced effective capacity is observed at the AI-fabric level.
V 2 The condition is read as scheduler–orchestrator–runtime–retry–policy coupling.
V 3 The effect space is control-coherence loss, retry amplification, or boundary oscillation.
V 4 The decision surface concerns boundary redesign, control separation, or evidence readiness.
Application identity AI.04 Runtime Control Coherence.
Scenario Class AI.04.C2 Retry Amplification; alternatively AI.04.O1 as an overlap with infrastructure coupling.
Metric Set Abstract risk, health, or overhead indicators; the set is declared at the assessment level, while implementation-specific contents are not disclosed.
Regime Classification Core for AI.04.C2; Overlap for AI.04.O1.
Evidence Interface Risk transition mapped to κ , ξ , and C V under the existing Core-3 evidence protocol [2].
Table 13. Complementarity of the present V1–V4 protocol with neighbouring frameworks. The protocol does not replace any of these layers; it specifies the public structural reading that links an observation to a downstream evidence interface.
Table 13. Complementarity of the present V1–V4 protocol with neighbouring frameworks. The protocol does not replace any of these layers; it specifies the public structural reading that links an observation to a downstream evidence interface.
Framework / practice Relation to the present protocol
Observability and tracing Exposes V1-type signals. The protocol consumes such signals without replacing the observation layer [12].
Site-reliability and incident practice Organizes operational response. The protocol uses the V1–V4 reading before any operational response is selected [16].
Benchmarking and model evaluation Evaluates bounded model and evaluation behaviour. The protocol adds a structural reading where deployment behaviour exceeds the benchmark’s evaluation scope [30].
Governance and risk-management frameworks Specify evidence and traceability requirements. The protocol provides a public assessment grammar through which technical states become input-legible to such frameworks [47,48,49].
Core-3 kernel-damping evidence protocol Handles declared downstream reproducibility. The protocol passes a compatibility-checked assessment case to that interface [2].
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.
Copyright: This open access article is published under a Creative Commons CC BY 4.0 license, which permit the free download, distribution, and reuse, provided that the author and preprint are cited in any reuse.
Prerpints.org logo

Preprints.org is a free preprint server supported by MDPI in Basel, Switzerland.

Subscribe

Disclaimer

Terms of Use

Privacy Policy

Privacy Settings

© 2026 MDPI (Basel, Switzerland) unless otherwise stated