Home/Engineering notes

Engineering notes

Experiments, architecture notes and measurements, with methodology and conditions described. Materials are published as they are ready; the status of each is shown.

applied result · open repository

swiftclf-tuna: bilingual hierarchical intent classification for assistant routing

From a single user message the model determines the request type and picks a route: retrieval, generation, tools, agent execution, clarification or fallback. The taxonomy has 4 top-level classes and 22 second-level ones. Selective prediction with a fallback branch and risk-aware metrics.

Methodology. AI-orchestrated research: problem framing, taxonomy and evaluation criteria design, direction of an autonomous LLM-agent workflow and human-in-the-loop validation of results — the founder; implementation, experiments and documentation were done by an agent workflow with counter-review.

2 625examples in the holdout set
85,14 %coverage
87,07 %accepted accuracy
80,88 %top-1 accuracy
0,061expected calibration error
77 msp95 on a single CPU core, 278M parameters

Metrics are from the current internal evaluation report of the model on the holdout set; the project is not presented as SOTA or an academic publication. Artifacts include model cards, the training and evaluation pipeline, and reports.

github.com/ascorblack/swiftclf-tuna-research

architecture note

Protocore: a protocol-first agent runtime and layer boundaries

How the core is built with typed contracts, hooks and execution strategies, why the core imports nothing from the enterprise, frontend and deploy layers, and how CI checks this. Open core: protocore-community; public page: protocore.anchorinference.com.

public research materials

From how an agent is built to how its result is verified

Three papers published on agent memory, task completion and artifact evaluation. They study specific methods and configurations; they do not promise the same effect in every system.

Papers, methods and limitations ↓

Public research

Public materials from Protocore research. Papers are in English; HTML, PDF and source packages are available on the Protocore research site.

01

QUALITY EVALUATION · MATERIAL DATE 16.07.2026

Check the artifact, not just the agent’s answer

A method for separately evaluating the produced result, tool actions, model-judge scores, completion status and infrastructure failures.

What limits the conclusions

The paper describes an evaluation method, not a model ranking. Experimental sets and measurement completeness vary; the paper notes gaps in data provenance.

02

AGENT MEMORY · MATERIAL DATE 30.07.2026

How to preserve facts when compressing context

A comparison of one shared memory field and several separate fields under the same total limit. The study tests exact fact retention in long sessions.

What limits the conclusions

The effect depends heavily on configuration. The result does not prove a universal advantage of structured memory; the historical experiment cannot be fully reproduced from the public package.

03

TASK COMPLETION · MATERIAL DATE 16.07.2026

Why a result in a simulator is not yet a result in the system

A study of how the execution environment helps an agent complete large files with limited output size. An audit found a discrepancy between the simulator and the real execution path.

What limits the conclusions

The simulator result cannot be carried over to production. The check of the real path lacks a comparable control group sufficient to estimate the overall effect.