Gym-Arc/RSI loop
Business-grounded RSI

Your business is the training signal.

Gym-Arc turns what a business already has (rulebooks, policy tables, case logs, agent trajectories and outcome feedback) into a Context Graph. From the graph it synthesizes whole families of worlds, compiles them into RL environments and Judges, trains the agent, and feeds every deployed conversation back in. The loop keeps closing, and the agent keeps getting better.

Load industry
Company
0Onboard a company

One command from data pack to a live environment.

Pick an industry and a company above. Gym-Arc reads the company's raw material, infers its operating rules, checks itself, and builds a trainable environment for that company. No code is written for a new company, and no LLM sits in the loop, so the same pack always yields the same Context.

1Raw, multi-source, heterogeneous

Start from what the business already has.

Handbooks written for people, policy tables kept by operations, years of case logs with what agents did and how each case ended, and a short questionnaire. Different formats, different owners, sometimes contradicting each other. This is the raw material.

2Unify into a Context Graph

Every rule, traced back to where it came from.

Gym-Arc links each source to the evidence inside it, each piece of evidence to the operating rule it supports, and each rule to the environment dynamics and Judge checks that enforce it. Click any rule to see its provenance. Clauses with no slot in the schema are not dropped: they are flagged for review.

3Synthesize from the graph

One graph, a whole family of companies and customers.

The Context Graph defines which rules can vary and how. Gym-Arc samples a family of companies around it, populates each with customers whose needs, trust and patience are hidden from the agent, and computes the best decision at every step from what the agent can actually see. Real companies slot into the same family.

Company family

Columns are companies, rows are rule dimensions. Brighter cells depart further from industry default. Outlined columns are the onboarded real-pack companies.

Synthetic customers

Each episode samples a customer. The agent sees the left column; the right column drives how the customer reacts and is only revealed by asking.

Same customer, different company, different right answer

Expected value of each next action, computed by the environment from what the agent can observe. This is the supervision signal, and it changes with the company's rules.

4Compile into RL Env + Judge

A gym the agent can train in, and a Judge it cannot game.

E = BuildEnv(T, C, A, V): the task structure T is shared across the industry, the Context C comes from the graph, A is the action set, and the Verifier V is configured by the same Context. Breaking a company rule scores zero, whatever the outcome.

5Train and evaluate

Trained on the family, tested on companies it has never seen.

A compact model is trained on the synthetic company family, then evaluated on held-out companies: similar new companies (E2), new rule combinations (E3), values beyond the training range (E4), unseen rule dimensions (E5), and the onboarded real-pack companies (E6). Every hypothesis is pre-registered before the first training run.

Rule compliance by evaluation set

Share of decisions that follow every company rule. Higher is better.

Decision quality gained by evaluation set

Value lost by the untrained model that training wins back.

Before Gym-Arc trainingTrained on one companyTrained on the Gym-Arc company family
6Self-improvement in deployment

Deploy, log, recalibrate, retrain. Every cycle gets better.

The agent is deployed into a business world it was not built from, with a different customer mix and different dynamics. Each cycle it logs every trajectory and outcome. Gym-Arc recalibrates its world from those logs, retrains, gates the new model with the Judge, and redeploys.

DEPLOYAgent serves live cases
LOGTrajectories + outcomes captured
CALIBRATEWorld re-fit to observed behaviour
REGENERATENew synthetic episodes from the updated graph
RETRAINModel trained on fresh supervision
GATEJudge must pass before redeploy

Decision accuracy across deployment cycles

Same held-out test decisions every cycle. Mean of two seeds.

Gym-Arc warm startCold start: deploy the rule playbook first

Data efficiency

Accuracy versus the number of logged business cases used for training.

Logged cases + Gym-Arc synthetic worldsLogged cases only
7The training ground evolves too

Real feedback sharpens the gym, not just the agent.

Every trajectory and outcome that comes back is also evidence about the training ground itself: how customers really respond, which rules only show up in results, and where the gym is still guessing. Gym-Arc folds that evidence back into the Context Graph, so each version of the environment is closer to the real business than the last.

FEEDBACKLive trajectories and business outcomes
RE-FITCustomer-response model calibrated to the logs
RECOVERRules that only show up in outcomes, read from case logs
ASKLow-confidence rules request more data
REVIEWNew clauses queued for sign-off
NEXT GYMA closer-to-real environment for the next cycle

World calibration from logged trajectories

Before: what the gym assumedAfter: re-fit on the logsReal business
Load your industry

Bring one rulebook and a case log.
We will show your loop running.

In the demo we onboard one of your data packs live, show the Context Graph it produces, and train against your rules.

contact@dataarctech.com ← Back to Gym-Arc home