Over the shoulder of an analyst reviewing a marked risk document while a colleague moves through the office

KADE / PERSPECTIVE

When the model changes, what should the institution keep?

A practical review exercise for retaining the question, permitted evidence and review trail when an institution changes an AI model.

← All insights

GOVERNANCE

A research team replaces the model inside an analytical workflow. The new version is faster and writes a clearer summary. The committee still needs to know whether it examined the same question, used the same permitted information and applied the same assumptions.

Changing a model can change the result. The institution needs a way to examine that change without reconstructing the whole review from scattered files and conversations. The useful question is what the institution can still inspect after the component has changed.

Keep the question before comparing the answers

Consider a fictional committee reviewing an existing exposure against its adopted mandate. Before comparing two summaries, record the question, scope, relevant date and intended readers. A clearer answer to a different question is not an improvement on the original task.

For this exercise, keep a small review record: the question as asked; the permitted input references and their dates; the material assumptions; the configuration and model or method version, where observable; and the limitations already known. These are proposed review fields, not a claim about a finished KADE implementation.

Make the change visible

Run the original and replacement configurations against the same permitted synthetic information. Record which conditions were held constant and which changed. If a model version cannot be identified, say so. If a source was refreshed between runs, the comparison now includes a data change as well as a model change.

Compare substantive differences: a missing source, a changed interpretation, a new limitation, an unresolved disagreement or a statement that the evidence does not support. Fluency and speed are useful observations, but neither establishes that the analysis is more accurate.

Identical inputs do not guarantee identical outputs. Retaining records can support investigation; it does not guarantee reproducibility, equivalence or correctness.

Keep disagreement attached to its evidence

If two perspectives differ, retain the question each addressed and the evidence each used. Ask the reviewer to distinguish a difference caused by a changed input from one whose cause remains unexplained. A polished combined paragraph should not silently turn that unresolved difference into agreement.

The committee can then see what is known, what has changed and what still needs examination. Systems of record remain authoritative, and the institution retains the decision.

Rehearse an unavailable supplier

Extend the same fictional exercise by making the usual model unavailable. Can the team recover the original question and permitted evidence? Does a replacement route preserve the relevant access restrictions? Can the receiving workflow recognise that the analytical conditions have changed?

Where a fallback is technically and contractually supported, test it within the institution's approved process. Otherwise record the dependency as unresolved. Do not present an untested alternative as operational continuity. A manual review or a temporary limitation notice may be the institution's appropriate response; the exercise does not prescribe a universal operating model.

Make return to use a recorded decision

Set comparison criteria before the exercise. Name the person authorised to decide whether the replacement can be used, identify the material differences they reviewed and record their decision under the institution's existing process. Where technically supported, establish how a prior configuration could be recovered. Keep the challenged and replacement records linked under the institution's adopted records policy.

A tabletop exercise establishes only what was tested. Its value is finding the missing input, unclear permission or unstaffed handoff before a real committee is waiting for an answer.

Industry context and KADE's development status

In its 23 September 2026 announcement, Brookstreet Equity Partners describes an internal intelligence architecture intended to retain institutional memory and methods across individual models. That is the firm's account of its own work. It does not independently validate this exercise or establish a relationship with KADE.

This article presents KADE's proposed review exercise. It is not a regulatory standard, investment advice, certification or evidence of a deployed customer control. KADE is developing intelligence infrastructure for capital markets. Its public platform description distinguishes the synthesis core in staging from the specified and mapped lens suite. Staging does not establish production readiness or general availability. See deployment and sovereignty for the qualifications attached to proposed deployment profiles.

Illustrative image generated with AI.