← Back to the directory

How expertise is built

Cross-Agent Review: Testing a Recommendation From Different Perspectives

What happens after one advisor reaches a conclusion? Structured review puts that recommendation through distinct evidence, failure, and authority challenges before someone relies on it.

Agreement is not the goal. Useful challenge is.

A primary advisor can develop a plausible proposal while overlooking a weak assumption or a simpler alternative. A useful review is allowed to change the recommendation, limit its scope, or stop it from being described as ready.

Review is valuable when it can change the recommendation.

Asking for a second answer is not the same as assigning a review responsibility. Structured passes give reviewers different questions, explicit evidence requirements, and a way to record unresolved objections. The output is a revised decision record, not a vote count.

Illustrative platform decision

From “replace the platform” to a staged intervention.

An initial recommendation proposes replacing an operational platform because staff repeatedly enter the same information. The review examines whether replacement actually addresses the cause.

Clio: is the diagnosis supported?
The available observations establish duplicate entry, but not that the platform itself is the root cause. Missing integration and unclear process ownership remain untested explanations.
Momus: what could make the proposal fail?
A full migration could interrupt live work, consume training capacity, and preserve the same unclear handoffs in a different tool. A targeted integration is a simpler alternative worth testing.
Themis: what changes at the control boundary?
The proposal introduces new credentials, data access, and recovery responsibilities without a sufficiently defined ownership or rollback plan.
Revised recommendation
First map the duplicate-entry workflow and test a bounded integration or staged modernization. Reconsider replacement if evidence shows the existing platform cannot meet the requirement.

This example illustrates challenge, not a reported client outcome. It does not establish that integration is always preferable. A materially different finding could still support replacement after the evidence and transition controls are adequate.

Different questions, a shared decision record.

The following roles match the directory's established advisory responsibilities. Review passes may run in parallel where the workflow supports it; their findings must still be compared and reconciled.

  1. Primary advisor: state the proposal.Record the objective, recommendation, alternatives, assumptions, and evidence so reviewers can challenge a defined position.
  2. Clio: evidence and validation.Check whether claims and calculations are supported, current, reproducible, and appropriately qualified. Unsupported confidence is a finding, not a minor wording issue.
  3. Momus: technical challenge.Search for counterexamples, simpler alternatives, hidden operating costs, vendor dependencies, and consequential failure modes.
  4. Themis: standards, security, and risk.Examine permissions, authority, exposure, testing, recovery, auditability, and ownership. Advisory review is not a formal certification.
  5. Lead and accountable reviewer: reconcile.Compare objections against evidence, revise the proposal, and record unresolved conflicts. Escalate material uncertainty or consequences to the responsible human decision-maker.

Disagreement changes the status, not just the wording.

Supported
The reviewed evidence and challenge passes reveal no material unresolved issue within the stated scope. This is not proof that no issue exists.
Revised
A correctable weakness changes the proposal. The revised portion returns for the relevant review rather than inheriting approval from an older version.
Qualified
The recommendation remains useful only with visible assumptions, exclusions, or operating limits. Those conditions travel with it.
Escalated
A conflict, missing authority, or consequential tradeoff requires accountable human judgment or specialist review.
Rejected
Evidence or control requirements are insufficient to support the proposed recommendation. Agreement among other reviewers does not erase the deficiency.

Findings should identify the contested claim and what evidence or decision could resolve it. Reviewers should not average incompatible conclusions or treat a majority as authorization. Client leadership retains the final business decision and risk acceptance; action permissions remain enforced separately.

Retain what changed and what remains open.

  • The recommendation version and evidence package each reviewer actually examined.
  • Reviewer role, challenge objective, material findings, and supporting counter-evidence.
  • How each objection was addressed, including rejected objections and their rationale.
  • The final status, changed recommendation, visible limitations, unresolved issues, and required human approval.

Evaluate the review process with examples containing known unsupported claims and missing controls. Check that it can revise or reject a proposal, not merely produce polished agreement. A record of reviewer names is not validation evidence.

Distinct roles are not perfect independence.

Reviewers may share a model family, source material, or framing and therefore share mistakes. Different objectives create separate challenge passes; they do not guarantee statistically independent judgments or correctness.

For high-impact conclusions, outside evidence, reproducible tests, and qualified human review remain important. Human review can also fail. If a required review cannot be completed, its absence should stay visible rather than being represented as a successful check.

The appropriate review depth depends on consequence and scope. This explanation does not claim that every answer automatically runs through all three agents or that any agent can authorize client actions.

Related explanations

Have a question about how this applies to your operation?

Discuss an operating question