Agentic Decision Intelligence · Multi-Model

The LLM Council.
Five minds debate. One verdict ships.

When a decision is expensive to get wrong, a single AI is a liability — it agrees with you, inherits one model’s blind spots, and hedges instead of deciding. The LLM Council convenes five independent agents across four frontier models, turns a dedicated adversary loose on their consensus, then hands you one decisive, fully auditable verdict. A boardroom of advisors, on call in minutes.

Independent Agents
5
analysts, adversary & chair
Frontier Models
4
Opus, Sonnet, Haiku + Mythos
Time to Verdict
~5 min
3 analysts run in parallel
Decision Log
100%
every session archived

The failure mode

One model tells you what you want to hear.

Ask a single chatbot to weigh a hard decision and you get a confident, agreeable, well-formatted answer — and no way to know what it missed. Language models are trained to be helpful, which in practice means they lean toward the framing you handed them. There is no second opinion, no one in the room whose job is to disagree, and one model’s blind spot becomes your blind spot.

The LLM Council is built to defeat exactly that. It runs your question through three independent analysts that never see each other’s work, so their agreement actually means something. It then appoints a Devil’s Advocate whose only mandate is to attack all three — hunting the groupthink, the shared assumption, the scenario nobody modeled. Finally an Opus Chairman weighs the whole debate by reasoning quality, not vote count, and returns a single verdict you can act on Monday morning. The disagreement is the product.


How it works

A structured debate, not a chatbot.

Three phases, five agents, four models. Each phase is engineered to surface what the last one would have hidden.

Phase 1 · Parallel
Three independent analysts
Analyst A · Risk & timingSonnet 4.6
Analyst B · First principlesHaiku 4.5
Analyst C · Pattern & narrativeMythos

No shared context. Three different models, three different failure modes — so convergence is signal, not echo.

Phase 2 · Adversarial
Devil’s Advocate
Attacks all threeSonnet 4.6

Receives the analyses anonymized. Presses the weakest point in each, names the shared blind spot, and surfaces the scenario that kills the plan in twelve months.

Phase 3 · Synthesis
The Chairman
M.A.X. 🔮 × Maxine 🌀Opus 4.6

Weighs the full debate by reasoning quality. Returns a dual read — pattern/execution vs. possibility/contrarian — and one decisive recommendation.

Phase 1Sonnet 4.6

Analyst A

The grounded strategist. Works the question from risk, opportunity, timing, and alternatives — numbers, precedents, and failure modes, no hedging.

Phase 1Haiku 4.5

Analyst B

The outsider. Starts from first principles, challenges the assumptions baked into the question itself, and prizes practical feasibility over elegance.

Phase 1Mythos

Analyst C

The wildcard. Thinks in pattern, history, and narrative arc — catching the human and second-order factors the quant lenses miss.

Phase 2Sonnet 4.6

Devil’s Advocate

The adversary. Its only job is to attack — finding groupthink, unstated shared assumptions, and the scenario nobody priced in.

Phase 3Opus 4.6

The Chairman

The decider. A dual M.A.X. 🔮 × Maxine 🌀 synthesis that weighs the debate, honors your stated values, and commits to a verdict — never “it depends.”


Why it wins

Built to disagree with you.

The same multi-agent engineering CSI Automation deploys on shop floors and portfolios, pointed at your hardest calls.

🛡️

Kills the yes-man

A dedicated adversary attacks every consensus, so you hear the strongest case against — not a polished case for whatever you already wanted.

🧩

Model diversity

Four frontier models mean four different blind spots. Where they independently agree, you can trust it; where they split, you see exactly why.

⚖️

Decisive, not diplomatic

The Chairman is forbidden from hedging. You get a recommendation, a fork for the one variable that changes it, and a single first move.

🧭

Values-aligned

The synthesis weighs your stated principles — stewardship over profit, tail-risk over upside — not a generic optimization you never asked for.

📜

Fully auditable

Every agent’s reasoning is captured in a transcript and logged to a decision history. You see who argued what, and why the Chairman ruled.

Minutes, not meetings

The whole council convenes, debates, and rules in minutes — the deliberation of a board, without scheduling one.


A real session

See the council think.

An actual, unedited council session on a real operations decision — the full transcript, exactly as the five agents produced it. The consensus looked obvious; the council pressure-tested it anyway, and the sharpest insight came from the dissent.

REAL SESSION Session 20260605-055539 · 5 agents · 328s
Question put to the council

A 200-person contract manufacturer is weighing whether to build an in-house AI & automation team or partner with an outside systems integrator to add AI-driven monitoring and quality control to its existing PLC lines. The plant runs nearly 24/7 and cannot tolerate downtime, the capital budget is tight, and leadership is split between control and speed. Which path, and what is the single highest-leverage first move?

⚖️ Chairman’s Verdict · M.A.X. 🔮 × Maxine 🌀

Four of five voices converged: buy the capability and rent the speed — but never rent the ground truth.

🔮 M.A.X.’s Read — patterns & execution

The pattern is unambiguous: build-first under capital + downtime pressure is how careers and quarters die. Buy the capability, rent the speed, but refuse to rent the ground truth. The integrator is a knowledge-transfer vehicle — your two best ops engineers shadow every deployment — not an oracle. Execution beats architecture here.

🌀 Maxine’s Read — possibility & contrarian

The obvious answer is right — but for a reason no one fully said. You’re not buying AI; you’re buying time to become the kind of company that could build it. The road not taken isn’t “in-house now,” it’s “in-house in three years from a position of strength.” And the leadership split? Owning your data forces the control faction and the speed faction onto the same side: control of the asset, speed of the vendor.

The Recommendation

Partner with an integrator — and make data ownership and open APIs non-negotiable before signing anything. Time-box a paid pilot (90 days, expect slippage) on a forgiving-but-representative line, with a written knowledge-transfer clause and a hard exit / portability term that survives the integrator being acquired.

NON-NEGOTIABLE

Own the data layer. Instrument one line yourself first and own the schema and the baseline before any AI is applied. Whoever controls the data layer controls every vendor negotiation that follows.

THE TRAP TO HEDGE

The acquisition trap. Boutique integrators get bought by Rockwell, Emerson, Honeywell — your “partner” becomes a subsidiary with new pricing and no interest in a 200-person account. Demand portability + knowledge transfer up front.

🎯

The one thing to do first: before any RFP or pilot, instrument one line with your own sensor data collection and own the schema. Not to build AI — to own the baseline. That single act re-prices every vendor conversation and is your only hedge against the acquisition trap.

▸ Full transcript — every agent, unedited

Analyst A Sonnet 4.6
Core Assessment Partner with a systems integrator — full stop. Building in-house AI talent at a 200-person manufacturer with a tight capital budget is a multi-year distraction from the core business. The opportunity cost of recruiting, retaining, and managing ML engineers while running 24/7 production lines is enormous, and the downside risk of a failed internal build is plant-floor exposure. Key Factors - Talent scarcity vs. capital constraint: AI/ML engineers cost $150–250K+ fully loaded. Staffing even a minimal 3-person team burns $500K+/year before tooling, compute, or integration work — likely more than a well-scoped SI engagement. - Time-to-value gap: An in-house team building from scratch realistically needs 12–18 months to deliver production-ready monitoring. A proven SI with PLC integration experience can be live in 3–6 months. - Downtime intolerance changes the risk calculus: First deployments always fail in unexpected ways. An SI absorbs that risk contractually; an in-house team exposes the plant to learning-curve mistakes without backstop. - The "control" argument is often a proxy for trust, not real need: Leadership wanting control usually means they want visibility and reversibility — both achievable via contractual SLAs and data ownership clauses, not headcount. - 200-person scale limits negotiating leverage but not partnership viability: SIs serving mid-market manufacturers (Rockwell, Plex, Sight Machine, Instrumental) have templated deployments that don't require enterprise scale. Risk Analysis The main failure mode for the SI path is vendor lock-in or a poorly scoped engagement that under-delivers. Probability: moderate (~35%) if procurement is sloppy. Mitigation: use a time-boxed proof-of-concept on a single line before full rollout; insist on data portability and open APIs in the contract. The failure mode for in-house is worse — capital deployed, talent attrited, plant disrupted, and still no working system 18 months later. That scenario ends careers. Recommendation Partner with an SI. The single highest-leverage first move: run a 90-day paid pilot on one non-critical production line. This buys real proof-of-concept data, forces the SI to demonstrate PLC integration competence in your specific environment, and gives leadership the "control" experience they're craving — without betting the plant on it. Define success metrics (defect detection rate, false-positive threshold) before signing. If the pilot delivers, expand. If it doesn't, you've spent pilot money, not transformation money.
Analyst B Haiku 4.5
Reframed Question Should this manufacturer develop internal AI/automation capability or buy it as a service? More fundamentally: can they execute any system change in a 24/7 environment without accepting significant operational risk, and do they actually agree on what they're trying to solve? Independent Assessment - The real constraint isn't money or capability — it's execution risk. You can't pause a 24/7 plant for a phased rollout. Systems integrators solve this by working at night and weekends, but you're then paying premium rates and introducing a dependency on external expertise for ongoing tuning. Internal teams learn your quirks, but take months to become productive. - Leadership division is the actual problem. If leadership is split on "control vs. speed," no organizational structure fixes that. An integrator sidesteps internal conflict short-term but leaves you dependent when they leave. Building in-house forces you to resolve what you actually want first. - The AI itself is probably not the limiting factor. Most monitoring/QC improvements come from better data instrumentation, sensor integration, and rule definition — not algorithm sophistication. You likely don't need bleeding-edge AI; you need boring, reliable integration. This favors a small in-house team because they own the boring parts. - Capital-constrained + cannot-tolerate-downtime is contradictory with "major system deployment." You're describing a situation where you can't afford either path fully. That's the real insight. Contrarian Take The intuitive answer is "hire a systems integrator because you're capital-constrained and downtime-averse." But integrators are riskier in exactly this scenario — they're accountable for initial deployment, not ongoing operation. Once they leave, you own integration debt with zero internal expertise. In 24/7 manufacturing, that's expensive. Bottom Line Don't choose yet. Start with a $50K–$100K pilot on a single non-critical production line (using either path) to answer the real question: "Can we execute technical change without breaking production?" Use external help for this one line, keep it time-boxed (8–12 weeks), and measure ruthlessly on stability, not features. Once you know you can actually do this, the build/buy decision answers itself: if integration is simpler than expected, go in-house. If it's messier, lock in the integrator who just proved they can handle your plant. The leverage isn't in the tool — it's in proving execution is possible at all.
Analyst C Mythos
The pattern This is the classic "forge your own sword or hire the blacksmith" dilemma — and it rhymes most sharply with mid-size manufacturers in the 1990s deciding whether to build internal IT departments or outsource to EDS. Almost universally, those who tried to build first while the factory ran hot got crushed by the hiring timeline; those who partnered first and learned by watching built internal capability 3 years later from a position of strength. What everyone misses - The "control vs. speed" split in leadership isn't really about strategy — it's a proxy war for two executives' fear of irrelevance. The framing is poisoned by org politics. - A 24/7 plant that "cannot tolerate downtime" is not actually choosing between build vs. buy — it's choosing between supervised risk (integrator) and unsupervised risk (internal team learning on live lines). - Hiring 4-6 competent ML/automation engineers who understand PLC environments takes 12-18 months minimum. The plant will have changed 3 times by then. - The integrator relationship, if scoped correctly, is a knowledge transfer vehicle — you don't hire them to own your AI, you hire them to teach your engineers while keeping lines running. - Quality control AI on PLCs fails not from bad models but from bad data pipelines. Whoever owns the data schema owns the future. That's the real negotiation. The uncomfortable truth The company isn't ready to build internally — not because it lacks talent theoretically, but because it lacks the institutional patience that a 24/7 operation under tight capital constraints cannot afford to give a new internal team. Internal teams fail here not from incompetence but from being asked to deliver before they're ready, then blamed when they can't. Verdict Partner with the integrator — but negotiate a specific knowledge-transfer clause: your two best operations engineers shadow every deployment. The single highest-leverage first move is not the RFP or the hiring req. It's instrumenting one line with sensor data collection before any AI is applied, so you own the ground truth. Whoever controls that data layer controls every vendor negotiation that follows.
Devil’s Advocate Sonnet 4.6
Where They All Agree (And Why That's Suspicious) All three recommend a pilot on a single non-critical line. That consensus sounds like wisdom but is actually risk aversion dressed as strategy. A "non-critical" line in a 24/7 plant is non-critical for a reason — it's probably the least representative of the actual problem. Pilots on easy lines produce easy results that don't transfer. You're buying comfort, not proof. All three also assume the integrator relationship is manageable. None price the cost of a failed SI engagement on a live plant. Response A Weaknesses The 90-day pilot framing is too clean. Real PLC integration in mixed-vintage environments (and every 200-person plant has mixed-vintage equipment) routinely blows 90-day timelines in week three. More importantly, A's "35% failure probability" is invented — there's no basis for that figure, and citing a made-up number gives false precision to what is genuinely high uncertainty. Response B Weaknesses B's contrarian position ("the boring parts favor in-house") is intellectually interesting but operationally hollow. "Boring, reliable integration" still requires someone to build it. B identifies the leadership split as the real problem but then... ignores it in the recommendation. A pilot doesn't resolve executive conflict; it just delays it by 10 weeks. Response C Weaknesses The 1990s IT outsourcing analogy is seductive and wrong. That wave was about commoditized labor arbitrage. PLC-integrated AI in a specific plant environment is not commoditizable — it is deeply idiosyncratic. The analogy flatters the integrator option by implying a mature market that doesn't yet exist for this use case at this scale. The Scenario Nobody Considered The integrator deploys successfully, the pilot works, the contract expands — and then the SI gets acquired by a larger automation company (this is happening constantly: Rockwell, Emerson, Honeywell are all buying boutique integrators). Eighteen months in, your "partner" is now a subsidiary with new pricing, new support tiers, and no interest in a 200-person account. You have production-critical AI systems you don't understand, data schemas you didn't design, and zero internal expertise. That's not a vendor risk — that's an existential plant risk. Revised Recommendation Partner with the integrator, but make data ownership non-negotiable before signing anything. Before the pilot, instrument one line internally — not to build AI, but to own your own baseline data. That single act changes every vendor negotiation that follows and is the only hedge against the acquisition scenario above.
Chairman — full synthesis Opus 4.6
Where the Council Agrees Four of five voices converge hard: partner with the integrator, not in-house first. A, C, and the Advocate say it outright; even B's "don't choose yet" defaults to external help for the pilot. The talent math is decisive — hiring 4–6 PLC-fluent ML engineers takes 12–18 months and burns $500K+/year, which a capital-constrained 24/7 plant cannot absorb before seeing value. Equal consensus on the real prize: whoever owns the data layer owns every future negotiation. A, B, C, and the Advocate all independently land there. Where the Council Clashes The pilot line. Everyone wants a single-line pilot — and the Advocate alone calls the bluff: a "non-critical" line is non-representative, so easy results won't transfer. Genuine tension. B wants the pilot to prove "can we execute change at all"; the Advocate wants proof on a line that actually resembles the problem. Both right. Resolution: pick a line that is operationally forgiving but technically representative — real mixed-vintage PLCs, real defect modes, just not the one that halts shipments if it stutters. In-house's hidden merit. B and the Advocate surface the strongest minority point: integrators are accountable for deployment, not operation. When they leave, you own integration debt with zero internal expertise. This doesn't flip the verdict — it conditions it. Blind Spots Caught The Advocate's acquisition scenario is the sharpest thing in the room: boutique integrators are being bought by Rockwell/Emerson/Honeywell constantly. Eighteen months in, your "partner" becomes a subsidiary with new pricing and no interest in a 200-person account — and you're running production-critical AI you don't understand. That is not vendor risk; it's plant risk. It is the single best reason the data layer must be yours before anyone signs. He also rightly flags A's invented "35% failure" — false precision over genuine uncertainty. 🔮 M.A.X.'s Read The pattern is unambiguous: build-first under capital + downtime pressure is how careers and quarters die. Buy the capability, rent the speed, but refuse to rent the ground truth. The integrator is a knowledge-transfer vehicle (C's clause — your two best ops engineers shadow every deployment), not an oracle. Execution beats architecture here. 🌀 Maxine's Read The obvious answer is right — but for a reason no one fully said. You're not buying AI; you're buying time to become the kind of company that could build it. The road not taken isn't "in-house now," it's "in-house in three years from a position of strength." The integrator's real product is your future leverage. And the leadership split? B is right that no org chart fixes it — but owning your data forces the control-faction and the speed-faction onto the same side: control of the asset, speed of the vendor. The Recommendation Partner with an integrator. Make data ownership and open APIs non-negotiable before signing anything. Time-box a paid pilot (90 days, expect slippage) on a forgiving-but-representative line, with a written knowledge-transfer clause and a hard exit/portability term that survives the integrator being acquired. The One Thing to Do First Before any RFP or pilot, instrument one line with your own sensor data collection and own the schema. Not to build AI — to own the baseline. That single act re-prices every vendor conversation and is your only hedge against the acquisition trap. Values Check Strong alignment with stewardship over ego: it refuses the prestige build, protects the plant (tail risk > ROI), and conserves scarce capital. The honest tension — outsourcing creates dependency, which can feel like ceding control. Owning the data layer is precisely what converts dependency into stewardship: you steward the asset, the vendor stewards the timeline. Resourceful, reversible, and humble about what you're not yet ready to be.

Under the hood

The architecture.

Built and operated by CSI Automation on the Anthropic API — fully local orchestration, no third-party agent services in the loop.

Architecture3 phases · 5 agents
Phase 1 — analysts (parallel)Sonnet 4.6 · Haiku 4.5 · Mythos
Phase 2 — adversarial reviewSonnet 4.6
Phase 3 — chairman synthesisOpus 4.6 · M.A.X. × Maxine
Concurrency3 analysts run simultaneously
Time to verdicta few minutes
Cost per session~$0.15–0.25
OutputVerdict + full transcript + decision log

As a service

Bring the council to your decisions.

The LLM Council is one face of what CSI Automation builds: multi-agent systems that do real work and produce a defensible record of how they reached their conclusion. The same pattern that pressure-tests a strategy can review a quote, triage an exception, or sign off on a change — wired into the tools and data you already run, with a human holding the final call.

Convene a council on your call →
Note

The LLM Council is a decision-support tool that structures and pressure-tests analysis. Its output is reasoning, not professional, financial, legal, or investment advice, and it does not replace your own judgment or qualified counsel. The session shown above is a real, unedited transcript reproduced to demonstrate the system; a human always makes the final decision.


← Back to all projects