Kainos AI CoE · Build · Platform

Platform architecture principles.

The non-negotiable standards every Kainos agent must meet before production. Not guidelines - baselines. If an agent doesn't meet these, it isn't ready to ship.

Security Governance Observability Responsible AI ISO 42001 OWASP LLM Top 10

The nine principles

These map directly to the AZ RFP governance build checklist and apply to every agent across the CoE platform - from SparkHub to AgentGate to customer-facing deployments.

01 - Oversight
Human in the Loop

Every agent must define explicit human oversight checkpoints. Irreversible actions - sending emails, writing records, triggering workflows - require an approval gate before execution. Autonomous action without oversight is not acceptable on high-impact paths.

HITLISO 42001 §6.1
02 - Data
Stateless by default

Agents must not retain customer data between sessions. All state is explicit, documented, and held in a named store. Implicit memory across turns is a privacy risk and a compliance failure. Architects must trace every data write at design time.

Privacy by DesignOneTrust intake
03 - Observability
Observable from day one

OTel instrumentation, structured logs, and an evaluation suite are required before any production deployment. If you can't observe it, you can't run it. Monitoring dashboards and alert thresholds are part of the definition of done, not an ops afterthought.

OpenTelemetryEval gates
04 - Security
OWASP LLM Top 10 reviewed at design time

Prompt injection, insecure output handling, data leakage, over-permissioned tools, and supply chain vulnerabilities are treated as blockers. A threat model covering LLM-specific attack surfaces is required before code is written, not reviewed at launch.

OWASP LLM Top 10Threat model
05 - Responsible AI
Bias monitoring and fairness assurance

ISO 42001 controls applied. Bias, fairness, and transparency statements documented before launch. Agents processing HR, health, or financial data require a fairness test plan covering protected characteristics. Results are logged and reviewed on a defined cadence.

ISO 42001Bias monitoringDPIA
06 - Knowledge
Retrieval over memorisation

Domain knowledge comes from RAG and grounding, not model fine-tuning. This keeps knowledge auditable, updatable, and version-controlled. Fine-tuning is a last resort - it makes the knowledge opaque, expensive to update, and difficult to audit for correctness.

RAGGroundingRetrieval
07 - Privacy
Privacy by design

OneTrust intake required before any personal data is processed. Every personal data flow documented in a RoPA entry. Lawful basis confirmed. Data minimisation applied - agents request only the data required for the task, not the data available to the tool.

OneTrustRoPAGDPR
08 - Quality
Evaluation gates in CI

Automated evaluation pipelines run on every merge. A deploy requires a passing evaluation score, not just passing unit tests. Evaluation covers accuracy, safety, tone, and refusal behaviour. A score below threshold is treated the same as a failing build.

CI gatesEval harness
09 - Handover
Built for handover

Every agent ships with a runbook and a monitoring dashboard. If you can't explain how to operate it without you in the room, you haven't finished building it. Operational documentation is part of the acceptance criteria, reviewed at the same time as the code.

RunbookOps dashboardMaintenance plan

These are baselines, not aspirations. They reflect the build checklist from the Workday AI governance approach review and the requirements surfaced in the AZ RFP security questionnaire. Any agent that can't demonstrate compliance with all nine is not production-ready.

Pre-ship checklist

Run this against every agent before requesting an approach review or production deployment approval.

HITL documented - approval gates defined for every irreversible action
Data flows mapped - all state stores identified, no implicit cross-session retention
OTel instrumented - traces, structured logs, and evaluation metrics emitted
Threat model complete - OWASP LLM Top 10 reviewed, prompt injection vectors addressed
OneTrust submitted - intake form submitted, lawful basis confirmed, RoPA entry created
Eval gate passing - CI evaluation pipeline green at agreed accuracy and safety thresholds
Bias assessment done - fairness test plan executed, results logged
Runbook written - operational guide and monitoring dashboard reviewed by the owning team
Security review attended - presented to Paul Coulter, Teresa (Responsible AI), and Gareth

Design standards

Visual and interaction design is part of the platform architecture, not a downstream concern. The Kainos design system sets the tokens, patterns, and methodology every CoE product must follow.

Design system
Kainos Design

Colour tokens, typography, component patterns, and the DESIGN.md methodology. Every UI built by the CoE starts here - not with a blank Figma file.

Open Design system

Repositories

The shared code that underpins AI delivery at Kainos. Every CoE project builds on or contributes back to these repos.

CoE repositories
Shared Repos

The agentic registry, skills library, Workday MCP server, tenant analyser, and the Cortex platform itself. These are the building blocks every CoE project draws from.

Browse repos