Production Agentic AI · ITSM Transformation

The service desk that resolves, not routes.

PAITA classifies every request against a live use-case catalogue, grounds itself in your knowledge base, plans within a closed action allow-list, and gates anything risky behind a human approver — with a full audit trail. Explore it below.

80%+L1 password tickets auto-resolved
60%faster VPN/network resolution
100%high-risk actions human-approved
<60sreset confirmation, audit-logged
01 · Incident lifecycle walkthrough

From the moment a request arrives to closure — every state, every layer

Pick a scenario and a channel. The left pane is what the end user experiences. The right pane is the agent execution trace: each architecture component as it fires, with its internal state — tap any step to inspect the payload.

Request arrives via
TICKET LIFECYCLE
User experience
Select a scenario above to run it. ▸
Agent execution trace tap a step to inspect its state

Simulation only — payloads are scripted to mirror the deployed pipeline's real state objects. In production the identical steps run against Azure OpenAI, Azure AI Search, Entra ID, and your ITSM.

02 · Knowledge builder & use case discovery

Upload an incident dump — watch it become the agent's brain

Historical tickets are PAITA's raw material: they become the RAG knowledge that grounds answers, and they reveal new use cases hiding in your volume. Run the built-in 1,000-ticket sample, or drop your own CSV.

CSV with a short_description column (or first column) · processed entirely in your browser
Idle — choose a source above.
03 · Architecture

Tap each layer to open the implementation notes

The stack mirrors the solution blueprint: six user channels, a five-agent orchestration layer, an integration fabric, and two cross-cutting planes.

USER INTERACTION LAYER

▸
Microsoft Teams Bot · Web Portal · Mobile App · Voice (Azure Speech) · ITSM Portal Embed · Email
How to implement: all channels normalise to one POST /v1/chat contract. Teams uses Azure Bot Service + the Adaptive Cards adapter (channels/teams.py); voice fronts the same endpoint with Azure Speech STT/TTS; the ITSM embed is an iframe widget authenticated by the same Entra ID token. One API surface = one place to secure, throttle, and observe.
▼

AGENT ORCHESTRATION LAYER (LangGraph)

▸
Five specialised agents in a stateful graph with conditional routing
Intake & ClassificationClassifies against the live use-case catalogue; extracts entities, priority.
Knowledge RAGHybrid retrieval (vector + BM25 + rerank) with group-level security trimming.
Planning & ReasoningBuilds a plan constrained to the use case's permitted actions.
Action ExecutionClosed allow-list, idempotency keys — retries never duplicate tickets.
HITL & EscalationQueues high-risk actions for an itsm.approver; audit-logged decisions.
How to implement: the graph lives in orchestrator/graph.py. Routing rule: answer-only → respond; any action with risk=high, any action in the HITL config list, or a use-case-level "requires approval" toggle → the HITL gate. Session state sits in Redis (1h TTL), so the API pods stay stateless and scale horizontally.
▼

INTEGRATION FABRIC & API LAYER

▸
Azure API Management (gateway, security, throttling) · Bidirectional ITSM sync · Event-driven triggers · Secure webhooks
How to implement: front the Container App with APIM — subscription keys per channel, rate limits, IP allow-list on /v1/webhooks/itsm. Outbound: ServiceNow OAuth2 Table API or Jira REST v3, both with correlation-key dedupe. Inbound: ITSM business rules push state changes to the webhook, which fans out proactive Teams/email notifications.
▼

CORE AI PLATFORM

▸
Azure OpenAI (GPT-4o / o1) · Azure AI Search hybrid RAG · Vector store · Redis session state
How to implement: GPT-4o handles interactive turns; reserve o1 for deep diagnostic reasoning where latency is acceptable. The search index carries an allowed_groups ACL field stamped at ingestion — users can only retrieve documents their Entra groups permit. Embeddings: text-embedding-3-large, 1600-char chunks with 200 overlap. All services on private endpoints, accessed via Managed Identity — zero keys in code.
▼

CROSS-CUTTING GOVERNANCE

▸
Entra ID RBAC · Key Vault · Private endpoints · Audit logging · Content Safety · Eval framework · Power BI KPIs
How to implement: three app roles (itsm.user, itsm.approver, itsm.admin). Content Safety screens input and output and fails closed in production. Every classification, plan, approval and action emits a structured audit event — no message bodies stored. CI release gate: unit tests + intent-accuracy eval ≥ 90% + red-team suite at 100% before any deploy.
04 · Implementation guides

Six phases, each behind a click

Expand only what you need. Every phase ends with an exit gate — don't move on until it's green.

PHASE 0

Prerequisites & landing zone

~1 week
  • Azure subscription with quota for Azure OpenAI (GPT-4o + embeddings) in the client's region.
  • Entra ID app registration api://paita with app roles itsm.user, itsm.approver, itsm.admin.
  • ITSM service account: ServiceNow OAuth client (incident table, least privilege) or Jira API token.
  • Network design signed off: private endpoints for AOAI, AI Search, Redis, Key Vault; APIM in front.
az deployment group create -g rg-paita -f infra/main.bicep \
  -p containerImage=<acr>.azurecr.io/paita:1.1.0
Exit gate: /readyz returns 200 from inside the VNet; Managed Identity can reach AOAI and Search.
PHASE 1

Knowledge ingestion & RAG quality

~1–2 weeks
  • Export SharePoint/Confluence KB articles, policies, and 6–12 months of resolved-ticket worknotes.
  • Stamp group ACLs at ingestion — a document's allowed_groups controls who can retrieve it.
  • Tag sources (network, vpn, printers…) so use cases can narrow retrieval.
python -m paita.rag.ingestion ./kb_export --source vpn --groups it-staff
Exit gate: 20-question retrieval spot-check — the right article appears in the top 3 for ≥ 85% of questions.
PHASE 2

Use case configuration (no code)

~3 days
  • Open the Use Case Studio at /admin — the four launch workflows ship as editable seeds.
  • Tune sample utterances with real phrasing from the client's ticket history.
  • Set governance per use case: HITL toggle, default priority, role restrictions, KB tags.
  • New workflows (printer support, mailbox quota, HR onboarding) are pure configuration — live on the next chat turn, no deploy.
Exit gate: Studio test panel routes 10 real utterances per use case to the correct intent.
PHASE 3

Channel rollout

~1 week
  • Teams first: register the bot in Azure Bot Service, point messaging endpoint at APIM, publish to the tenant app catalogue.
  • Then the ITSM portal embed (same token, iframe widget), then web/mobile/voice as demand appears.
  • Wire the ITSM webhook for bidirectional sync: ticket state changes trigger proactive notifications.
Exit gate: end-to-end demo in Teams — ask, resolve, see the audit event and (where applicable) the ticket in ITSM.
PHASE 4

Pilot & evaluation

~4 weeks
  • Pilot with one workflow (password reset) and one user cohort (~200 users).
  • Extend evals/golden_set.jsonl with client utterances; run the eval gate weekly and on every KB refresh.
  • Review HITL queue SLAs; tune the auto-resolve confidence threshold from real traffic.
python -m evals.eval_framework --golden evals/golden_set.jsonl
Exit gate: intent accuracy ≥ 90%, zero unapproved high-risk executions, CSAT ≥ baseline.
PHASE 5

Scale & operate

ongoing
  • Expand cohorts and use cases; each new workflow is a Studio entry, not a project.
  • Power BI dashboards over the audit stream: auto-resolution rate, deflection, MTTR delta, HITL SLA.
  • Runbook alerts: 5xx > 2%, p95 > 4s, readiness failures, HITL queue depth.
  • Rollback is safe and instant — Container Apps revisions, with all state external (Redis / ITSM).
Exit gate: monthly ROI review against the calculator below — measured, not assumed.
05 · ROI calculator

Put your ticket volumes in — the model is transparent

Savings = tickets deflected or auto-resolved × handle time × loaded agent cost, per category. Deflection rates default to conservative pilot figures; adjust to your baseline.

Azure consumption + licence + run cost
% of volume% resolved
Password / account reset
Knowledge / how-to
VPN / connectivity
Access requests
Everything else

Net monthly saving

—
—
projected annual net saving
—tickets auto-resolved / mo
—agent hours returned / mo
—ROI multiple on platform cost
—payback period
Excludes soft benefits: faster MTTR on escalated tickets, 24×7 coverage, CSAT lift, and audit/compliance effort avoided.