Integrations · OpenAI-compatible · native middleware

Drop in.
Keep everything else.

CloakPipe speaks the OpenAI API dialect, so the simplest integration is changing one base URL. For the frameworks, gateways, and agent runtimes you already run, there's native middleware — no rewrites, no lock-in, and the same Rust pipeline underneath every connector.

01 · LLM providers

Route to any model.

How the proxy routes

The proxy is OpenAI-compatible and provider-agnostic. Point your app at a CloakPipe endpoint and route to closed models, managed clouds, or self-hosted weights. Different masking policies per provider — strict for closed models, lighter or bypassed for models inside your own perimeter.

OpenAI

Swap api.openai.com for your CloakPipe base URL. GPT-class models, function calling, and streaming SSE all keep working unchanged.

Anthropic (Claude)

Pseudonymize prompts before they reach Claude, then rehydrate the streamed response in real time. Privileged content never leaves your control.

Google (Gemini)

Mask financial and customer data on the way to Gemini, restore real values on return. Per-entity policy decides what Google ever sees.

AWS Bedrock

Route to Bedrock-hosted models with the same detection pipeline in front. Vault and audit run inside your AWS account.

Azure OpenAI

Azure deployments behave like any other OpenAI-compatible target. One config switch, full pseudonymization and rehydration.

Mistral

Forward clean prompts to Mistral endpoints. Structurally valid replacements keep the model reasoning correctly about entities.

Cohere

Cohere chat and command models route through the proxy with the same sub-50 ms overhead and full audit trail.

Any OpenAI-compatible endpoint

If it speaks the OpenAI API dialect, CloakPipe routes to it. No SDK fork required — just the base URL.

Self-hosted · vLLM · Ollama · TGI

Run models inside your perimeter via vLLM, Ollama, or Text Generation Inference. Policy can bypass masking when the model is already yours.

02 · AI frameworks

Native middleware,
zero rewrites.

Browse the connectors

For the orchestration frameworks you already build on, CloakPipe ships as a wrapper that slots into the existing data path. One line in your chain or agent — masking, vault, and policy come along for free.

★ 102K PYTHON
langchain-ai/langchain
CloakPipeRunnable middleware. Drop-in for any chain or agent. Streaming-safe.
★ 38K PYTHON
run-llama/llama_index
Query-time masking for RAG. Pseudonymize retrieved chunks before they hit the LLM.
★ 28K PYTHON
crewAIInc/crewAI
Per-agent masking context and access level. Policy enforced across the orchestration.
Agent wrapper SHIPPED
★ 18K TYPESCRIPT
langchain-ai/langgraph
Policy-aware tool wrapper. CBAC on every node transition.
Tool wrapper SHIPPED
★ 12K GO
BerriAI/litellm
Middleware in the proxy chain. Protects every downstream model with one config.
★ 4.2K RUST
rohansx/cloakpipe-mcp
Native Model Context Protocol server. mask, unmask, scan tools for any MCP client.
MCP server SHIPPED

AutoGen and other multi-agent runtimes are covered by the same model: the orchestrator defines the security posture, each agent gets its own masking context, access level, and audit scope, and individual agents cannot override it. The framework changes; the trust layer underneath does not.

03 · AI gateways

One integration.
Every downstream model.

Platform & embed licensing

For platforms that route requests across many model providers, CloakPipe embeds as middleware in the existing proxy chain. A single integration protects all downstream calls for every user of the gateway.

Venice.ai

Close the content-privacy gap on routed closed models. CloakPipe sits in the proxy chain, masking before the provider ever sees a prompt.

OpenRouter

Add pseudonymization to multi-provider routing. One embed protects every model OpenRouter forwards to.

LiteLLM

Run as a middleware plugin in the LiteLLM proxy chain so one config protects all downstream models at once.

Kong AI Gateway

Enterprise API gateway adding AI features. PII protection is the natural next layer in the request lifecycle.

Gravitee

Slot CloakPipe into Gravitee's AI gateway policy chain for masking and audit across every routed model call.

Cloudflare AI Gateway

Add a privacy layer to edge-routed model traffic, with vault and audit hosted inside your own perimeter.

Portkey

Embed masking middleware into Portkey's gateway so prompts are pseudonymized before reaching any configured provider.

TrueFoundry

Wrap TrueFoundry's model gateway with CloakPipe to keep sensitive data inside your infrastructure across every deployment.

04 · Agent protocols

CloakPipe as
a tool.

MCP server reference

The native Model Context Protocol server exposes CloakPipe's core operations as agent tools. Any MCP client can mask, unmask, scan, and apply policy without leaving the protocol — and every call lands in the audit trail.

mask & unmask tools

mask_text, mask_file, and unmask_in_context let an agent pseudonymize content and reverse it under policy — vault-backed, authorized per request.

scan tool

scan_directory detects sensitive data across files and data sources, returning entity types and confidence without ever exposing raw values.

policy tool

Agents evaluate masking and unmask decisions against the same OPA / Cedar policy engine the proxy uses. The orchestrator's posture is enforced, not advisory.

Claude Desktop · Cursor · any MCP client

Drop the server into Claude Desktop, Cursor, or any MCP-compatible runtime. Tool responses are intercepted, scanned, and policy-checked before the agent processes them.

05 · Key management

You hold
the keys.

How the vault works

The vault encrypts every real value with AES-256, and the root keys stay yours. Bring-your-own-key through your existing KMS — CloakPipe never holds the keys to your customer's data. Envelope encryption with automatic rotation.

AWS KMS

Customer-managed keys in AWS KMS via envelope encryption. Keys rotate on your schedule; existing tokens stay decryptable.

GCP Cloud KMS

Root keys in Google Cloud KMS. Per-tenant vault namespaces mean no cross-tenant access is possible at the cryptographic level.

Azure Key Vault

Manage encryption keys in Azure Key Vault. Automatic rotation runs without disrupting active tokens.

HashiCorp Vault Transit

Use Vault Transit as the key-management backend for BYOK envelope encryption across self-hosted and air-gapped deployments.

06 · Identity & access

Map your IdP
to policy.

Policy & RBAC

Single sign-on and provisioning plug into your existing identity provider. IdP roles map directly to CloakPipe policies, so who can unmask what is decided by the same directory that runs the rest of your stack.

SAML 2.0

Enterprise SSO via SAML 2.0. Authenticate operators against your IdP before any unmask or dashboard access.

OIDC (SSO)

OpenID Connect single sign-on for modern identity providers, with session and role claims flowing into policy decisions.

SCIM provisioning

Automatic user provisioning and de-provisioning through SCIM. Lifecycle stays in sync with your directory.

IdP role mapping

Map directory groups and roles straight onto CloakPipe RBAC and CBAC rules — physicians unmask diagnoses, sales never can.

07 · Observability

OpenTelemetry-
native.

The audit layer

Every API call emits structured traces, metrics, and logs from day one. Export to any OTEL-compatible collector with pre-built dashboards for detection rates, entity distribution, latency percentiles, and unmask patterns.

OpenTelemetry

Traces, metrics, and logs in OTEL format. The foundation every other observability integration builds on — no vendor lock-in.

Datadog

Stream CloakPipe telemetry into Datadog dashboards and monitors for latency, detection, and policy-decision metrics.

Grafana

Visualize entity-type distribution and proxy overhead in Grafana with the bundled OTEL-backed dashboards.

Splunk

Forward structured events to Splunk for operational monitoring alongside the rest of your platform telemetry.

Honeycomb

High-cardinality tracing in Honeycomb to debug per-request detection and rehydration behavior.

Prometheus

Scrape CloakPipe metrics with Prometheus for alerting on latency percentiles and detection-rate anomalies.

08 · Compliance tooling

Evidence,
automated.

Compliance posture

Audit logs are privacy-safe by design — they record what types of data were processed and what actions were taken, never the values. Wire them into the evidence and SIEM tools you already run for SOC 2 and security operations.

Vanta

Automated SOC 2 evidence collection. CloakPipe's access-control and audit-logging controls feed Vanta continuously.

Drata

Continuous compliance monitoring with Drata, pulling encryption and change-management evidence from the audit layer.

Comp AI

Connect Comp AI for SOC 2 evidence automation across CloakPipe's logging, encryption, and access controls.

SIEM webhooks · Splunk · Sentinel · Elastic

Webhook integration streams privacy-relevant events into Splunk, Microsoft Sentinel, or Elastic for security monitoring and alerting.

Need a connector that isn't listed? The proxy is OpenAI-compatible and the audit layer is OTEL-native, so most integrations are a base-URL switch or a webhook away. Talk to us about embedding CloakPipe into your gateway or platform — Email the team

One base URL.
Everything else stays.