Skip to main content
v1.3.13

Changelog

This release upgrades the base OSS version from v1.4.16 to v1.4.17, bringing denylist model support, numerous streaming and provider fixes, and WebSocket concurrency safety. On the enterprise side, the Datadog span type for LLM calls is updated to llm.call for correct Datadog LLM Observability categorization.

✨ Features

  • Denylist Models - Provider keys now support a blacklisted_models field to exclude specific models from routing and filtered list-models ; denylist takes precedence over the models allow list

🐞 Fixed

  • Datadog LLM Span Type - Changed Datadog span type for LLM calls from llm to llm.call for proper Datadog LLM Observability integration
  • MCP Gateway Headers - Fixed support for x-bf-mcp-include-clients and x-bf-mcp-include-tools headers to filter MCP tools/list response
  • Bedrock Duplicate Events - Fixed duplicate content_block_stop events in Bedrock streaming responses
  • Reasoning Content Marshaling - Fixed reasoning_content JSON tag in OpenAI response types
  • OTEL Streaming Traces - Fixed response capture in OTEL tracing for streaming calls
  • Broken Pipe Handling - Added broken pipe detection to connection pool error handler
  • Cache Token Streaming - Fixed cache token capture for streaming calls across Anthropic and Bedrock providers
  • Vertex Embedding URL - Fixed global region URL construction in Vertex embedding method
  • Bedrock Reasoning Merge - Fixed reasoning content merge logic for Bedrock provider
  • Bedrock HTTP/2 Toggle - Fixed enforce HTTP/2 toggle behavior for Bedrock provider
  • Codex Store Parameter - Fixed store parameter handling for Codex conversations
  • Gemini Duplicate Text - Skipped OutputTextDone events to prevent duplicate text in Gemini GenAI streaming
  • Gemini Thought Signatures - Handled missing thought signatures in Gemini provider
  • Replicate Model Slugs - Refined Replicate model slug resolution in model catalog
  • Logging Default - Kept logging enabled by default for new configurations
  • Gin Migration Deadlocks - Moved all gin migrations to Go to avoid deadlocks
  • WebSocket Concurrent Writes - Fixed concurrent write safety in WebSocket Responses API sessions
  • Persist Store Config - Persisted store raw request/response config at provider level

πŸ“€ Base OSS version

transports/v1.4.17

πŸ—ΊοΈ Helm chart version

2.0.14

πŸ”Œ If you are compiling plugin against this release - use following deps