Skip to content

Skip Envoy body processing for prefix-free 2026-07-28 routes #1496

Description

@david-martin

From future work captured in

- **Body phase skip.** When no prefix is configured on any MCPServerRegistration, the ext_proc could be configured with `request_body_mode: NONE` for `2026-07-28` routes, eliminating the body phase entirely at the Envoy level.

For 2026-07-28 routes, skip Envoy’s ext_proc request body phase when no MCPServerRegistration uses a tool prefix. Configure request_body_mode: NONE when prefix stripping is unnecessary.

This removes buffering and parsing from the tool-call hot path, reducing CPU, memory use, and latency while enabling Envoy-level streaming.

Current performance testing shows that 2025 and 2026 tool-call results are nearly identical. This post-GA 1.1 optimization should make the expected 2026 performance advantage measurable.

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    priority/normalCan be worked on after critical and high priority items are accounted fortriage/acceptedHas been assessed, and accepted for work

    Type

    No type

    Projects

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions