Skip to content

test: add downstream client conformance coverage - #107

Merged
dawid-nowak merged 1 commit into
mainfrom
user/luca/add-client-conformance
Aug 27, 2026
Merged

test: add downstream client conformance coverage#107
dawid-nowak merged 1 commit into
mainfrom
user/luca/add-client-conformance

Conversation

@lucarlig

@lucarlig lucarlig commented Aug 20, 2026

Copy link
Copy Markdown
Contributor

Summary

  • run the official MCP 2026-07-28 client conformance scenarios against the dataplane outbound client path
  • route scenario tool calls through nginx and the dataplane to the official downstream backend
  • add client expected-failure reporting and blessing alongside the server suite
  • run both directions from CI, make conformance, and make conformance-bless

OAuth client scenarios remain control-plane owned. The shell adapter is not a schema-aware MCP client, so the four x-mcp-header generation check IDs remain baselined. PR #109 covers gateway validation and forwarding.

Validation

  • MCP_CONFORMANCE_COLOR=never make conformance
  • conformance adapter, reporter, and baseline unit tests
  • Python and shell syntax checks for the changed harness files
  • repository commit hooks

The fresh composed run had no unexpected server or client failures; client findings were limited to the four baselined parameter-header generation checks.

@lucarlig
lucarlig marked this pull request as ready for review August 20, 2026 15:55
@lucarlig
lucarlig requested a review from cafalchio August 20, 2026 15:55
@lucarlig lucarlig self-assigned this Aug 20, 2026
@lucarlig
lucarlig force-pushed the user/luca/add-client-conformance branch from 62242b6 to ce43d06 Compare August 21, 2026 16:42
@lucarlig
lucarlig changed the base branch from main to user/luca/fix-unused-async-handlers August 21, 2026 16:43
@lucarlig
lucarlig force-pushed the user/luca/add-client-conformance branch 2 times, most recently from 97316e6 to 7f1f4fd Compare August 24, 2026 13:59
@lucarlig
lucarlig force-pushed the user/luca/add-client-conformance branch from 7f1f4fd to 12fe357 Compare August 24, 2026 14:29
@lucarlig
lucarlig force-pushed the user/luca/add-client-conformance branch from 12fe357 to 439ca3c Compare August 26, 2026 08:33
@lucarlig
lucarlig changed the base branch from user/luca/fix-unused-async-handlers to main August 26, 2026 08:33
Signed-off-by: lucarlig <luca.carlig@ibm.com>
@lucarlig
lucarlig force-pushed the user/luca/add-client-conformance branch from 439ca3c to 0b870a5 Compare August 26, 2026 09:07
@dawid-nowak
dawid-nowak merged commit 8d36f17 into main Aug 27, 2026
12 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants