rebrand: standalone Prem Agent Gateway (patches + rebrand -> main) - #1
Open
athena-git-bot[bot] wants to merge 9 commits into
Open
rebrand: standalone Prem Agent Gateway (patches + rebrand -> main)#1athena-git-bot[bot] wants to merge 9 commits into
athena-git-bot[bot] wants to merge 9 commits into
Conversation
Codex CLI's Responses SSE parser declares input_tokens_details.cache_write_tokens as i64 with #[serde(default)], which accepts a missing field but rejects an explicit null. The Bedrock -> Responses conversion emitted null whenever Bedrock reported no cache writes, so every streamed turn failed with 'failed to parse ResponseCompleted: invalid type: null, expected i64'. Emit 0 instead, matching how cached_tokens is handled. Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
The Bedrock -> Responses streaming conversion emitted the final message item (and content_part.done) with empty content, even though text deltas had been streamed. Clients that build the assistant message from output_item.done rather than from deltas (e.g. Codex CLI) saw an empty assistant message. Accumulate the streamed text and fold it into the final message item. Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
Agent clients (e.g. Codex CLI) replay prior assistant turns as
{type:message, role:assistant, content:[{type:output_text, text}]} without the
server-assigned id/status or the annotations array. The typed OutputMessage
requires those, so multi-step turns failed with
'data did not match any variant of untagged enum InputParam'.
Add a RequestType::normalize_json hook and fill in the missing fields for
Responses requests before deserialization.
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
Newer Codex CLI sends MCP servers as a single Namespace tool (NamespaceToolParam) instead of individual function tools. The Bedrock conversion dropped the unsupported type with a warning, so models behind the gateway saw no MCP tools at all. - request: flatten each namespace into per-tool Bedrock specs named '<ns>::<tool>' via the existing BedrockToolNameMap sanitization - response (streaming + non-streaming): split restored names back and emit FunctionToolCall items carrying the namespace field - input replay: recombine namespace+name for assistant tool-call history Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
Replace upstream README/governance files with Prem-specific ones, retarget image CI to main, keep Apache-2.0 license and upstream attribution. Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
charitra-prem
approved these changes
Aug 24, 2026
…nd output_item.done fixes Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
1 participant
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Promotes our working branch to
main, making this the standalone Prem Agent Gateway repo.Included:
RequestTypedyn-compat, Bedrock namespace tools for Codex >=0.149, GHCR image CI)main(was the feature branch)Follow-ups after merge (already prepared):
GitRepositorybranch tomain🤖 Generated with Claude Code