Skip to content

fix(plugin-testops): Align the upload payload with the backend contract - #889

Closed
todti wants to merge 1 commit into
mainfrom
fix/testops-payload-gaps
Closed

fix(plugin-testops): Align the upload payload with the backend contract#889
todti wants to merge 1 commit into
mainfrom
fix/testops-payload-gaps

Conversation

@todti

@todti todti commented Aug 25, 2026

Copy link
Copy Markdown
Collaborator

Context

Three defects found by comparing what the plugin uploads against what the TestOps API accepts. They are independent of each other and of #888, which fixes the ci block of the same request.

A blank error message rejects the whole batch. Global errors come from the results files test framework adapters write, and their message is optional in our model — nothing validates it on the way in. TestOps requires a non-blank message and rejects the entire bulk request when one item lacks it, so a single untitled error dropped every valid error uploaded alongside it. A placeholder is sent instead, keeping the trace. This became easier to hit once every not-yet-uploaded error started being sent rather than only the last one.

A long launch name fails launch creation. TestOps accepts a launch name of at most 255 characters and fails the request otherwise, so a longer report title killed the upload before it started. The name is trimmed to the accepted length now.

environment was sent into the void. The upload API has no environment property on a test result, so the value was dropped on arrival; the binding it was meant to carry travels in namedEnv, which is sent next to it. The dead field is gone from the payload and from the type that mirrors the API.

Checklist

Three defects found by comparing what the plugin uploads against what the
TestOps API accepts. They are independent of each other.

Global errors come from the results files test framework adapters write, and
their message is optional in our model — nothing validates it on the way in.
TestOps requires a non-blank message and rejects the entire bulk request when
one item lacks it, so a single untitled error dropped every valid error
uploaded alongside it. Send a placeholder instead, keeping the trace. This
became easier to hit once every not-yet-uploaded error started being sent
rather than only the last one.

TestOps accepts a launch name of at most 255 characters and fails the request
otherwise, so a longer report title killed the upload before it started. Trim
the name to the accepted length.

The upload API has no `environment` property on a test result, so the value was
dropped on arrival; the binding it was meant to carry travels in `namedEnv`,
which is sent next to it. Remove the dead field from the payload and from the
type that mirrors the API.
@todti
todti force-pushed the fix/testops-payload-gaps branch from c27adb0 to 54ce38f Compare August 25, 2026 17:22
@todti todti added the pr:bug label Aug 25, 2026
@github-actions

github-actions Bot commented Aug 25, 2026

Copy link
Copy Markdown

Allure Report Summary

Name Duration Stats New Flaky Retry Report
Allure 3 Report (plugin-allure2) 36m 1s Passed tests 10136   Skipped tests 15   Unknown tests 24 6 0 33 View
Allure 3 Report 36m 1s Passed tests 10136   Skipped tests 15   Unknown tests 24 6 0 33 View
Allure 3 Report (plugin-classic) 36m 1s Passed tests 10136   Skipped tests 15   Unknown tests 24 6 0 33 View
My Dashboard 36m 1s Passed tests 10136   Skipped tests 15   Unknown tests 24 6 0 33 View
Allure Report 0s 0 0 0

@github-actions

github-actions Bot commented Aug 25, 2026

Copy link
Copy Markdown

Allure perf metrics

Generated at: 2026-08-26T10:01:59.459Z

Phase Count Total Avg Min Max
restoreState.total 1 2289.5 ms 2289.5 ms 2289.5 ms 2289.5 ms
restoreState.dump 3 2288.9 ms 763.0 ms 722.7 ms 808.9 ms
restoreState.attachments 3 1608.4 ms 536.1 ms 497.6 ms 574.5 ms
restoreState.storeRestore 3 167.5 ms 55.8 ms 53.5 ms 57.0 ms
generate.total 1 14528.6 ms 14528.6 ms 14528.6 ms 14528.6 ms
generate.plugins.done 1 14004.9 ms 14004.9 ms 14004.9 ms 14004.9 ms
publish.upload.total 1 360259.3 ms 360259.3 ms 360259.3 ms 360259.3 ms
summary.generate 2 51.3 ms 25.7 ms 7.2 ms 44.1 ms
generate.plugin.done.agent 1 0.1 ms 0.1 ms 0.1 ms 0.1 ms
generate.plugin.done.allure2 1 3049.3 ms 3049.3 ms 3049.3 ms 3049.3 ms
generate.plugin.done.awesome 1 5508.5 ms 5508.5 ms 5508.5 ms 5508.5 ms
generate.plugin.done.classic 1 4473.0 ms 4473.0 ms 4473.0 ms 4473.0 ms
generate.plugin.done.dashboard 1 969.8 ms 969.8 ms 969.8 ms 969.8 ms
generate.plugin.done.log 1 2.8 ms 2.8 ms 2.8 ms 2.8 ms
generate.plugin.done.testops 1 0.3 ms 0.3 ms 0.3 ms 0.3 ms
publish.upload.plugin.allure2 1 99849.4 ms 99849.4 ms 99849.4 ms 99849.4 ms
publish.upload.plugin.awesome 1 128859.6 ms 128859.6 ms 128859.6 ms 128859.6 ms
publish.upload.plugin.classic 1 98822.2 ms 98822.2 ms 98822.2 ms 98822.2 ms
publish.upload.plugin.dashboard 1 17354.1 ms 17354.1 ms 17354.1 ms 17354.1 ms

Artifacts: allure-perf-metrics

@todti

todti commented Sep 1, 2026

Copy link
Copy Markdown
Collaborator Author

Superseded by #906 — this branch's content is fully merged there (byte-identical for #818/#888; #889's fixes cherry-picked in 52798bf).

@todti todti closed this Sep 1, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant