Skip to content

tests: allow to save results if there are improvements only - #242

Merged
dabrain34 merged 2 commits into
KhronosGroup:mainfrom
dabrain34:dab_improvement_save
Sep 10, 2026
Merged

tests: allow to save results if there are improvements only#242
dabrain34 merged 2 commits into
KhronosGroup:mainfrom
dabrain34:dab_improvement_save

Conversation

@dabrain34

Copy link
Copy Markdown
Contributor

Description

This MR allows to get input from user if we wants to save the results if there are new tests or improvements

Type of change

feature

Issue (optional)

Tests

NVIDIA GeForce RTX 3050 Ti Laptop GPU (10de:25a0) / NVIDIA 595.44.14 / Ubuntu 24.04.4 LTS

Total Tests: 85
Passed: 66 (1 warning(s))
Crashed: 0
Failed: 0
Not Supported: 18
Skipped: 1 (in skip list)
Success Rate: 100.0%

Intel(R) Iris(R) Xe Graphics (ADL GT2) (8086:46a6) / Intel open-source Mesa driver Mesa 26.3.0-devel (git-5472c10fad) / Ubuntu 24.04.4 LTS

Total Tests: 85
Passed: 58
Crashed: 0
Failed: 0
Not Supported: 24
Skipped: 3 (in skip list)
Success Rate: 100.0%

Additional Details (optional)

@dabrain34
dabrain34 force-pushed the dab_improvement_save branch from 05c9b87 to 9c0aab0 Compare September 8, 2026 11:18
Comment thread tests/results/vvs_test_results.json
Comment thread tests/vvs_test_runner.py Outdated
Comment thread tests/libs/video_test_result_storage.py
@dabrain34
dabrain34 force-pushed the dab_improvement_save branch 2 times, most recently from c7110a6 to da3055d Compare September 10, 2026 15:29
If a new test has been introduced or a test  is now passing,
the testing framework will prompt to save the new results.

@crmurillo crmurillo left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM, thanks!

The detection of right encode profile
has been improved in KhronosGroup#171.

high444 are now success and main10 as well.

av1 high and pro profile results have change to not supported as
these HWs do not support these profiles, so should not allow
to run an encode with these profiles.
@dabrain34
dabrain34 merged commit 39cbc95 into KhronosGroup:main Sep 10, 2026
20 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants