Skip to content

test(bench): add a separate GDC SNB BI suite #963

Description

@DecisionNerd

Objective

Integrate SNB BI as an independent analytical suite using pinned official assets.

Requirements

  • Separate BI from Interactive profiles and reporting.
  • Use public query interfaces and official result validation.
  • Record load, query, spill, RSS, I/O, and correctness separately.

Acceptance criteria

  • Tiny fixtures cover adapter, parameters, and validation.
  • Coverage and unsupported semantics are explicit.
  • Large factors are opt-in external runs only.

BDD completion scenario

Given pinned BI data and parameters
When supported queries run
Then normalized results match references
And resource evidence remains distinct from correctness.

Remaining completion evidence (2026-09-04)

Reopened after independent verification against main 905f2c5d: the existing suite does not yet execute the trusted live public GraphForge path proposed in #1083. Static/reference replay alone does not establish the public-path execution required above. Complete and review existing PR #1083, then verify the cumulative suite against every original acceptance criterion, including explicit unsupported semantics and truthful provenance/resource evidence. This note does not reduce workload coverage or turn a bounded live example into a full-suite claim. #952 remains the M11 completion gate.

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    testingTest coverage and testing infrastructure

    Type

    No type

    Projects

    No projects

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions