Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
20 commits
Select commit Hold shift + click to select a range
e0b44ff
[None][feat] modeling_v2: build target C++/CUDA as per-family libraries
Wanli-Jiang Oct 23, 2026
80f93f8
[None][feat] modeling_v2: build, package and load family libraries li…
Wanli-Jiang Oct 26, 2026
4195583
[None][fix] modeling_v2: remove a family library an earlier build ins…
Wanli-Jiang Oct 26, 2026
9763613
[None][chore] modeling_v2: keep the native-code fixture as temporary …
Wanli-Jiang Oct 26, 2026
e33fc68
[None][chore] modeling_v2: check side effects of routes registered wi…
Wanli-Jiang Oct 26, 2026
9382cdc
[None][feat] modeling_v2: family-shared native ops and targets withou…
Wanli-Jiang Oct 26, 2026
65b5ec2
[None][feat] modeling_v2: keep a family's native code with its Python…
Wanli-Jiang Oct 26, 2026
f1a2874
[None][fix] modeling_v2: stop installing the library of a family that…
Wanli-Jiang Oct 26, 2026
eb47e3c
[None][fix] modeling_v2: link family libraries against Python, as th_…
Wanli-Jiang Oct 26, 2026
a78626a
[None][fix] modeling_v2: accept the license headers the C++ license c…
Wanli-Jiang Oct 26, 2026
1a914e8
[None][feat] modeling_v2: let native code include any stock header
Wanli-Jiang Oct 27, 2026
23d8066
[None][chore] modeling_v2: narrow the native loader's API to four names
Wanli-Jiang Oct 27, 2026
58c47ce
[None][chore] modeling_v2: leave modeling_v2_resolve as it was
Wanli-Jiang Oct 27, 2026
587ccd0
[None][chore] modeling_v2: fold the native-code guide into the README
Wanli-Jiang Oct 27, 2026
09193e4
[None][chore] modeling_v2: keep one B300 directory entry for the unit…
Wanli-Jiang Oct 27, 2026
c66125a
[None][test] modeling_v2: fold the native-code tests into fewer cases
Wanli-Jiang Oct 27, 2026
8e25d34
[None][fix] modeling_v2: keep gpt_oss's host scale swizzle
Wanli-Jiang Oct 27, 2026
29a8448
[None][chore] modeling_v2: always build the family libraries; name th…
Wanli-Jiang Oct 27, 2026
1412f28
[None][chore] modeling_v2: reuse NoTarget for missing native code
Wanli-Jiang Oct 27, 2026
5cf96b9
[None][fix] modeling_v2: retain upstream node-scoped CBTS after rebase
Wanli-Jiang Oct 28, 2026
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
21 changes: 21 additions & 0 deletions .cmake-format.json
Original file line number Diff line number Diff line change
Expand Up @@ -25,6 +25,27 @@
"NAMESPACE": "+",
"ARCHS": "+"
}
},
"add_modeling_v2_family": {
"pargs": 1
},
"add_modeling_v2_shared": {
"pargs": 1,
"kwargs": {
"ARCHS": "+",
"SOURCES": "+",
"DEPS": "+",
"REQUIRES": "+"
}
},
"add_modeling_v2_target": {
"pargs": 2,
"kwargs": {
"ARCHS": "+",
"SOURCES": "+",
"DEPS": "+",
"REQUIRES": "+"
}
}
},
"_help_vartags": [
Expand Down
9 changes: 9 additions & 0 deletions .github/CODEOWNERS
Original file line number Diff line number Diff line change
Expand Up @@ -387,6 +387,11 @@
# Individual handles rather than a team, like SCAFFOLDING: this is one bounded
# experiment with named owners, not a standing domain.
/tensorrt_llm/_torch/_experimental/modeling_v2 @tianyuxbear @Wanli-Jiang @WeiHaocheng @litaotju
# What every modeling_v2 family library shares (the discovery and the common/
# macros): the modeling_v2 owners, and the kernels owners because it is CUDA and
# links against the stock libraries.
/cpp/tensorrt_llm/modeling_v2 @tianyuxbear @Wanli-Jiang @WeiHaocheng @litaotju @NVIDIA/trt-llm-kernels-devs
/cpp/cmake/modules/modeling_v2.cmake @tianyuxbear @Wanli-Jiang @WeiHaocheng @litaotju @NVIDIA/trt-llm-kernels-devs
/tests/unittest/_torch/modeling_v2 @tianyuxbear @Wanli-Jiang @WeiHaocheng @litaotju
/tests/integration/defs/accuracy/modeling_v2 @tianyuxbear @Wanli-Jiang @WeiHaocheng @litaotju
# The two catalog categories whose contracts state kernel behaviour the
Expand All @@ -399,6 +404,10 @@
/tests/unittest/_torch/modeling_v2/models/glm_moe_dsa @tianyuxbear @Wanli-Jiang @WeiHaocheng @litaotju @dongfengy @Tabrizian @xwang233
/cpp/tensorrt_llm/kernels/glmMoeDsa @NVIDIA/trt-llm-kernels-devs @dongfengy @Tabrizian @xwang233
/cpp/tensorrt_llm/thop/glmMoeDsa/ @NVIDIA/trt-llm-kernels-devs @dongfengy @Tabrizian @xwang233
# A family's native code lives in its csrc/ directories: the kernels owners
# co-own it. Last, so it applies under the family rules above; a family with its
# own owners adds them here.
/tensorrt_llm/_torch/_experimental/modeling_v2/models/**/csrc/ @tianyuxbear @Wanli-Jiang @WeiHaocheng @litaotju @NVIDIA/trt-llm-kernels-devs

## TensorRT-LLM LLM Disaggregated
/examples/disaggregated @NVIDIA/trt-llm-disagg-devs @NVIDIA/trt-llm-doc-owners
Expand Down
6 changes: 6 additions & 0 deletions cpp/CMakeLists.txt
Original file line number Diff line number Diff line change
Expand Up @@ -49,6 +49,12 @@ option(BUILD_DEEP_EP "Build the Deep EP module" ON)
option(BUILD_NCCL_EXTENSIONS "Build the nccl-extensions Python wheel" ON)
option(BUILD_DEEP_GEMM "Build the DeepGEMM module" ON)
option(BUILD_FLASH_MLA "Build the FlashMLA module" ON)
set(TRTLLM_MODELING_V2_TARGETS
"all"
CACHE
STRING
"modeling_v2 native targets to build: all, none, or a list of <family>/<target> globs"
)
option(BUILD_MICRO_BENCHMARKS "Build C++ micro benchmarks" OFF)
option(NVTX_DISABLE "Disable all NVTX features" ON)
option(WARNING_IS_ERROR "Treat all warnings as errors" OFF)
Expand Down
Loading
Loading