Tools for merging pretrained large language models.
-
Updated
Oct 31, 2026 - Python
Tools for merging pretrained large language models.
Model Merging in LLMs, MLLMs, and Beyond: Methods, Theories, Applications and Opportunities. ACM Computing Surveys, 2026.
FusionBench: A Comprehensive Benchmark/Toolkit of Deep Model Fusion
[COLM 2025] LoRI: Reducing Cross-Task Interference in Multi-Task Low-Rank Adaptation
A collection of weight space learning including papers, codes, and datasets.
AdaMerging: Adaptive Model Merging for Multi-Task Learning. ICLR, 2024.
Flexible library for merging large language models (LLMs) via evolutionary optimization (ACL 2025 Demo).
Executable Stable Diffusion merge recipes in comfyui
Code release for Dataless Knowledge Fusion by Merging Weights of Language Models (https://openreview.net/forum?id=FCnohuR6AnM)
Preset and per-layer Base+SFT merge node for MOSS-Image in ComfyUI.
[NeurIPS'25 Spotlight🔥] Official Implementation of RobustMerge: Parameter-Efficient Model Merging for MLLMs with Direction Robustness
[ICLR 2026] OptMerge: data-free merging of multimodal LLM experts (VQA, Geometry, Chart, OCR, Grounding) and modalities, plus SWUDI / ASWUDI closed-form spectral merging for CLIP-ViT, Flan-T5, Llama-3.2 and MLLMs.
Official repository of "Localizing Task Information for Improved Model Merging and Compression" [ICML 2024]
Representation Surgery for Multi-Task Model Merging. ICML, 2024.
The source code of "Merging Experts into One: Improving Computational Efficiency of Mixture of Experts (EMNLP 2023)":
ZhiJian: A Unifying and Rapidly Deployable Toolbox for Pre-trained Model Reuse
[ICML 2025] No Task Left Behind: Isotropic Model Merging with Common and Task-Specific Subspaces (official repository)
Pytorch code for NeurIPS 2025 paper "Accurate and Efficient Low-Rank Model Merging in Core Space"
Model merging, task-vector rebasin, and fine-tuning for vision and LLM models.
To associate your repository with the model-merging topic, visit your repo's landing page and select "manage topics."