#

merge-llm

Here is 1 public repository matching this topic...

louisbrulenaudet / mergeKit

Tools for merging pretrained Large Language Models and create Mixture of Experts (MoE) from open-source models.

leaderboard transformer moe mixture-of-experts huggingface slerp large-language-models llm ties mergekit merge-llm dare-ties

Updated Feb 11, 2024
Jupyter Notebook

Improve this page

Add a description, image, and links to the merge-llm topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the merge-llm topic, visit your repo's landing page and select "manage topics."