Infini-AI-Lab / MagicDec-part2 Public

Notifications You must be signed in to change notification settings
Fork 0
Star 0

MagicDec: Breaking the Latency-Throughput Tradeoff for Long Contexts with Speculative Decoding

Apache-2.0 license

0 stars 0 forks Branches Tags Activity

Notifications

Name		Name	Last commit message	Last commit date
Latest commit History 5 Commits
static		static
LICENSE		LICENSE
README.md		README.md
index.html		index.html

Repository files navigation

MagicDec-part2

MagicDec: Breaking the Latency-Throughput Tradeoff for Long Contexts with Speculative Decoding

About

MagicDec: Breaking the Latency-Throughput Tradeoff for Long Contexts with Speculative Decoding

Apache-2.0 license

Custom properties

Report repository

Releases

No releases published

Packages

No packages published

Languages