Post
Anchor Large Language Models: Up to 99% KV cache reduction!
paper: https://arxiv.org/pdf/2402.07616.pdf
paper: https://arxiv.org/pdf/2402.07616.pdf
Jianhuipang
pangjh3
AI & ML interests
None yet
Organizations
None yet
Posts 1
models 11
pangjh3/AnLLM-EP-xllarge-wikiart
Text Generation • Updated • 16
pangjh3/allm-juhao-txllarge-fullatt-ctwithanchor-ct664
Updated
pangjh3/allm-juhao-txllarge-fullatt
Updated
pangjh3/AnLLM-EP-7B-translation
Text Generation • Updated • 9 • 1
pangjh3/AnLLM-AC-7B-translation
Text Generation • Updated • 11 • 1
pangjh3/LLM4MT-en2he-50k
Text Generation • Updated • 8
pangjh3/AnLLM-AC-13B-PT
Text Generation • Updated • 11
pangjh3/AnLLM-AC-7B-PT
Text Generation • Updated • 12 • 1
pangjh3/AnLLM-EP-7B-PT
Text Generation • Updated • 10
pangjh3/LLM4MT-zh2en-10k
Text Generation • Updated • 7
datasets 0
None public yet