Instructions to use JunlongTong/StreamingLLM with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use JunlongTong/StreamingLLM with Transformers:
# pip install -U transformers accelerate # Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("JunlongTong/StreamingLLM", device_map="auto") - Notebooks
- Google Colab
- Kaggle
Commit History
-
Update README.md
Verified signature19de515 -
Upload 2 files
Verified signature56d73fa
-
Update README.md
Verified signature4f40398 -
Update README.md
Verified signatureb779915
-
initial commit
Verified signature7b06e12