Instructions to use Enferlain/ellmo with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- llama.cpp
How to use Enferlain/ellmo with llama.cpp:
Install (macOS, Linux)
curl -LsSf https://llama.app/install.sh | sh # Start a local OpenAI-compatible server with a web UI: llama serve -hf Enferlain/ellmo:Q4_K_M # Run inference directly in the terminal: llama cli -hf Enferlain/ellmo:Q4_K_M
Install from WinGet (Windows)
winget install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama serve -hf Enferlain/ellmo:Q4_K_M # Run inference directly in the terminal: llama cli -hf Enferlain/ellmo:Q4_K_M
Build from source code
git clone https://github.com/ggml-org/llama.cpp.git cd llama.cpp cmake -B build cmake --build build -j --target llama-app # Start a local OpenAI-compatible server with a web UI: ./build/bin/llama serve -hf Enferlain/ellmo:Q4_K_M # Run inference directly in the terminal: ./build/bin/llama cli -hf Enferlain/ellmo:Q4_K_M
Use Docker
docker model run hf.co/Enferlain/ellmo:Q4_K_M
- Llama new
- LM Studio
- Jan
- Ollama
How to use Enferlain/ellmo with Ollama:
ollama run hf.co/Enferlain/ellmo:Q4_K_M
- Unsloth Desktop
- Docker Model Runner
How to use Enferlain/ellmo with Docker Model Runner:
docker model run hf.co/Enferlain/ellmo:Q4_K_M
- Lemonade
How to use Enferlain/ellmo with Lemonade:
Pull the model
# Download Lemonade from https://lemonade-server.ai/ lemonade pull Enferlain/ellmo:Q4_K_M
Run and chat with the model
lemonade run user.ellmo-Q4_K_M
List all available models
lemonade list
- Atomic Chat
Commit History
24 days ago
-
Archive Command-R v0.1 EXL2 3.5bpw
Verified signature29d6959
-
Upload TheDrummer_Cydonia-R1-24B-v4.1-Q5_K_L.gguf
Verified signature17fd4db -
Upload TheDrummer_Skyfall-36B-v2-IQ4_XS.gguf
Verified signaturea84e974 -
Upload magnum-v4-27b-Q4_K_M.gguf
Verified signature06ef9ee -
Upload magnum-v4-22b-Q5_K_M.gguf
Verified signature4ab4e03 -
Upload Star-Command-R-32B-v1-Q4_K_M.gguf
Verified signatureeb8ddd8 -
Upload c4ai-command-r-08-2024-IQ4_XS.gguf
Verified signature46d3249
-
Upload 3 files
Verified signature1fef54c -
Upload 3 files
Verified signature481210e -
Create juice/ass.txt
Verified signaturec572a29
-
Upload 4 files
Verified signature493851a -
Upload 8 files
Verified signature950b556 -
Upload eileithyia-20b.gguf.q5_k_m.bin
Verified signatureee31192
-
Upload 12 files
Verified signature546e11e -
Upload 11 files
Verified signaturef3cb380 -
Upload 13 files
Verified signature0623a26 -
Create exl2/asd.csv
Verified signaturec0d7c1e -
Upload Undi95_Miqu-70B-Alpaca-DPO-b2131-iMat-c32_ch1000-IQ1_S_v3.gguf
Verified signature867da74
-
Upload miqu-1-70b-Requant-b2131-iMat-c32_ch400-IQ1_S_v3.gguf
Verified signatureb2afba0 -
Upload ggml-qwen1.5-72b-chat-iq2_xxs.gguf
Verified signaturebdd0b13 -
Create 70b/asd.csv
Verified signaturedf4ae75 -
Upload 5 files
Verified signatureb72ee25
-
Upload blurred-beagle-7b-slerp.Q8_0.gguf
Verified signature066c97e -
Upload 4 files
Verified signatureb11c570 -
Upload mixtral-8x7b-instruct-v0.1.Q4_0.gguf
Verified signature0400a85 -
Upload 2 files
Verified signature3f18e38
-
Upload dolphin-2.7-mixtral-8x7b.Q4_0.gguf
Verified signaturea0ea91e -
Upload Buttercup-4x7B-GGUF-q5_k_m.gguf
Verified signaturecac4cf5 -
Upload Blue-Orchid-2x7b-Q4_K_M.gguf
Verified signature8bbc49a -
Upload beyonder-4x7b-v2.Q5_K_M.gguf
Verified signature4c58255 -
Create moe/asd.csv
Verified signaturee4034cd -
Upload 2 files
Verified signature41d878c
-
Upload folder using huggingface_hub
Verified signature12b262f
-
Upload folder using huggingface_hub
Verified signature3202dee -
Upload folder using huggingface_hub
Verified signaturec5d32a9 -
Upload folder using huggingface_hub
Verified signature1c3aa55 -
Delete 13b
Verified signature0eb4b99 -
Delete 33b
Verified signatured6540bc -
Delete 7b
Verified signatured7d1f1b -
Delete ellmo
Verified signature9da396c -
Upload folder using huggingface_hub
Verified signature6590d9b -
Delete Hestia-20b.q5_k_m.gguf
Verified signature3509fc3 -
Delete capybara-tess-yi-34b-200k-dare-ties.Q4_K_M.gguf
Verified signatured9f54fc -
Delete psymedrp-v1-20b.Q5_K_M.gguf
Verified signature8825063 -
Create 7b/asd.csv
Verified signature46f5982 -
Create 13b/asd.csv
Verified signaturef8d25d2 -
Create 33b/asd.csv
Verified signature99f98c4 -
Upload folder using huggingface_hub
Verified signaturea7beaf8 -
Upload .gitattributes
Verified signature757e2f1 -
Delete .gitattributes
Verified signaturea911a03