YAML Metadata Warning:empty or missing yaml metadata in repo card
Check out the documentation for more information.
0.3b
LuauCoder: Differential Attention V2 + Exclusive Self-Attention dense decoder, pretraining in progress.
- step: 126,200
- tokens: 64,728,118,216
- parameters: 337,684,272
from transformers import AutoModelForCausalLM, AutoTokenizer
tok = AutoTokenizer.from_pretrained(repo, trust_remote_code=True)
model = AutoModelForCausalLM.from_pretrained(repo, trust_remote_code=True, dtype="bfloat16",
attn_implementation="sdpa") # or flash_attention_2
- Downloads last month
- -
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support