toksuite/microsoft-Phi-3-mini-4k-instruct
Text Generation • 1B • Updated • 254 • 1
Edit Models filters
Model Tree
Apps
Inference Providers
One-click Deployment
Models
544
Active filters: tokenization
ftrproger/KazTok-BPE-100k-v5
Updated • 1
aymaralima/deeplima
Updated • 3
gsar78/Greek_Tokenizer
Updated • 1
microsoft/VidTok
Updated • 43
Emova-ollm/emova_speech_tokenizer_hf
Feature Extraction • 0.1B • Updated • 229 • 2
metinovadilet/kyrgyz_t5_tokenizer
Updated
microsoft/vidtwin
Updated • 2
JephteyAdolphe/ht_core_news_sm
Updated
Hanbaike/kyrgyz_bpe_16000
Updated
Hanbaike/kyrgyz_bpe_24000
Updated
Hanbaike/kyrgyz_bpe_32000
Updated
Hanbaike/kyrgyz_bpe_4000
Updated
Hanbaike/kyrgyz_bpe_51200
Updated
Hanbaike/kyrgyz_bpe_8000
Updated
Hanbaike/kyrgyz_unigram_16000
Updated
Hanbaike/kyrgyz_unigram_24000
Updated
Hanbaike/kyrgyz_unigram_32000
Updated
Hanbaike/kyrgyz_unigram_4000
Updated
Hanbaike/kyrgyz_unigram_51200
Updated
Hanbaike/kyrgyz_unigram_8000
Updated
Hanbaike/kyrgyz_spm_tokenizer
Updated
Hengzongshu/Chinse_BBPE_Vocab
Text Classification • Updated
khopilot/khmer-tokenizer-v7
Feature Extraction • Updated • 3 • 2
toksuite/google-gemma-2-2b
Text Generation • 2B • Updated • 82
toksuite/common-pile-comma-v0.1
Text Generation • 2B • Updated • 167
toksuite/meta-llama-Llama-3.2-1B
Text Generation • 2B • Updated • 48
toksuite/gpt2
Text Generation • 1B • Updated • 628
toksuite/bigscience-bloom
Text Generation • 2B • Updated • 41
toksuite/facebook-xglm-564M
Text Generation • 2B • Updated • 38