UltraBERT
Collection
UltraBERT: Beyond the Limit of BERT Pre-Training. Pre-trained 150M/380M encoders and a text embedding model, English, 32K context. • 4 items • Updated • 30
Jelena Mitrović
Jecovit
AI & ML interests
NLP, LLMs
Recent Activity
upvoted a collection 19 days ago
UltraBERT upvoted an article 7 months ago
KV Caching Explained: Optimizing Transformer Inference Efficiency liked a dataset 7 months ago
mteb/WebFAQRetrievalOrganizations
upvoted a collection 19 days ago
upvoted an article 7 months ago
Article
KV Caching Explained: Optimizing Transformer Inference Efficiency
not-lain
• • 434 upvoted an article over 1 year ago
Article
Binary and Scalar Embedding Quantization for Significantly Faster & Cheaper Retrieval
- +1
aamirshakir, tomaarsen, SeanLee97
• • 136