Speedrun architecture: 8 pretraining seeds/size, anneal marks every 10 TPP as revisions. Plain ladder: “Scaling Ladder — 4 sizes, 135M–973M, 200 TPP”
Julian Minder
jkminder
AI & ML interests
None yet
Recent Activity
updated a model 7 days ago
jkminder/pretraining-priors-doormail4k-d32-treated-base published a model 7 days ago
jkminder/pretraining-priors-doormail4k-d32-treated-base updated a model 14 days ago
jkminder/d20_477m_seed4_sftOrganizations
Scaling Ladder (optimized) — 3 sizes, 286M–897M, 200 TPP
Speedrun architecture: 8 pretraining seeds/size, anneal marks every 10 TPP as revisions. Plain ladder: “Scaling Ladder — 4 sizes, 135M–973M, 200 TPP”
Scaling Ladder — 4 sizes, 135M–973M, 200 TPP
The whole ladder, 200 TPP on ClimbMix; plain GPT (nanochat mechanisms disabled). Bases, then chat-SFTs (_sft).
models 177
jkminder/pretraining-priors-doormail4k-d32-treated-base
Text Generation • 2B • Updated • 156
jkminder/d20_477m_seed4_sft
Text Generation • 0.5B • Updated • 422
jkminder/d20_477m_seed3_sft
Text Generation • 0.5B • Updated • 435
jkminder/d20_477m_seed1_sft
Text Generation • 0.5B • Updated • 485
jkminder/d20_477m_seed2_sft
Text Generation • 0.5B • Updated • 492
jkminder/d26_973m_seed4_sft
Text Generation • 1.0B • Updated • 516
jkminder/d26_973m_seed3_sft
Text Generation • 1.0B • Updated • 474
jkminder/d26_973m_seed1_sft
Text Generation • 1.0B • Updated • 458
jkminder/d26_973m_seed2_sft
Text Generation • 1.0B • Updated • 447
jkminder/d12_135m_seed4_sft
Text Generation • 0.1B • Updated • 519
datasets 15
jkminder/pretraining-priors-pirate-register
Viewer • Updated • 999k • 142
jkminder/normative-reflections-feedback
Viewer • Updated • 5 • 8
jkminder/apertus-annotation-feedback
Viewer • Updated • 52 • 7
jkminder/model-raising-interp-prepared
Viewer • Updated • 100k • 22
jkminder/model-raising-pbsft-eval
Viewer • Updated • 9.99k • 13
jkminder/model-raising-reflection-end-eval
Viewer • Updated • 28.7k • 25
jkminder/model-raising-pb-300k-3c-sft
Viewer • Updated • 302k • 11
jkminder/or-bench-1k-overrefusal
Viewer • Updated • 962 • 47
jkminder/xstest-overrefusal
Viewer • Updated • 214 • 40
jkminder/orfuzz
Viewer • Updated • 1.79k • 7