Commit History

17 days ago

  1. Fix over-stated quality claims: model is first-sentence-coherent then loops, not "fluent/on-topic" (#9)⁠

    9323e39
  2. Add version note: v2 replaces earlier 6.16M word-salad build

    Verified signature
    5dbd13e
  3. Add model weights (27 MB F32 safetensors)

    Verified signature
    ca0370c
  4. Add BPE tokenizer (8192 vocab)

    Verified signature
    a50c5c3
  5. Add architecture config (4,912,992 params)

    Verified signature
    e834811
  6. Add model card: CompactLM-5M from-scratch 4.9M-param GQA LLaMA

    Verified signature
    a6ec395

18 days ago

  1. Fix Results section to report the measured val loss/ppl from the shipped checkpoint's own eval (eval_fresh.json: 3.8719 / 48.03). The previous card cited 3.8775 / 48.30 / "step 20000", but the training run diverged to NaN at step 14300 and the log died at step 16000 — step 20000 was never reached. Also correct the eval filename reference (eval_shipped.json -> eval_fresh.json, the file actually in the repo). (#8)⁠

    23f2b03
  2. Remove stray compactlm-5m.pt (dead step-3800 re-run checkpoint, not the shipped model). The shipped weights are model.safetensors (step 20000), which is what the README documents. Avoids two undocumented weights files in the repo.

    Verified signature
    23ed361
  3. Fix: quote verbatim samples from the shipped eval, correct over-optimistic framing

    Verified signature
    186d75e
  4. Add model card (honest: real samples, final val 3.8775 / ppl 48.30).

    Verified signature
    c353fb6
  5. Fix card: replace hand-written sample sentences with real output from the shipped weights, and correct the capability claims to match what the model actually produces (#7)⁠

    ed33551
  6. Add model card (honest: arch, data, measured val PPL 48.03, 0/15 degenerate) (#6)⁠

    cafd02f
  7. Add config.json (architecture params, verified 6,162,688 params) (#5)⁠

    43373af
  8. Add exact eval script (val PPL + generation + degeneracy check) (#4)⁠

    8c65959
  9. Add exact training script (defines CompactLM class) (#3)⁠

    de1cc93
  10. Add gollem_eval byte-level BPE tokenizer (12,288 vocab) (#2)⁠

    e1fdac6
  11. Add CompactLM-5M weights (39 tensors, F32, 6,162,688 params, tied embeddings) (#1)⁠

    eb6d259
  12. Add fresh eval results (val ppl + 15 samples + degeneracy check)

    Verified signature
    ea6833a
  13. Add CompactLM-5M checkpoint (6,162,688 params, 39 tensors)

    Verified signature
    9e7c54e
  14. Add CompactLM-5M: from-scratch LLaMA-style 6.2M-param English LM on fineweb-edu

    Verified signature
    da4f145
  15. Add architecture config

    Verified signature
    a6ce552
  16. initial commit

    Verified signature
    607e91c