airgpt-night

a 40M param model trained from scratch in eight hours on a macbook air (m5, 16gb, no fan) with airgpt. the air didn't throttle once the whole night.

it writes longer stories that mostly hold together. the chat is still pretty weak, it loops and makes things up.

  • pretrain val loss 2.11, chat val loss 1.62
  • 120M tokens of tinystories + cosmopedia (50/50), then short chats from everyday-conversations and smol-smoltalk
  • model.safetensors is the chat model, base.safetensors is the model before chat training

to talk to it:

git clone https://github.com/navthings/airgpt && cd airgpt
pip install -r requirements.txt
hf download navthings/airgpt-night --local-dir runs/night
python chat.py runs/night

python chat.py runs/night --base uses the base model, which just continues whatever you type.

Downloads last month
17
Safetensors
Model size
39.6M params
Tensor type
F32
ยท
MLX
Hardware compatibility
Log In to add your hardware

Quantized

Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support