Inference

Prequisites

A model checkpoint is required. You can use your own or e.g. get the example file provided by karpathy:

wget https://huggingface.co/karpathy/tinyllamas/resolve/main/stories15M.bin

Inferencing

We need more working code for this.