Quickstart - Luminal

Clone the repo

Clone the codebase locally by running the following:

git clone https://github.com/luminal-ai/luminal
cd luminal

Simple examples demonstrate how a library works without diving in too deep. Run your first Luminal code like so:

cd ./examples/simple
cargo run --release

Great! You’ve ran your first Luminal model!

Run the following to start generating text with Llama 3 8B on a CUDA device:

cd ./examples/llama
# Download the model
uv run --script ./setup/setup.py
# Run the model
cargo run --release