CLI

apps/cli builds the sipp command-line application for local GGUF text generation. It is useful for runtime smoke testing, manual model checks, and quick local prompts.

Build

cargo xtask build cli --backend cpu
cargo xtask build cli --backend all

Run

cargo run -p sipp-cli -- <model.gguf> "Explain Sipp."

Useful flags include:

• --max-tokens
• --ctx-size
• --backend auto|cpu|cuda|metal|vulkan
• --temperature
• --stats off|basic|profile
• --chat

Use cargo run -p sipp-cli -- --help for the full generated help.