rssto/crates/llm/README.md

rssto-llm

LLM daemon for the rssto DB translations

Note

In development!

1. Setup rssto-crawler first and collect initial data

2. Run LLM server:

llama-server -hf ggml-org/gemma-3-1b-it-GGUF

3. Launch rssto-llm to handle content DB:

cd rssto/crates/rssto-llm
cargo run -- --mysql-username {USER} \
             --mysql-password {PASS} \
             --mysql-database {NAME} \
             --llm-host {HOST}       \
             --llm-port {PORT}       \
             --llm-model {MODEL}     \
             --llm-message {MESSAGE}

• see --help to display all supported options