mirror of
https://github.com/YGGverse/rssto.git
synced 2026-03-31 17:15:29 +00:00
28 lines
No EOL
615 B
Markdown
28 lines
No EOL
615 B
Markdown
# rssto-llm
|
|
|
|
LLM daemon for the rssto DB translations
|
|
|
|
> [!NOTE]
|
|
> In development!
|
|
|
|
1. Setup `rssto-crawler` first and collect initial data
|
|
|
|
2. Run LLM server:
|
|
|
|
```
|
|
llama-server -hf ggml-org/gemma-3-1b-it-GGUF`
|
|
```
|
|
|
|
3. Launch `rssto-llm` to handle `content` DB:
|
|
|
|
```
|
|
cd rssto/crates/rssto-llm
|
|
cargo run -- --mysql-username {USER} \
|
|
--mysql-password {PASS} \
|
|
--mysql-database {NAME} \
|
|
--llm-host {HOST} \
|
|
--llm-port {PORT} \
|
|
--llm-model {MODEL} \
|
|
--llm-message {MESSAGE}
|
|
```
|
|
* see `--help` to display all supported options |