implement initial llm features

This commit is contained in:
yggverse 2026-01-08 14:05:16 +02:00
parent 5608e2e081
commit de3fda435a
10 changed files with 269 additions and 14 deletions

28
crates/llm/README.md Normal file
View file

@ -0,0 +1,28 @@
# rssto-llm
LLM daemon for the rssto DB translations
> [!NOTE]
> In development!
1. Setup `rssto-crawler` first and collect initial data
2. Run LLM server:
```
llama-server -hf ggml-org/gemma-3-1b-it-GGUF`
```
3. Launch `rssto-llm` to handle `content` DB:
```
cd rssto/crates/rssto-llm
cargo run -- --mysql-username {USER} \
--mysql-password {PASS} \
--mysql-database {NAME} \
--llm-host {HOST} \
--llm-port {PORT} \
--llm-model {MODEL} \
--llm-message {MESSAGE}
```
* see `--help` to display all supported options