mirror of
https://github.com/YGGverse/rssto.git
synced 2026-04-02 01:55:30 +00:00
implement initial llm features
This commit is contained in:
parent
5608e2e081
commit
de3fda435a
10 changed files with 269 additions and 14 deletions
28
crates/llm/README.md
Normal file
28
crates/llm/README.md
Normal file
|
|
@ -0,0 +1,28 @@
|
|||
# rssto-llm
|
||||
|
||||
LLM daemon for the rssto DB translations
|
||||
|
||||
> [!NOTE]
|
||||
> In development!
|
||||
|
||||
1. Setup `rssto-crawler` first and collect initial data
|
||||
|
||||
2. Run LLM server:
|
||||
|
||||
```
|
||||
llama-server -hf ggml-org/gemma-3-1b-it-GGUF`
|
||||
```
|
||||
|
||||
3. Launch `rssto-llm` to handle `content` DB:
|
||||
|
||||
```
|
||||
cd rssto/crates/rssto-llm
|
||||
cargo run -- --mysql-username {USER} \
|
||||
--mysql-password {PASS} \
|
||||
--mysql-database {NAME} \
|
||||
--llm-host {HOST} \
|
||||
--llm-port {PORT} \
|
||||
--llm-model {MODEL} \
|
||||
--llm-message {MESSAGE}
|
||||
```
|
||||
* see `--help` to display all supported options
|
||||
Loading…
Add table
Add a link
Reference in a new issue