YGGverse/rssto
1
0
Fork 0
mirror of https://github.com/YGGverse/rssto.git synced 2026-03-31 17:15:29 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions
rssto/crates/crawler
History
yggverse e26236a591 rename table
2026-01-08 00:42:26 +02:00
..
config handle some 3'th party errors, init scraper features 2026-01-07 18:25:21 +02:00
src rename table 2026-01-08 00:42:26 +02:00
Cargo.toml handle some 3'th party errors, init scraper features 2026-01-07 18:25:21 +02:00
LICENSE initial commit 2026-01-07 15:00:55 +02:00
README.md add readme 2026-01-07 20:53:37 +02:00

README.md

rssto-crawler

Install

git clone https://github.com/YGGverse/rssto.git
cd rssto
cargo build --release

Launch

rssto-crawler -c config/example.toml

Tip

  • prepend RUST_LOG=rssto_crawler=trace to print worker details (supported levels)
    • or just RUST_LOG=trace to debug all components in use
  • append -u TIME to run as the daemon with TIME interval update
  • see rssto-crawler --help to print all available options

Systemd

  1. Install rssto-crawler by copy the binary compiled into the native system apps destination:
    • Linux: sudo install target/release/rssto-crawler /usr/local/bin/rssto-crawler
  2. Create systemd configuration file at /etc/systemd/system/rssto-crawler.service:
[Unit]
After=network-online.target
Wants=network-online.target

[Service]
Type=simple

User=rssto
Group=rssto

# Uncomment for debug
# Environment="RUST_LOG=DEBUG"
# Environment="NO_COLOR=1"

ExecStart=/usr/local/bin/rssto-crawler -c /path/to/config.toml

StandardOutput=file:///home/rssto/crawler-debug.log
StandardError=file:///home/rssto/crawler-error.log

[Install]
WantedBy=multi-user.target
  • example above requires new system user (useradd -m rssto)
  1. Run in priority:
  • systemctl daemon-reload - reload systemd configuration
  • systemctl enable rssto-crawler - enable new service
  • systemctl start rssto-crawler - start the process
  • systemctl status rssto-crawler - check process launched