mirror of
https://github.com/YGGverse/aquatic-crawler.git
synced 2026-03-31 17:15:35 +00:00
SSD-friendly FS crawler for the Aquatic BitTorrent tracker, based on librqbit API
https://crates.io/crates/aquatic-crawler
apiaquaticbencodebittorrentbtrackercrawlerdaemoninfo-hashipv6librqbitmagnetparserresolverrqbittorrenttracker
| .github | ||
| src | ||
| .gitignore | ||
| Cargo.toml | ||
| LICENSE | ||
| README.md | ||
aquatic-crawler
Crawler/aggregation tool for the Aquatic BitTorrent tracker.
Note
Project in development!
Roadmap
- Targets supported
- IPv4/IPv6 info-hash JSON/API (see PR#233)
- local file path
- remote URL
- IPv4/IPv6 info-hash JSON/API (see PR#233)
- Storage
- File system (dump as
.torrent) [x] V1 [ ] V2 - Manticore full text search
- SQLite
- File system (dump as
- Tools
- Storage cleaner
- Implement tests
Install
git clone https://github.com/YGGverse/aquatic-crawler.git && cd aquatic-crawlercargo build --releasesudo install target/release/aquatic-crawler /usr/local/bin/aquatic-crawler
Usage
aquatic-crawler --infohash-source /path/to/info-hash-ipv4.json\
--infohash-source /path/to/info-hash-ipv6.json\
--infohash-source /path/to/another-source.json\
--torrents-path /path/to/storage
- all arguments are optional, to support multiple source and target drivers running without arguments does nothing!
Options
Options:
-d, --debug <DEBUG>
Debug level
* `e` - error * `i` - info
[default: ei]
-i, --infohash-source <INFOHASH_SOURCE>
Filepath(s) to the Aquatic tracker info-hash JSON/API (PR#233)
-t, --torrents-path <TORRENTS_PATH>
Directory path to store the `.torrent` files
-s, --sleep <SLEEP>
Crawl loop delay in seconds
[default: 300]
-h, --help
Print help (see a summary with '-h')
-V, --version
Print version