YGGverse/aquatic-crawler
1
0
Fork 0
mirror of https://github.com/YGGverse/aquatic-crawler.git synced 2026-03-31 17:15:35 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

implement preload_total_size argument

Browse source
This commit is contained in:
yggverse 2025-06-16 19:15:20 +03:00
parent cb377425a7
commit c206a06c25
3 changed files with 22 additions and 10 deletions
Download patch file Download diff file Expand all files Collapse all files

8
README.md
View file

@ -94,6 +94,9 @@ aquatic-crawler --infohash-file /path/to/info-hash-ipv4.json\
* requires `storage` argument defined
--preload-total-size <PRELOAD_TOTAL_SIZE>
Stop crawler on total preload files size reached
--preload-max-filesize <PRELOAD_MAX_FILESIZE>
Max size sum of preloaded files per torrent (match `preload_regex`)
@ -125,11 +128,6 @@ aquatic-crawler --infohash-file /path/to/info-hash-ipv4.json\
[default: 10]
--download-torrent-timeout <DOWNLOAD_TORRENT_TIMEOUT>
Max time to download each torrent
[default: 10]
--sleep <SLEEP>
Crawl loop delay in seconds