update readme

This commit is contained in:
yggverse 2024-06-26 00:02:37 +03:00
parent bde3b4f138
commit 7c36d7fdfa

View file

@ -17,23 +17,25 @@ At this moment, project under development, some [features](#features) already im
## Features ## Features
* [x] Grab single location or entire capsule for mirroring or offline reading * [x] Grab single URL or `--crawl` entire capsule
* [x] Multiple MIME types download support (e.g. inline images and other media) * [x] Multiple MIME types download support (e.g. inline images and other media)
* [x] Detailed crawler log for every request * [x] Detailed crawler logs for every request
* [ ] Flexible options * [ ] Flexible options
* [x] Custom delay between requests * [x] Custom `--delay` between requests
* [x] Custom index filename for directories * [x] Custom `--index` filename for directories
* [x] Custom storage location * [x] Custom storage location
* [x] Filesystem * [x] Filesystem
* [ ] FTP * [ ] FTP
* [x] Optional URL replacement to relative URI * [x] Optional link replacement for local navigation
* [x] Recursive crawler * [x] Relative (default)
* [x] Regex URL rules * [x] Absolute (`--absolute`)
* [x] Unique snap version or sync local copy (by default) * [x] Original (`--keep`)
* [ ] Configurable redirect levels to follow * [x] `--match` regex URL rules
* [ ] Crawl depth levels limit * [x] `--unique` snap version or sync local copy
* [ ] Configurable redirect levels to `--follow`
* [ ] Crawl depth `--level` limit
* [ ] Document size limit to download * [ ] Document size limit to download
* [ ] Follow external links on crawl * [ ] Follow `--external` links on crawl
## Environment ## Environment