mirror of
https://github.com/YGGverse/Yo.git
synced 2026-03-31 17:55:35 +00:00
Micro Web Crawler in PHP & Manticore
alfis-dnsaltwebcomposerfull-text-searchgeminigemini-protocolhttpinternetjs-lessmanticoremanticore-crawler-phpmanticoresearch-phpphp-crawlersearch-enginesmallwebspiderwebweb-crawleryggdrasil
| src | ||
| .gitignore | ||
| composer.json | ||
| LICENSE | ||
| README.md | ||
Yo!
Micro Web Crawler in PHP & Manticore
CLI
Index
Init
Create initial index
php src/cli/index/init.php [reset]
reset- optional, reset existing index
Document
Add
php src/cli/document/add.php URL
URL- add new URL to the crawl queue
Crawl
php src/cli/document/crawl.php
Search
php src/cli/document/search.php '@title "*"' [limit]
query- requiredlimit- optional search results limit