Join GitHub today
GitHub is home to over 50 million developers working together to host and review code, manage projects, and build software together.
Sign up--crawler and --multi #2765
Open
--crawler and --multi #2765
Labels
Comments
|
Yeah I think that's something I've missed, let me check how much work that is to fix it. |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment


when both
--crawlerand--multiare set, the crawling is silently ignored.--crawleris useful for giving just one page, like http://www.example.com and then discovering automatically some urls.--multiis useful for make those subsequent urls to use caches.Currently these switches can not be combined, how to enable crawling with caches?