Crawl-on-demand
You can use this feature to refresh your data in Sitexploration. Though,
Siexploration also crawls by itself. By using the crawl-on-demand feature,
you control a given crawler’s work pattern. You order the ZookaBot to crawl the
url to revisit or discover the chosen domains link graph.
The crawl-on-demand 'behind the scenes' works by having three vic crawl containers
that are running concurrently. You, the user, have your own dedicated container
for the crawl-on-demands. The other two are dedicated to the system, where it periodically
searches the internet for new links. Searches not finished on vic 2 after being
there for 24 hours will be moved to vic 1. And if the page is not indexed by Google,
then you should not expect links like these to send any linkjuice, and will therefore not be shown. Sitexploration
removes them from our index and move them to an index cesspool.