Can my crawled pages be accessed while crawling?

YaCy
1

I am currently crawling Wikipedia (Stupid idea, I know) but I don’t know if other peers can get the links while i’m crawling for them.

2

I think so. You can see your own indexed pages through Stealth Mode. If you have caching enabled, you should be able to view documents through the Cache option in results.

3

Yes! Now people on YaCy can search Bob Marley (I think)

4

Neat. I think it is important that we focus on crawling the lesser known sites, since I assume the big name sites have already been indexed by others.

5

Actually, Wikipedia isnt really crawled. I didnt get any results for Wikipedia before I started the crawl.