Edit an existing crawler job?


How can I edit an existing crawler job?

I want to add or remove urls if possible.

Regards Patrick


  • open “Crawler Monitor” → “Crawler Steering” → “Scheduler and Profile Editor”
    or http://localhost:8090/CrawlProfileEditor_p.html
  • then select the crawl you want to edit in “Select the profile to edit”.
  • click “edit profile”

However, the bad news is: you can edit everything but the urls that you want to remove.
This is because they form the root of the crawl and they are all loaded immediately as soon as you start the crawl.
You can still stop the crawl, remove urls manually in http://localhost:8090/IndexDeletion_p.html and start over.