Setting offline URL's during crawl

[iansemper]

While copping I stop the process  and was not able to browse offline  is this a normal thing with Cyotek? What I mean is the url were not fixed for offline browsing, I have notice that if the process get's complected all links work fine but if not completed the links do not work offline, Am I doing something wrong or is this normal.

[Richard Moss]

Hello and welcome to the forums. I split your reply into a new post as it had nothing at all to do with the topic you replied to.

Currently as you have noted WebCopy only remaps the downloaded files when copying has completed, and is skipped if you cancel the crawl. This was the original design of the of the program, although you aren't the first person to query the behaviour.

Short term, the WebCopy GUI will be updated so that if you cancel the crawl, it will then prompt to remap what it has downloaded so far.

Long term, I'll rework the functionality so that while it's downloading files, a background process will also remap files deemed complete. However, this depends on if I can make the functionality efficient enough, so that it doesn't slow down the process, and also so that it is memory efficient, something WebCopy needs more work on.

At the moment I don't have any suggestions as to when this work will be carried out; I'm busy with other work at the moment.

Regards;
Richard Moss