how to be sure that a page as been crawled

Started by folamour, June 27, 2016, 06:24:29 AM

Previous topic - Next topic

folamour

hi i have make a donation because this program is awesome, i use it to populate the cache of my cdn

but yesterday when i was opening a downloaded page in browser she was displayed immediately

but its no more the case,

how to be sure that page has been crawled,

my site have 11.000 page so it's a real problem when copy stop i've to restart from the begining

hope you can help

Richard Moss

Hello,

By default, WebCopy will try to copy only new or changed files. If you want to force WebCopy to download everything, then either hold down Shift when clicking the Copy Website button, or trying setting the Always download latest version from the Advanced category in your project properties. This knowledgebase article describes the different options you can use so that WebCopy only downloads new or changed files, you can use this for more information.

While scanning your website, if the main log shows entries with a yellow icon and a Status of Skipped, that probably indicates that WebCopy doesn't think the file has changed.

It's not really clear from your message precisely what issue you're having with WebCopy, so any further information you can provide would be helpful.

Regards;
Richard Moss
Read "Before You Post" before posting (https://forums.cyotek.com/cyotek-webcopy/before-you-post/). Do not send me private messages. Do not expect instant replies.

All responses are hand crafted. No AI involved. Possibly no I either.