Good evening. Love the software and it's been a lifesaver so far, but I've run into one issue I can't figure out.
Trying to pull down a site where there are links to external files such as:
http://storage.ning.com/topology/rest/1.0/file/get/2865592760?profile=original
These links are coming up as 302 redirects, but they're not. In this case, the above link is a JPG. I'm betting they were configured that way by Ning.com to make it just a little harder for people to scrape their files when trying to leave the service...
I've tried every setting in the software, but I can't get it down download the file and then remap the links for these. I have the domain added as an additional domain, have it set to follow redirects, have tried downloading "everything" (ended up with tons of stuff, just nothing from these particular 302s, which continue to show up as "skipped")
Any thoughts?
Thanks! Appreciate the help.
Andy
Hello,
Welcome to the forums and thanks for the question.
I think this is related to a bug I fixed in WebCopy recently where it wouldn't write remapped links for redirects. I suspect the source page is HTTP but the destination is redirecting to HTTPS, and while WebCopy is probably still following the HTTPS link it doesn't rewrite the original link.
If you're able to try the latest 1.8 nightly which includes this fix, it may help. Otherwise if you're still having problems if you're able to share the URL of one of the source pages that link to one of these files, I can test further.
Regards;
Richard Moss