Main Menu

Recent posts

#1
WebCopy / The rules do not seem to be wo...
Last post by Esche - Yesterday at 10:43:46 AM
Hi all, Im new to WebCopy.
Now I need to copy a website whose critical css and js stripts are storaged in another domain, so I tried to set some rules to include those files for downloading.
However, after the rules I set have passed the rule checker, such files still be skipped to download.
I have no idea how to solve this problem now, could anyone tell me what could I do now? Many thanks!

I have attached the copy result and how the stripts are cited in the webpages below.

#2
WebCopy / Creating a Kiosk from NASA dat...
Last post by evolgomi - December 24, 2024, 06:23:21 PM
I'm attempting to create an offline website for a kiosk in a museum.  We have a lot of these actual patches on display, and would love to have a little iPad or something to give more information.

Nasa has the gallery here:

https://www.nasa.gov/gallery/human-spaceflight-mission-patches/

I need to limit what links can be gone to, and was hoping to be able to just download the 7 gallery pages and the corresponding detail pages.

When I attempt to copy just that link, the scan pulls EVERYTHING.  So insane amount of data.

I've tried doing a does not match string on the above link, and get nothing.

Any help is appreciated.
#3
WebCopy / Please include an option to co...
Last post by whiggs - December 22, 2024, 04:19:38 PM
Hello,
I am trying to scan a website using the "scan" button right next to the input box where you type the URL:

You can see the URL for the site that I want to scan in the image, but I will include it at the bottom of the post so that you can just copy/paste it.  In any event, when I attempt to scan the site indicated in the picture, part way through the process, this appears on my screen:

You can see the url that the application ran into which generated the error in the message box, but the error also immediately terminates the scan and prevents it from scanning the remainder of the site, which is NOT what I want the program to do, so including an option to ignore errors like this would be awesome.
#4
WebCopy / Difficult site to map, on mult...
Last post by micnolmad - December 22, 2024, 11:08:59 AM
Hello guys

I want to save the cartoons from supercartoons so my children can get a sunday playlist each week, kind of when I was a child when binge watching didn't exist.

The main site is https://www.supercartoons.net

The shows are located as /serie/tom-and-jerry/ or /serie/looney-tunes/ but when you click an episode it is now /cartoon/EPISODE.

/cartoon/ is not searchable, 404. You would need all episode filenames to directly search each of those urls.

The actual mp4 files are located on https://ww.supercartoons.net/SERIE/EPISODE.mp4
Notice the missing w.

Here SERIE can be /tom-and-jerry/ or /looney-tunes/ and EPISODE is the filename.

Example:
https://ww.supercartoons.net/tom-and-jerry/the-million-dollar-cat.mp4

The link to the mp4 file is given only when entering the episode url aka
https://www.supercartoons.net/cartoon/the-million-dollar-cat/

BUT when I start the search on the either the root or serie, i.e. tom and jerry, no matter what depth I set or non at all, I never get the mp4 links and it never follows the next pages or goes into the episode page.

I know I am only using this cyotek program for a few hours.. please can anyone help?
I would love to share my settings cwb but how?
#5
WebCopy / Re: Rules Exclusion Happens Af...
Last post by zebigbos - December 11, 2024, 07:55:50 PM
Currently I am trying again WITHOUT 'Download all resources'.
But this same issue is troubling me a long time already.
Was there any progress in solving it?
Greetings,
Job
#6
WebCopy / Unable to access posts of down...
Last post by fiverr - December 09, 2024, 01:21:39 PM
Hi,
From the downloaded website, i can access pages as each page has it's own folder.
But there is no way to reach the posts.

plse advise how to access the posts from the downloaded website. thanks
#7
WebCopy / Images unfortunately get a Fai...
Last post by asterix_bay - November 29, 2024, 08:30:29 PM
Hi,
First of all, many thanks for the great software. Unfortunately I am too stupid to fix these errors.


The HTML code is:
<img src="/component/ajax/?p=image&amp;src=%7B%22file%22%3A%22images%2Fhome%2F1. jpg%22%2C%22thumbnail%22%3A%22%2C%2C%22%7D&amp;hash=94e86104" srcset="/component/ajax/?p=image&amp;src=%7B%22file%22%3A%22images%2Fhome%2F1. jpg%22%2C%22thumbnail%22%3A%22%2C%2C%22%7D&amp;hash=94e86104 750w" sizes="(min-width: 750px) 750px" width="750" height="1000" alt="" loading="eager" class="el-image uk-transition-opaque">
or

<img src="/component/ajax/?p=image&amp;src=%7B%22file%22%3A%22images%2Fhome%2F7.jpg%22%2C%22thumbnail%22%3A%22%2C%2C%22%7D&amp;hash=4f801134" srcset="/component/ajax/?p=image&amp;src=%7B%22file%22%3A%22images%2Fhome%2F7.jpg%22%2C%22thumbnail%22%3A%22%2C%2C%22%7D&amp;hash=4f801134 750w" sizes="(min-width: 750px) 750px" width="750" height="1000" alt="" loading="eager" class="el-image uk-transition-opaque">
Unfortunately the download always fails. I have already tried attributes and that it should be done via the browser, all without effect.

I think you have to try it with rules right? If so, what should they be? Unfortunately I don't have the knowledge.
#8
WebCopy / Remapping
Last post by mr.scraper - November 19, 2024, 02:25:16 PM
Hello Guys,

I have downloaded a large project and have forgotten to activate "Use query string in local file names". Is there a way to carry out a remapping afterwards? Without having to download it again. Or how should I proceed?
#9
WebCopy / Re: SSL/TLS error: Could not e...
Last post by scylla - November 07, 2024, 04:42:54 PM
Does the issue persist in the Nightly builds also?

Do note that the nightly builds are using 1.10 vs 1.9 also.

#10
WebCopy / Re: Download entire website - ...
Last post by scylla - November 02, 2024, 12:55:33 AM
Not sure about faster but you can try blackwidow from softbyte labs.
https://softbytelabs.com/wp/blackwidow/
You can also try
https://www.httrack.com/