- Welcome to Cyotek Forums.
Recent posts
#81
WebCopy / Skip reason is Failed although...
Last post by Manuela - June 22, 2023, 06:56:52 AMHi,
I am new to Webcopy. This is a great tool for me.
Finally I found a tool that is working for me. I have tried several tools (wget, httrack and dumpgenerator) and could not bring them to work (maybe I am too stupid). After I had invested hours of searching, trying and investigation I found Webcopy which is really working even when login to a website is required.
I want to make a copy of my wikis on Miraheze because Miraheze seems to cease service, at least there is a discussion. I want to have at least a working copy on my hard drive.
Many rules are necessary to prevend unwanted downloads in a MediaWiki website, so I created a bunch of rules for that.
The problem is a minor one, but it seems to waste time. I seems to me that Webcopy is trying to download the page although it is already excluded by rule and no need for further processing.
I have made a screenshot of an ongoing download that I did not want to stop because it is already runnung for hours.
Thank you for your support,
--Manuela
BTW, creating the account was a challenge. For visually impaired people it is almost impossible to solve the riddle, I had to zoom in and request a new one several times.
I am new to Webcopy. This is a great tool for me.
Finally I found a tool that is working for me. I have tried several tools (wget, httrack and dumpgenerator) and could not bring them to work (maybe I am too stupid). After I had invested hours of searching, trying and investigation I found Webcopy which is really working even when login to a website is required.
I want to make a copy of my wikis on Miraheze because Miraheze seems to cease service, at least there is a discussion. I want to have at least a working copy on my hard drive.
Many rules are necessary to prevend unwanted downloads in a MediaWiki website, so I created a bunch of rules for that.
The problem is a minor one, but it seems to waste time. I seems to me that Webcopy is trying to download the page although it is already excluded by rule and no need for further processing.
I have made a screenshot of an ongoing download that I did not want to stop because it is already runnung for hours.
Thank you for your support,
--Manuela
BTW, creating the account was a challenge. For visually impaired people it is almost impossible to solve the riddle, I had to zoom in and request a new one several times.
#82
WebCopy / Need help configure a project ...
Last post by ahammadah - June 17, 2023, 03:05:53 PMI tried to download material from my son's google class room, I stored his credentials in the project, however I always ended up in the case where software kept digging in the login domain (account.google.com - even when I tried excluding it explicitly) rather than reaching what matters to me which is the domain classroom.google.com.
can someone help me fine tune this project to work the way I want?
can someone help me fine tune this project to work the way I want?
#83
WebCopy / Poor image resolution for proj...
Last post by Pcastiglia - June 13, 2023, 01:38:05 PMGood Day
first of all, let me thank you for WebCopy - this is a very powerful tool, and I was looking for something similar for a long time since I prefer taking data from the internet and use them when offline.
Unfortunately I am not very skilled and I am not sure if what I am trying to do is possible.
I am lately trying to download an interactive map so I can use it when I am offline. This is correctly managed by WebCopy, but the resolution of the map is VERY poor, in fact it is impossible to read.
I attach all the files (sorry for large dimensions, I was not sure is reducing was a good idea):
a)First image is a screenshot of what I was able to download with WebCopy:
b)Second image is a screenshot of the online version of the map
Even stranger is that, when I zoom in using the downloaded version, some parts of the map (but only some parts) are seen in correct resolution, but it reverts back to the "blurry" version when zooming out.
c)Third image is a screenshot of what I randomly get when zooming in the downloaded version:
d)Last image is a screenshot of the zoomed online
Now, since I am a newbie on that, am I doing something wrong? Maybe this download is not possible with WebCopy? There is any option I need to activate?
For info, I tried opening the downloaded version with several browsers (Chrome, Firefox, Edge, even Internet Explorer), but the behavior is similar.
I just downloaded WebCopy, so it is the newest version.
Any help is highly appreciated, as I said I am new but willing to learn
Please let me know any missing information I need to provide for potential further analysis.
first of all, let me thank you for WebCopy - this is a very powerful tool, and I was looking for something similar for a long time since I prefer taking data from the internet and use them when offline.
Unfortunately I am not very skilled and I am not sure if what I am trying to do is possible.
I am lately trying to download an interactive map so I can use it when I am offline. This is correctly managed by WebCopy, but the resolution of the map is VERY poor, in fact it is impossible to read.
I attach all the files (sorry for large dimensions, I was not sure is reducing was a good idea):
a)First image is a screenshot of what I was able to download with WebCopy:
b)Second image is a screenshot of the online version of the map
Even stranger is that, when I zoom in using the downloaded version, some parts of the map (but only some parts) are seen in correct resolution, but it reverts back to the "blurry" version when zooming out.
c)Third image is a screenshot of what I randomly get when zooming in the downloaded version:
d)Last image is a screenshot of the zoomed online
Now, since I am a newbie on that, am I doing something wrong? Maybe this download is not possible with WebCopy? There is any option I need to activate?
For info, I tried opening the downloaded version with several browsers (Chrome, Firefox, Edge, even Internet Explorer), but the behavior is similar.
I just downloaded WebCopy, so it is the newest version.
Any help is highly appreciated, as I said I am new but willing to learn
Please let me know any missing information I need to provide for potential further analysis.
#84
WebCopy / Re: Blank error message when a...
Last post by Richard Moss - May 24, 2023, 07:22:19 AMHello,
Version 1.9.1 is currently listed in the "Nightly Builds" section of the Downloads page.
Regards;
Richard Moss
Version 1.9.1 is currently listed in the "Nightly Builds" section of the Downloads page.
Regards;
Richard Moss
#85
WebCopy / Re: Blank error message when a...
Last post by scottywatty - May 23, 2023, 09:33:35 PMi am getting this same issue on Windows but do not see a version available past 1.9.0.822. It was working perfectly this morning and not stopped.
#86
WebCopy / Re: Unable to copy website, co...
Last post by Richard Moss - May 22, 2023, 06:50:19 PMHello,
This sounds like a manifestation of issue #471. Basically, the web server is misbehaving a little and returning a non-standard encoding. Current versions of WebCopy throw a fit at this because they can't decode things they don't know about and web servers usually return standard values like gzip, deflate, br etc.
If you download one of the 1.9 nightlies this issue is resolved so WebCopy will now ignore these content encodings and will just download the file as-is. Of course, if the web server truly is returning the data in a custom form it won't be decompressed.
If possible, can you share the URL causing the crash if known, or the website if not. I'd like to test that URL to verify the existing fix is sufficient.
Thanks;
Richard Moss
This sounds like a manifestation of issue #471. Basically, the web server is misbehaving a little and returning a non-standard encoding. Current versions of WebCopy throw a fit at this because they can't decode things they don't know about and web servers usually return standard values like gzip, deflate, br etc.
If you download one of the 1.9 nightlies this issue is resolved so WebCopy will now ignore these content encodings and will just download the file as-is. Of course, if the web server truly is returning the data in a custom form it won't be decompressed.
If possible, can you share the URL causing the crash if known, or the website if not. I'd like to test that URL to verify the existing fix is sufficient.
Thanks;
Richard Moss
#87
WebCopy / Re: Content Encoding 'base64' ...
Last post by Richard Moss - May 16, 2023, 05:39:39 PMHello,
This sounds like a manifestation of issue #471. Basically, the web server is misbehaving a little and returning a non-standard encoding. Current versions of WebCopy throw a fit at this because they can't decode things they don't know about and web servers usually return standard values like gzip, deflate, br etc.
If you download one of the 1.9 nightlies this issue is resolved so WebCopy will now ignore these content encodings and will just download the file as-is. Of course, if the web server truly is returning the data in a custom form it won't be decompressed.
If possible, can you share the URL causing the crash if known, or the website if not. I'd like to test that URL, firstly to verify the existing fix is sufficient, and also to see if the data is being returned as base64... a curious choice given it is the exact opposite of compression.
Thanks;
Richard Moss
This sounds like a manifestation of issue #471. Basically, the web server is misbehaving a little and returning a non-standard encoding. Current versions of WebCopy throw a fit at this because they can't decode things they don't know about and web servers usually return standard values like gzip, deflate, br etc.
If you download one of the 1.9 nightlies this issue is resolved so WebCopy will now ignore these content encodings and will just download the file as-is. Of course, if the web server truly is returning the data in a custom form it won't be decompressed.
If possible, can you share the URL causing the crash if known, or the website if not. I'd like to test that URL, firstly to verify the existing fix is sufficient, and also to see if the data is being returned as base64... a curious choice given it is the exact opposite of compression.
Thanks;
Richard Moss
#88
WebCopy / Content Encoding 'base64' not ...
Last post by logos - May 09, 2023, 03:00:28 PMHi all ,
Today I am getting below error message when I try to copy the site .
any idea where I can exlude in the project such content and carry on ?
Because of that error , project is not able to finalize the copy process , so its a showstopper.
please help !
Thanks,
Today I am getting below error message when I try to copy the site .
any idea where I can exlude in the project such content and carry on ?
Because of that error , project is not able to finalize the copy process , so its a showstopper.
please help !
Thanks,
#89
Color Palette Editor / Re: Support for NES Palettes
Last post by brunobox99 - April 30, 2023, 02:46:31 AMHello Richard, sorry for the late reply.
Tried the nightly build of Palette Editor 1.8 for opening NES palettes, and it worked perfectly, thank you very much!
Wish you all the best,
Bruno
Tried the nightly build of Palette Editor 1.8 for opening NES palettes, and it worked perfectly, thank you very much!
Wish you all the best,
Bruno
#90
Color Palette Editor / Re: Support for NES Palettes
Last post by Richard Moss - April 10, 2023, 09:05:33 AMHello,
Thanks for the suggestion. 192 and 64 suggested this is a simple RGB triplets palette and I logged issue #485 to implement it.
On checking the source website I found http://www.firebrandx.com/nespalettes.html. This useful page included downloadable palettes along with reference images and thus I was easily able to test my implementation using the Digital Prime (FBX) download.
The next build nightly build of 1.8 should include this type.
(PS: Requests like this normally wouldn't normally be implemented Soon(TM) let alone instantly, a) you caught me in a break b) it is probably the simplest file format possible and which is already implemented and c) reference images were available so I could instantly be sure it was correct)
Regards;
Richard Moss
Thanks for the suggestion. 192 and 64 suggested this is a simple RGB triplets palette and I logged issue #485 to implement it.
On checking the source website I found http://www.firebrandx.com/nespalettes.html. This useful page included downloadable palettes along with reference images and thus I was easily able to test my implementation using the Digital Prime (FBX) download.
The next build nightly build of 1.8 should include this type.
(PS: Requests like this normally wouldn't normally be implemented Soon(TM) let alone instantly, a) you caught me in a break b) it is probably the simplest file format possible and which is already implemented and c) reference images were available so I could instantly be sure it was correct)
Regards;
Richard Moss