Has anyone tried compressing any of the Web Pages they have saved?
I'm going to fiddle around with that later and see if it's worth it. Smaller pages I wouldn't see a need for compressing. But maybe pages that are over half a gig might be worth compressing. I'm curious if they will retain functionality after compression.
I'll report back later.
Hello,
Although I really don't want to be the one trying to render a 500MB HTML document, if by compress you mean remove whitespace then "they" (if "they" is HTML content) should still work fine. If you mean actual compression then I doubt they'll work "out of the box" as the browser won't know how to handle them.
I actually considered building this into WebCopy, but in the opposite direction - given quite a lot a content is minified I was planning on including an un-minifier option, I just haven't got around to it yet.
I'd be interested in hearing what files you're trying to compress and why!
Regards;
Richard Moss
Maybe you can look into converting your downloaded web directory into .warc web archive files? They say they can use gzip compression, also .warc is also a standard of web archival, so it probably won't go away any time soon and can only get better with more support. .warc files can be viewed by a viewer:
Info:
http://fileformats.archiveteam.org/wiki/WARC
More info:
https://iipc.github.io/warc-specifications/specifications/warc-format/warc-1.1/
Viewer:
https://github.com/webrecorder/webrecorder-player
I'm in the same boat as you right now, where I would like to archive a site, but I know I can get at least 60% file size savings by compressing it with gzip or similar, but would like an easier way for the files and pages to be browsed rather than unzipping it all first, then browsing.
Hello,
That is an interesting suggestion thanks! That is definitely something I think I'd be interested in, I'll log this to investigate when I'm not as swamped / burned out.
Regards;
Richard Moss