Keeps logging out during crawl

Started by ThomasS, March 13, 2023, 07:25:34 PM

Previous topic - Next topic


It has been reported a year ago (link to thread), but for me it still doesn't work: I try to crawl a phpbb site that contains many logoff links. Although I excluded these through a rule (which apparently works), it seems like WebCopy calls the excluded URLs anyway before deciding to exclude them.


When I look at the local pages, "memberlist" (and all the other pages above) still shows that I'm logged in, while "search" shows that I was logged out - although the "mode=logout" link was excluded.

Is there anything I can do to stay logged in? I tried 1.9.0 and 1.9.1 (nightly), but to no avail: both logged off during crawling.

Thank you for you support