Cyotek Forums

Products => WebCopy => Topic started by: marcel580 on August 10, 2022, 12:21:22 PM

Title: exclude of domains doesn´t work
Post by: marcel580 on August 10, 2022, 12:21:22 PM
Hey guys,
if I try to exclude a domain by pressing the exclude-button after sanning a website it doesn´t work. It just stays included.

Isn´t that the correct way to exclude a website?

Best regards
Marcel HentschelCyotek exclude.png
Title: Re: exclude of domains doesn´t work
Post by: ebuzzz on January 17, 2023, 08:39:08 AM
I'm having the exact same issue. The main reason I want to exclude domains is that WebCopy follows AddThis links on news articles pages. This AddThis link is a redirect and these redirects are done multiple times per page. There does not seem to be a way to exclude this domain in WebCopy. This results in a huge number of requests and a very long crawl time.