How to define negative crawl depth limit?

Started by chrzesm, November 13, 2022, 02:26:50 AM

Previous topic - Next topic

chrzesm

Hello, I am new to the forum and just started with WebCopy tool. My issue relates to "above root" messages. I wanted to crawl a web page which needs ".../index" in the address line. The page has many links to other pages which are in the same directory ".../page1.html", ".../page2.html", etc., so during crawling they are "above root" :-(. My question is if there is any way to define the root level separatelly to the website address or to define negative crawl depth limit, eg "-1"? I do not want to use "crawl above root" option. Thank you for any suggestions.