I am pretty new so please bear with me if my terminology use is not proper in regards to html or web dev lingo.
I am trying build a set of rules that will give a root URL crawl down the folder structure of the webiste's content. So far I can pull files from any specified individual page fine using.
Rule 1: .* (Exclude flag set)
Rule 2: \.<filetype> (Exclude, Include, Crawl Content, Disablelinks flags set)
However this requires I use the page the files exist from to and is quite cumbersome.
1. How do I setup the rules to crawl down the folder structure from the root URL path I set for the project?
2. How can I specify to download multiple file types if need be?
3. Why does the Exclude flag keep being set on Rule 2 when after I uncheck it, hit apply, close the editor and reopen the editor? I am not sure why this is required for the rule.