skip downloading the files already been downloaded

Post Reply
simonrule
Posts: 24
Joined: 26 Sep 2022, 03:42

skip downloading the files already been downloaded

Post by simonrule »

like title said

for example simcity topic when there is new posts when click update the template start pasrsing all the topic pages is it possible to just start for the new files been posted instead of going through everything again ?
Maksym
Site Admin
Posts: 2434
Joined: 02 Mar 2009, 17:02

Re: skip downloading the files already been downloaded

Post by Maksym »

The "Update" function is programmed to re-check all the pages. This is the only way the software can find new pages/content.

I think you should create a new project with a new thread page address and remove the URL filter that allows the program to crawl other pages of the thread. This one:

^[^\?]+/threads/[^/]+/page-\d+$
simonrule
Posts: 24
Joined: 26 Sep 2022, 03:42

Re: skip downloading the files already been downloaded

Post by simonrule »

ok thank you :)
Post Reply