Page 1 of 1

skip downloading the files already been downloaded

Posted: 10 Apr 2024, 08:05
by simonrule
like title said

for example simcity topic when there is new posts when click update the template start pasrsing all the topic pages is it possible to just start for the new files been posted instead of going through everything again ?

Re: skip downloading the files already been downloaded

Posted: 10 Apr 2024, 11:05
by Maksym
The "Update" function is programmed to re-check all the pages. This is the only way the software can find new pages/content.

I think you should create a new project with a new thread page address and remove the URL filter that allows the program to crawl other pages of the thread. This one:

^[^\?]+/threads/[^/]+/page-\d+$

Re: skip downloading the files already been downloaded

Posted: 11 Apr 2024, 06:16
by simonrule
ok thank you :)