The title is as follows.
I want EPF to memorize it once downloaded.
In order to avoid re-downloading, it seems necessary to keep the file without erasing it.
Also, even if I keep image files, it is barren to check the same album URL each time. Periodically checking the page with the update is still necessary. However, on sites like simple album hosting, EPF should avoid the update check by revisit and speed up to reduce the burden on the site side.
I do not want to download the downloaded file again.
-
- Site Admin
- Posts: 2077
- Joined: 02 Mar 2009, 17:02
Re: I do not want to download the downloaded file again.
Can I have sample URLs please for the tests?
-
- Posts: 6
- Joined: 05 Nov 2017, 19:44
-
- Site Admin
- Posts: 2077
- Joined: 02 Mar 2009, 17:02
Re: I do not want to download the downloaded file again.
Well, if you use the "Resume" or "Update" option to start your projects - EPF should not download the same files again. Only if you use "Restart" option.
But for some video / image hosting websites, where URLs for actual video/image files are re-generated every time and they are different every time - it won't work. EPF will re-download such files over and over again every time you re-start the project using any option.
That's why I asked for sample URLs to find out if this is the case.
But for some video / image hosting websites, where URLs for actual video/image files are re-generated every time and they are different every time - it won't work. EPF will re-download such files over and over again every time you re-start the project using any option.
That's why I asked for sample URLs to find out if this is the case.
-
- Posts: 6
- Joined: 05 Nov 2017, 19:44
Re: I do not want to download the downloaded file again.
Wow, It is very nice behavior.
I fear re-downloading, so I will back up the entire EPF configuration frequently.
For example, what is the behavior of EPF when it is a website to be paged and the latest information is displayed on the first page?
My ideal idea is to crawl pages, but images that have already been downloaded are ignored.
The important thing here is not that images do not overlap when files are present in the save destination after downloading.
It is not to download the image that you really downloaded once. It should check the image URL and Content-Length. (It may be just a URL)
-
- Site Admin
- Posts: 2077
- Joined: 02 Mar 2009, 17:02
Re: I do not want to download the downloaded file again.
If you need to re-crawl pages to find newly added content without re-downloading already saved files - use "Update" option. It works exactly as you described.