Png Problem

Post Reply
superpipposuper
Posts: 6
Joined: 02 Oct 2017, 12:21

Png Problem

Post by superpipposuper » 02 Oct 2017, 12:41

Hi all, I'm new here and I've just downloaded Extreme Picture Finder.
I guess there's something wrong with settings of my project because I can't success in downloading files.
I would like to download all pictures (in folders possibly) from the website erowall.com with resolution 1920x1080 (for this I used filters). If I try to download a single pic from the website seems to be png (the name is the same for any pic!).
I would appriciate any kind of help. Thanks.

Maksym
Site Admin
Posts: 2077
Joined: 02 Mar 2009, 17:02

Re: Png Problem

Post by Maksym » 03 Oct 2017, 13:31

Hello,

I created a template which downloads all wallpapers from any selected tag on erowall.com website:

http://www.webimagedownloader.com/templ ... -template/

It downloads original-sized wallpapers. Original size is always better, right? Windows can automatically resize bigger images to fit any screen resolution.

But if you really need 1920x1080 images (resized by the website script from the original images), then your target file should be:

download_img.php

And if you exclude everything and in "Excluded URLs" then your "Included URLs" filters should contain this:

erowall\.com/download_img\.php\?dimg=\d+&raz=1920x1080

If you want me to create a project - tell me which tag do you want and I'll do it.

superpipposuper
Posts: 6
Joined: 02 Oct 2017, 12:21

Re: Png Problem

Post by superpipposuper » 03 Oct 2017, 15:45

First of all thank you very much for your help.
I don't really need 1920x1080 pics, my only goal was to have wallpapers of the right size for my 16:9 screen.
I would like to download all the pictures from that website sorted in folders (brunette, blond etc)... if you have time to do the project would be great (I've just tried with the template but I got only 16 files...)

thanks again!

superpipposuper
Posts: 6
Joined: 02 Oct 2017, 12:21

Re: Png Problem

Post by superpipposuper » 04 Oct 2017, 12:12

Ok I tried many times and I realized that if I use:

http://erowall.com/dat/page/1
http://erowall.com/dat/page/2
http://erowall.com/dat/page/3

As starting addresses it gets all the original size pics with your template. I have some questions now:

1) Why to download all the 48 pics in the links above (16 each page) I have to refresh the project 4 times? Why doesn't EPF gets all of them at the first try?
2) If I success in this way I will have a folder with all the pictures on the website, is there a way to have them instead already sorted in folders?
3) In the template you gave me, included urls section: is right erowall\.com/teg/[^/]+/page/\d+$ or should be erowall\.com/tag/[^/]+/page/\d+$ (with tag or teg)??? ...anyway I tried both with no difference.

Thanks, bye.

Maksym
Site Admin
Posts: 2077
Joined: 02 Mar 2009, 17:02

Re: Png Problem

Post by Maksym » 04 Oct 2017, 13:13

Well, the template I created is meant for any category on the website. You can see the list of all available categories on the top of any page. It looks like this:

#BRUNETTE #BLOND #READHEAD ....

So you just had to use any link under the category name. If you want entire site content - just add all category URLs to your project created with the template. Here, I did it for you:

erowall.com.epr

Use right-click, Save file as... to save the project file, then double-click it to open it with Extreme Picture Finder.
1) Why to download all the 48 pics in the links above (16 each page) I have to refresh the project 4 times? Why doesn't EPF gets all of them at the first try?
Not sure why. Maybe your internet connection is to blame? I downloaded about 4000 pics from this website at first try.
2) If I success in this way I will have a folder with all the pictures on the website, is there a way to have them instead already sorted in folders?
Yes, of course. Take a look at the "Sub-folders" section of the project settings for the above project. I used the following Regular Expression to create sub-folders:

erowall.com/search/([^/]+)/
3) In the template you gave me, included urls section: is right erowall\.com/teg/[^/]+/page/\d+$ or should be erowall\.com/tag/[^/]+/page/\d+$ (with tag or teg)??? ...anyway I tried both with no difference.
These Regular Expressions work with URLs, not with page text. And this website uses the following URLs for pagination:

http://erowall.com/teg/brunette/page/3

As you can see it has teg, not tag

You can hover your mouse above any pagination link to see the actual URL, or you could use right-click, and use Copy link address menu item to copy the link URL and then you could paste it in Notepad to see the actual URL.

superpipposuper
Posts: 6
Joined: 02 Oct 2017, 12:21

Re: Png Problem

Post by superpipposuper » 05 Oct 2017, 14:54

Hello once again!

Thank you very much for your help. I tried using your epr and it worked... almost. In the website there are more than 23000 pics.... so if I use your epr I should get much more than 23k pic (same pictures has different tags). I got around 800!!! I have the problem I told you in the number 1) of the previous post. I tried in another website and checked the internet connection and is everything ok (93.93 Mb/s DL 27.66 Mb/s UL), so I don't understand what's going on! Maybe some ports have to be opened on the firewall or...????
Do you have any idea?

Thanks, bye

Maksym
Site Admin
Posts: 2077
Joined: 02 Mar 2009, 17:02

Re: Png Problem

Post by Maksym » 05 Oct 2017, 15:07

I mean, maybe there is a problem in your connection to that website? Not with your connection in general. Please try running the following command in Windows command prompt:

ping -t erowall.com

to see if there will be delays or pocket loss.

Also you could check project's download log to see if there are HTTP or socket errors in it.

Other than that - no idea why could this happen. I stopped this project after 5000+ files.

superpipposuper
Posts: 6
Joined: 02 Oct 2017, 12:21

Re: Png Problem

Post by superpipposuper » 05 Oct 2017, 17:53

Ping is ok. Log is reporting a lot of 404 and some links look like not even checked:

https://www.dropbox.com/s/y1i3bznqgc6jx ... m.dat?dl=0

One more thing I've just noticed is that with the other website links goes like connecting->processing->parsing->downloading while with this project (erowall) a lot stay in connecting and then disappear without processing.

Maksym
Site Admin
Posts: 2077
Joined: 02 Mar 2009, 17:02

Re: Png Problem

Post by Maksym » 06 Oct 2017, 13:55

Hmm. I see. And I don't understand why does Extreme Picture Finder have problems with this website on your PC. :( The project works perfectly here... Have you tried using proxy? One of the free proxies from this page, for example: https://www.us-proxy.org/ You can enter proxy address and port into the EPF settings...

You could also try increasing the Timeout value in the EPF settings, Internet -> Connection section.

Post Reply