Extreme Picture Finder gets stuck...

Post Reply
NeilPearson
Posts: 1
Joined: 25 Mar 2015, 08:36

Extreme Picture Finder gets stuck...

Post by NeilPearson » 25 Mar 2015, 08:49

if you set your source to mulitple urls (more than the number of threads you are running), it just gets stuck.

Example:

Create a project with the following starting urls (follow all links to depth 2). If you run it on 30 threads it will get to http://www.listal.com/jenna-dewan--tatum/pictures//31 and just continuously loop and hit that page. Changing the number of connections to 1 and then back to 30 will then allow it to go to 61(or in this case 51)...

... well usually it goes to 31, I just did it and it stopped at 28 this time:

Image

http://www.listal.com/jenna-dewan--tatum/pictures
http://www.listal.com/jenna-dewan--tatum/pictures//2
http://www.listal.com/jenna-dewan--tatum/pictures//3
http://www.listal.com/jenna-dewan--tatum/pictures//4
http://www.listal.com/jenna-dewan--tatum/pictures//5
http://www.listal.com/jenna-dewan--tatum/pictures//6
http://www.listal.com/jenna-dewan--tatum/pictures//7
http://www.listal.com/jenna-dewan--tatum/pictures//8
http://www.listal.com/jenna-dewan--tatum/pictures//9
http://www.listal.com/jenna-dewan--tatum/pictures//10
http://www.listal.com/jenna-dewan--tatum/pictures//11
http://www.listal.com/jenna-dewan--tatum/pictures//12
http://www.listal.com/jenna-dewan--tatum/pictures//13
http://www.listal.com/jenna-dewan--tatum/pictures//14
http://www.listal.com/jenna-dewan--tatum/pictures//15
http://www.listal.com/jenna-dewan--tatum/pictures//16
http://www.listal.com/jenna-dewan--tatum/pictures//17
http://www.listal.com/jenna-dewan--tatum/pictures//18
http://www.listal.com/jenna-dewan--tatum/pictures//19
http://www.listal.com/jenna-dewan--tatum/pictures//20
http://www.listal.com/jenna-dewan--tatum/pictures//21
http://www.listal.com/jenna-dewan--tatum/pictures//22
http://www.listal.com/jenna-dewan--tatum/pictures//23
http://www.listal.com/jenna-dewan--tatum/pictures//24
http://www.listal.com/jenna-dewan--tatum/pictures//25
http://www.listal.com/jenna-dewan--tatum/pictures//26
http://www.listal.com/jenna-dewan--tatum/pictures//27
http://www.listal.com/jenna-dewan--tatum/pictures//28
http://www.listal.com/jenna-dewan--tatum/pictures//29
http://www.listal.com/jenna-dewan--tatum/pictures//30
http://www.listal.com/jenna-dewan--tatum/pictures//31
http://www.listal.com/jenna-dewan--tatum/pictures//32
http://www.listal.com/jenna-dewan--tatum/pictures//33
http://www.listal.com/jenna-dewan--tatum/pictures//34
http://www.listal.com/jenna-dewan--tatum/pictures//35
http://www.listal.com/jenna-dewan--tatum/pictures//36
http://www.listal.com/jenna-dewan--tatum/pictures//37
http://www.listal.com/jenna-dewan--tatum/pictures//38
http://www.listal.com/jenna-dewan--tatum/pictures//39
http://www.listal.com/jenna-dewan--tatum/pictures//40
http://www.listal.com/jenna-dewan--tatum/pictures//41
http://www.listal.com/jenna-dewan--tatum/pictures//42
http://www.listal.com/jenna-dewan--tatum/pictures//43
http://www.listal.com/jenna-dewan--tatum/pictures//44
http://www.listal.com/jenna-dewan--tatum/pictures//45
http://www.listal.com/jenna-dewan--tatum/pictures//46
http://www.listal.com/jenna-dewan--tatum/pictures//47
http://www.listal.com/jenna-dewan--tatum/pictures//48
http://www.listal.com/jenna-dewan--tatum/pictures//49
http://www.listal.com/jenna-dewan--tatum/pictures//50
http://www.listal.com/jenna-dewan--tatum/pictures//51

Maksym
Site Admin
Posts: 2077
Joined: 02 Mar 2009, 17:02

Re: Extreme Picture Finder gets stuck...

Post by Maksym » 25 Mar 2015, 12:44

OK, thank you for reporting this problem. Gonna try to fix it ASAP.

Maksym
Site Admin
Posts: 2077
Joined: 02 Mar 2009, 17:02

Re: Extreme Picture Finder gets stuck...

Post by Maksym » 25 Mar 2015, 13:18

All right, the problem is fixed and the next version with this fix (and a lot of other cool stuff) will be released soon. As for this project, you can do the following:

In the "Filters -> Excluded URLs" section add the following filter:

.*

And in the "Filters -> Included URLs" section add this filter:

image/

That's it. And you'll have all the image WAAAAAY faster.

Nantoh
Posts: 1
Joined: 03 Jan 2014, 08:49

Re: Extreme Picture Finder gets stuck...

Post by Nantoh » 29 Aug 2015, 12:34

Some sites seem to cause loops as trap such as siteA>siteB>siteA>siteB>siteA>.....

If you could add the new function to detect intentional loop and giving up the target page then go to the following pages,I would appreciate.
Thanks in advance.

Maksym
Site Admin
Posts: 2077
Joined: 02 Mar 2009, 17:02

Re: Extreme Picture Finder gets stuck...

Post by Maksym » 30 Aug 2015, 14:08

OK, I understand what you're talking about, but it's rather hard to implement. Can you give me a sample URL for this one?

Post Reply