if you set your source to mulitple urls (more than the number of threads you are running), it just gets stuck.
Example:
Create a project with the following starting urls (follow all links to depth 2). If you run it on 30 threads it will get to http://www.listal.com/jenna-dewan--tatum/pictures//31 and just continuously loop and hit that page. Changing the number of connections to 1 and then back to 30 will then allow it to go to 61(or in this case 51)...
... well usually it goes to 31, I just did it and it stopped at 28 this time:
http://www.listal.com/jenna-dewan--tatum/pictures
http://www.listal.com/jenna-dewan--tatum/pictures//2
http://www.listal.com/jenna-dewan--tatum/pictures//3
http://www.listal.com/jenna-dewan--tatum/pictures//4
http://www.listal.com/jenna-dewan--tatum/pictures//5
http://www.listal.com/jenna-dewan--tatum/pictures//6
http://www.listal.com/jenna-dewan--tatum/pictures//7
http://www.listal.com/jenna-dewan--tatum/pictures//8
http://www.listal.com/jenna-dewan--tatum/pictures//9
http://www.listal.com/jenna-dewan--tatum/pictures//10
http://www.listal.com/jenna-dewan--tatum/pictures//11
http://www.listal.com/jenna-dewan--tatum/pictures//12
http://www.listal.com/jenna-dewan--tatum/pictures//13
http://www.listal.com/jenna-dewan--tatum/pictures//14
http://www.listal.com/jenna-dewan--tatum/pictures//15
http://www.listal.com/jenna-dewan--tatum/pictures//16
http://www.listal.com/jenna-dewan--tatum/pictures//17
http://www.listal.com/jenna-dewan--tatum/pictures//18
http://www.listal.com/jenna-dewan--tatum/pictures//19
http://www.listal.com/jenna-dewan--tatum/pictures//20
http://www.listal.com/jenna-dewan--tatum/pictures//21
http://www.listal.com/jenna-dewan--tatum/pictures//22
http://www.listal.com/jenna-dewan--tatum/pictures//23
http://www.listal.com/jenna-dewan--tatum/pictures//24
http://www.listal.com/jenna-dewan--tatum/pictures//25
http://www.listal.com/jenna-dewan--tatum/pictures//26
http://www.listal.com/jenna-dewan--tatum/pictures//27
http://www.listal.com/jenna-dewan--tatum/pictures//28
http://www.listal.com/jenna-dewan--tatum/pictures//29
http://www.listal.com/jenna-dewan--tatum/pictures//30
http://www.listal.com/jenna-dewan--tatum/pictures//31
http://www.listal.com/jenna-dewan--tatum/pictures//32
http://www.listal.com/jenna-dewan--tatum/pictures//33
http://www.listal.com/jenna-dewan--tatum/pictures//34
http://www.listal.com/jenna-dewan--tatum/pictures//35
http://www.listal.com/jenna-dewan--tatum/pictures//36
http://www.listal.com/jenna-dewan--tatum/pictures//37
http://www.listal.com/jenna-dewan--tatum/pictures//38
http://www.listal.com/jenna-dewan--tatum/pictures//39
http://www.listal.com/jenna-dewan--tatum/pictures//40
http://www.listal.com/jenna-dewan--tatum/pictures//41
http://www.listal.com/jenna-dewan--tatum/pictures//42
http://www.listal.com/jenna-dewan--tatum/pictures//43
http://www.listal.com/jenna-dewan--tatum/pictures//44
http://www.listal.com/jenna-dewan--tatum/pictures//45
http://www.listal.com/jenna-dewan--tatum/pictures//46
http://www.listal.com/jenna-dewan--tatum/pictures//47
http://www.listal.com/jenna-dewan--tatum/pictures//48
http://www.listal.com/jenna-dewan--tatum/pictures//49
http://www.listal.com/jenna-dewan--tatum/pictures//50
http://www.listal.com/jenna-dewan--tatum/pictures//51
Extreme Picture Finder gets stuck...
-
- Site Admin
- Posts: 2077
- Joined: 02 Mar 2009, 17:02
Re: Extreme Picture Finder gets stuck...
OK, thank you for reporting this problem. Gonna try to fix it ASAP.
-
- Site Admin
- Posts: 2077
- Joined: 02 Mar 2009, 17:02
Re: Extreme Picture Finder gets stuck...
All right, the problem is fixed and the next version with this fix (and a lot of other cool stuff) will be released soon. As for this project, you can do the following:
In the "Filters -> Excluded URLs" section add the following filter:
.*
And in the "Filters -> Included URLs" section add this filter:
image/
That's it. And you'll have all the image WAAAAAY faster.
In the "Filters -> Excluded URLs" section add the following filter:
.*
And in the "Filters -> Included URLs" section add this filter:
image/
That's it. And you'll have all the image WAAAAAY faster.
-
- Posts: 1
- Joined: 03 Jan 2014, 08:49
Re: Extreme Picture Finder gets stuck...
Some sites seem to cause loops as trap such as siteA>siteB>siteA>siteB>siteA>.....
If you could add the new function to detect intentional loop and giving up the target page then go to the following pages,I would appreciate.
Thanks in advance.
If you could add the new function to detect intentional loop and giving up the target page then go to the following pages,I would appreciate.
Thanks in advance.
-
- Site Admin
- Posts: 2077
- Joined: 02 Mar 2009, 17:02
Re: Extreme Picture Finder gets stuck...
OK, I understand what you're talking about, but it's rather hard to implement. Can you give me a sample URL for this one?