Question about sex.com configs

Post Reply
Pattumi
Posts: 6
Joined: 24 Oct 2021, 16:37

Question about sex.com configs

Post by Pattumi » 24 Oct 2021, 16:42

Hello.

When downloading content from sex.com (from category "boards" made by users) there is always a chance that the download will be buggy. It will suddenly start to look through thousands of pages of other websites like tumbrview.com instead of staying at sex.com. I know this can happen when images were originally linked to other websites like tumbrview and similar, but as I can see in the settings, searcing should only be limited to sex.com domained websites.

So, are restrictions not working properly? What exactly do I need to do to prevent it from searching other linked sites than sex.com? I tried to add it manually, but I am not sure if I handled regex expressions correctly. It did not really work. Right now I am using the default settings. And this bug doesnt happen always, but occassionally with a few boards. Problem is, I let it download multiple boards of a category at once, so if there is one black sheep which causes this bug, nothing will be downloaded and it just endlessly loops the pages of tumbrview and similar websites.

Any solutions?

Pattumi
Posts: 6
Joined: 24 Oct 2021, 16:37

Re: Question about sex.com configs

Post by Pattumi » 24 Oct 2021, 18:22

I think I found out the reason why it searched other pages, too. Looking at included URLs, it looks like this:

Code: Select all

page=\d+$
sex\.com/pin/\d+(-[^/]+)?/$
\.sex\.com/images/pinporn/\d+/\d+/.+\?width=620
/stream/
\.sex\.com/videos/pinporn/
-------> so "page" and "stream" are basically floating in the air, not specified to any URL. so ANY url which turns out to have "pages" or "stream" in their name will be fully searched, when sex.com redirects to that. and tumbrlview for example has pages "page" in its url. (tumbrview is only an example, there are alot more pages sex.com redirects the software, which happen to have the word "page" in the link. so excluding them 1 by 1 is not an option. makes more sense to specify "page" to sex.com galleries instead.)

anyone knows how to change this expressions, so "stream" and "pages" only occur to sex.com?

An example link for usercontent would be like this:

Code: Select all

https://www.sex.com/user/USERNAME/GALLERYNAME/?page=PAGENUMBER
in this link, "username" and "galleryname" can be anything. numbers, letters or even signs. (since the users pick their usernames themselves and they pick a gallery name themselves, so it could be anything). when there are many images in a gallery, there are multiple pages, means "pagenumber" is variable.

unfortunately i dont know much about reg expressions, so i have struggles to turn the example link i gave into reg-expression. basically, the idea is to prevent it from searching other sites, which have "page" or "stream" in name. i ony want it to search sex.com for "pages" (and "streams", but i never needed stream, so we can actually ignore this).

Thank you in advance!

Maksym
Site Admin
Posts: 2077
Joined: 02 Mar 2009, 17:02

Re: Question about sex.com configs

Post by Maksym » 25 Oct 2021, 12:15

Can you give me exact Starting URL you're trying to download from?

Pattumi
Posts: 6
Joined: 24 Oct 2021, 16:37

Re: Question about sex.com configs

Post by Pattumi » 26 Oct 2021, 15:45

Maxim wrote:
25 Oct 2021, 12:15
Can you give me exact Starting URL you're trying to download from?
Hello. I did, it is this pattern:

Code: Select all

https://www.sex.com/user/USERNAME/GALLERYNAME/?page=PAGENUMBER

Example Gallery would look like this (i dont know anymore which gallery redirected me to other websites with "page" in the url. but the bug is obvious i think, since the page expression is floating generally in its own row, allowing every url with "page" in its name without any restriction. when i find an url that redirects, i will make a new post here and show you. But for now, i just gave an example of a random gallery):

Code: Select all

https://www.sex.com/user/maryan18/sexy-babes-hot-babes-sexy-amateurs/
https://www.sex.com/user/maryan18/sexy-babes-hot-babes-sexy-amateurs/?page=2
https://www.sex.com/user/maryan18/sexy-babes-hot-babes-sexy-amateurs/?page=3
and so on... the usernames and gally names are variable. they can also be chinese, russian or japanese letters, i think. but not sure if they can be signs (like: :.,?!%&- etc...)

The problem is, the expression page=\d+$ is general, because it has its own row. That means, when sex.com redirects to other websites, which also have "page" as a word in the URL, the downloader will start to look through all of these pages, too. And that's what I wanted to prevent.

Maksym
Site Admin
Posts: 2077
Joined: 02 Mar 2009, 17:02

Re: Question about sex.com configs

Post by Maksym » 26 Oct 2021, 17:03

Please try this template:

sex.com template

It works only with the old site design and with the pages where you can see the pins.

Pattumi
Posts: 6
Joined: 24 Oct 2021, 16:37

Re: Question about sex.com configs

Post by Pattumi » 26 Oct 2021, 18:15

Maxim wrote:
26 Oct 2021, 17:03
Please try this template:

sex.com template

It works only with the old site design and with the pages where you can see the pins.
Thanks I will try it. And yes, I know, sex.com made a new page, I am using the sex.com/pins (the old one where i can find pins and user galleries. The new sex.com is rather awkward. There are not even real pins and galleries, it is something paid I think)

Pattumi
Posts: 6
Joined: 24 Oct 2021, 16:37

Re: Question about sex.com configs

Post by Pattumi » 26 Oct 2021, 18:31

Maxim wrote:
26 Oct 2021, 17:03
Please try this template:

sex.com template

It works only with the old site design and with the pages where you can see the pins.
Unfortunately it still doesnt work. I now found a link that redirects me (to iloopit.net and tnafix.com because the urls have the word "page" in their linknames.)

Code: Select all

https://www.sex.com/user/frank007/balls/
That gallery only has 2 pages but after page 1 it redircts to iloopit.net and tnafix.com websites because of certain images which redirect. And thats possible because the page=\d+$ is not restricted to sex.com website, but it allows all random websites.

There are, now and then, many more galleries which have certain images that redirect to awkward websites which contain "page" in their linkname, so the sex.com-plugin accepts these sites and empty-loop-searches them without ever finishing or continuing the real download. You can test it with the link I sent you in this post, you will notice what I mean.

So what I think is, to change "page=\d+$" so it is restricted to only sex.com website. That means, more links need to be defined with "page=\d+$", like newest, most popular, usergalleries, gifs, videos, pics, all file type categories and sortings probably need to be re-defined with "page=\d+$" so no random websites with the word "page" will be considered anymore, but only restricted to sex.com links.

Maksym
Site Admin
Posts: 2077
Joined: 02 Mar 2009, 17:02

Re: Question about sex.com configs

Post by Maksym » 26 Oct 2021, 18:48

Oh, I see now. I updated the template. Please re-download, create new project and try again.

Pattumi
Posts: 6
Joined: 24 Oct 2021, 16:37

Re: Question about sex.com configs

Post by Pattumi » 26 Oct 2021, 23:33

Maxim wrote:
26 Oct 2021, 18:48
Oh, I see now. I updated the template. Please re-download, create new project and try again.
Thanks for your efforts, now it works perfectly!

Post Reply