this site is weird

Post Reply
KAIAD
Posts: 16
Joined: 03 Aug 2017, 20:10

this site is weird

Post by KAIAD » 03 Aug 2017, 20:26

simple

You can download images from the top address of this site

https://onehallyu.com/

But I can not get any images from the topic.

https://onehallyu.com/topic/166992-%E3% ... /page-1290

How should I solve this?

Maksym
Site Admin
Posts: 2077
Joined: 02 Mar 2009, 17:02

Re: this site is weird

Post by Maksym » 04 Aug 2017, 16:18

Yeah, this one may turn out a little bit tricky. First of all - what version of the program do you have? Earlier versions of the program could not handle long folder and file names and default folder name for project with this starting URL is super long. So you need to make sure you have the most recent version of the program:

http://www.webimagedownloader.com/download/

Second, tell me exactly what you need? All images from all pages of this (or any other) thread of this forum? Or images from this page only?

KAIAD
Posts: 16
Joined: 03 Aug 2017, 20:10

Re: this site is weird

Post by KAIAD » 12 Aug 2017, 07:05

Oh I just saw it. Thanks for the answer

Now I am using version 3.38.0.0
And the problem was solved by shortening the folder name

But now I have another problem.
using this grateful program for a few days after this post
I found I could not get the twitter's videos and twitter's specific image extensions like "*.jpg:orig" "*.jpg:large"
sadly adding them to 'target file' dose not solve anything
I only got "*.jpg" from twitter link

Still referring to:
https://onehallyu.com/topic/166992-%E3% ... ry23033139

Post with "*.jpeg:orig"
https://onehallyu.com/topic/166992-【off ... p=23033139


And my goal is to get all the photos and videos on every page of this topic.

thanks for reading

Maksym
Site Admin
Posts: 2077
Joined: 02 Mar 2009, 17:02

Re: this site is weird

Post by Maksym » 13 Aug 2017, 15:48

OK, turned out there is a bug when ":" is present in the file name. Gonna fix it and post here when it's done.

Maksym
Site Admin
Posts: 2077
Joined: 02 Mar 2009, 17:02

Re: this site is weird

Post by Maksym » 14 Aug 2017, 13:45

OK, please download and install the fixed version:

http://www.webimagedownloader.com/download/

It doesn't add a colon to the file name anymore, so original images from twitter that are embedded directly into the page will be downloaded now.

KAIAD
Posts: 16
Joined: 03 Aug 2017, 20:10

Re: this site is weird

Post by KAIAD » 15 Aug 2017, 13:11

I experimented with a new version, and the jpg: orig file is well fixed!

however, there are still twitter issues

Reference:
Https://twitter.com/0423CHAEYOUNG

In this twitter account, a lot of photosets are made up of "* .jpg:large" files. EPF still can't get them
It would be cool if the app could completely download this kind of Twitter account

Thank you!

Maksym
Site Admin
Posts: 2077
Joined: 02 Mar 2009, 17:02

Re: this site is weird

Post by Maksym » 15 Aug 2017, 13:33

Well, the main problem with twiiter is: it loads more content when user scrolls down. EPF can not scroll down.

Second: there are no direct links to jpg:large on the page you sent me. Take a look inside the page source and try to find "jpg:large" text.

But you can create such links with Custom Parsers like this:

Regular Expression: src="(https://pbs.twimg.com/media/[^"]+\.jpg)"
Result: [#1]:large

It will get you links to the large images for those images that are initially loaded when you open the page. Those that are loaded when user scrolls the page down are currently unreachable for EPF. But you can still get image from any post if you use a post link as a starting URL and the above Custom Parser.

KAIAD
Posts: 16
Joined: 03 Aug 2017, 20:10

Re: this site is weird

Post by KAIAD » 15 Aug 2017, 13:57

Ok, I was surprised by quick answer

really helpful

I hope EPF can support scrolling down someday


Thank you for making a great program!

Post Reply