themaLeecher
http://leecher.themasoftware.com/forum/

[imdb.com]
http://leecher.themasoftware.com/forum/viewtopic.php?f=19&t=6519
Page 1 of 1

Author:  Crackpot [ December 24th, 2019, 10:32 pm ]
Post subject:  [imdb.com]

URL: https://www.imdb.com/search/title/?title_type=movie

Error message: Failed to find message

Problem: Failed to find message

i tried to add "p.text-muted" "div.subtext" but multi page leech giving error.

only i need to collect the movie name and would be nice if can grab the genre and imdb rating with votes.

Author:  Freddy [ December 28th, 2019, 8:08 am ]
Post subject:  Re: [imdb.com]

Message selector should be taken from the post ("movie" in this case) page, for example: https://www.imdb.com/title/tt8623904

It really depends on what you want to leech. For the basic summary "div.plot_summary" would be fine.

Here are all selectors:

You just need to add custom selectors: http://leecher.themasoftware.com/faq.php?expand=faq206

Go to "WEBSITES" -> select that website -> "Selectors" tab -> add these selectors:

Subject:
Code:
h1


Message:
Code:
div.plot_summary


Subject with URL:
Code:
h3.lister-item-header

Author:  Crackpot [ December 28th, 2019, 7:09 pm ]
Post subject:  Re: [imdb.com]

page number help. after 9950 IMDB giving different page number. if you click next after below link

Code:
https://www.imdb.com/search/title/?title_type=movie&start=9950&ref_=adv_nxt


this is for 10000 page list. will TL able to grab such page link for multipage fetch
Code:
https://www.imdb.com/search/title/?title_type=movie&after=WzE0NDcwLCJ0dDI3Mjg3ODQiLDEwMDAwXQ%3D%3D&ref_=adv_nxt


=====================
multipage has option "don't use subject with url" if select that TL add
movie name (Year)

but "Pages" option don't have such option. is there anyway to add year with title for "Pages" leech?

Author:  Freddy [ December 29th, 2019, 10:57 am ]
Post subject:  Re: [imdb.com]

No, it won't be possible to leech those further pages with "Multi-Pages".

There is exactly the same option for "Pages" as well in "Websites" -> "Pages" -> "Other settings" tab (above the page "URL" field).

Author:  Crackpot [ January 7th, 2020, 11:17 pm ]
Post subject:  Re: [imdb.com]

works all perfect and for increment should i use "50" or 51?

Author:  Freddy [ January 8th, 2020, 9:40 am ]
Post subject:  Re: [imdb.com]

Use 50. They adjust the page results automatically. It will work better.

Author:  Crackpot [ February 19th, 2022, 4:06 pm ]
Post subject:  Re: [imdb.com]

for recent imdb template changes, message selector is not working.

Code:
Failed to find message. Custom "Message" selector need to be added.


i tried this multiple selector but i could not able to add the proper selector. kindly help please.

Author:  Freddy [ February 19th, 2022, 6:34 pm ]
Post subject:  Re: [imdb.com]

It really depends on what you want to leech, their information is all over the place.

For plot only this would work:
Code:
span.eqbKRZ

Author:  Crackpot [ December 11th, 2023, 5:37 am ]
Post subject:  Re: [imdb.com]

they have changed their layout. can you please help me again

https://www.imdb.com/search/title/?title_type=feature

also they changed their next page options. it's like loading the next page with javascript or something. possible to do multipage leech?

i only need the imdb URL in message and title. so that I can get movie list.

Author:  Freddy [ December 11th, 2023, 9:09 am ]
Post subject:  Re: [imdb.com]

Go to "WEBSITES" -> select that website -> "Selectors" tab -> add these selectors:

Subject:
Code:
h1


Message:
Code:
span[data-testid=plot-xl]


Subject with URL:
Code:
a.ipc-title-link-wrapper



Seems like there are no pages anymore and it's not possible to view all results at once.

Multi-Pages won't really work.

Author:  Crackpot [ March 23rd, 2024, 6:58 am ]
Post subject:  Re: [imdb.com]

Freddy wrote:
Go to "WEBSITES" -> select that website -> "Selectors" tab -> add these selectors:

Subject:
Code:
h1


Message:
Code:
span[data-testid=plot-xl]


Subject with URL:
Code:
a.ipc-title-link-wrapper



Seems like there are no pages anymore and it's not possible to view all results at once.

Multi-Pages won't really work.



sorry to bother you again. following URL msg leech

Code:
https://www.imdb.com/search/title/?title_type=feature


this is the output we can get. is there anyway we can include the imdb URL in message. so that we can get use imdb URL leech feature of TL?
https://i.postimg.cc/CMfC1sMs/image.png

Author:  Freddy [ March 23rd, 2024, 9:22 pm ]
Post subject:  Re: [imdb.com]

Yes, you can with message replacement.

Search for:
Code:
^


Replace with:
Code:
<postUrl>\n\n


Enable regex search.

Assign only for that site after adding.

Page 1 of 1 All times are UTC
Powered by phpBB © 2000, 2002, 2005, 2007 phpBB Group
http://www.phpbb.com/