It is currently March 28th, 2024, 9:25 am



Post new topic Reply to topic  [ 3 posts ] 
Author Message
 Post subject: [myduckisdead.org] How to mass leech?
PostPosted: November 7th, 2018, 12:50 pm 

Joined: December 30th, 2013, 3:54 pm
Posts: 319
URL: http://www.myduckisdead.org/

Hey Freddy
Do you know a way to leech posts from this website using multi-pages?

Each page has different url and I don't know if this is possible.

I could pull out every post url from that website but in TL there isn't an easy way to download lets say 1000 posts, right now you need to click on by one to add the page.

Cheers


Top
 Profile  
Reply with quote  
 Post subject: Re: [myduckisdead.org] How to mass leech?
PostPosted: November 7th, 2018, 5:31 pm 
Site Admin
User avatar

Joined: March 10th, 2011, 11:14 pm
Posts: 12629
Location: Earth
Hi,

seems like there isn't any easy way for Multi-Pages leeching.

The best you could do is probably add all (or needed) categories to "Pages" leeching (just change in URL "max-results=10" to "max-results=100", they are showing much more then).

You will get all movies which are shown (on first page) on that category and all future movies which they will add.

If you really need older posts - only by adding each page to "Pages" (you can increase max-results number in URL to get a bit more), and later removing it (since there is no point in checking for new posts in older pages).

_________________
themaPoster | themaCreator | themaManager | themaLeecher | themaRegister


Top
 Profile  
Reply with quote  
 Post subject: Re: [myduckisdead.org] How to mass leech?
PostPosted: November 7th, 2018, 8:47 pm 

Joined: December 30th, 2013, 3:54 pm
Posts: 319
Thanks Freddy.

I didn't notice you can increase results number, that will help a bit :)

Take care


Top
 Profile  
Reply with quote  
Display posts from previous:  Sort by  
Post new topic Reply to topic  [ 3 posts ] 

Who is online

Users browsing this forum: Google [Bot] and 15 guests


You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot post attachments in this forum

Search for:
Jump to:  
cron
Theme designed by stylerbb.net © 2008
Powered by phpBB © 2000, 2002, 2005, 2007 phpBB Group
All times are UTC