Author
bigpaulie426
Very Respected VIP club member
Added: Jan 01, 2008 12:18 am
I was wondering if anybody could help me. I am looking for Site ripping software that will not trigger the Pennywise security on websites with download limits. I currently use Aaron's webvacuum, which works great on non-secured sites. Any help would be greatly appreciated.
wraith
Respected Poster
Added: Jan 01, 2008 6:00 am
I'm not sure what the "Pennywise security" system is, but if you are asking if there is any way to easily fool a webserver that keeps track of how much data each IP address downloads, the only way to do it is by changing proxies (and then you need a large list of proxies). If you had to log into the website to download, and it's tracking by username, there is pretty much no way to do it unless the webserver software is truly awful.

One thing you might consider, though, is scheduling your downloads. If you have a limit per 24 hours, for instance, use a download manager to schedule another few megabytes the next day automatically, and so on down the week. Come back a couple of weeks later, and you have a complete collection without setting off alarms. The downside is, there are no download managers with siterip capabilities, if that's what you're looking for. Another possibility is to use a siteripper with the option to delay each request by several minutes, which may spread out your bandwidth use enough to get around the limits.

For reference, I usually use Pavuk for this, but I do most of my serious work on Unix systems, not Windows.
ictos
Good Poster
Added: Jan 01, 2008 3:27 pm
wraith wrote:

For reference, I usually use Pavuk for this, but I do most of my serious work on Unix systems, not Windows.


I use wget, which is probably even more awkward. Wink
lonelyguy
Respected Poster
Added: Jan 05, 2008 5:15 pm
I use a D/L manager on those sites, because they are simply limiting so many MBs/GBs per 24 hours. I do know that some sites are logging IPs now, so unless you also change it, you may have a problem.
bigpaulie426
Very Respected VIP club member
Added: Jan 07, 2008 1:45 am
lonelyguy wrote:
I use a D/L manager on those sites, because they are simply limiting so many MBs/GBs per 24 hours. I do know that some sites are logging IPs now, so unless you also change it, you may have a problem.



Is there anyway I can hook up a D/L manager to my site ripping software (Aaron's WebVacuum) so that I don't have to be there to load it? Possibly leave a certain amount of bandwith open at all times like a torrent client does?

Personally I think it's BS that I pay for a website only to get limited to how much content I can view per day!!