Hotfile Woes

Hello everyone,

Haven’t posted on this blog in a while. And I would not be typing this post, either. But it’s out of necessity, much less an announcement that would generally be exciting.

Most of you, if not all, have noticed the troubles we’ve been having with Hotfile in the past couple days. Randomly failing link generations and such. Initially, it was Hotfile not sending back the correct response to our server which would result in a dead link. Or at least, that is what we thought. We decided to dig deeper earlier yesterday and we found out that Hotfile would consistently ban/block our server(s) randomly.

We have been using the database server to generate Hotfile links and the download servers then download those links. Hotfile, being a popular service/site, gets used a lot on RPNet. With the number of users on RPNet increasing by the day, it’s only obvious that there would be more Hotfile links being generated all day long. This causes a flood of requests and Hotfile bans our server (although only temporarily) time and again.

We fixed this issue yesterday by making the download servers generate the links instead of the database. That would route requests on 2 servers, instead of 1. That would mean the load on Hotfile would be distributed between 2 servers, not 1 and we would have lesser chances of getting banned.

That theory was fine and it worked, for about 12-18 hours. Today, one of our clients reported issues with downloading Hotfile, and on looking into the issue we found out that Hotfile had banned/blocked both our download servers. There’s obviously not as much load on Hotfile from one server, but we figure there’s enough on both servers individually to trigger a Hotfile ban.

We don’t know the threshold. We don’t know at what ‘point’ Hotfile bans the server temporarily due to an overload of requests. We don’t know what Hotfile considers an ‘overload’. So our only option, at this point, is to somehow test, trial, error and then find out the limit.

We’re doing exactly that at this moment. We’ve limited Hotfile links to 20 per user for all users. We’ll gradually increase that and see at what point we get banned by Hotfile for a connection flood.

Dman has also suggested (in fact, he’s trying to persuade me) that we drop support for Hotfile completely. Over the past couple months we’ve spent a lot of time and resources on maintaining Hotfile. Time and resources that we could have otherwise spent on better developing RPNet and a lot of features that we have been missing out on and putting a hold on. Hotfile has seriously been a real pain for us over the past couple months. They’re one of the most notorious filehost out there.

Fortunately, they have not permanently banned us just yet, so we’re not forced to drop it. However, if we DO get banned (permanently) by Hotfile in the future, we will NOT be able to support it again as it’s neither feasible nor practical to switch servers (and datacenters) because of a Hotfile ban.

Basically, if you see issues and kinks with Hotfile in the coming couple days, please don’t be surprised. We’re going to try and fix this issue somehow, although there is no guarantee of anything at this moment regarding Hotfile. Blame Hotfile for this. We would love to play fair, but Hotfile does not want to.


bookmark bookmark bookmark bookmark bookmark bookmark bookmark bookmark bookmark bookmark bookmark bookmark
tabs-top


22 Comments »

  1. Phinix (16 comments) Says:

    Well all i can is i hope things get sorted out. I really use hotfile links a lot, and it would be a real shame if rpnet had to drop support for it. Good luck.

    [Reply]

    comment-bottom
  2. meh (1 comments) Says:

    I have no idea how much this would cost or even if it’s possible, but what about buying a block of IP’s and somehow rotating the server addresses?

    [Reply]

    Hamza (250 comments) Reply:

    That’s quite pointless. Buying an IP block/subnet is not the issue. The problem is that when hotfile decides to ban it, all they have to do is ban the entire subnet and we’ll be back to step one – exactly where we started.

    [Reply]

    comment-bottom
  3. Darkwinter (7 comments) Says:

    Ahh sorry to hear this. Hotfile is one of the most popular service for now.. I hope RP won’t drop the HF.

    [Reply]

    comment-bottom
  4. Bob (1 comments) Says:

    Hey, a bit confused…

    Is it limited to x hotfile links per user per day

    or to x hotfile links simulaneously per user?

    cheers

    [Reply]

    Hamza (250 comments) Reply:

    At the moment, it’s 30 links per user per day. We’ll gradually change that limit.

    [Reply]

    comment-bottom
  5. Saman SarKo (9 comments) Says:

    Hi , Sorry to hear that , after RS failed , Hotfile is now on the lead beside FileServe , FileServe not works fine here , we have regenerate links over and over ..

    [Reply]

    comment-bottom
  6. Rits (5 comments) Says:

    I know this was coming. I got info from FS support that they have been banned by HF so no remote uploads. HF will take place of RS and seems we will have to buy HF account along with rpnet, eventually.

    [Reply]

    comment-bottom
  7. hahdi (13 comments) Says:

    would be really sad if hotfile would get dropped!

    most important host right now

    [Reply]

    comment-bottom
  8. Anshuman (5 comments) Says:

    My concern is that once you remove hotfile support the next most popular filehost(megaupload or netload) will face same download pressure and we could face problems from those filehosts also when it happens.

    [Reply]

    Hamza (250 comments) Reply:

    We won’t be removing Hotfile. We did think of it, but we know very well how crucial it is. We’re just gonna speed up on the HDD addon and make HF an HDD-only host once we have the addon. That will allow us to implement a queue system so we can specify a maximum number of links to process and then each batch is processed every X minutes to minimize or control load on Hotfile.

    Also, Hotfile has a history of being notorious. The most obvious/classic example is them having banned FileFactory’s servers and FileServe’s servers so as to prevent files being leeched there. They are basically going to go any lengths to preserve their position as one of the most popular filehost (which btw, is only because they offer cash in exchange).

    [Reply]

    comment-bottom
  9. Anshuman (5 comments) Says:

    For a start limit hotfile to 3gb a day and gradually keep on increasing it till we know what the most we can stretch it.

    [Reply]

    Hamza (250 comments) Reply:

    I’ve found a *possible* workaround that might give us 3 times the current ‘generation capacity’ before we get banned. Spanning over 3 servers, that’s 9 times. I’m waiting for Dman to get online and see how possible it is to actually implement it. We’ll raise download limit, obviously. We just need to trial and error with the new workaround.

    [Reply]

    comment-bottom
  10. Spazo (5 comments) Says:

    Don’t lose hot file even if it has to be limited,otherwise i think you will end up losing customers.

    [Reply]

    comment-bottom
  11. wincel (6 comments) Says:

    Will buying more HF accounts help?

    [Reply]

    comment-bottom
  12. Saman SarKo (9 comments) Says:

    Hi Hamza , is there any news about FileServe ??

    [Reply]

    comment-bottom
  13. Will (1 comments) Says:

    Hmmm, I signed up due to one of your staff extolling the virtues of RPNet on a public forum (http://forums.whirlpool.net.au/archive/1475864) but since I’ve signed up there have been several issues. I’m sorry guys, this is simply not good enough. It’s OK to say “RS did this” or “Hotfile did that” but the fact remains what I paid for is not what I’m getting. These are the kinds of contingencies that should have been planned for long ago.

    [Reply]

    Anshuman (5 comments) Reply:

    Will
    I agree that you did not get what was promised and I am sure that if you request for a refund Hamza will gladly provide you that and even with all the glitches this site is the best thing one can have for downloading from various filehosts.
    Have patience as you will not find anything better than this.

    [Reply]

    wincel (6 comments) Reply:

    @Will

    I think that your expectation that everything should run 100% all the time is unfair. I don’t think you will find any other services that would meet your level of expectations.

    The admins of rpnet have proven again and again that they’re up to the tasks of fixing problems.

    For hotfile, it’s certainly worked well previously, so the current issue is unexpected.

    Rpnet has an unenviable task of keeping over 10 hosts humming. It’s a tough job, so please give them time to fix the problems.

    Don’t forget that we’re paying only a fraction of what it would’ve cost if we subscribed to the hosters separately. What rpnet has offered so far has far exceeded my expectation of what I’ve paid for.

    Peace. :D

    [Reply]

    comment-bottom
  14. hahdi (13 comments) Says:

    there are cheaper hotfile accounts available for example @ebay.. you could try those

    is it possible to route the traffic through some socks/proxies?

    [Reply]

    comment-bottom
  15. DrLove (1 comments) Says:

    I am a user of a RDP (Remote Desktop) which is banned by HF. That’s why I bought an account with RPnet. Ironically one hour after signing up the download was limited to 30 links per day.

    [Reply]

    comment-bottom
  16. jayfella (3 comments) Says:

    Where there’s a will there’s a way. Im sure you guys will overcome the issue, which will probably be imitated along with the other providers if you dont..

    Im sure you guys can come up with a good way around it. If you need any help from my side you know its always there :)

    <3 JayFella

    [Reply]

    comment-bottom

RSS feed for comments on this post. TrackBack URL

Leave a comment

Spam Protection by WP-SpamFree