This thread will be utilized for updates as they are getting lost in the long thread:
We had the service running for about 3 hours and came under another attack. Our mitigation specialists are working on fixing the current attack and we should have an update for you shortly.
The systems that we were attempting to use to block the attacks were not sufficient enough and we are going to be implementing a new system over the next several hours. I would expect this would take a MINIMUM of 6 hours before you see anything and I will update you again with the status of that.
There's a very good chance it's some of our own players unknowingly attacking us, as we saw with the last DDOS as soon as we started banning large chunks of ip's that were attacking us we saw numerous threads start to crop up complaining of being unable to connect to the services. If you've installed any purported "map-hacks" "camera distance hacks" or anything else claiming these types of things and you're no longer able to connect to the network, it's very possible YOU yourself are attacking the network, please scan your pc for trojans, viruses, etc.
Last edited by Deejay; 05-26-2011 at 11:50 AM.
Golden Pebbles Update:
We will be extending the time this is available to account for the downtime we have been experiencing.
2:36 PM Update
We are continuing on implementing a new solution and will provide a further update once we have been able to test the viability of that solution.
6:33 PM Update
Some of the services are slowly being restored, some of you may actually be able to get in and play a game however it is not fully restored 100%, and will not be working for everyone. We are continuing to work on the problem, and yes the boxes are still being attacked and the software is mitigating the attack as we teach it what are valid requests and what aren't.
10:35 PM Update
Yes we know, there are still major issues, yes we are still working on them, unfortunately I cannot give you a firm ETA.
Chat is up, match making will be disabled for a bit.
Logging in: working fairly well
Creating games and joining games: Still buggy working on this before matchmaking is turned back on.
8:18 AM: More Informative Majorish Update
We have been working with a top networking firm on preventing DDOS traffic into our network, while this has been very successful part of the problem with working with a technology like this is you introduce a whole new network layer and have some pains in getting that ironed out and working perfectly in a complex environment.
We know some of you are having issues authorizing to game servers and match making we are still working on fixing that and will hopefully have those issues ironed out quickly.
Last edited by Toolz; 05-27-2011 at 02:20 PM.
Matchmaking is up and functioning for most people, there are still going to be some issues creating public games and some people who end up unintentionally blocked for short periods of time. If you are having issues logging in you should do an ipconfig/ flushdns to make sure you have the latest entries for the servers we are using now.
A traceroute to masterserver.hon.s2games.com should be pointing you to: 22.214.171.124 currently
Matchmaking is back down we are working on restoring that service along with all the other services.
4:06 PM EST
We are shutting down all servers at the moment to fix an issue. The game will not be playable at all for a short time.
Last night we had our system up and operating with activity as usual. At that time we were seeing hit and miss issues with stats submissions but everything else looked good.
Overnight, as many of the S2 staff working on this attempted to get some sleep, we began to see more issues. While stats were still spotty, the chatserver began to behave incorrectly. We are looking into this issue to get HoN operational again.
I understand that this entire situation has been a complete disaster. I am sure to many of you, this seems completely unacceptable and shows significant incompetence. I can assure you, that is not the case. The HoN system is anything but simple. In an attempt to protect the "wrong" kind of traffic from entering our system, it has caused us to change the way we do a number of things. This is causing the unforseen issues that crop up as we plug one hole, another pops up! Please accept my apologies and realize that we are more stressed about this situation than anyone. We are working as hard (and intelligently) as we can to remedy the issues.
Once things are operating as they should be, we will be running a 2X Coin Event to help ease the pain of the downtime.
HoN is semi-operational again. We are not out of the water just yet. However, we are making progress.
On a more positive note, we have confirmed the identity of the individual responsible for the criminal acts causing HoN's downtime. Even better news is the UK government takes these matters VERY seriously http://www.met.police.uk/pceu/ 10 years in prison for a "flag in a video game" seems pretty silly to me!
We are working with authorities there and expect to have justice soon!
10:05 PM Friday night EST
We are going to be applying a small client side patch to help some of the issues. This should happen soon and after that we will be patching servers. After that we should be much better off.
Will be at least 30 minutes before servers are operational. We will let you know.
Getting there, doing some tests on the servers to make sure what we put in will work correctly, then we have to patch it and we should be good to go.
Matchmaking is now online and we know the UI bug of it stuck at 0:00. We will be fixing that when we can, but it does work, so just be patient when you enter the queue.
We are still working on servers.
Had to turn off Matchmaking due to a Master Server error. Working on it, sorry. No ETA at the moment.
Pub games should be working again. DDOS continues but we are handling it. Server patch AT SOME POINT IN THE NEXT 100 YEARS. PROMISE.
Building and client and server patch to help solve the issues. Sadly, Mac and Linux versions are going to be behind the curve by at least 6 hours due to a porting problem. We are going to get them up over the weekend when we can, but this solution is better than no one being able to play the game.
Working on it.
We just patched with a load of fixes for clients and servers to stabalize everything and let us get through the weekend easily. Sadly, though, Mac and Linux versions will not be updated until tomorrow sometime due to a problem with porting some of the new code over. I would suggest, if you need to play, using wine/bootcamp/whatever to get a windows version for now. That or you wait until tomorrow.
Sorry, but this is better than zero people being able to play. We will do what we can quickly.