Servers crashing

zackychuu

zackychuu

TD Admin / Wanker
Earlier today I was called into Toronto #2 about an Aimbotter, as I was joining the server crashed.
I was told that it had been happening a lot, and it happened another 2-3 times while I was there.

I closed all the servers and ran an update, just to check.
Restarted them all again and carried on playing...nothing happened for about half an hour.
I've just gone to dinner and came back to find out that the servers have crashed another 3 times while I was gone.

I haven't tested any of the other servers, but I can only assume that because they are so empty, the same is happening there as well.
Gatherix Low Budget Shotgun Jesus


HappySticks™ and kath told me about the recent crashes.
Do you guys know how long it has been going on for, or have any other information?
 
HappySticks™

HappySticks™

TD Admin
Right before you swung the ban hammer after I called you in for the aimbotter it crashed; lol.
Kanna and kath told me the crashes started around 3:00 pm EST yesterday but I was on from 4-7 pm EST and there were no problems.
Today though starting around 5:30 am EST it was crashing and so on throughout the afternoon around 15 times total for myself personally.
After zackychuu restarted/updated the servers it was fine for awhile and we managed to build it up to 27 players until it derped again.

:rip:

(2:42 pm) Edit: Just crashed.
(2:44 pm) Edit: Just crashed.
(2:47 pm) Edit: Just crashed.
 
kath

kath

Spycrab Queen
it crashed 3 times while i was in. first time not sure but second it was Zacky trying to fix it. then 2 more times after that..
it was crashing alot last night too it was about 7 pm my time for the first crash then 30 mins later and 30 mins after another 2 times
i hope it gets fixed soon <3
 
kath

kath

Spycrab Queen
ohh i forgot to add that i after it crashed the 3rd time i rejoined it crashed the second i got in lol and just did it to be this very minute.
its a crash re crash its what i call it :D
 
Gatherix

Gatherix

Death by Darkly
Low Budget said:
Gatherix Maybe there is a new crash exploit that we don't know about?
Click to expand...

Possibly. I recently enabled SMAC and updated it to the latest version available via Updater - SMAC's devs are currently in a legal dispute and aren't permitted to provide any sort of download version, so the SMAC we have is still an old one. It's dispensing the occasional error, so for now I've disabled it. Let me know if you guys see a difference.

MOTDgd is still spamming the error logs; most of its issues are just due to a dysfunctional and poorly-written plugin. That's why it 'drops' a bunch of impressions. I wouldn't be surprised if it's creating another backend problem - when can we start on Pinion?
 
kath

kath

Spycrab Queen
i didnt get any lag on #5 when i was on to mute a guy for spamming the mic and my admin stuff work ok in game its just not on here i get a error
 
Khârn the Betrayer

Khârn the Betrayer

DARKLY Regular
Was on Toronto #2 earlier today for a while, and it crashed around 3 times while I was there. I can't remember the EXACT times of all the crashes but it was pretty regular and one of them was around 1:45pm GMT.

Tick Tock Man was also on at the time and may be able to be more helpful!

EDIT: I was for a long while too and it was fine for the most part, the crashes seemed to take place around early afternoon for me, which I find kind of strange since everything seemed fine beforehand.
 
Low Budget

Low Budget

DGN Staff
Staff member
Khârn the Betrayer said:
Was on Toronto #2 earlier today for a while, and it crashed around 3 times while I was there. I can't remember the EXACT times of all the crashes but it was pretty regular and one of them was around 1:45pm GMT.

Tick Tock Man was also on at the time and may be able to be more helpful!

EDIT: I was for a long while too and it was fine for the most part, the crashes seemed to take place around early afternoon for me, which I find kind of strange since everything seemed fine beforehand.
Click to expand...

Reaks of the possibility of someone deliberately crashing the servers via an exploit or something. If this was a server problem, it would be crashing all the time, not work fine all day and all of a sudden start crashing.
The CSGO server is not affected by these crashes so it's not an attack on the entire box.
If you guys can start recording the times of the crashes and maybe Gatherix can look at the logs and see if there are any errors during that time.

Posted using dat Q10
 
HappySticks™

HappySticks™

TD Admin
Gatherix
I just noticed this and it appears to be spamming everyones console, I also consulted with Tick Tock Man and he said it could potentially be an issue: control point 3 for effect 'cart_flashinglight'. Cannot update control point 3 for effect 'cart_flashinglight'.

(2:32 pm) Edit: Just crashed.
 
zackychuu

zackychuu

TD Admin / Wanker
Low Budget said:
The CSGO server is not affected by these crashes so it's not an attack on the entire box.
Click to expand...

This was my thought too, if it was a box issue then the CS:GO server would get hit.
It also seems to be localised to just #2, the other 5 servers are fine.

Unless someone has seen the other servers crashing as well?
 
Khârn the Betrayer

Khârn the Betrayer

DARKLY Regular
Have this in my console when I join #2.

Team Fortress
Map: trade_plaza
Players: 4 / 32
Build: 2070272
Server Number: 1

ConVarRef sr_checker_version doesn't point to an existing ConVar
SetConVar: No such cvar ( sr_checker_version set to 1.1.2), skipping
The server is using sv_pure 0. (Enforcing consistency for select files only)

Zacky said that ConVar is the server settings? Either way it could be something, or it's just nothing but.. yeah. Server crashed again earlier and Happy said he edited his other post with the time. I saw the red text at the top right aswell and hit my fraps so I have that uploading now.. although I'm not sure if it'll be much help.
 
Gatherix

Gatherix

Death by Darkly
HappySticks™ said:
It's not all the servers that crashed though this time; only #2.

(3:36 pm) Edit: Just crashed.
(4:10 pm) Edit: Just crashed.
Click to expand...

The backend setup for each server should be identical. If its only one server crashing it strongly suggests the attacks LB is suggesting, though human error in the configs of perfermance/leak issues could also be culprit.

I'm busy this week, and all of the above theories would require some troubleshooting, so I won't be able to look into it until the weekend. In the meantime, please follow LB's suggestion: record the exact time whenever a crash happens, in addition to any common variables (e.g. number of players) or abnormalities (a suspicious player, odd console/chat messages, etc) and send me the results in a private message.

Khârn the Betrayer, the errors in the console are nornal and are just due to the map and some erroneous plugins. They shouldn't be affecting anything.

Low Budget, if its OK with you, I may want to setup some sort of logging bash script on the server box when I start working on the problem.
 
You must log in or register to reply here.
Top