Server Crash

Hey,

i've a Problem with Glizer:
Sometimes the Server laggs after the Message "Saving banqueue" for 5-10 Minutes! Then all player lost connection and the server is not available!

Here is the Log-File ( Without Debug ):

Code:

2012-05-03 16:24:32 [INFO] [glizer] Saving banqueue
2012-05-03 16:44:31 [INFO] GroupManager - INFO -  Data files refreshed.
2012-05-03 16:44:31 [INFO] Connection reset
2012-05-03 16:44:31 [INFO] Read timed out
16:44:31 [SEVERE] java.net.SocketException: Datenübergabe unterbrochen (broken pipe)
16:44:31 [INFO] Connection reset
16:44:31 [SEVERE]       at java.net.SocketOutputStream.socketWrite0(Native Method)
16:44:31 [SEVERE]       at java.net.SocketOutputStream.socketWrite(Unknown Source)
16:44:31 [SEVERE]       at java.net.SocketOutputStream.write(Unknown Source)
16:44:31 [SEVERE]       at java.io.BufferedOutputStream.flushBuffer(Unknown Source)
16:44:31 [SEVERE]       at java.io.BufferedOutputStream.flush(Unknown Source)
16:44:31 [SEVERE]       at java.io.DataOutputStream.flush(Unknown Source)
16:44:31 [SEVERE]       at net.minecraft.server.NetworkWriterThread.run(SourceFile:103)
16:44:31 [SEVERE] java.net.SocketException: Datenübergabe unterbrochen (broken pipe)
16:44:31 [SEVERE]       at java.net.SocketOutputStream.socketWrite0(Native Method)
16:44:31 [SEVERE]       at java.net.SocketOutputStream.socketWrite(Unknown Source)
16:44:31 [SEVERE]       at java.net.SocketOutputStream.write(Unknown Source)
16:44:31 [SEVERE]       at java.io.BufferedOutputStream.flushBuffer(Unknown Source)
16:44:31 [SEVERE]       at java.io.BufferedOutputStream.flush(Unknown Source)
16:44:31 [SEVERE]       at java.io.DataOutputStream.flush(Unknown Source)
16:44:31 [SEVERE]       at net.minecraft.server.NetworkWriterThread.run(SourceFile:103)
16:44:31 [INFO] userXX lost connection: disconnect.endOfStream
16:44:31 [INFO] userXX lost connection: disconnect.endOfStream
16:44:31 [INFO] userXX lost connection: disconnect.endOfStream
16:44:31 [INFO] userXX lost connection: disconnect.endOfStream
16:44:31 [INFO] [Global][VIP] userXX :lasst mal mad in ruhe wenn ihr son mist baut :/
16:44:31 [INFO] userXX lost connection: disconnect.endOfStream
16:44:31 [INFO] userXX lost connection: disconnect.endOfStream
16:44:31 [WARNING] Can't keep up! Did the system time change, or is the server overloaded?
16:44:31 [INFO] /176.xx.xx.8:33415 lost connection
16:44:31 [INFO] /87.xx.xx.196:52513 lost connection
16:44:31 [INFO] /84.xx.xx.232:28202 lost connection
16:44:31 [INFO] /213.xx.xx.162:52339 lost connection
16:44:31 [INFO] /217.xx.xx.194:49803 lost connection
16:44:31 [INFO] /77.xx.xx.165:25716 lost connection
16:44:31 [INFO] /84.xx.xx.125:60397 lost connection
16:44:31 [INFO] /79.xx.xx.197:55154 lost connection
16:44:31 [INFO] /87.xx.xx.196:52609 lost connection

Since i've had this Problem three times, i've enabled the Debug-Mode but since this time, the error don't came again. But i've some Errors in the Log-File after the "Saving banqueue" Message:

Error 1
( I've deleted the banqueue.json File - The Plugin creates it again: Same Error! )

Code:

2012-05-04 21:19:16 [INFO] [glizer] Saving banqueue
2012-05-04 21:19:16 [INFO] url_req ip_userabc=37.24.100.248&ip_userabc=79.208.52.42&users=userabc%2CMrSt0ne%2Cuserabc%2Cuserabc&ip_userabc=84.151.225.109&ticks=19.9860097931448&account=server&exec=heartbeat&ip_userabc=79.193.36.9&ip=1.1.1.1
2012-05-04 21:19:16 [INFO] [glizer] {"response":"ok","whitelist":"0"}
2012-05-04 21:19:16 [SEVERE] org.json.JSONException: JSONObject["error"] not found.
2012-05-04 21:19:16 [SEVERE]    at org.json.JSONObject.get(JSONObject.java:456)
2012-05-04 21:19:16 [SEVERE]    at org.json.JSONObject.getInt(JSONObject.java:516)
2012-05-04 21:19:16 [SEVERE]    at com.beecub.util.bConnector.checkResult(bConnector.java:128)
2012-05-04 21:19:16 [SEVERE]    at com.beecub.util.bTimer.heartbeat(bTimer.java:71)
2012-05-04 21:19:16 [SEVERE]    at com.beecub.util.bTimer.run(bTimer.java:29)
2012-05-04 21:19:16 [INFO] [glizer] ok
2012-05-04 21:19:16 [INFO] [glizer] Heartbeat, Online Players: 4

Error 2

Code:

2012-05-04 21:40:16 [INFO] [glizer] Saving banqueue
2012-05-04 21:40:16 [INFO] url_req users=userabc%2Cuserabc%2Cuserabc&ip_userabc=84.xx.xx.109&ip_userabc=91.52.187.25&ticks=20.026033843997197&account=server&exec=heartbeat&ip_userabc=79.193.36.9&ip=1.1.1.1
2012-05-04 21:40:16 [INFO] [glizer] 19.99400179946016 ticks
2012-05-04 21:40:16 [SEVERE] java.io.IOException: Server returned HTTP response code: 504 for URL: http://api.glizer.de/********ce05be80a3a388fc5b3af8/
2012-05-04 21:40:16 [SEVERE]    at sun.net.www.protocol.http.HttpURLConnection.getInputStream(Unknown Source)
2012-05-04 21:40:16 [SEVERE]    at com.beecub.util.bConnector.APIRequest(bConnector.java:67)
2012-05-04 21:40:16 [SEVERE]    at com.beecub.util.bConnector.hdl_com(bConnector.java:26)
2012-05-04 21:40:16 [SEVERE]    at com.beecub.util.bTimer.heartbeat(bTimer.java:70)
2012-05-04 21:40:16 [SEVERE]    at com.beecub.util.bTimer.run(bTimer.java:29)
2012-05-04 21:40:16 [WARNING] [glizer] Error on request from API
2012-05-04 21:40:16 [WARNING] [glizer] Receiving data failed
2012-05-04 21:40:16 [INFO] [glizer] A JSONObject text must begin with '{' at 1 [character 2 line 1]
2012-05-04 21:40:16 [INFO] [glizer] Error - server connection failed, aborting actions
2012-05-04 21:40:16 [INFO] [glizer] Heartbeat: Status unkown
2012-05-04 21:40:16 [INFO] [glizer] Heartbeat failed. Trying again in 1h

EDIT 1 / 06.06.2012 14:46:
I think I can narrow down the problem a bit: It always occurs after the function "[glizer] Saving banqueue" on. The server continues to run, is accessible from the outside, but all users lose the connection and can not reconnect to the server! This only changes when you type something on the console, so the server again "wake up".

If I use the debug mode, the problem is not on - I think that comes through the logged ticks every 10 seconds.



I hope someone can help me!


Blackbird_89

Ps: Sry for my bad english

 

AW: Server Crash

okay my 1 post

Is your Server an root server or an managed server by an gameserver - provider?

In your log stands, that the system is possible overloaded. How many RAM has your system - it is to low?

Glizer would connect to the glizer main server, but can not connect. Can you please add anyone as your frind to see if your server can gennerally connect to the Glizer main server. Is your Server marked as online and can you see who is online?

When 1 of my ideas are sucesfully, your server can connect and the problem is on your server.
Is the plugin up to date? yes the best ask

"[SEVERE] org.json.JSONException: JSONObject["error"] not found." Has your server rights to write to this file?

Blocked any firewall connections to port 80? because glizer will open an URL and become an response code 504 (an error) . That say us, that the gateway have not Responded in the required time, that say your connection is closed by server, blocked or the glizer server was down :S

i hope i can help you with this

Knight

 

AW: Server Crash

in the logfile #1 glizer reports, that everything is fine. Debugmode is exactly the same as non-debug mode except the debug messages. So it doesn't look like its from glizer.

in logfile #2 it looks like the api was down for a few secs.

however, everything from glizer is in another thread - so it cant affect your main-game-thread. You're the first person with such a problem.

 

Re: AW: Server Crash

Hey,

thanks for you answers.

I've a root server running with Debian 6.0.
The used Java-Version is 1.7 (build 1.7.0_03-b04)
Glizer-Version: Version 2.2 for Java 1.7
Bukkit-Version: 1.2.5 RC
Hardware: AMD Athlon™ II X4 / 8GB Ram (Java VM has 6GB available, but it never used more then 20% ) (Link)

Glizer is sucessfully connected with the Network: Link

Everytime i start the Server i use "chown -R user:group *" - This must be Okay. I've tried to delete the file, but it creates themself new and throw the exception again!

I've blocked all incoming connections with iptables, only the MC/Dynmap Port is open. Outgoing Connections are not blocked!

Before I recorded Glizer, I had no such problems. And the problem ALWAYS occurs after "Saving banqueue" on. Something Glizer makes between "Saving banqueue" and "ok" which is why the server is causing problems.


Perhaps there is a problem with java 1.7?


Best Regards

Blackbird_89

 

AW: Server Crash

we're running java 1.7 on our platform, and everything is working perfectly for us. Are you using a beta build of java 1.7?

We're running Glizer on our machines using:
java version "1.7.0_03-icedtea"
OpenJDK Runtime Environment (IcedTea7 2.1) (7~u3-2.1-3)
OpenJDK 64-Bit Server VM (build 22.0-b10, mixed mode)

and
java version "1.6.0_26"
Java(TM) SE Runtime Environment (build 1.6.0_26-b03)
Java HotSpot(TM) 64-Bit Server VM (build 20.1-b02, mixed mode)

fyi: the debug message "[SEVERE] org.json.JSONException: JSONObject["error"] not found." is absolutely normal. If there is no error the server will not send one to the plugin - so the object "error" is not found :) - w/o debug mode this message is catched and deleted.


Did you try to delete the glizer folder in your plugins dir? maybe your banbackup file is broken or your firewall is blocking/throttling the connection to the server.

 

Re: AW: Server Crash

Hey,
I do not think I did a beta build was loaded, but I've just downloaded the latest version of Oracle:

Java(TM) SE Runtime Environment (build 1.7.0_04-b20)
Java HotSpot(TM) 64-Bit Server VM (build 23.0-b21, mixed mode)

I will test the new version and see if the problem persists.

I deleted the entire folder to create new and ever have - this has not helped overall it works well. Only every $ x hours on this problem occurs. In between there are long time no errors and also "Saving banqueue" works perfectly



Best Regards

Blackbird_89

 

Re: Server Crash

Hey,

Over 60 hours, everything runs perfectly and then this:

Code:

[2012-05-13 09:32:39]userabc [/95.*.*.236:51294] logged in with entity id 281737 at ([World] -205.25580445768514, 61.0, 90.57516763679361)
[B][2012-05-13 09:32:39]url_req username=userabc&relation=-200&account=server&exec=login&ip=1.1.1.1[/B]
[2012-05-13 09:36:17][glizer] {"name":"userabc","nickname":"","realname":"","age":"0","status":"","mehr":"","lastip":"95.*.*.209","locip":"","reputation":"0","userreputation":"0","lastserver":"893","lastseen":"1336831195","developer":"0","profilepic":"","profileviews":"6","deleted":"0","allowmail":"1","disable_relation":"0","relation":0,"shared":0,"localglobal":"0","global":0,"local":0,"tempglobal":0,"templocal":0,"banned":false,"whitelisted":0,"token":"","iplock":false}
[2012-05-13 09:36:17]url_req username=murmel1610&account=server&exec=ip&userip=95.*.*.236&ip=1.1.1.1
[2012-05-13 09:36:17][glizer] {"response":"ok"}
[2012-05-13 09:36:17]userabclost connection: disconnect.endOfStream
[2012-05-13 09:36:17]/95.*.*.*:51297 lost connection
[2012-05-13 09:36:17]/79.*.*.244:50664 lost connection
[2012-05-13 09:36:17]/79.*.*.244:50665 lost connection
[2012-05-13 09:36:17]/77.*.*.21:49505 lost connection
[2012-05-13 09:36:17]/84.*.*.145:49648 lost connection
[2012-05-13 09:36:17]/188.*.*.81:50542 lost connection
[2012-05-13 09:36:17]/87.*.121.*:49815 lost connection

This time the crash was not in "Saving banque" but when a user joins and requests a URL for profile data. The new Java version seems to have little effect, but is still not quite perfect, though this is a very good improvement already!


Best Regards

Blackbird_89

 

AW: Server Crash

It took 4 minutes to complete the glizer request...
seems like your internet connection is really f**ed up. Where is your server located? China? Could it be, that the routing to europe is nearly impossible?

 

Re: AW: Server Crash

Hey,

The Server is located in Straßburg,France! The ServerHoster is Server4You

EDIT: Hostname for Ping/Trace Test: server.blackzone-community.de