Broken connection stream causes multiple errors on the agent and CMR

Description

We are seeing a lot of exceptions like:

1 2018-09-18 23:43:58,430: 385187 [ Server] INFO all.minlog.MinlogToSLF4JLogger - kryonet: Connection 33 connected: /10.127.126.40 2018-09-18 23:43:58,895: 385652 [ervice-thread-1] WARN tExtendedByteBufferInputStream - Socket read runnable can not get the empty buffer to write to, aborting read. 2018-09-18 23:44:01,529: 388286 [ Server] ERROR all.minlog.MinlogToSLF4JLogger - kryonet: Error reading TCP from connection: Connection 33 com.esotericsoftware.kryo.KryoException: Buffer underflow. Serialization trace: timerData (rocks.inspectit.shared.all.communication.data.InvocationSequenceData) nestedSequences (rocks.inspectit.shared.all.communication.data.InvocationSequenceData) nestedSequences (rocks.inspectit.shared.all.communication.data.InvocationSequenceData) at com.esotericsoftware.kryo.io.Input.require(Input.java:181) at com.esotericsoftware.kryo.io.Input.skip(Input.java:137) at com.esotericsoftware.kryo.io.InputChunked.nextChunks(InputChunked.java:85) at rocks.inspectit.shared.all.serializer.impl.CustomCompatibleFieldSerializer.read(CustomCompatibleFieldSerializer.java:208) at com.esotericsoftware.kryo.Kryo.readObject(Kryo.java:679) at com.esotericsoftware.kryo.serializers.ObjectField.read(ObjectField.java:106) at rocks.inspectit.shared.all.serializer.impl.CustomCompatibleFieldSerializer.read(CustomCompatibleFieldSerializer.java:207) at rocks.inspectit.shared.all.serializer.impl.InvocationSequenceCustomCompatibleFieldSerializer.read(InvocationSequenceCustomCompatibleFieldSerializer.java:40) at rocks.inspectit.shared.all.serializer.impl.InvocationSequenceCustomCompatibleFieldSerializer.read(InvocationSequenceCustomCompatibleFieldSerializer.java:16)

Other types of the errors could be related to this. Seems that sending of the bytes from the agent to the CMR is sometimes out-of-order.

Environment

None

Status

Assignee

Ivan Senic

Reporter

Ivan Senic

Labels

None

Pull Request

None

Integrator

None

Sprint

Fix versions

Affects versions

1.8.5

Priority

Highest
Configure