[help]System.IO.IOException: Unable to write data to the transport connection: Broken pipe

[saber-wang]

I use the direct forwarding function and provide a customized HttpContent to send messages.
Broken pipe occasionally appears at runtime, and the remote server also displays the shutdown log. What might cause this problem?

Server log:

 caught exception while handling client http traffic, closing connection Netty4HttpChannel{localAddress=/172.19.80.191:9200, remoteAddress=/172.19.80.72:7447}
io.netty.handler.codec.DecoderException: java.lang.NullPointerException: Cannot load from object array because "this.components" is null
        at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:280) ~[netty-codec-4.1.49.Final.jar:4.1.49.Final]
        at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) [netty-transport-4.1.49.Final.jar:4.1.49.Final]
        at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) [netty-transport-4.1.49.Final.jar:4.1.49.Final]
        at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) [netty-transport-4.1.49.Final.jar:4.1.49.Final]
        at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) [netty-handler-4.1.49.Final.jar:4.1.49.Final]
        at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) [netty-transport-4.1.49.Final.jar:4.1.49.Final]
        at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) [netty-transport-4.1.49.Final.jar:4.1.49.Final]
        at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) [netty-transport-4.1.49.Final.jar:4.1.49.Final]
        at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:103) [netty-codec-4.1.49.Final.jar:4.1.49.Final]
        at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) [netty-transport-4.1.49.Final.jar:4.1.49.Final]
        at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) [netty-transport-4.1.49.Final.jar:4.1.49.Final]
        at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) [netty-transport-4.1.49.Final.jar:4.1.49.Final]
        at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) [netty-transport-4.1.49.Final.jar:4.1.49.Final]
        at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) [netty-transport-4.1.49.Final.jar:4.1.49.Final]
        at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) [netty-transport-4.1.49.Final.jar:4.1.49.Final]
        at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) [netty-transport-4.1.49.Final.jar:4.1.49.Final]
        at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) [netty-transport-4.1.49.Final.jar:4.1.49.Final]
        at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) [netty-transport-4.1.49.Final.jar:4.1.49.Final]
        at io.netty.channel.nio.NioEventLoop.processSelectedKeysPlain(NioEventLoop.java:615) [netty-transport-4.1.49.Final.jar:4.1.49.Final]
        at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:578) [netty-transport-4.1.49.Final.jar:4.1.49.Final]
        at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) [netty-transport-4.1.49.Final.jar:4.1.49.Final]
        at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) [netty-common-4.1.49.Final.jar:4.1.49.Final]
        at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) [netty-common-4.1.49.Final.jar:4.1.49.Final]
        at java.lang.Thread.run(Thread.java:832) [?:?]
Caused by: java.lang.NullPointerException: Cannot load from object array because "this.components" is null
        at io.netty.buffer.CompositeByteBuf.toComponentIndex0(CompositeByteBuf.java:911) ~[netty-buffer-4.1.49.Final.jar:4.1.49.Final]
        at io.netty.buffer.CompositeByteBuf.addFlattenedComponents(CompositeByteBuf.java:482) ~[netty-buffer-4.1.49.Final.jar:4.1.49.Final]
        at io.netty.handler.codec.ByteToMessageDecoder$2.cumulate(ByteToMessageDecoder.java:132) ~[netty-codec-4.1.49.Final.jar:4.1.49.Final]
        at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:274) ~[netty-codec-4.1.49.Final.jar:4.1.49.Final]

[samsp-msft]

Wow, that's a lot of code to read, is not directly related to YARP, and it's too much for google translate in one chunk so i don't understand the comments, so I am bit lost as to what exactly you are trying to do.

Can you step back a bit and provide some more context on what you are trying to do? The exception is from Netty on Java, and is that the client or server?

[saber-wang]

@samsp-msft
Yes, it should have nothing to do with Yarp, so I put it in the discussion.
Netty is the server.

Comments in the code are not important.

This is the agent from skywalking to es. Here is the code processed by the es bulk interface.

In general, it is to judge whether the index meets the expectation. If it meets the expectation, it will read the next row and get 'tags_raw_data' from it.
After parsing, it will modify the index name and write

Bulk protocol example

{ "index" : { "_index" : "sw_log_1124", "_id" : "1" } }
{ "field1" : "value1","tags_raw_data":"ChEKCHRlc3QxS2V5EgV0ZXN0MQoRCgh0ZXN0MktleRIFdGVzdDIKEQoIdGVzdDNLZXkSBXRlc3QzChEKCHRlc3Q0S2V5EgV0ZXN0NAoRCgh0ZXN0NUtleRIFdGVzdDUKEQoIdGVzdDZLZXkSBXRlc3Q2ChEKCHRlc3Q3S2V5EgV0ZXN0NwoRCgh0ZXN0OEtleRIFdGVzdDgKEQoIdGVzdDlLZXkSBXRlc3Q5ChMKCXRlc3QxMEtleRIGdGVzdDEwChMKCXRlc3QxMUtleRIGdGVzdDExChMKCXRlc3QxMktleRIGdGVzdDEyChMKCXRlc3QxM0tleRIGdGVzdDEz" }
{ "create" : { "_index" : "sw_log_1124", "_id" : "3" } }
{ "field1" : "value3","tags_raw_data":"ChAKB2xvZ2NvZGUSBXRlc3QxCiYKD2FwcGxpY2F0aW9ubmFtZRITdGVzdGFwcGxpY2F0aW9ubmFtZQoRCgh0ZXN0M0tleRIFdGVzdDMKEQoIdGVzdDRLZXkSBXRlc3Q0CgoKCHRlc3Q1S2V5ChEKCHRlc3Q2S2V5EgV0ZXN0NgoRCgh0ZXN0N0tleRIFdGVzdDcKEQoIdGVzdDhLZXkSBXRlc3Q4ChEKCHRlc3Q5S2V5EgV0ZXN0OQoTCgl0ZXN0MTBLZXkSBnRlc3QxMAoTCgl0ZXN0MTFLZXkSBnRlc3QxMQoTCgl0ZXN0MTJLZXkSBnRlc3QxMgoTCgl0ZXN0MTNLZXkSBnRlc3QxMw==" }
{ "index" : { "_index" : "sw_log_1124", "_id" : "1" } }
{ "field1" : "value1","tags_raw_data":"ChEKCHRlc3QxS2V5EgV0ZXN0MQoRCgh0ZXN0MktleRIFdGVzdDIKEQoIdGVzdDNLZXkSBXRlc3QzChEKCHRlc3Q0S2V5EgV0ZXN0NAoRCgh0ZXN0NUtleRIFdGVzdDUKEQoIdGVzdDZLZXkSBXRlc3Q2ChEKCHRlc3Q3S2V5EgV0ZXN0NwoRCgh0ZXN0OEtleRIFdGVzdDgKEQoIdGVzdDlLZXkSBXRlc3Q5ChMKCXRlc3QxMEtleRIGdGVzdDEwChMKCXRlc3QxMUtleRIGdGVzdDExChMKCXRlc3QxMktleRIGdGVzdDEyChMKCXRlc3QxM0tleRIGdGVzdDEz" }

[samsp-msft]

This is the repo for YARP so I am confused as to why you are asking questions here about something that I am not understanding the relation to the reverse proxy functionality which is what this repo is for?

[saber-wang]

Sorry, maybe I should go to stackhoverflow to ask this question,You can delete this questionヾ(•ω•`)o

[Tratcher]

Yes, Stackoverflow would be a better location for this.