Cyrillic is not supported?

[vasylmykytiuk]

Hey,

Please help me understand how to fix this if it's possible:
I'm trying to get my list of contacts, but those with cyrillic in names are with "???" symbols.
I know I can use profile object, but for the other contacts both name and profile.givenName are with "???" symbols.

{
   "jsonrpc":"2.0",
   "result":[
      {
         "number":"+<number>",
         "uuid":"123",
         "name":"?????? ????????",
         "color":null,
         "isBlocked":false,
         "messageExpirationTime":0,
         "profile":{
            "lastUpdateTimestamp":1672555170789,
            "givenName":"Vasyl",
            "familyName":"Mykytiuk",
            "about":null,
            "aboutEmoji":null,
            "mobileCoinAddress":null
         }
      }
   ],
   "id":2
}

The same is when someone wrote me a message in cyrillic ('тест' was the sent message):

{
  "jsonrpc": "2.0",
  "method": "receive",
  "params": {
    "envelope": {
      "source": "+<number>",
      "sourceNumber": "+<number>",
      "sourceUuid": "123",
      "sourceName": "",
      "sourceDevice": 1,
      "timestamp": 1672936130960,
      "dataMessage": {
        "timestamp": 1672936130960,
        "message": "????",           <<<<<< ---- there should be 'тест'
        "expiresInSeconds": 0,
        "viewOnce": false
      }
    },
    "account": "+<number>",
    "subscription": 0
  }
}

[AsamK]

All unicode characters, which includes cyrillic are supported. You need to check that you're using UTF-8 encoding for reading and writing messages (not ASCII or some 8-bit local encoding).

[vasylmykytiuk]

Looks like it's correctly configured everything to use UTF-8 without BOM:

private ProcessStartInfo GetProcessStartInfo()
    {
        var encoding = new UTF8Encoding(false);

        var cliProcessInfo = new ProcessStartInfo(Options.CliPath)
        {
            Arguments = $"-a {_account.Number} {SignalCliCommands.JsonRpc}",
            RedirectStandardInput = true,
            RedirectStandardOutput = true,
            RedirectStandardError = true,
            UseShellExecute = false,
            CreateNoWindow = true,
            StandardErrorEncoding = encoding,
            StandardInputEncoding = encoding,
            StandardOutputEncoding = encoding
        };
        return cliProcessInfo;
    }

    private JsonRpc GetJsonRpc()
    {
        ProcessStartInfo cliProcessInfo = GetProcessStartInfo();
        Process cliProcess = Process.Start(cliProcessInfo)!;

        var formatter = new JsonMessageFormatter(new UTF8Encoding(false));

        var messageHandler = new NewLineDelimitedMessageHandler(
            cliProcess.StandardInput.BaseStream,
            cliProcess.StandardOutput.BaseStream,
            formatter)
        {
            NewLine = NewLineDelimitedMessageHandler.NewLineStyle.Lf
        };

        var jsonRpc = new JsonRpc(messageHandler);

        jsonRpc.AddLocalRpcMethod(SignalCliCommands.Receive, new Action<JsonEnvelope, string, int>(DataMessageReceived));
        jsonRpc.StartListening();

        return jsonRpc;
    }

And it behaves the same when using cmd.exe directly...
Any clue what might be wrong? Is it Windows-specific for the command-line?

[vasylmykytiuk]

Changing active code page using chcp command didn't help:
cmd.exe /c chcp 65001 > nul && cmd /c "signal-cli.bat -a +<number> jsonRpc"

Also, setting UTF-8 encoding for StandardOutputEncoding didn't help too.

I resolved it by changing the signal-cli.bat file by adding -Dfile.encoding=UTF-8:
"%JAVA_EXE%" %DEFAULT_JVM_OPTS% %JAVA_OPTS% %SIGNAL_CLI_OPTS% -Dfile.encoding=UTF-8 -classpath "%CLASSPATH%" org.asamk.signal.Main %*