[22 July 2024] Spark.NET for .NET 9.0?

[GeorgeS2019]

Third party to Official library in .NET 9.0

Migration from a third party library to official System.Runtime.Serialization.Formatters

[15th July 2024]Spark.NET 3.5.1 for .NET 8.0 with No MessagePack serialization

$ spark-shell --version
Welcome to
      ____              __
     / __/__  ___ _____/ /__
    _\ \/ _ \/ _ `/ __/  '_/
   /___/ .__/\_,_/_/ /_/\_\   version 3.5.1
      /_/

Using Scala version 2.12.18, Java HotSpot(TM) 64-Bit Server VM, 1.8.0_211
Branch HEAD
Compiled by user heartsavior on 2024-02-15T11:24:58Z
Revision fd86f85e181fc2dc0f50a096855acf83a6cc5d9c
Url https://github.com/apache/spark
Type --help for more information.

For detail => #1178

• Extracted binary formatter in a separate class + tests

https://github.com/grazy27/spark/blob/main/docs/how-does-it-work.md

[16th April 2024]Spart.Net 3.2 for .NET 8.0 with MessagePack serialization

https://github.com/dbeavon/sparkdotnet

PR: Replace BinaryFormatter with MessagePack serialization

using a third party library: https://github.com/MessagePack-CSharp/MessagePack-CSharp

[30thAug2023] .NET for Apache Spark documentation will no longer be updated

[30thAug2023] .NET for Apache Spark documentation will no longer be updated

We're no longer updating the .NET for Apache Spark documentation, and have archived it to https://learn.microsoft.com/previous-versions/dotnet/spark/what-is-spark. As a result, we're closing all the active .NET for Apache Spark issues. I'm sorry we couldn't address your issue.

[grazy27]

I'll create a PR when my prev one is merged

[grazy27]

Since .NET9 is not LTS, it makes sense to wait for .net10 to upgrade

[wudanzy]

Agreed! Let's wait until .NET 10.