[doc] Recommended Engines

apache · Apr 23, 2024 · 303342e · 303342e
1 parent 8b1f91e
commit 303342e
Showing 1 changed file with 48 additions and 12 deletions.
diff --git a/docs/content/engines/overview.md b/docs/content/engines/overview.md
@@ -28,18 +28,54 @@ under the License.
 
 ## Compatibility Matrix
 
-|                                     Engine                                      |    Version    | Batch Read | Batch Write | Create Table | Alter Table | Streaming Write | Streaming Read | Batch Overwrite |
-|:-------------------------------------------------------------------------------:|:-------------:|:----------:|:-----------:|:------------:|:-----------:|:---------------:|:--------------:|:---------------:|
-|                                      Flink                                      |  1.15 - 1.19  |     ✅      |      ✅      |      ✅       |  ✅(1.17+)   |        ✅        |       ✅        |        ✅        |
-|                                      Spark                                      |   3.1 - 3.5   |     ✅      |      ✅      |      ✅       |      ✅      |        ✅        |    ✅(3.3+)     |        ✅        |
-|                                      Hive                                       |   2.1 - 3.1   |     ✅      |      ✅      |      ✅       |      ❌      |        ❌        |       ❌        |        ❌        |
-|                                      Trino                                      |   422 - 426   |     ✅      |      ❌      |      ❌       |      ❌      |        ❌        |       ❌        |        ❌        |
-|                                      Trino                                      |   427 - 439   |     ✅      |      ❌      |      ✅       |      ✅      |        ❌        |       ❌        |        ❌        |
-|                                     Presto                                      | 0.236 - 0.280 |     ✅      |      ❌      |      ✅       |      ✅      |        ❌        |       ❌        |        ❌        |
-| [StarRocks](https://docs.starrocks.io/docs/data_source/catalog/paimon_catalog/) |     3.1+      |     ✅      |      ❌      |      ❌       |      ❌      |        ❌        |       ❌        |        ❌        |
-|     [Doris](https://doris.apache.org/docs/lakehouse/multi-catalog/paimon/)      |     2.0+      |     ✅      |      ❌      |      ❌       |      ❌      |        ❌        |       ❌        |        ❌        |
-
-Recommended versions are Flink 1.17.2, Spark 3.5.0, Hive 2.3.9
+|                                     Engine                                      |    Version    | Batch Read  | Batch Write  | Create Table | Alter Table  | Streaming Write  | Streaming Read | Batch Overwrite  | DELETE & UPDATE  | MERGE INTO  |
+|:-------------------------------------------------------------------------------:|:-------------:|:-----------:|:------------:|:------------:|:------------:|:----------------:|:--------------:|:----------------:|:----------------:|:-----------:|
+|                                      Flink                                      |  1.15 - 1.19  |     ✅      |      ✅      |      ✅       |  ✅(1.17+)   |        ✅        |       ✅        |        ✅        |    ✅(1.17+)      |      ❌     |
+|                                      Spark                                      |   3.1 - 3.5   |     ✅      |   ✅(3.3+)   |      ✅       |      ✅      |      ✅(3.3+)    |    ✅(3.3+)     |      ✅(3.3+)    |     ✅(3.2+)      |   ✅(3.2+)  |
+|                                      Hive                                       |   2.1 - 3.1   |     ✅      |      ✅      |      ✅       |      ❌      |        ❌        |       ❌        |        ❌        |         ❌        |      ❌     |
+|                                      Trino                                      |   422 - 426   |     ✅      |      ❌      |      ❌       |      ❌      |        ❌        |       ❌        |        ❌        |         ❌        |      ❌     |
+|                                      Trino                                      |   427 - 439   |     ✅      |      ❌      |      ✅       |      ✅      |        ❌        |       ❌        |        ❌        |         ❌        |      ❌     |
+|                                     Presto                                      | 0.236 - 0.280 |     ✅      |      ❌      |      ✅       |      ✅      |        ❌        |       ❌        |        ❌        |         ❌        |      ❌     |
+| [StarRocks](https://docs.starrocks.io/docs/data_source/catalog/paimon_catalog/) |     3.1+      |     ✅      |      ❌      |      ❌       |      ❌      |        ❌        |       ❌        |        ❌        |         ❌        |      ❌     |
+|     [Doris](https://doris.apache.org/docs/lakehouse/multi-catalog/paimon/)      |     2.0+      |     ✅      |      ❌      |      ❌       |      ❌      |        ❌        |       ❌        |        ❌        |         ❌        |      ❌     |
+
+## Streaming Engines
+
+### Flink Streaming
+
+Flink is the most comprehensive streaming computing engine that is widely used for data CDC ingestion and the
+construction of streaming pipelines.
+
+Recommended version is Flink 1.17.2.
+
+### Spark Streaming
+
+You can also use Spark Streaming to build a streaming pipeline. Spark's schema evolution capability will be better
+implemented, but you must accept the mechanism of mini-batch.
+
+## Batch Engines
+
+### Spark Batch
+
+Spark Batch is the most widely used batch computing engine.
+
+Recommended version is Spark 3.4.3.
+
+### Flink Batch
+
+Flink Batch is also available, which can make your pipeline more integrated with streaming and batch unified.
+
+## OLAP Engines
+
+### StarRocks
+
+StarRocks is the most recommended OLAP engine with the most advanced integration.
+
+Recommended version is StarRocks 3.2.6.
+
+### Other OLAP
+
+You can also use Doris and Trino and Presto, or, you can just use Spark, Flink and Hive to query Paimon tables.
 
 ## Download