0.9.2b1

What's Changed

Added

• Enhancement: Support JOIN after UNION operation.
• Add SCQL Agent to facilitate running SCQL query tasks in Kuscia, making it easier to integrate into SecretPad.
• [feat] write query result into multi-parties via "select ... into outfile" statement by @ancongxue in #391 co-authored-by @jingshi-ant
• Support datasource ODPS via integrating with dataproxy.
• Support order by by @fucangfy .
• Support a lot of single-party operators, such as ABS, ASIN, EXP, FLOOR, SQRT etc by @fucangfy .
• Support "postgres" and "postgresql" in kuscia datamesh by @tyrone-yu in #424

Changed

• Improve the JOIN and IN performance via integrating RR22 PSI by @tyrone-yu .
• Improve the aggregation with group by performance if reveal_group_count enabled by @tyrone-yu.

Fixed

• Fixed an occasional crash issue when canceling query job.
• Fixed select now() is not supported issue by @fucangfy .
• Fix compile erorr without -c opt option by @tongke6 in #389
• fix macos engine ut by @jingshi-ant in #407
• Bump golang.org/x/net from 0.26.0 to 0.33.0 by @tongke6 in #425
• avoid mix usage of uint64_t and size_t by @jingshi-ant in #423

New Contributors

• @ancongxue made their first contribution in #391

Full Changelog: 0.9.1b1...0.9.2b1

0.9.1b1

Added

• Support window function ROW_NUMBER() with PARTITION BY clause and ORDER BY clause.
• Add new CCL constraint REVAL_RANK.
• Add ExplainQuery API with path /intra/query/explain.
• Support INSERT INTO SELECT syntax to allow writing query result back to db (mysql/sqlite/postgres).
• Support trim function.

Changed

• Improved the job watcher to work better in broker clustered mode.
• Breaking: broker db schema has incompatible changes, please check here for details.

Full Changelog: 0.9.0b1...0.9.1b1

0.9.0b1

What's Changed

Added

• Support write outfile to OSS/MINIO via select into query.
• Support sin, cos, acos function.
• Support geodist function.
• Broker support using postgres as metadata storage.

Changed

• Reduce the memory peak of large-scale intersection tasks through streaming execution.
• Link tcmalloc to solve the problem of memory increase.

Fixed

• Fix crashes when dumpfile exceeds 2GB string column.
• Reduce the probability of graph checksum inconsistency issues.

Full Changelog: 0.8.1b1...0.9.0b1

Note: Cross-version compatibility is not currently guaranteed, please make sure all parties use the same version.

0.8.1b1

Added

• [feature] Support session-based log isolation functioality in the SCQL Engine.
• [feature] Support consul-based broker registration/discovery services, providing ACL/TLS authentication.

0.8.0b2

Fixed

• Avoid generating AVX512 instructions when compiling FourQ.

0.8.0b1

What's Changed

Added

• [feature] Support obtaining query job progress information via FetchResult RPC.
• [feature] Support project/query level configs.
• [feature] Support handling NULL for private data: including Arithmetic, Logic, Aggregation, etc., {IS [NOT] NULL, IFNULL, COALESCE} are also supported.
• [feature] Support port isolation for engine link service and control panel service (RunExecutionPlan).
• [enhancement] Add new CCL constraint PLAINTEXT_AS_JOIN_PAYLOAD.

Note: Cross-version compatibility is not currently guaranteed, please make sure all parties use the same version.

0.7.0b1

Added

• Added CheckAndUpdate API for self-recovery when status is inconsistent in P2P mode

Fixed

• Fixed the problem that Broker was unable to detect SCQLEngine crashes or being killed by OOM

0.6.0b2

Fixed

• Fixed Uri config for peer engine
• Disabled ccache to avoid conflict when building duckdb
• Fixed concurrency issues

0.6.0b1

Added

• [feature] Support DRY-RUN mode.
• [feature] Add support for RSA key pairs in SCQLBroker.
• [experiment][feature] support running on kuscia and scheduling SCQLEngine dynamic via kuscia job.
• [Enhancement] Improve Broker high availability, support depoly in multi-node cluster deployment.
• [feature] Add cancel query job API, it only works when scql running on kuscia for now.
• [feature] Support reading csv from oss/minio

Changed

• Breaking: Reshape column data type, data type LONG is deprecated.
• Breaking: Modify table schema in broker storage for P2P mode.

0.6.0dev20240403

Added

• Support for RSA key pairs in SCQLBroker.
• Support running on kuscia and scheduling SCQLEngine dynamic via kuscia job.
• Added dry_run parameter in DoQuery request, it could be used to check query syntax and CCL without actually executing the query.
• Improve Broker high availability, support depolying in multi-node cluster deployment.
• Support reading csv from OSS/MINIO.