v0.0.17

What's Changed

• Add rate runner by @XuanYang-cn in #403
• fix conc_latency_p99 calculation; add conc_latency_avg metric; conc_test first by @alwayslove2013 in #410

Full Changelog: v0.0.16...v0.0.17

v0.0.16

What's Changed

• Fix code for custom dataset usage by @acanadil in #395
• remove older zillizcloud test results from leaderboard by @alwayslove2013 in #399
• Fix pgvectorivfflat reranking key bug by @Sheharyar570 in #401

New Contributors

• @acanadil made their first contribution in #395

Full Changelog: v0.0.15...v0.0.16

v0.0.15

What's Changed

• Support for pgdiskann client by @wahajali in #388
• increase timeout by @alwayslove2013 in #390
• Binary Quantization Support for pgvector HNSW Algorithm by @Sheharyar570 in #389
• fix weaviate client bug by @alwayslove2013 in #392

Full Changelog: v0.0.14...v0.0.15

v0.0.14

What's Changed

• fix redis benchmark execution bug by @angus0wang in #358
• Add support for filtered search in pgvector by @wahajali in #362
• Add CLI Support for pgvectorscale by @Sheharyar570 in #365
• Add support for filtered search in pgvectorscale by @Sheharyar570 in #364
• Add quantization option for pgvector with support for halfvec by @lucagiac81 in #366
• Add cli support for running benchmark with custom dataset by @Sheharyar570 in #372
• pgvecto.rs: upgrade pgvecto.rs sdk to v0.2.2 by @cutecutecat in #373
• Randomly pick start idx of test dataset in concurrency search. by @Sheharyar570 in #377
• Added optimization for Opensearch and also included the options to tweak the hyper parameters by @navneet1v in #378
• update leaderboard data by @alwayslove2013 in #379
• fix bug: date to datetime by @alwayslove2013 in #380
• update leaderboard data by @alwayslove2013 in #381
• fix leaderboard data: zillizcloud version by @alwayslove2013 in #383
• Custom case cli bug, refactoring and README updates. by @Sheharyar570 in #384
• fix warnings: add key for plotly_chart by @alwayslove2013 in #386
• fix pinecone client by @alwayslove2013 in #387

New Contributors

• @angus0wang made their first contribution in #358
• @lucagiac81 made their first contribution in #366
• @navneet1v made their first contribution in #378

Full Changelog: v0.0.13...v0.0.14

v0.0.13

What's Changed

• add new db_config for better labeling: version, note by @alwayslove2013 in #350
• Support for MemoryDB client by @baswanth09 in #339
• refactor: migrate to new pgvecto_rs sdk by @cutecutecat in #353
• Added pgvectorscale client by @Sheharyar570 in #355

New Contributors

• @baswanth09 made their first contribution in #339
• @Sheharyar570 made their first contribution in #355

Full Changelog: v0.0.12...v0.0.13

v0.0.12

What's Changed

• support custom_dataset by @alwayslove2013 in #320
• Add client aws_opensearch by @cydrain in #342

New Contributors

• @cydrain made their first contribution in #342

Full Changelog: v0.0.11...v0.0.12

VectorDBBench 0.0.11 Release Notes

What's Changed

• the dataset_local_dir should be kept consistent by @alwayslove2013 in #331
• Introduce a command line interface. by @greenhal in #330
• pgvector: ensure vector is sent in binary representation by @jkatz in #335
• new metric support: ndcg@100, performance under conc_test by @alwayslove2013 in #337

New Contributors

• @greenhal made their first contribution in #330

Full Changelog: v0.0.10...v0.0.11

v0.0.10

What's Changed

• fix bugs: should normalize cosine dataset when test with milvus gpu_index by @alwayslove2013 in #326
• Increase the optimization time limit. by @alwayslove2013 in #332

Full Changelog: v0.0.9...v0.0.10

VectorDBBench 0.0.9 Release Notes

What's Changed

• Support pgvector-hnsw by @alwayslove2013 in #311
• Remove last batch in insert_embeddings by @XuanYang-cn in #314
• Optimize pgvector test for semi-recent enhancements by @jkatz in #319

Bug fixes:

• Pinning Streamlit to version 1.31.1 to avoid error #315 by @yorek in #316
• Skip streamlit 1.34.0 by @XuanYang-cn in #322

New Contributors

• @yorek made their first contribution in #316
• @jkatz made their first contribution in #319

Full Changelog: v0.0.8...v0.0.9

VectorDBBench 0.0.8 Release Notes

What's Changed

• update zillizcloud results (2024-01) by @alwayslove2013 in #295
• add zillizcloud failed results by @alwayslove2013 in #296
• Add support for HNSW index in pgvector client by @wahajali in #294

Bug fixes

• fix qdrant_cloud import bugs by @alwayslove2013 in #300
• fix the label of zillizcloud test results (Jan 2024) by @alwayslove2013 in #302
• fix: new interface of pgvecto.rs after v0.2 by @cutecutecat in #301
• fix qdrant client: compatibe with open-source qdrant by @alwayslove2013 in #308

New Contributors

• @wahajali made their first contribution in #294

Full Changelog: v0.0.7...v0.0.8