knowhere-v1.3.4

Release : knowhere-v1.3.4

Main Changes

• Faster Index build for DiskANN and HNSW. For SIFT1M data, DiskANN improved from 699s to 275s, HNSW improved from 318s to 294s
• Faster Search for HNSW serial execution improved ~50% at 90% recall, parallel improved ~3 times QPSs.
• Fix potential aio exceeding OS limit problem by introducing an aio pool.
• Fixed aio io_getevents crash problem
• Add Thread pool for all indexes to fix the omp threads number problem.

Chang List

• Print error message when the function abnormal returns by @cqy123456 in #491
• Add ut for AsyncIndex by @smellthemoon in #492
• [skip e2e] Add deps for code checker into build image by @jennyli-z in #495
• [skip e2e]Add python2 for cpp lint by @jennyli-z in #497
• [skip e2e]Add python2 for cpp lint by @jennyli-z in #498
• [skip e2e]Update ut to 20.04 by @jennyli-z in #488
• Support metric IP for diskann range search by @cqy123456 in #496
• Re-organize knowhere benchmark by @cydrain in #499
• Add benchmark ssnpp by @cydrain in #501
• Remove assemble and disassemble util func by @xige-16 in #502
• Update benchmark SSNPP by @cydrain in #503
• Add float test for benchmark SSNPP by @cydrain in #504
• [skip e2e] Update sift rane search benchmark logs by @cydrain in #505
• Remove setting thread omp logs by @cydrain in #506
• Update HNSW range search benchmark by @cydrain in #507
• Add benchmark qps for search and range search by @cydrain in #508
• Remove HNSW range search parameter range_k, use ef instead by @cydrain in #509
• Update SSNPP benchmark by @cydrain in #510
• Update SSNPP benchmark test name by @cydrain in #511
• Add sift range search benchmark with multi radius by @cydrain in #512
• [skip e2e] Update benchmark readme by @cydrain in #515
• Pass CMAKE_PREFIX_PATH to externla project by @jiaoew1991 in #516
• Add ctpl as ThreadPool and use it in HNSW search by @liliu-z in #513
• Release free mem in diskann aligned_free function by @cqy123456 in #520
• Make the Query thread pool global by @liliu-z in #517
• Add thread pool to diskann search by @liliu-z in #522
• Support Feder for DiskANN by @cydrain in #521
• Remove stats in hnsw by @liliu-z in #527
• Fix HNSW/DiskANN feder memory leak by @cydrain in #529
• Refactor knowhere range search to accept 2-side boundaries by @cydrain in #528
• Update release for current branch by @liliu-z in #534
• Use elkan's algo to accelerate KMeans by @hhy3 in #537
• Add prefetch in hnsw by @hhy3 in #546
• Optimize hnsw search by @hhy3 in #552
• Optimize hnsw search algo by @hhy3 in #553
• [skip e2e]Delete Unit Test on windows by @Bennu-Li in #561
• Add visited list pool in hnsw by @hhy3 in #559
• Replace diskann compute function with faiss's compute function by @cqy123456 in #568
• Fix aio io_getevents by @hhy3 in #567
• Add Thread Pool for all indexes in Knowhere by @liliu-z in #570
• Fix thread safety in hnsw by @hhy3 in #575

New Contributors

• @xige-16 made their first contribution in #502
• @Bennu-Li made their first contribution in #561

Full Changelog: v1.3.2...v1.3.4