Skip to content

Fast-Forward Indexes v0.3.0

Compare
Choose a tag to compare
@mrjleo mrjleo released this 25 Aug 14:09
· 59 commits to main since this release
de69cdc

Index operations

  • When calling Index.add, the sequences doc_ids and psg_ids can now contain None elements, as long as each vector has at least one ID.
  • Indexes (vectors and corresponding IDs) can now be iterated over using Index.batch_iter and Index.__iter__.

Vector quantization

  • Indexes now support vector quantization via the fast_forward.quantizer.Quantizer interface.
  • fast_forward.quantizer.nanopq.NanoPQ implements product quantization based on nanopq.

Misc

  • The default ranking mode has been changed to MAXP.

API changes

  • The dim argument has been removed from OnDiskIndex and InMemoryIndex.
  • The dtype argument has been removed from OnDiskIndex.