From 0605b45c4615c977c640ac7c628e5a5b28b1629e Mon Sep 17 00:00:00 2001 From: Frank Liu Date: Mon, 5 Dec 2022 22:17:04 -0800 Subject: [PATCH] Update missing diagrams --- codelabs/get-started-with-vector-db-6/index.md | 9 ++------- 1 file changed, 2 insertions(+), 7 deletions(-) diff --git a/codelabs/get-started-with-vector-db-6/index.md b/codelabs/get-started-with-vector-db-6/index.md index 9058424..1997c4c 100644 --- a/codelabs/get-started-with-vector-db-6/index.md +++ b/codelabs/get-started-with-vector-db-6/index.md @@ -49,12 +49,7 @@ From the above example, we can see that scalar quantization has reduced the tota ## Scalar quantization Duration: 3 -So how exactly does scalar quantization work? Let's first take a look at the indexing process, i.e. turning floating point vectors into integer vectors. For each vector dimension, scalar quantization takes the maximum and minimum value of that particular dimension as seen across the entire database, and uniformly splits that dimension into bins across its entire range: - -
- -
-

Scalar quantization, visualized.

+So how exactly does scalar quantization work? Let's first take a look at the indexing process, i.e. turning floating point vectors into integer vectors. For each vector dimension, scalar quantization takes the maximum and minimum value of that particular dimension as seen across the entire database, and uniformly splits that dimension into bins across its entire range. Let's try writing that in code. We'll first generate a dataset of a thousand 128D floating point vectors sampled from a multivariate distribution. Since this is a toy example, I'll be sampling from a Gaussian distribution; in practice, actual embeddings are rarely Gaussian distributed unless added as a constraint when training the model (such as in variational autoencoders): @@ -180,7 +175,7 @@ This might sound complex, but it becomes much easier to understand if we break i 3) With all centroids computed, we'll replace all subvectors in the original dataset with the ID of its closest centroid.
- +

Product quantization, visualized.