v2.0.0 - Vector Search Capabilities with Azure Cog Search
What's New in this 2.0 release:
- This is a major change , jumping versions from 1.7 to 2.0
- The way documents search work changes from Semantic Search results to Vector Similarity results
- Now two indexes coexist: text-based indexes and its corresponding vector-based indexes
- Vectorization of chunks happens on demand as users discover documents (vs embedding all documents at ingestion)
- Azure Document Intelligence (former Form Recognizer) is added to the repo in a new Notebook 4 when dealing with Complex PDF files. Manual chunking (per page) and push to vector-only index
- Improvements in prompts and functions
- New Architecture image