Code

support for larger extraction tasks#14

Code

Merged

a5huynh merged 2 commits intomainspyglass-search/memex:mainfrom feature/extract-taskspyglass-search/memex:feature/extract-taskCopy head branch name to clipboardOct 3, 2023

+39-8

Commits

Commits on Oct 3, 2023

• handle large extraction requests and truncate content to fit 16K context if larger

  a5huynh

  committed
  4861b5f

• fix corner case where if size == MAX_TOKENS it'll go into segmenter

  a5huynh

  committed
  90baebd