Not able to upload any file other that image. It says error processing file

[PR4SAN]

What happened?

I am using Claude API, and when I am trying to upload pdf it says error processing file and doesn't work. works with images.

Steps to Reproduce

Upload pdf to chat window.

What browsers are you seeing the problem on?

No response

Relevant log output

2024-08-28 11:31:24 error: Error embedding file File embedding failed.
2024-08-28 11:31:24 error: [/files] Error processing file: File embedding failed.
2024-08-28 11:31:53 error: Error embedding file File embedding failed.
2024-08-28 11:31:53 error: [/files] Error processing file: File embedding failed.
2024-08-28 11:45:42 error: Error embedding file File embedding failed.
2024-08-28 11:45:42 error: [/files] Error processing file: File embedding failed.
2024-08-28 11:45:56 error: Error embedding file File embedding failed.
2024-08-28 11:45:56 error: [/files] Error processing file: File embedding failed.

Screenshots

Code of Conduct

• I agree to follow this project's Code of Conduct

[danny-avila]

Please read through this, then let us know if you need any further help

https://www.librechat.ai/docs/configuration/rag_api

[bzjohnson]

How do you find the .env file to put the OPENAI key into? I used the Docker installation.
@danny-avila

[PR4SAN]

yes, I have gone through the documentation. I am following everything in the document there step by step. Also, there is no mention of what to do when using Claude API. Can you help me here what I am missing?

Just noticed this. even though i am using Claude for file uploads the rag logs shows its trying to call openAI and i am getting invalid key.

2024-08-28 11:14:19,838 - root - INFO - Initialized embeddings of type: <class 'langchain_openai.embeddings.base.OpenAIEmbeddings'> /usr/local/lib/python3.10/site-packages/langchain_community/vectorstores/pgvector.py:322: LangChainPendingDeprecationWarning: Please use JSONB instead of JSON for metadata. This change will allow for more efficient querying that involves filtering based on metadata.Please note that filtering operators have been changed when using JSOB metadata to be prefixed with a $ sign to avoid name collisions with columns. If you're using an existing database, you will need to create adb migration for your metadata column to be JSONB and update your queries to use the new operators. warn_deprecated( 2024-08-28 11:14:19,887 - uvicorn.error - INFO - Started server process [1] 2024-08-28 11:14:19,888 - uvicorn.error - INFO - Waiting for application startup. 2024-08-28 11:14:19,888 - uvicorn.error - INFO - Application startup complete. 2024-08-28 11:14:19,888 - uvicorn.error - INFO - Uvicorn running on http://0.0.0.0:8000 (Press CTRL+C to quit) 2024-08-28 11:14:53,455 - httpx - INFO - HTTP Request: POST https://api.openai.com/v1/embeddings "HTTP/1.1 401 Unauthorized" 2024-08-28 11:14:53,457 - root - ERROR - Error code: 401 - {'error': {'message': 'Incorrect API key provided: user_pro*ided. You can find your API key at https://platform.openai.com/account/api-keys.', 'type': 'invalid_request_error', 'param': None, 'code': 'invalid_api_key'}} 2024-08-28 11:14:53,458 - root - INFO - Request POST http://rag_api:8000/embed - 200 2024-08-28 11:18:41,552 - httpx - INFO - HTTP Request: POST https://api.openai.com/v1/embeddings "HTTP/1.1 401 Unauthorized" 2024-08-28 11:18:41,554 - root - ERROR - Error code: 401 - {'error': {'message': 'Incorrect API key provided: user_pro*ided. You can find your API key at https://platform.openai.com/account/api-keys.', 'type': 'invalid_request_error', 'param': None, 'code': 'invalid_api_key'}} 2024-08-28 11:18:41,556 - root - INFO - Request POST http://rag_api:8000/embed - 200 2024-08-28 11:25:31,782 - httpx - INFO - HTTP Request: POST https://api.openai.com/v1/embeddings "HTTP/1.1 401 Unauthorized" 2024-08-28 11:25:31,784 - root - ERROR - Error code: 401 - {'error': {'message': 'Incorrect API key provided: user_pro*ided. You can find your API key at https://platform.openai.com/account/api-keys.', 'type': 'invalid_request_error', 'param': None, 'code': 'invalid_api_key'}} 2024-08-28 11:25:31,786 - root - INFO - Request POST http://rag_api:8000/embed - 200 2024-08-28 11:27:39,395 - httpx - INFO - HTTP Request: POST https://api.openai.com/v1/embeddings "HTTP/1.1 401 Unauthorized" 2024-08-28 11:27:39,397 - root - ERROR - Error code: 401 - {'error': {'message': 'Incorrect API key provided: user_pro*ided. You can find your API key at https://platform.openai.com/account/api-keys.', 'type': 'invalid_request_error', 'param': None, 'code': 'invalid_api_key'}} 2024-08-28 11:27:39,399 - root - INFO - Request POST http://rag_api:8000/embed - 200 2024-08-28 11:29:11,288 - httpx - INFO - HTTP Request: POST https://api.openai.com/v1/embeddings "HTTP/1.1 401 Unauthorized" 2024-08-28 11:29:11,289 - root - ERROR - Error code: 401 - {'error': {'message': 'Incorrect API key provided: user_pro*ided. You can find your API key at https://platform.openai.com/account/api-keys.', 'type': 'invalid_request_error', 'param': None, 'code': 'invalid_api_key'}} 2024-08-28 11:29:11,291 - root - INFO - Request POST http://rag_api:8000/embed - 200 2024-08-28 11:31:24,311 - httpx - INFO - HTTP Request: POST https://api.openai.com/v1/embeddings "HTTP/1.1 401 Unauthorized" 2024-08-28 11:31:24,313 - root - ERROR - Error code: 401 - {'error': {'message': 'Incorrect API key provided: user_pro*ided. You can find your API key at https://platform.openai.com/account/api-keys.', 'type': 'invalid_request_error', 'param': None, 'code': 'invalid_api_key'}} 2024-08-28 11:31:24,315 - root - INFO - Request POST http://rag_api:8000/embed - 200 2024-08-28 11:31:53,255 - httpx - INFO - HTTP Request: POST https://api.openai.com/v1/embeddings "HTTP/1.1 401 Unauthorized" 2024-08-28 11:31:53,257 - root - ERROR - Error code: 401 - {'error': {'message': 'Incorrect API key provided: user_pro*ided. You can find your API key at https://platform.openai.com/account/api-keys.', 'type': 'invalid_request_error', 'param': None, 'code': 'invalid_api_key'}} 2024-08-28 11:31:53,258 - root - INFO - Request POST http://rag_api:8000/embed - 200 2024-08-28 11:45:42,035 - httpx - INFO - HTTP Request: POST https://api.openai.com/v1/embeddings "HTTP/1.1 401 Unauthorized" 2024-08-28 11:45:42,037 - root - ERROR - Error code: 401 - {'error': {'message': 'Incorrect API key provided: user_pro*ided. You can find your API key at https://platform.openai.com/account/api-keys.', 'type': 'invalid_request_error', 'param': None, 'code': 'invalid_api_key'}} 2024-08-28 11:45:42,038 - root - INFO - Request POST http://rag_api:8000/embed - 200 2024-08-28 11:45:56,801 - httpx - INFO - HTTP Request: POST https://api.openai.com/v1/embeddings "HTTP/1.1 401 Unauthorized" 2024-08-28 11:45:56,804 - root - ERROR - Error code: 401 - {'error': {'message': 'Incorrect API key provided: user_pro*ided. You can find your API key at https://platform.openai.com/account/api-keys.', 'type': 'invalid_request_error', 'param': None, 'code': 'invalid_api_key'}} 2024-08-28 11:45:56,805 - root - INFO - Request POST http://rag_api:8000/embed - 200 2024-08-28 11:51:57,319 - httpx - INFO - HTTP Request: POST https://api.openai.com/v1/embeddings "HTTP/1.1 401 Unauthorized" 2024-08-28 11:51:57,321 - root - ERROR - Error code: 401 - {'error': {'message': 'Incorrect API key provided: user_pro*ided. You can find your API key at https://platform.openai.com/account/api-keys.', 'type': 'invalid_request_error', 'param': None, 'code': 'invalid_api_key'}} 2024-08-28 11:51:57,323 - root - INFO - Request POST http://rag_api:8000/embed - 200 2024-08-28 11:53:36,684 - httpx - INFO - HTTP Request: POST https://api.openai.com/v1/embeddings "HTTP/1.1 401 Unauthorized" 2024-08-28 11:53:36,686 - root - ERROR - Error code: 401 - {'error': {'message': 'Incorrect API key provided: user_pro*ided. You can find your API key at https://platform.openai.com/account/api-keys.', 'type': 'invalid_request_error', 'param': None, 'code': 'invalid_api_key'}} 2024-08-28 11:53:36,687 - root - INFO - Request POST http://rag_api:8000/embed - 200 2024-08-28 11:53:54,087 - httpx - INFO - HTTP Request: POST https://api.openai.com/v1/embeddings "HTTP/1.1 401 Unauthorized" 2024-08-28 11:53:54,089 - root - ERROR - Error code: 401 - {'error': {'message': 'Incorrect API key provided: user_pro*ided. You can find your API key at https://platform.openai.com/account/api-keys.', 'type': 'invalid_request_error', 'param': None, 'code': 'invalid_api_key'}} 2024-08-28 11:53:54,090 - root - INFO - Request POST http://rag_api:8000/embed - 200

[danny-avila]

and you've set up an embedding service? note that anthropic doesn't offer embeddings that I know of. They recommend using other services like Voyage

[danny-avila]

so you have to set up OpenAI or one of the other services

[danny-avila]

[danny-avila]

From your logs, it's evident that's what's going on

Set RAG_OPENAI_API_KEY=sk-your-openai-api-key-example to an OpenAI API key for this to work, then restart the services.

[odin-loki]

I tried the same. I am using Claude API and am Wondering if Claude API is compatible with RAG because it only says how to configure OpenAI RAG but I am also wondering if Claude has an OpenAI Compatible RAG.

Here is my RAG File:

#==================================================#

RAG

#==================================================#

More info: https://www.librechat.ai/docs/configuration/rag_api

RAG_OPENAI_BASEURL=http://host.docker.internal:8000

RAG_OPENAI_API_KEY=MY API KEY

RAG_USE_FULL_CONTEXT=

EMBEDDINGS_PROVIDER=openai

EMBEDDINGS_MODEL=text-embedding-3-small

Am I missing anything? Thats literally all it says to do? I put my API key in the GUI when you select your model and I put it in the RAG too.