Search code examples
azureazure-cognitive-searchazure-storage-accountazure-openai

Error when custom data is added to Azure OpenAI Service Deployment


I receive the following error when adding my custom data which is a .txt file (it doesn't matter whether I add it via Azure Cognitive Search, Azure Blob Storage, or File Upload or whether the respective Congnitive Search index contains any data):

Image of Error

The error as text:
Error
Server disconnected
LLM call failed for chat completion endpoint. Please set OAIGenerationConfig(is_chat=True)

After removing the Data Source, everything works fine again and the bot responds to my queries.

I am using an Azure OpenAI Service with a gpt-35-turbo deployment, which has the following details: Version: 0301, Deployment Type: Standard, Capacity: 120K TPM

I have no idea at the moment how I should further approach this problem.

Any advice is much appreciated!

Edit: I had the OpenAI resource deployed to West Europe and redeployed it to East US. It now works perfectly as expected.


Solution

  • can you test the same in another region? It may hint on a possible issue in the original geography.