You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
I cannot get a deepseek deployment on azure to work.
This python code WORKS:
importosfromazure.ai.inferenceimportChatCompletionsClientfromazure.core.credentialsimportAzureKeyCredentialfromdotenvimportload_dotenvload_dotenv()
api_key=os.getenv("AZURE_INFERENCE_CREDENTIAL", '')
ifnotapi_key:
raiseException("A key should be provided to invoke the endpoint")
client=ChatCompletionsClient(
endpoint="https://MYDEPLOYMENTl.services.ai.azure.com/models",
credential=AzureKeyCredential(api_key),
model="DeepSeek-R1",
)
# Adding the model name in the headerheaders= {
'x-ms-model-mesh-model-name': 'DeepSeek-R1'
}
print(client.get_model_info(headers=headers))
fromazure.ai.inference.modelsimportSystemMessage, UserMessageresponse=client.complete(
messages=[
SystemMessage(content="You are a helpful assistant."),
UserMessage(content="How many languages are in the world?"),
],
)
Environment
GitHub v2-dev branch
Description
I cannot get a deepseek deployment on azure to work.
This python code WORKS:
When trying the same URL with big-AGI it says
[OpenAI/azure issue]: Resource Not Found - Resource not found - "https://XXXX.services.ai.azure.com/models/openai/deployments?api-version=2023-03-15-preview" cannot be found by the server
The azure config is not compatible with deepseek (non openai deployments)
Device and browser
Brave
Screenshots and more
No response
Willingness to Contribute
The text was updated successfully, but these errors were encountered: