Azure OpenAI
https://gateway.ai.cloudflare.com/v1/{account_id}/{gateway_slug}/azure-openai/{resource_name}/{deployment_name}
When making requests to Azure OpenAI, you will need:
- AI Gateway account tag
- AI Gateway gateway name
- Azure OpenAI API key
- Azure OpenAI resource name
- Azure OpenAI deployment name (aka model name)
Your new base URL will use the data above in this structure: https://gateway.ai.cloudflare.com/v1/{account_id}/{gateway_slug}/azure-openai/{resource_name}/{deployment_name}
. Then, you can append your endpoint and api-version at the end of the base URL, like .../chat/completions?api-version=2023-05-15
.
Example fetch requestcurl 'https://gateway.ai.cloudflare.com/v1/{account_id}/{gateway_slug}/azure-openai/{resource_name}/{deployment_name}/chat/completions?api-version=2023-05-15' \ --header 'Content-Type: application/json' \ --header 'api-key: {azure_api_key}' \ --data '{ "messages": [ { "role": "user", "content": "What is Cloudflare?" } ]}'
If you are using the openai-node
library, you can set your endpoint like this:
index.jsimport OpenAI from "openai";
const resource = 'xxx'; //without the .openai.azure.com const model = 'xxx'; const apiVersion = 'xxx'; const apiKey = env.AZURE_OPENAI_API_KEY;
const azure_openai = new OpenAI({ apiKey, baseURL: `https://gateway.ai.cloudflare.com/v1/{account_id}/{gateway_slug}/azure-openai/${resource}/${model}`, defaultQuery: { 'api-version': apiVersion }, defaultHeaders: { 'api-key': apiKey }, });