Help configuring Guidance with Azure

[doomgrave]

Hi all.
I cannot run guidance on Azure Openai, may you suggest me whats the problem?
I've uninstalled and reinstalled guidance, tiktoken, openai modules, but still i get the error below.

PS: the data shared are scrubbled as an example.

CODE:
azure_api_key = 'api_key_here'
azure_version='2023-07-01-preview'
azure_model = 'gpt-4'
azure_deployment_url='https://mydomain.openai.azure.com/openai/deployments/AITEST/chat/completions?api-version=2023-07-01-preview'

azureLLM = guidance.models.AzureOpenAI(azure_endpoint=azure_deployment_url,api_key=azure_api_key,version=azure_version,model=azure_model)

ERROR:
Exception has occurred: AttributeError
module 'guidance.models' has no attribute 'AzureOpenAI'
File "C:\Guidance_Examples\Guidance_Llama_llamacpp_Azure.py", line 26, in
azureLLM = guidance.models.AzureOpenAI(
azure_endpoint=azure_deployment_url,
api_key=azure_api_key,
version=azure_version,
model=azure_model
)
^^^^^^^^^^^^^^^^^^^^^^^^^^^
AttributeError: module 'guidance.models' has no attribute 'AzureOpenAI'

[Harsha-Nori]

Hi @doomgrave, what version of the guidance library are you running? You can do:

import guidance
print(guidance.__version__)

to check.

[doomgrave]

PROBLEM SOLVED!
I was running the test from the Cloned repository, so even if my version of guidance was updated it was reading the local ./guidance folder with an older version!
Really stupid but i was going crazy!

[Harsha-Nori]

Glad it all worked out 🙂