Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

azurerm_cognitive_deployment not able to deploy latest version(0613) of gpt3.5 #22501

Closed
1 task done
jayendranarumugam opened this issue Jul 13, 2023 · 2 comments · Fixed by #22520
Closed
1 task done

Comments

@jayendranarumugam
Copy link
Contributor

jayendranarumugam commented Jul 13, 2023

Is there an existing issue for this?

  • I have searched the existing issues

Community Note

  • Please vote on this issue by adding a 👍 reaction to the original issue to help the community and maintainers prioritize this request
  • Please do not leave "+1" or "me too" comments, they generate extra noise for issue followers and do not help prioritize the request
  • If you are interested in working on this issue or have submitted a pull request, please leave a comment and review the contribution guide to help.

Terraform Version

1.3.0

AzureRM Provider Version

3.64.0

Affected Resource(s)/Data Source(s)

azurerm_cognitive_deployment

Terraform Configuration Files

provider "azurerm" {
  features {}
}

resource "azurerm_resource_group" "example" {
  name     = "example-resources"
  location = "uksouth"
}

resource "azurerm_cognitive_account" "example" {
  name                = "example-ca"
  location            = azurerm_resource_group.example.location
  resource_group_name = azurerm_resource_group.example.name
  kind                = "OpenAI"
  sku_name            = "S0"
}

resource "azurerm_cognitive_deployment" "example" {
  name                 = "example-cd"
  cognitive_account_id = azurerm_cognitive_account.example.id
  model {
    format  = "OpenAI"
    name    = "gpt-35-turbo"
    version = "0613"
  }

  scale {
    type = "Standard"
  }
}

Debug Output/Panic Output

When i used newer version 0613 on gpt-35-turbo it looks like below (perfect) but when i checked in the portal the version is pointing as old (0301). I believe somehow while creating it took the default version and not the newer version

+ model {
          + format  = "OpenAI"
          + name    = "gpt-35-turbo"
          + version = "0613"
        }

      + scale {
          + capacity = 120
          + type     = "Standard"
        }

I manually updated the version on the portal, and ran the terraform again now it shows like below

      ~ model {
            name    = "gpt-35-turbo"
          ~ version = "0301" -> "0613"
            # (1 unchanged attribute hidden)
        }

but I got the error like Error: doesn't support update (I can able to update the version from the portal successfully)

#References

#22198 (comment)

@lonegunmanb
Copy link
Contributor

lonegunmanb commented Jul 14, 2023

Hi @jayendranarumugam, thanks for opening this issue, after some debugging I found that this issue was caused by the absent of VersionUpgradeOption argument. I'll open a pr to fix this issue.


Once the pr has been merged, you can modify your config like this:

resource "azurerm_cognitive_deployment" "example" {
  name                 = "example-cd"
  cognitive_account_id = azurerm_cognitive_account.example.id
  model {
    format  = "OpenAI"
    name    = "gpt-35-turbo"
    version = "0613"
  }
  rai_policy_name = "Microsoft.Default"
  version_upgrade_option = "OnceCurrentVersionExpired"
  scale {
    type = "Standard"
    capacity = 120
  }
}

Copy link

github-actions bot commented May 2, 2024

I'm going to lock this issue because it has been closed for 30 days ⏳. This helps our maintainers find and focus on the active issues.
If you have found a problem that seems similar to this, please open a new issue and complete the issue template so we can capture all the details necessary to investigate further.

@github-actions github-actions bot locked as resolved and limited conversation to collaborators May 2, 2024
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Projects
None yet
3 participants