Add Claude 3 Haiku (Free) and Claude 3 Sonnet (Premium) to model selection

[bbondy]

We'd like to deprecate Claude Instant in favor of Claude 3 Haiku for the free tier and Claude 3 Sonnet for the premium tier.
The client should reflect the name of the model in use, and we do not need to list Haiku once the user purchases premium, we can just upgrade Haiku to Sonnet for the usage.
We may want to consider changing the default at some point to Haiku but the scope of this task is to only add support and not change the default.

[nvonpentz]

Serverside changes https://github.com/brave/aichat-ops/pull/251

[LorenzoMinto]

This issue is not fully resolved by the above PR. Follow up outstanding issues:

• [Brave Leo]: Deprecate Claude Instant model #37988
• [Brave Leo]: Add Claude 3 model (Haiku and Sonnet) to model selection in iOS #37989

[kjozwiak]

Closing as brave/brave-core#22706 was merged into master. As per the discussion via https://bravesoftware.slack.com/archives/CHGKGMHDJ/p1715100595902499, iOS is currently QA/Blocked until #37989 has been resolved. CCing @Uni-verse @hffvld. So for the time being, verification for the above can only be done for Desktop & Android.

[kjozwiak]

The above requires 1.66.103 or higher for 1.66.x verification 👍

[stephendonner]

Verification PASSED using

Brave | 1.66.103 Chromium: 124.0.6367.159 (Official Build) beta (x86_64)
-- | --
Revision | 74d46bb25d9ea5e6432e19f0cf38480cc372b0cf
OS | macOS Version 11.7.10 (Build 20G1427)

Shared Steps:

1. installed 1.66.103
2. launched Brave
3. confirmed addition of Claude 3 Haiku and Claude 3 Sonnet (Premium) models in brave://settings/leo-assistant
4. clicked on Leo in the sidebar
5. confirmed addition of Claude 3 Haiku and Claude 3 Sonnet models in the Leo pane
6. confirmed working AI-chat generated answers for Mixtral, Claude 3 Haiku, Claude Sonnet (Premium), and Llama2-13b

Confirmed working output from all models, both free and Premium

Default list

example	example

Mixtral

Claude 3 Haiku

Claude Sonnet (Premium)

example	example	example

Llama2-13b

[Uni-verse]

Verified on Samsung Galaxy S21 using version:

Brave	1.66.105 Chromium: 125.0.6422.41 (Official Build) (64-bit) 
Revision	ba88d7bb175a55287d14014823d5da31fe9c8a47
OS	Android 13; Build/TP1A.220624.014; 33; REL

• Ensured that Claude 3 Haiku and Claude 3 Sonnet are shown on the list as free tier and premium tier respectively for new users.
• Ensured that Default model for new conversation setting shows all the models in the list and Mixtral is set by default.
• Ensured that new Claude 3 models have the correct badging for free users:
  • LIMITED badging for Haiku
  • The lock icon for Sonnet
• Ensured that new Claude 3 models show the correct badging for premium users:
  • UNLIMITED badging for Haiku
  • `Open lock icon for Sonnet
• Ensured that Leo defaults to Mixtral model.
• Ensured upgrade card is shown when selecting Claude 3 Sonnet from Language models menu as well as starting new conversation when default model is set to Sonnet in settings.
• Ensured switching language model to Haiku and hitting rate limit, upgrading to premium using IAP.
• Ensured premium status is shown when using active credentials from account.brave.com

Defaults

Example	Example	Example	Example	Example

Premium via Active Credentials

Example	Example	Example	Example

Premium via IAP

Example	Example	Example

[Uni-verse]

Verified on iPhone 12 running iOS 17.3.1 using version 1.66.110

• Ensured that Claude 3 Haiku and Claude 3 Sonnet are shown on the list as free tier and premium tier respectively for new users.
• Ensured that Default model for new conversation setting shows all the models in the list and Mixtral is set by default.
• Ensured that new Claude 3 models have the correct badging for free users:
  • LIMITED badging for Haiku
  • The lock icon for Sonnet
• Ensured that new Claude 3 models show the correct badging for premium users:
  • UNLIMITED badging for Haiku
  • Open lock icon for Sonnet
• Ensured that Leo defaults to Mixtral model.
• Ensured upgrade card is shown when selecting Claude 3 Sonnet from Language models menu as well as starting new conversation when default model is set to Sonnet in settings. - logged Connection error when using Leo Sonnet model #38385
• Ensured switching language model to Haiku and hitting rate limit, upgrading to premium using IAP.
• Ensured switching to free model will enable user to continue to use chat after hitting rate limit.
• Ensured premium status is shown when using active credentials from account.brave.com

Defaults

Example	Example	Example	Example	Example

Upgrade to Premium (Active Credentials)

Example	Example	Example	Example	Example

Upgrade (IAP)

Example	Example	Example	Example	Example