Support GCP Vertex AI as inference provider

[mmurad2]

Description
Add GCP Vertex AI as a supported inference provider

Tasks

• Implement inference provider following these instructions
• Add example under provider folder
• Update docs to include supported interfaces
• Run tests

[Tomas2D]

Tutorial on how to do so: https://i-am-bee.github.io/bee-agent-framework/#/llms?id=adding-a-new-provider-adapter

[akihikokuroda]

HI! I would like try this. Would you assign to me? Thanks!

[mmurad2]

Awesome! just assigned you @akihikokuroda

[akihikokuroda]

Thanks!

[akihikokuroda]

I need some guidance here.

I'm trying to serialize VertexAI class from "@google-cloud/vertexai". This class has a member type of GoogleAuth from "google-auth-library" class. I can register both classes to the serializer. So these are OK.
The issue is that the VertexAI has another member type of VertexAIPreview that is a class defined in the same package as VertexAI class but it is not exposed so I can not register it to the serializer.

How can I workaround this?
Thanks!

Here is the class definitions : https://github.com/googleapis/nodejs-vertexai/blob/31de0e92bb7e0efd5afca2728d6175095175be04/src/vertex_ai.ts#L43

export class VertexAI {
  public readonly preview: VertexAIPreview;
  private readonly project: string;
  private readonly location: string;
  private readonly googleAuth: GoogleAuth;
  private readonly apiEndpoint?: string;
 ......
}

class VertexAIPreview {
  private readonly project: string;
  private readonly location: string;
  private readonly googleAuth: GoogleAuth;
  private readonly apiEndpoint?: string;

  private readonly apiClient: Resources.ApiClient;
  readonly cachedContents: Resources.CachedContents;
.....
}

[Tomas2D]

Actually, you don't want to do that. It is okay to do something like this.

static {
    this.register();

    // you register top class, not its children
    Serializer.register(Client, {
      toPlain: (value) => ({
        options: getPropStrict(value, "_options") as ClientOptions,
      }),
      fromPlain: (value) => new Client(value.options),
    });
  }

and then add that Client class to verifyDeserialization.ignoredClasses in tests/e2e/utils.ts.

If you get stuck, no worries, just create a PR without serialization, and I will help.

[Tomas2D]

Released in v0.0.43

[mmurad2]

@akihikokuroda thanks for the contribution! could you also complete the following so that our docs and examples folders follow suite:

• Add example under provider folder
• Update docs to include supported interfaces

[Tomas2D]

I added examples because I wanted to try it with my GCP credentials.

However, the implementation needs to be fixed, and the following updates are needed.

• The parameters property is not used and is not typed; ideally, they should correspond or map to `BaseModelParams.
• hence, you should completely rework the utility function createModel
• your code contains expressions like for await (const chunk of await response.stream) {, rewrite to just for await (const chunk of response.stream) {