Create a models leaderboard based on your private data.
- AWS account with Amazon Bedrock access to selected models.
- Clone the repository:
git clone https://github.com/aws-samples/fm-leaderboarder.git
To get started, open the example-1 notebook and follow the instructions provided.
This code can interact with the OpenAI service which has terms published here and pricing described here. You should be familiar with the pricing and confirm that your use case complies with the terms before proceeding.
This repository makes use of aws/fmeval Foundation Model Evaluations Library. Please review any license terms applicable to the dataset with your legal team and confirm that your use case complies with the terms before proceeding.
See CONTRIBUTING for more information.
Contributions to FM-Leaderboarder are welcome! Please refer to the CONTRIBUTING.md file for guidelines on how to contribute.
This project is licensed under the Apache-2.0 License.