Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Improve visibility of LLM candidates in the arena for user awareness #25

Open
kangsuhyun-yanolja opened this issue Feb 5, 2024 · 2 comments
Assignees

Comments

@kangsuhyun-yanolja
Copy link
Collaborator

Users currently lack the ability to see which Language Learning Models (LLMs) are included in our arena. This lack of visibility makes it difficult for users to understand the range of models they are interacting with or comparing. To enhance user awareness and engagement, it's crucial to display information about the LLM candidates available in the arena.

@kangsuhyun-yanolja kangsuhyun-yanolja self-assigned this Feb 5, 2024
@kimsooyeon-yanolja
Copy link

kimsooyeon-yanolja commented Mar 21, 2024

@kangsuhyun-yanolja
Do we have our own data on how much each model has been exposed to testing and comparison?
It seems important for boosting user leaderboard reliability to ensure a fair distribution of model testing.

if the number of tests is relatively low compared to other leaderboards, it would be good to directly convey that the model exposure count follows a uniform distribution.

cc. @seungduk-yanolja

@kangsuhyun-yanolja
Copy link
Collaborator Author

We store every battle result so I think we could implement the uniform distribution. thank you for the comment!

kangsuhyun-yanolja added a commit that referenced this issue Sep 29, 2024
This PR adds Llama 3.2 models using DeepInfra API.

Also, it adds a list of available models to the UI to help users check what models are available.
kangsuhyun-yanolja added a commit that referenced this issue Oct 11, 2024
* [#25|#128] Add Llama 3.2 models and available models list

This PR adds Llama 3.2 models using DeepInfra API.

Also, it adds a list of available models to the UI to help users check what models are available.

* 002
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants