Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[FEAT] Cluster evaluation - with ground truth data #2191

Open
OlivierBinette opened this issue May 20, 2024 · 0 comments
Open

[FEAT] Cluster evaluation - with ground truth data #2191

OlivierBinette opened this issue May 20, 2024 · 0 comments
Labels
enhancement New feature or request

Comments

@OlivierBinette
Copy link
Contributor

Is your proposal related to a problem?

I have "ground truth" labels for a subset of my data. Specifically I have a set of clusters that I know to be correct, with nothing that should be added or removed from them.

I'd like to use these resolved clusters to evaluate the quality of my clustering results.

Describe the solution you'd like

I'd like to:

  • See how my predicted clustering compares to the ground truth clustering.
  • Compute precision, recall, and cluster metrics based on this set of resolved clusters.
  • Compare summary statistics (e.g. the average cluster size) between my predicted clustering and the ground truth data.

Describe alternatives you've considered

Some of it is implemented in the er-evaluation package, but it's quite slow with its Pandas implementation. Some of the methods are described in my paper https://arxiv.org/pdf/2404.05622, but I think that stuff needs to be simplified.

@OlivierBinette OlivierBinette added the enhancement New feature or request label May 20, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

1 participant