Skip to content

SAE Features

Latest
Compare
Choose a tag to compare
@enjalot enjalot released this 20 Dec 16:09

If you've embeded a dataset with nomic-embed-text-v1.5 you can "process SAE" in the embed step.
This will then annotate each row with SAE features from https://enjalot.github.io/latent-taxonomy/articles/about

You can then explore essentially the concepts that the embedding model uses to represent each data point.
You can also filter by a particular SAE feature to see which rows strongly activate for that concept.

Screenshot 2024-12-20 at 11 05 43 AM Screenshot 2024-12-20 at 11 05 51 AM Screenshot 2024-12-20 at 11 06 19 AM