evanhanders / sae_validation_blogpost Public

Small experiments for verifying how good SAEs are.

Notifications

Name		Name	Last commit message	Last commit date
Latest commit History 12 Commits
README.md		README.md
activation_scatterplot_cbt.png		activation_scatterplot_cbt.png
activation_scatterplot_lambada.png		activation_scatterplot_lambada.png
cbt_accuracy.png		cbt_accuracy.png
cbt_df.csv		cbt_df.csv
context_size_df.csv		context_size_df.csv
context_sizes.png		context_sizes.png
context_sizes_CE.png		context_sizes_CE.png
delta_ln_prob_cbt.png		delta_ln_prob_cbt.png
delta_ln_prob_lambada.png		delta_ln_prob_lambada.png
err_prop.png		err_prop.png
feature_hist_cbt.png		feature_hist_cbt.png
feature_hist_lambada.png		feature_hist_lambada.png
gpt2_small_autoencoder_benchmarks.ipynb		gpt2_small_autoencoder_benchmarks.ipynb
lambada_accuracy.png		lambada_accuracy.png
lambada_df.csv		lambada_df.csv
layer_effect_cbt.png		layer_effect_cbt.png
layer_effect_delta_ln_prob_cbt.png		layer_effect_delta_ln_prob_cbt.png
layer_effect_delta_ln_prob_lambada.png		layer_effect_delta_ln_prob_lambada.png
layer_effect_l2_activation_cbt.png		layer_effect_l2_activation_cbt.png
layer_effect_l2_activation_lambada.png		layer_effect_l2_activation_lambada.png
layer_effect_lambada.png		layer_effect_lambada.png
model_activations_vs_mse.png		model_activations_vs_mse.png
scatterhists_cbt.png		scatterhists_cbt.png
scatterhists_lambada.png		scatterhists_lambada.png