Skip to content

Commit

Permalink
formatting
Browse files Browse the repository at this point in the history
  • Loading branch information
callummcdougall committed Oct 7, 2024
1 parent e33c8e8 commit 4deca23
Showing 1 changed file with 3 additions and 1 deletion.
4 changes: 3 additions & 1 deletion sae_lens/sae.py
Original file line number Diff line number Diff line change
Expand Up @@ -442,7 +442,9 @@ def forward(
sae_in @ (self.W_enc * self.r_mag.exp()) + self.b_mag
)
feature_magnitudes = self.activation_fn(magnitude_pre_activation)
feature_acts_clean = self.hook_sae_acts_post(active_features * feature_magnitudes)
feature_acts_clean = self.hook_sae_acts_post(
active_features * feature_magnitudes
)
x_reconstruct_clean = self.reshape_fn_out(
self.apply_finetuning_scaling_factor(feature_acts_clean)
@ self.W_dec
Expand Down

0 comments on commit 4deca23

Please sign in to comment.