Skip to content

Commit

Permalink
[FA] Remove unused variable rng_engine_inputs
Browse files Browse the repository at this point in the history
  • Loading branch information
tridao committed Jan 25, 2023
1 parent 78b7a1d commit 6b4a482
Showing 1 changed file with 0 additions and 2 deletions.
2 changes: 0 additions & 2 deletions csrc/flash_attn/fmha_api.cpp
Original file line number Diff line number Diff line change
Expand Up @@ -309,7 +309,6 @@ mha_fwd(const at::Tensor &q, // total_q x num_heads x head_size, total_q
// state
// We use a custom RNG that increases the offset by batch_size * nheads * 32.
int64_t counter_offset = launch_params.params.b * launch_params.params.h * 32;
at::PhiloxCudaState rng_engine_inputs;

if( is_dropout ) {
// See Note [Acquire lock when using random generators]
Expand Down Expand Up @@ -612,7 +611,6 @@ mha_fwd_block(const at::Tensor &q, // total_q x num_heads x head_size, t
// number of times random will be generated per thread, to offset philox counter in thc random
// state
int64_t counter_offset = launch_params.elts_per_thread;
at::PhiloxCudaState rng_engine_inputs;

if( is_dropout ) {
// See Note [Acquire lock when using random generators]
Expand Down

0 comments on commit 6b4a482

Please sign in to comment.