Skip to content

Commit

Permalink
update
Browse files Browse the repository at this point in the history
  • Loading branch information
Patrick-Star125 committed Dec 5, 2023
1 parent aa4a35e commit e5483e0
Showing 1 changed file with 0 additions and 1 deletion.
Original file line number Diff line number Diff line change
Expand Up @@ -27,7 +27,6 @@ $$
\begin{aligned}
& \mathrm{ head\_output }=\mathrm{ linear(input, head\_weight, head\_bias) } \\
& \mathrm{ head\_logprob }=\mathrm{ log\_softmax (head\_output, axis) }=1 \\
& \mathrm{output} += \mathrm{take\_along\_axis}(\mathrm{head\_logprob}, \mathrm{gather_inds.unsqueeze(1)}, \mathrm{axis}=1).\mathrm{squeeze()} \\
& \mathrm{loss} = -\mathrm{output.mean()}
\end{aligned}
$$
Expand Down

0 comments on commit e5483e0

Please sign in to comment.