MLP equations

[xuewei4d]

In the equations of MLP

https://github.com/lisa-lab/DeepLearningTutorials/blob/master/doc/mlp.txt#L64

The equations seem missing transpose operations. Since the shape of W is n_input x n_output, i.e. D x D_hidden. There should be a transpose for W in the equation, like W^(1)T x.

[nouiz]

I agree with that change. @lamblin can you confirm?

[lamblin]

It would probably be easier (and clutter less the formulas) to write x \cdot W^{(1)} instead, and it would be consistent with the code (dot(x, W)).