[Interpreter] Add exp and log to the interpreter.

[srush]

Getting errors with these in the latest version of triton.

[jlebar]

Needs tests (see the other interpreter PRs that have been merged).

cc @Jokeren

[Jokeren]

Agree.

Maybe merge the test with test_math_divide_op.

Also I think we could have test_math.py out of test_core.py in the future? What do you think @jlebar ?

[jlebar]

Also I think we could have test_math.py out of test_core.py in the future? What do you think @jlebar ?

Personally I think splitting up tests into separate files is useful if and only if we can make a simple rule for why something is in file X versus Y. For example, if math were in a separate namespace, or if it were defined in a separate implementation file, then, fine. But if it's all defined in core.py and it's all in namespace triton.language, I think it invites confusion, e.g. why is tl.minimum in test_math but tl.min in test_core?

But I don't feel strongly and as the person doing the actual work I defer to you.

[Jokeren]

Oh sorry, I think I missed some previous commits. I thought all libdevice functions are still under tl.math, actually they have been refactored out to triton.language.extra.cuda. Never mind.

[Jokeren]

Merge it for now. And I'll clean up math functions in tl.math and tl in another PR