Update to PyTorch 1.9.0

[fritzo]

Addresses #2886

• Updates to torch>=1.9
• Replaces torch.cholesky -> torch.linalg.cholesky
• Replaces torch.symeig -> torch.linalg.eigvalsh
• Replaces torch.solve(B,A)[0] -> torch.linalg.solve(A,B)
• Works around torch.tensordot(-,-,0) no longer works pytorch/pytorch#61096
• Works around [Bug] TypeError: __array__() takes 1 positional argument but 2 were given pytorch/pytorch#61125

[fritzo]

@eb8680 @ordabayevy I'm seeing some failures when updating Pyro to use funsor master:

pytest tests/contrib/funsor/test_vectorized_markov.py::test_model_enumerated_elbo
...
AttributeError: module 'funsor.sum_product' has no attribute 'dynamic_partial_sum_product'

Can you please advise on how to update this test or the usage?

[ordabayevy]

Hi @fritzo . dynamic_partial_sum_product was added in the very last commit to the funsor master branch and is used by TraceMarkovEnum_ELBO with new tests in test_vectorized_markov.py. Maybe make a funsor release first? Otherwise we will have to change back TraceMarkovEnum_EBLO and disable some tests.

[fritzo]

Thanks @ordabayevy, it looks like my funsor master branch was just stale; I've updated and pushed and hopefully things should work now 🤞

[fritzo]

Could either @eb8680 or @neerajprad review this please?

[eb8680]

LGTM assuming the Funsor release didn't break anything

[fritzo]

Thanks @eb8680!