Support for more pascal architecture GPUs?

[chinoll]

Hi, Tri Tao,

Do you have plans to support more consumer-grade GPUs(e.g., 1080, 1070, 1060)?

[tridao]

We currently support Turing (e.g. RTX 2080) and Ampere (e.g. RTX 3080) GPUs. We rely on tensor cores for matrix multiplication, which older GPUs lack.
You might be interested in the memory-efficient attention implemented by the xformers team (targeting fp32 instead of fp16), which I believe supports Pascal cards:
facebookresearch/xformers#267
facebookresearch/xformers#281

[mihdalal]

Do you support V100? (roadmap doesn't have it crossed out so I wanted to double check): [Jul 2022] Support SM70 GPUs (V100).

[tridao]

Not yet, that'll take some work. Hopefully in the near future.

[chinoll]

We currently support Turing (e.g. RTX 2080) and Ampere (e.g. RTX 3080) GPUs. We rely on tensor cores for matrix multiplication, which older GPUs lack. You might be interested in the memory-efficient attention implemented by the xformers team (targeting fp32 instead of fp16), which I believe supports Pascal cards: facebookresearch/xformers#267 facebookresearch/xformers#281

thanks

[TimJDix]

We rely on tensor cores for matrix multiplication, which older GPUs lack.

What about GPUs like the p40? It uses pascal architecture, but has more tensor cores than a 4090. Is it possible to do add support for this GPU?

[tridao]

What about GPUs like the p40? It uses pascal architecture, but has more tensor cores than a 4090. Is it possible to do add support for this GPU?

I personally don't have plan to do that. We're mostly constrained by time.