Skip to content

Issues: NVIDIA/TransformerEngine

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

140 Open 178 Closed
140 Open 178 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

FP8 for norm inputs and residuals?
#1193 opened Sep 21, 2024 by cbcase
[PyTorch] FP8 and activation checkpointing causes training instabilities
#1190 opened Sep 18, 2024 by Marks101
@ksivaman
FSDP: How to do all-gather using FP8?
#1188 opened Sep 17, 2024 by vgoklani
3
fused_attn_fwd_qkvpacked silently doesn't support 3 or 7 heads
#1182 opened Sep 15, 2024 by ajayjain
1
@cyanguwa
1
[Question] fp8 amax_history setup
#1169 opened Sep 9, 2024 by tylaar
AssertionError: Outputs not close enough in tensor in test_numerics.py bug Something isn't working
#1165 opened Sep 6, 2024 by sirutBuasai
AssertionError: Device compute capability 8.9 or higher required for FP8 execution.
#1159 opened Sep 5, 2024 by kamrul-NSL
1
installation guide for NVHPC SDK
#1156 opened Sep 4, 2024 by jinz2014
The question about flash attention and fused attention
#1153 opened Sep 3, 2024 by HenHenry-Z
1
Dose the FA3 commit of TE support bf16 or mixed precision？
#1144 opened Aug 28, 2024 by Desperadoze
fp8_model_init doesn't work with DDP
#1135 opened Aug 26, 2024 by MaciejBalaNV
3
RMSNorm precision different from HF implementation
#1132 opened Aug 23, 2024 by void-main
5
Transformer Engine using FlashAttention V3
#1125 opened Aug 21, 2024 by heavyrain-lzy
1
How to debug CUDNN_STATUS_EXECUTION_FAILED?
#1116 opened Aug 15, 2024 by vedantroy
@cyanguwa
6
TE 1.4 fused attn caused a NaN when backward
#1101 opened Aug 13, 2024 by Jack47
1
How to use var_len attention in context parallel?
#1080 opened Aug 6, 2024 by liuzhaowen1218
@cyanguwa
1
stuck at building wheel
#1077 opened Aug 5, 2024 by neurosynapse
3
When will comm-gemm-overlap support multi nodes?
#1071 opened Aug 2, 2024 by umiswing
@denera
6
[PyTorch] Bug in FP8 buffer update causing training instabilities
#1047 opened Jul 26, 2024 by Marks101
@ksivaman
1
why context parallel do not support alibi?
#1046 opened Jul 26, 2024 by Monekyzoon
@cyanguwa
2
Error pre-training BERT
#1043 opened Jul 25, 2024 by fabiancpl
@ksivaman
1
apply_query_key_layer_scaling
#1030 opened Jul 22, 2024 by wccccp
@ksivaman
1
jaxlib.xla_extension.XlaRuntimeError: UNIMPLEMENTED: No registered implementation for custom call to xxx for platform CUDA bug Something isn't working jax
#1024 opened Jul 18, 2024 by MoFHeka
@denera
4
Bulid transformer enginer is failed caused by cmake command error!
#1020 opened Jul 17, 2024 by sfdeggb
1
Error in NVRTC compilation bug Something isn't working
#1018 opened Jul 16, 2024 by tarunvallabh
@timmoon10
5
ProTip! Mix and match filters to narrow down what you’re looking for.