| Operation | Implemented | Function | Gradient Implemented |
|---|---|---|---|
| Abs | ✔️ | absolute |
✔️ |
| Acos | ✔️ | acos |
✔️ |
| Acosh | ✔️ | acosh |
✔️ |
| Add | ✔️ | add |
✔️ |
| And | ✔️ | logical_and |
❌ |
| ArgMax | ✔️ | argmax |
❌ |
| ArgMin | ✔️ | argmin |
❌ |
| Asin | ✔️ | asin |
✔️ |
| Asinh | ✔️ | asinh |
✔️ |
| Atan | ✔️ | atan |
✔️ |
| Atanh | ✔️ | atanh |
✔️ |
| AveragePool | ✔️ | nn.average_pool |
❌ |
| BatchNormalization | ✔️ (eval mode only) | nn.batch_normalization |
❌ |
| BitShift | ✔️ | bitshift, right_shift, left_shift |
❌ |
| Cast | ✔️ | cast |
❌ |
| Ceil | ✔️ | ceil |
❌ |
| Clip | ✔️ | clip |
❌ |
| Compress | ✔️ | compress |
❌ |
| Concat | ✔️ | concat |
❌ |
| ConcatFromSequence | ❌ | ❌ | |
| Constant | ✔️ | constant |
❌ |
| ConstantOfShape | ✔️ | constant_of_shape |
❌ |
| Conv | ✔️ | nn.conv |
❌ |
| ConvInteger | ✔️ (tests not working) | nn.conv_integer |
❌ |
| ConvTranspose | ✔️ | nn.conv_transpose |
❌ |
| Cos | ✔️ | cos |
✔️ |
| Cosh | ✔️ | cosh |
✔️ |
| CumSum | ✔️ | cumsum |
❌ |
| DepthToSpace | ✔️ | nn.depth_to_space |
❌ |
| DequantizeLinear | ✔️ | nn.dequantize_linear |
❌ |
| Det | ✔️ | det |
❌ |
| Div | ✔️ | divide |
✔️ |
| Dropout | ✔️ | nn.dropout |
❌ |
| Einsum | ✔️ | einsum |
❌ |
| Elu | ✔️ | nn.elu |
❌ |
| Equal | ✔️ | equal |
❌ |
| Erf | ✔️ | erf |
❌ |
| Exp | ✔️ | exp |
✔️ |
| Expand | ✔️ | expand |
❌ |
| EyeLike | ✔️ | eye_like |
❌ |
| Flatten | ✔️ | flatten |
❌ |
| Floor | ✔️ | floor |
❌ |
| GRU | ✔️ | nn.gru |
❌ |
| Gather | ✔️ | nn.gather |
❌ |
| GatherElements | ✔️ | nn.gather_elements |
❌ |
| GatherND | ✔️ | nn.gathernd |
❌ |
| Gemm | ✔️ | gemm |
❌ |
| GlobalAveragePool | ✔️ | nn.global_average_pool |
❌ |
| GlobalLpPool | ✔️ | nn.global_lp_pool |
❌ |
| GlobalMaxPool | ✔️ | nn.global_max_pool |
❌ |
| Greater | ✔️ | greater |
❌ |
| GreaterOrEqual | ✔️ | greater_equal |
❌ |
| HardSigmoid | ✔️ | nn.hard_sigmoid |
❌ |
| Hardmax | ✔️ | nn.hardmax |
❌ |
| Identity | ✔️ | identity |
❌ |
| If | ❌ | ❌ | |
| InstanceNormalization | ✔️ | instance_normalization |
❌ |
| IsInf | ✔️ | isinf , isneginf , isposinf |
❌ |
| IsNaN | ✔️ | isnan |
❌ |
| LRN | ✔️ | lrn |
❌ |
| LSTM | ✔️ | nn.lstm |
❌ |
| LeakyRelu | ✔️ | nn.leakyrelu |
❌ |
| Less | ✔️ | less |
❌ |
| LessOrEqual | ✔️ | less_equal |
❌ |
| Log | ✔️ | log |
✔️ |
| LogSoftmax | ✔️ | nn.logsoftmax |
❌ |
| Loop | ❌ | ❌ | |
| LpNormalization | ✔️ | nn.lp_normalization |
❌ |
| LpPool | ✔️ | nn.lp_pool |
❌ |
| MatMul | ✔️ | matmul |
❌ |
| MatMulInteger | ✔️ | matmul_integer |
❌ |
| Max | ✔️ | max |
❌ |
| MaxPool | ✔️ | nn.maxpool |
❌ |
| MaxRoiPool | ✔️ | nn.maxroipool |
❌ |
| MaxUnpool | ✔️ | nn.maxunpool |
❌ |
| Mean | ✔️ | elementwise_mean |
❌ |
| Min | ✔️ | minimum |
❌ |
| Mod | ✔️ | mod |
❌ |
| Mul | ✔️ | multiply |
✔️ |
| Multinomial | ✔️ | random.multinomial |
❌ |
| Neg | ✔️ | negative |
❌ |
| NegativeLogLikelihoodLoss | ✔️ (unstable) | nn.negative_loglikelihood_loss |
❌ |
| NonMaxSuppression | ✔️ | nn.non_max_suppression |
❌ |
| NonZero | ✔️ | nonzero |
❌ |
| Not | ✔️ | not_ |
❌ |
| OneHot | ✔️ | one_hot |
❌ |
| Or | ✔️ | logical_or |
❌ |
| PRelu | ✔️ | nn.prelu |
❌ |
| Pad | ❌ | ❌ | |
| Pow | ✔️ | power |
✔️ |
| QLinearConv | ❌ | ❌ | |
| QLinearMatMul | ❌ | ❌ | |
| QuantizeLinear | ❌ | ❌ | |
| RNN | ❌ | ❌ | |
| RandomNormal | ✔️ | random.normal |
❌ |
| RandomNormalLike | ✔️ | random.normal_like |
❌ |
| RandomUniform | ✔️ | random.uniform |
❌ |
| RandomUniformLike | ✔️ | random.uniform_like |
❌ |
| Reciprocal | ✔️ | reciprocal |
❌ |
| ReduceL1 | ✔️ | l1_norm |
❌ |
| ReduceL2 | ✔️ | l2_norm |
❌ |
| ReduceLogSum | ✔️ | log_sum |
❌ |
| ReduceLogSumExp | ✔️ | log_sum_exp |
❌ |
| ReduceMax | ✔️ | max |
❌ |
| ReduceMean | ✔️ | mean |
✔️ |
| ReduceMin | ✔️ | min |
❌ |
| ReduceProd | ✔️ | prod |
❌ |
| ReduceSum | ✔️ | sum |
❌ |
| ReduceSumSquare | ✔️ | sum_square |
❌ |
| Relu | ✔️ | relu |
❌ |
| Reshape | ✔️ | reshape |
❌ |
| Resize | ✔️ | interpolate |
❌ |
| ReverseSequence | ❌ | ❌ | |
| RoiAlign | ❌ | ❌ | |
| Round | ✔️ | round |
❌ |
| Scan | ❌ | ❌ | |
| Scatter | Deprecated | ❌ | |
| ScatterElements | ✔️ | nn.scatter |
❌ |
| ScatterND | ✔️ | nn.scatter_nd |
❌ |
| Selu | ✔️ | nn.selu |
❌ |
| SequenceAt | ❌ | ❌ | |
| SequenceConstruct | ❌ | ❌ | |
| SequenceEmpty | ❌ | ❌ | |
| SequenceErase | ❌ | ❌ | |
| SequenceInsert | ❌ | ❌ | |
| SequenceLength | ❌ | ❌ | |
| Shape | ✔️ | shape |
❌ |
| Shrink | ✔️ | nn.shrink |
❌ |
| Sigmoid | ✔️ | nn.sigmoid |
❌ |
| Sign | ✔️ | sign |
❌ |
| Sin | ✔️ | sin |
✔️ |
| Sinh | ✔️ | sinh |
✔️ |
| Size | ✔️ | size |
❌ |
| Slice | ✔️ | slice and Array.__getitem__ |
❌ |
| Softplus | ✔️ | nn.softplus |
❌ |
| Softsign | ✔️ | nn.softsign |
❌ |
| SpaceToDepth | ✔️ | nn.space_to_depth |
❌ |
| Split | ❌ | ❌ | |
| SplitToSequence | ❌ | ❌ | |
| Sqrt | ✔️ | sqrt |
✔️ |
| Squeeze | ✔️ | squeeze |
❌ |
| StringNormalizer | ❌ | ❌ | |
| Sub | ✔️ | subtract |
✔️ |
| Sum | ❌ | ❌ | |
| Tan | ✔️ | tan |
✔️ |
| Tanh | ✔️ | tanh |
✔️ |
| TfIdfVectorizer | ❌ | ❌ | |
| ThresholdedRelu | ✔️ | nn.thresholded_relu |
❌ |
| Tile | ✔️ | tile |
❌ |
| TopK | ✔️ | topk |
❌ |
| Transpose | ✔️ | transpose |
❌ |
| Trilu | ❌ | ❌ | |
| Unique | ✔️ | unique |
❌ |
| Unsqueeze | ✔️ | unsqueeze |
❌ |
| Upsample | Deprecated | ❌ | |
| Where | ✔️ | where |
❌ |
| Xor | ✔️ | logical_xor |
❌ |