[RFC] Rebase Torch-MLIR Upstream TorchToMhlo Pipeline

[tanyokwok]

Recently, we cooperated with developers from ByteDance AML on upstreaming the TorchToMhlo pass pipeline to Torch-MLIR; see RFC llvm/torch-mlir#999.

The Upstream Status

• Cmake build + code structure [MHLO] Init MHLO integration. llvm/torch-mlir#1083
• Torch to MHLO lowering pipeline [MHLO] Init MHLO integration. llvm/torch-mlir#1083
• Operator coverage
  • Basic Ops (~35 ops)
    [MHLO] Init MHLO basic op conversion llvm/torch-mlir#1092
    [MHLO] Add support for dynamic shape in basic op conversion llvm/torch-mlir#1116
    [MHLO] Support for dynamic shape in basic op conversion by introducing CHLO dialect llvm/torch-mlir#1123
    [MHLO] add aten::gelu op pattern llvm/torch-mlir#1127
    [MHLO] support non-constant torch scalar in BasicOps llvm/torch-mlir#1134
  • View like Ops
    [MHLO] Init MHLO view like op patterns llvm/torch-mlir#1090
    [MHLO] Add [un]squeeze op patterns llvm/torch-mlir#1099
  • Slice like Ops [MHLO] Init MHLO slice like op patterns llvm/torch-mlir#1091
  • Gather Ops [MHLO] Init MHLO gather op patterns llvm/torch-mlir#1104
  • Linear Ops
    [MHLO] Init MHLO linear op patterns llvm/torch-mlir#1132
    [MHLO] Add convolution op pattern llvm/torch-mlir#1152
  • Reduction [MHLO] Init MHLO reduce-like op conversion llvm/torch-mlir#1133
  • Others
    [NFC][MHLO] move util funcs to MhloLegalizeUtils.h/cpp llvm/torch-mlir#1128
    [MHLO] Init MHLO pooling-like op conversion llvm/torch-mlir#1141

We would eventually like to support ResNet and BERT examples in our upstream schedule.

Schedule in BladeDISC Repo

Now I think it's ready to rebase upstream Torch-MLIR. The issue is created to track the progress.

[tanyokwok]

The goals that upstream to Torch-MLIR are complete. And we had rebased our TorchToMhlo pass to the one in Torch-MLIR.