[DRR] C++ DRR (Declarative Rewrite Rule) of Paddle (PaddlePaddle#55859)

* fix cudnn 8.7+ bug on cudnnConvolutionBiasActivationForward

* add drr_rewrite_pattern.h and remove_redundent_reshape demo

* add drr_context and pattern_graph class

* add test case

* fix cmake file

* fix compile bug

* fix runtime bug and refine code

* add MatchContext

* update code

* add impl of tensor_interface

* fix compile bug

* change smart ptr to pointor

* change smart to pointor

* change smart to pointor

* Replace 'weak_ptr' with pointer

* modify weak_ptr use count==0 judgment logic

* change smart to pointor

change smart to pointor

Replace 'weak_ptr' with pointer

modify weak_ptr use count==0 judgment logic

Replace the declaration and call of weakptr with pointer

* add match

* add match

* remove OperationInterface

* update

* Add Rewrite impl of DrrRewritePattern

* refine code

* rename ir_value to get in IrValue

* fix header include

* add CreateOperation template demo

* Add GraphTopo class in pattern_graph

* Reimplementing the GraphTopo class using queue

* Reimplementing the GraphTopo class using queue

* Optimize the access method of visited tensor

* Considering that the inputs of opcall may be empty

* Overloading the operator() method of Op, supporting dual tensor inputs

* support attr

* 1. Add Op class support for multi input and multi output function. 2. Add DRR duplicate TransposeOp merge testing code

* 1. Add transferOP in createOption func

* fix bug

* fix NotifyOperationRemoved

* refine code

* Fix axis bug in perm

* mupdate share_ptr

* update

* refine drr_test ut

* Modify according to review

* modify reshape_op

* format code

* support vector<int> for attr

* fix drr test

* refine code

* Resolve compilation loop dependencies

* add RequireNativeCall

* support native_call in drr api

* temp tensor prefix fix

* refine code

* suport Tensor Assgin API in ResultPattern

* refine test code

* refactor ther drr_pattern class

* refine test case

* rename  DrrPatternBuilder to DrrPatternBase

* fix compile bug

* adjust include

* Add log info in DrrRewritePattern

* use ir::get_type_name

* use ir::get_type_name

* support compute attrbute in drr pattern

* refine code

* Add fusion testing code for fullOp and expandOp

* Standardize code format

* Replace IR_THROW() with PADDLE_THROW()

* refine code

* add attention fuse demo

* update

* fix compile error

* add multihead_matmul fuse pattern

* fix multihead_matmul

* Update drr_attention_fuse_test.cc

add buildprogram

* fix drr_attention_fuse_test compile

* add fused_gemm_epilogue in drr

* attr support std::vector<int64_t>

* add debug log

* update

* fix some bug

* fix confilct

* support subgraph replace in source pattern graph for drr

* Improve the implementation of Drr and multihead_matmul_fuse_pass

* add ReorderBlockOpsPass

* fix drr_attention_fuse_pass

* update

* update reorder_block_ops_pass

* revert fusedgemm

* update

* Add Bottom2UpMatch() func

* merge code

* fix bug

* add log & fix bug

* refine cpp type trait

* using oprand() & num_oprand() replace oprands()

* fix conflict

* fix compile

* fix pd.xxx to pd_op.xxx

* fix bug of delete op in drr

* add PatternGraphMatchV2 & FindOutputOp func

* refactor ir operation creator

* fix include pir

* fix ir

* merging

* Split out dfsvisitor func from FindOutputOp func

* fix bug

* fix output op in source pattern bug

* Debugging drr_test drr_attention_fuse_test passed!

* Debugging drr_fuse_linear_test passed!

* Optimize the PatternGraphMatchV2 function interface and overload the operator= method in  MatchContextImpl

* Modify comments and function names

* auto code-gen for creating ir operation in drr

* delete debug log

* optimize the interface of MatchFromOutputToInput()

* Optimize SourcePatternGraph::OutputNodes judgment logic

* polish code

* using default operator=() in MatchContextImpl

* fix merge conflict

* create test case: drr_same_name_test

* fix duplicate binding of ir op bug

* Rename drr_same_name_test to drr_same_type_binding_test & Add graphical notes

* refactor logic of insert point for creating new operation in drr

* update

* fix compile error

* fix some bug

* fix codestyle

* fix bug

* Update anchor node judgment logic

* fix bug of link pir

* fix codestyle

* self review v1

* refine code format

* set thread_local for count in op class

* fix compile on mac

* remove unused .h in value.cc

* fix compile

---------

Co-authored-by: zyfncg <zhangyunfei07@baidu.com>
Co-authored-by: gongshaotian <gstian5555@outlook.com>
Co-authored-by: gongshaotian <>
Co-authored-by: gongshaotian <141618702+gongshaotian@users.noreply.github.com>

paddle/fluid/pir/CMakeLists.txt

@@ -1,2 +1,3 @@
 add_subdirectory(dialect)
 add_subdirectory(transforms)
+add_subdirectory(drr)

paddle/fluid/pir/dialect/op_generator/op_creator_drr_gen.py

@@ -0,0 +1,166 @@
+# Copyright (c) 2023 PaddlePaddle Authors. All Rights Reserved.
+#
+# Licensed under the Apache License, Version 2.0 (the "License");
+# you may not use this file except in compliance with the License.
+# You may obtain a copy of the License at
+#
+#     http://www.apache.org/licenses/LICENSE-2.0
+#
+# Unless required by applicable law or agreed to in writing, software
+# distributed under the License is distributed on an "AS IS" BASIS,
+# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+# See the License for the specific language governing permissions and
+# limitations under the License.
+
+import argparse
+
+import yaml
+from op_gen import OpCompatParser, OpInfoParser, to_pascal_case
+
+CPP_FILE_TEMPLATE = """
+#include "paddle/fluid/pir/drr/ir_operation_factory.h"
+
+#include "paddle/fluid/pir/dialect/operator/ir/pd_op.h"
+#include "paddle/fluid/pir/dialect/operator/ir/manual_op.h"
+
+namespace pir {{
+namespace drr {{
+
+void OperationFactory::RegisterGeneratedOpCreator() {{
+{body}
+}}
+
+}}  // namespace drr
+}}  // namespace pir
+
+"""
+
+NORMAL_FUNCTION_TEMPLATE = """
+  RegisterOperationCreator(
+      "{op_name}",
+      [](const std::vector<Value>& inputs,
+         const pir::AttributeMap& attrs,
+         pir::PatternRewriter& rewriter) {{
+        return rewriter.Build<paddle::dialect::{op_class_name}>(
+         {params_code});
+      }});
+"""
+
+MUTABLE_ATTR_FUNCTION_TEMPLATE = """
+  RegisterOperationCreator(
+      "{op_name}",
+      [](const std::vector<Value>& inputs,
+         const pir::AttributeMap& attrs,
+         pir::PatternRewriter& rewriter) {{
+        // mutable_attr is tensor
+        if (inputs.size() > {inputs_num}) {{
+          return rewriter.Build<paddle::dialect::{op_class_name}>(
+          {params_code_with_mutable_attr});
+        }} else {{
+          return rewriter.Build<paddle::dialect::{op_class_name}>(
+          {params_code_no_mutable_attr});
+        }}
+      }});
+"""
+
+
+class OpCreatorCodeGen:
+    def __init__(self, op_yaml_files, op_compat_yaml_file, dialect_name):
+        self.op_info_items = self.parse_yaml(op_yaml_files, op_compat_yaml_file)
+        self.dialect_name = dialect_name
+
+    def parse_yaml(self, op_yaml_files, op_compat_yaml_file):
+        op_compat_parser = OpCompatParser(op_compat_yaml_file)
+
+        op_yaml_items = []
+        for yaml_file in op_yaml_files:
+            with open(yaml_file, "r") as f:
+                ops = yaml.safe_load(f)
+                op_yaml_items = op_yaml_items + ops
+        op_info_items = []
+        for op in op_yaml_items:
+            op_compat_item = op_compat_parser.get_compat(op['name'])
+            if (
+                op_compat_item is not None
+                and op_compat_item['op'] == "pow"
+                and 'scalar' in op_compat_item
+            ):
+                op_compat_item = op_compat_item.pop('scalar')
+            op_info_items.append(OpInfoParser(op, op_compat_item))
+        return op_info_items
+
+    def gen_cpp_file_code(self, cpp_file_path):
+        body_code = ""
+        for op_info_item in self.op_info_items:
+            if op_info_item.infer_meta_map is None:
+                continue
+            for phi_op_name in op_info_item.op_phi_name:
+                ir_op_name = self.dialect_name + "." + phi_op_name
+                params_no_mutable_attr = []
+                for i in range(len(op_info_item.input_name_list)):
+                    params_no_mutable_attr.append(
+                        f"inputs[{i}].dyn_cast<pir::OpResult>()"
+                    )
+                if len(op_info_item.attribute_name_list) > 0:
+                    params_no_mutable_attr.append("attrs")
+
+                if len(op_info_item.mutable_attribute_name_list) == 0:
+                    body_code += NORMAL_FUNCTION_TEMPLATE.format(
+                        op_name=ir_op_name,
+                        op_class_name=(to_pascal_case(phi_op_name) + "Op"),
+                        params_code=", ".join(params_no_mutable_attr),
+                    )
+                else:
+                    params_with_mutable_attr = []
+                    for i in range(
+                        len(op_info_item.input_name_list)
+                        + len(op_info_item.mutable_attribute_name_list)
+                    ):
+                        params_with_mutable_attr.append(
+                            f"inputs[{i}].dyn_cast<pir::OpResult>()"
+                        )
+                    if len(op_info_item.attribute_name_list) > len(
+                        op_info_item.mutable_attribute_name_list
+                    ):
+                        # TODO(zyfncg): Currently Op::Build Interface doesn't support this case.
+                        continue
+                        # params_with_mutable_attr.append("attrs")
+
+                    body_code += MUTABLE_ATTR_FUNCTION_TEMPLATE.format(
+                        op_name=ir_op_name,
+                        inputs_num=len(op_info_item.input_name_list),
+                        op_class_name=(to_pascal_case(phi_op_name) + "Op"),
+                        params_code_with_mutable_attr=",".join(
+                            params_with_mutable_attr
+                        ),
+                        params_code_no_mutable_attr=", ".join(
+                            params_no_mutable_attr
+                        ),
+                    )
+
+        with open(cpp_file_path, 'w') as f:
+            f.write(CPP_FILE_TEMPLATE.format(body=body_code))
+
+
+def ParseArguments():
+    parser = argparse.ArgumentParser(
+        description='Generate Op Creator Files By Yaml'
+    )
+    parser.add_argument('--op_yaml_files', type=str)
+    parser.add_argument('--op_compat_yaml_file', type=str)
+    parser.add_argument('--dialect_name', type=str)
+    parser.add_argument('--op_creator_file', type=str)
+    return parser.parse_args()
+
+
+if __name__ == '__main__':
+    args = ParseArguments()
+    op_yaml_files = args.op_yaml_files.split(",")
+    op_compat_yaml_file = args.op_compat_yaml_file
+    op_creator_file = args.op_creator_file
+    dialect_name = args.dialect_name
+
+    code_gen = OpCreatorCodeGen(
+        op_yaml_files, op_compat_yaml_file, dialect_name
+    )
+    code_gen.gen_cpp_file_code(op_creator_file)

paddle/fluid/pir/drr/CMakeLists.txt

@@ -0,0 +1,65 @@
+file(GLOB DRR_SRCS "*.cc" "api/*.cc")
+
+set(op_creator_gen_file
+    ${PADDLE_SOURCE_DIR}/paddle/fluid/pir/dialect/op_generator/op_creator_drr_gen.py
+)
+set(op_compat_yaml_file ${PADDLE_SOURCE_DIR}/paddle/phi/api/yaml/op_compat.yaml)
+set(op_forward_yaml_file1
+    ${PADDLE_SOURCE_DIR}/paddle/fluid/operators/generator/parsed_ops/ops.parsed.yaml
+)
+set(op_forward_yaml_file2
+    ${PADDLE_SOURCE_DIR}/paddle/fluid/operators/generator/parsed_ops/legacy_ops.parsed.yaml
+)
+set(op_backward_yaml_file1
+    ${PADDLE_SOURCE_DIR}/paddle/fluid/operators/generator/parsed_ops/backward_ops.parsed.yaml
+)
+set(op_backward_yaml_file2
+    ${PADDLE_SOURCE_DIR}/paddle/fluid/operators/generator/parsed_ops/legacy_backward_ops.parsed.yaml
+)
+set(fused_op_forward_yaml_file
+    ${PADDLE_SOURCE_DIR}/paddle/fluid/operators/generator/parsed_ops/fused_ops.parsed.yaml
+)
+set(fused_op_backward_yaml_file
+    ${PADDLE_SOURCE_DIR}/paddle/fluid/operators/generator/parsed_ops/fused_backward.parsed.yaml
+)
+
+set(parsed_op_dir
+    ${PADDLE_SOURCE_DIR}/paddle/fluid/pir/dialect/operator/ir/generated)
+
+set(op_yaml_file3 ${parsed_op_dir}/ops.parsed.yaml)
+set(op_yaml_file4 ${parsed_op_dir}/ops_backward.parsed.yaml)
+
+set(op_yaml_files
+    ${op_forward_yaml_file1},${op_forward_yaml_file2},${op_backward_yaml_file1},${op_backward_yaml_file2},${fused_op_forward_yaml_file},${fused_op_backward_yaml_file},${op_yaml_file3},${op_yaml_file4}
+)
+
+set(op_creator_file
+    ${PADDLE_BINARY_DIR}/paddle/fluid/pir/drr/ir_op_factory_generated.cc)
+set(op_creator_file_tmp ${op_creator_file}.tmp)
+
+set(dialect_name pd_op)
+
+add_custom_command(
+  OUTPUT ${op_creator_file}
+  COMMAND
+    ${PYTHON_EXECUTABLE} ${op_creator_gen_file} --op_yaml_files ${op_yaml_files}
+    --op_compat_yaml_file ${op_compat_yaml_file} --dialect_name ${dialect_name}
+    --op_creator_file ${op_creator_file_tmp}
+  COMMAND ${CMAKE_COMMAND} -E copy_if_different ${op_creator_file_tmp}
+          ${op_creator_file}
+  COMMENT "copy_if_different ${op_creator_file}"
+  DEPENDS ${op_creator_gen_file}
+          ${op_forward_yaml_file1}
+          ${op_forward_yaml_file2}
+          ${op_backward_yaml_file1}
+          ${op_backward_yaml_file2}
+          ${op_compat_yaml_file}
+          ${op_yaml_file3}
+          ${op_yaml_file4}
+          pd_op_dialect_op
+  VERBATIM)
+
+cc_library(
+  drr
+  SRCS ${DRR_SRCS} ${op_creator_file}
+  DEPS pd_op_dialect pir)

paddle/fluid/pir/drr/api/drr_pattern_base.h

@@ -0,0 +1,41 @@
+// Copyright (c) 2023 PaddlePaddle Authors. All Rights Reserved.
+//
+// Licensed under the Apache License, Version 2.0 (the "License");
+// you may not use this file except in compliance with the License.
+// You may obtain a copy of the License at
+//
+//     http://www.apache.org/licenses/LICENSE-2.0
+//
+// Unless required by applicable law or agreed to in writing, software
+// distributed under the License is distributed on an "AS IS" BASIS,
+// WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+// See the License for the specific language governing permissions and
+// limitations under the License.
+
+#pragma once
+
+#include "paddle/fluid/pir/drr/api/drr_pattern_context.h"
+#include "paddle/fluid/pir/drr/drr_rewrite_pattern.h"
+
+namespace pir {
+namespace drr {
+
+template <typename DrrPattern>
+class DrrPatternBase {
+ public:
+  virtual ~DrrPatternBase() = default;
+
+  // Define the Drr Pattern.
+  virtual void operator()(pir::drr::DrrPatternContext* ctx) const = 0;
+
+  std::unique_ptr<DrrRewritePattern<DrrPattern>> Build(
+      pir::IrContext* ir_context, pir::PatternBenefit benefit = 1) const {
+    DrrPatternContext drr_context;
+    this->operator()(&drr_context);
+    return std::make_unique<DrrRewritePattern<DrrPattern>>(
+        drr_context, ir_context, benefit);
+  }
+};
+
+}  // namespace drr
+}  // namespace pir