This class coordinates the application of a rewrite on a set of IR, providing a way for clients to track mutations and create new operations. More...
#include "mlir/IR/PatternMatch.h"
Inheritance diagram for mlir::RewriterBase:Classes | |
| struct | ForwardingListener |
| A listener that forwards all notifications to another listener. More... | |
| struct | Listener |
| struct | PatternLoggingListener |
| A listener that logs notification events to llvm::dbgs() before forwarding to the base listener. More... | |
Public Member Functions | |
| void | inlineRegionBefore (Region ®ion, Region &parent, Region::iterator before) |
| Move the blocks that belong to "region" before the given position in another region "parent". More... | |
| void | inlineRegionBefore (Region ®ion, Block *before) |
| virtual void | replaceOp (Operation *op, ValueRange newValues) |
| Replace the results of the given (original) operation with the specified list of values (replacements). More... | |
| virtual void | replaceOp (Operation *op, Operation *newOp) |
| Replace the results of the given (original) operation with the specified new op (replacement). More... | |
| template<typename OpTy , typename... Args> | |
| OpTy | replaceOpWithNewOp (Operation *op, Args &&...args) |
| Replace the results of the given (original) op with a new op that is created without verification (replacement). More... | |
| virtual void | eraseOp (Operation *op) |
| This method erases an operation that is known to have no uses. More... | |
| virtual void | eraseBlock (Block *block) |
| This method erases all operations in a block. More... | |
| virtual void | inlineBlockBefore (Block *source, Block *dest, Block::iterator before, ValueRange argValues={}) |
| Inline the operations of block 'source' into block 'dest' before the given position. More... | |
| void | inlineBlockBefore (Block *source, Operation *op, ValueRange argValues={}) |
| Inline the operations of block 'source' before the operation 'op'. More... | |
| void | mergeBlocks (Block *source, Block *dest, ValueRange argValues={}) |
| Inline the operations of block 'source' into the end of block 'dest'. More... | |
| Block * | splitBlock (Block *block, Block::iterator before) |
| Split the operations starting at "before" (inclusive) out of the given block into a new block, and return it. More... | |
| void | moveOpBefore (Operation *op, Operation *existingOp) |
Unlink this operation from its current block and insert it right before existingOp which may be in the same or another block in the same function. More... | |
| void | moveOpBefore (Operation *op, Block *block, Block::iterator iterator) |
Unlink this operation from its current block and insert it right before iterator in the specified block. More... | |
| void | moveOpAfter (Operation *op, Operation *existingOp) |
Unlink this operation from its current block and insert it right after existingOp which may be in the same or another block in the same function. More... | |
| void | moveOpAfter (Operation *op, Block *block, Block::iterator iterator) |
Unlink this operation from its current block and insert it right after iterator in the specified block. More... | |
| void | moveBlockBefore (Block *block, Block *anotherBlock) |
Unlink this block and insert it right before existingBlock. More... | |
| void | moveBlockBefore (Block *block, Region *region, Region::iterator iterator) |
| Unlink this block and insert it right before the location that the given iterator points to in the given region. More... | |
| virtual void | startOpModification (Operation *op) |
| This method is used to notify the rewriter that an in-place operation modification is about to happen. More... | |
| virtual void | finalizeOpModification (Operation *op) |
| This method is used to signal the end of an in-place modification of the given operation. More... | |
| virtual void | cancelOpModification (Operation *op) |
| This method cancels a pending in-place modification. More... | |
| template<typename CallableT > | |
| void | modifyOpInPlace (Operation *root, CallableT &&callable) |
| This method is a utility wrapper around an in-place modification of an operation. More... | |
| void | replaceAllUsesWith (Value from, Value to) |
Find uses of from and replace them with to. More... | |
| void | replaceAllUsesWith (Block *from, Block *to) |
| void | replaceAllUsesWith (ValueRange from, ValueRange to) |
| void | replaceAllOpUsesWith (Operation *from, ValueRange to) |
Find uses of from and replace them with to. More... | |
| void | replaceAllOpUsesWith (Operation *from, Operation *to) |
| void | replaceUsesWithIf (Value from, Value to, function_ref< bool(OpOperand &)> functor, bool *allUsesReplaced=nullptr) |
Find uses of from and replace them with to if the functor returns true. More... | |
| void | replaceUsesWithIf (ValueRange from, ValueRange to, function_ref< bool(OpOperand &)> functor, bool *allUsesReplaced=nullptr) |
| void | replaceOpUsesWithIf (Operation *from, ValueRange to, function_ref< bool(OpOperand &)> functor, bool *allUsesReplaced=nullptr) |
| void | replaceOpUsesWithinBlock (Operation *op, ValueRange newValues, Block *block, bool *allUsesReplaced=nullptr) |
Find uses of from within block and replace them with to. More... | |
| void | replaceAllUsesExcept (Value from, Value to, Operation *exceptedUser) |
Find uses of from and replace them with to except if the user is exceptedUser. More... | |
| void | replaceAllUsesExcept (Value from, Value to, const SmallPtrSetImpl< Operation * > &preservedUsers) |
| template<typename CallbackT > | |
| std::enable_if_t<!std::is_convertible< CallbackT, Twine >::value, LogicalResult > | notifyMatchFailure (Location loc, CallbackT &&reasonCallback) |
| Used to notify the listener that the IR failed to be rewritten because of a match failure, and provide a callback to populate a diagnostic with the reason why the failure occurred. More... | |
| template<typename CallbackT > | |
| std::enable_if_t<!std::is_convertible< CallbackT, Twine >::value, LogicalResult > | notifyMatchFailure (Operation *op, CallbackT &&reasonCallback) |
| template<typename ArgT > | |
| LogicalResult | notifyMatchFailure (ArgT &&arg, const Twine &msg) |
| template<typename ArgT > | |
| LogicalResult | notifyMatchFailure (ArgT &&arg, const char *msg) |
| Public Member Functions inherited from mlir::OpBuilder | |
| OpBuilder (MLIRContext *ctx, Listener *listener=nullptr) | |
| Create a builder with the given context. More... | |
| OpBuilder (Region *region, Listener *listener=nullptr) | |
| Create a builder and set the insertion point to the start of the region. More... | |
| OpBuilder (Region ®ion, Listener *listener=nullptr) | |
| OpBuilder (Operation *op, Listener *listener=nullptr) | |
| Create a builder and set insertion point to the given operation, which will cause subsequent insertions to go right before it. More... | |
| OpBuilder (Block *block, Block::iterator insertPoint, Listener *listener=nullptr) | |
| void | setListener (Listener *newListener) |
| Sets the listener of this builder to the one provided. More... | |
| Listener * | getListener () const |
| Returns the current listener of this builder, or nullptr if this builder doesn't have a listener. More... | |
| void | clearInsertionPoint () |
| Reset the insertion point to no location. More... | |
| InsertPoint | saveInsertionPoint () const |
| Return a saved insertion point. More... | |
| void | restoreInsertionPoint (InsertPoint ip) |
| Restore the insert point to a previously saved point. More... | |
| void | setInsertionPoint (Block *block, Block::iterator insertPoint) |
| Set the insertion point to the specified location. More... | |
| void | setInsertionPoint (Operation *op) |
| Sets the insertion point to the specified operation, which will cause subsequent insertions to go right before it. More... | |
| void | setInsertionPointAfter (Operation *op) |
| Sets the insertion point to the node after the specified operation, which will cause subsequent insertions to go right after it. More... | |
| void | setInsertionPointAfterValue (Value val) |
| Sets the insertion point to the node after the specified value. More... | |
| void | setInsertionPointToStart (Block *block) |
| Sets the insertion point to the start of the specified block. More... | |
| void | setInsertionPointToEnd (Block *block) |
| Sets the insertion point to the end of the specified block. More... | |
| Block * | getInsertionBlock () const |
| Return the block the current insertion point belongs to. More... | |
| Block::iterator | getInsertionPoint () const |
| Returns the current insertion point of the builder. More... | |
| Block * | getBlock () const |
| Returns the current block of the builder. More... | |
| Block * | createBlock (Region *parent, Region::iterator insertPt={}, TypeRange argTypes={}, ArrayRef< Location > locs={}) |
| Add new block with 'argTypes' arguments and set the insertion point to the end of it. More... | |
| Block * | createBlock (Block *insertBefore, TypeRange argTypes={}, ArrayRef< Location > locs={}) |
| Add new block with 'argTypes' arguments and set the insertion point to the end of it. More... | |
| Operation * | insert (Operation *op) |
| Insert the given operation at the current insertion point and return it. More... | |
| Operation * | create (const OperationState &state) |
| Creates an operation given the fields represented as an OperationState. More... | |
| Operation * | create (Location loc, StringAttr opName, ValueRange operands, TypeRange types={}, ArrayRef< NamedAttribute > attributes={}, BlockRange successors={}, MutableArrayRef< std::unique_ptr< Region >> regions={}) |
| Creates an operation with the given fields. More... | |
| template<typename OpTy , typename... Args> | |
| OpTy | create (Location location, Args &&...args) |
| Create an operation of specific op type at the current insertion point. More... | |
| template<typename OpTy , typename... Args> | |
| void | createOrFold (SmallVectorImpl< Value > &results, Location location, Args &&...args) |
| Create an operation of specific op type at the current insertion point, and immediately try to fold it. More... | |
| template<typename OpTy , typename... Args> | |
| std::enable_if_t< OpTy::template hasTrait< OpTrait::OneResult >), Value > | createOrFold (Location location, Args &&...args) |
| Overload to create or fold a single result operation. More... | |
| template<typename OpTy , typename... Args> | |
| std::enable_if_t< OpTy::template hasTrait< OpTrait::ZeroResults >), OpTy > | createOrFold (Location location, Args &&...args) |
| Overload to create or fold a zero result operation. More... | |
| LogicalResult | tryFold (Operation *op, SmallVectorImpl< Value > &results, SmallVectorImpl< Operation * > *materializedConstants=nullptr) |
Attempts to fold the given operation and places new results within results. More... | |
| Operation * | clone (Operation &op, IRMapping &mapper) |
| Creates a deep copy of the specified operation, remapping any operands that use values outside of the operation using the map that is provided ( leaving them alone if no entry is present). More... | |
| Operation * | clone (Operation &op) |
| Operation * | cloneWithoutRegions (Operation &op, IRMapping &mapper) |
| Creates a deep copy of this operation but keep the operation regions empty. More... | |
| Operation * | cloneWithoutRegions (Operation &op) |
| template<typename OpT > | |
| OpT | cloneWithoutRegions (OpT op) |
| void | cloneRegionBefore (Region ®ion, Region &parent, Region::iterator before, IRMapping &mapping) |
| Clone the blocks that belong to "region" before the given position in another region "parent". More... | |
| void | cloneRegionBefore (Region ®ion, Region &parent, Region::iterator before) |
| void | cloneRegionBefore (Region ®ion, Block *before) |
| Public Member Functions inherited from mlir::Builder | |
| Builder (MLIRContext *context) | |
| Builder (Operation *op) | |
| MLIRContext * | getContext () const |
| Location | getUnknownLoc () |
| Location | getFusedLoc (ArrayRef< Location > locs, Attribute metadata=Attribute()) |
| FloatType | getF8E8M0Type () |
| FloatType | getBF16Type () |
| FloatType | getF16Type () |
| FloatType | getTF32Type () |
| FloatType | getF32Type () |
| FloatType | getF64Type () |
| FloatType | getF80Type () |
| FloatType | getF128Type () |
| IndexType | getIndexType () |
| IntegerType | getI1Type () |
| IntegerType | getI2Type () |
| IntegerType | getI4Type () |
| IntegerType | getI8Type () |
| IntegerType | getI16Type () |
| IntegerType | getI32Type () |
| IntegerType | getI64Type () |
| IntegerType | getIntegerType (unsigned width) |
| IntegerType | getIntegerType (unsigned width, bool isSigned) |
| FunctionType | getFunctionType (TypeRange inputs, TypeRange results) |
| TupleType | getTupleType (TypeRange elementTypes) |
| NoneType | getNoneType () |
| template<typename Ty , typename... Args> | |
| Ty | getType (Args &&...args) |
Get or construct an instance of the type Ty with provided arguments. More... | |
| template<typename Attr , typename... Args> | |
| Attr | getAttr (Args &&...args) |
Get or construct an instance of the attribute Attr with provided arguments. More... | |
| NamedAttribute | getNamedAttr (StringRef name, Attribute val) |
| UnitAttr | getUnitAttr () |
| BoolAttr | getBoolAttr (bool value) |
| DictionaryAttr | getDictionaryAttr (ArrayRef< NamedAttribute > value) |
| IntegerAttr | getIntegerAttr (Type type, int64_t value) |
| IntegerAttr | getIntegerAttr (Type type, const APInt &value) |
| FloatAttr | getFloatAttr (Type type, double value) |
| FloatAttr | getFloatAttr (Type type, const APFloat &value) |
| StringAttr | getStringAttr (const Twine &bytes) |
| ArrayAttr | getArrayAttr (ArrayRef< Attribute > value) |
| TypedAttr | getZeroAttr (Type type) |
| TypedAttr | getOneAttr (Type type) |
| FloatAttr | getF16FloatAttr (float value) |
| FloatAttr | getF32FloatAttr (float value) |
| FloatAttr | getF64FloatAttr (double value) |
| IntegerAttr | getI8IntegerAttr (int8_t value) |
| IntegerAttr | getI16IntegerAttr (int16_t value) |
| IntegerAttr | getI32IntegerAttr (int32_t value) |
| IntegerAttr | getI64IntegerAttr (int64_t value) |
| IntegerAttr | getIndexAttr (int64_t value) |
| IntegerAttr | getSI32IntegerAttr (int32_t value) |
| Signed and unsigned integer attribute getters. More... | |
| IntegerAttr | getUI32IntegerAttr (uint32_t value) |
| DenseIntElementsAttr | getBoolVectorAttr (ArrayRef< bool > values) |
Vector-typed DenseIntElementsAttr getters. values must not be empty. More... | |
| DenseIntElementsAttr | getI32VectorAttr (ArrayRef< int32_t > values) |
| DenseIntElementsAttr | getI64VectorAttr (ArrayRef< int64_t > values) |
| DenseIntElementsAttr | getIndexVectorAttr (ArrayRef< int64_t > values) |
| DenseFPElementsAttr | getF32VectorAttr (ArrayRef< float > values) |
| DenseFPElementsAttr | getF64VectorAttr (ArrayRef< double > values) |
| DenseIntElementsAttr | getI32TensorAttr (ArrayRef< int32_t > values) |
| Tensor-typed DenseIntElementsAttr getters. More... | |
| DenseIntElementsAttr | getI64TensorAttr (ArrayRef< int64_t > values) |
| DenseIntElementsAttr | getIndexTensorAttr (ArrayRef< int64_t > values) |
| DenseBoolArrayAttr | getDenseBoolArrayAttr (ArrayRef< bool > values) |
| Tensor-typed DenseArrayAttr getters. More... | |
| DenseI8ArrayAttr | getDenseI8ArrayAttr (ArrayRef< int8_t > values) |
| DenseI16ArrayAttr | getDenseI16ArrayAttr (ArrayRef< int16_t > values) |
| DenseI32ArrayAttr | getDenseI32ArrayAttr (ArrayRef< int32_t > values) |
| DenseI64ArrayAttr | getDenseI64ArrayAttr (ArrayRef< int64_t > values) |
| DenseF32ArrayAttr | getDenseF32ArrayAttr (ArrayRef< float > values) |
| DenseF64ArrayAttr | getDenseF64ArrayAttr (ArrayRef< double > values) |
| ArrayAttr | getAffineMapArrayAttr (ArrayRef< AffineMap > values) |
| ArrayAttr | getBoolArrayAttr (ArrayRef< bool > values) |
| ArrayAttr | getI32ArrayAttr (ArrayRef< int32_t > values) |
| ArrayAttr | getI64ArrayAttr (ArrayRef< int64_t > values) |
| ArrayAttr | getIndexArrayAttr (ArrayRef< int64_t > values) |
| ArrayAttr | getF32ArrayAttr (ArrayRef< float > values) |
| ArrayAttr | getF64ArrayAttr (ArrayRef< double > values) |
| ArrayAttr | getStrArrayAttr (ArrayRef< StringRef > values) |
| ArrayAttr | getTypeArrayAttr (TypeRange values) |
| AffineExpr | getAffineDimExpr (unsigned position) |
| AffineExpr | getAffineSymbolExpr (unsigned position) |
| AffineExpr | getAffineConstantExpr (int64_t constant) |
| AffineMap | getEmptyAffineMap () |
| Returns a zero result affine map with no dimensions or symbols: () -> (). More... | |
| AffineMap | getConstantAffineMap (int64_t val) |
| Returns a single constant result affine map with 0 dimensions and 0 symbols. More... | |
| AffineMap | getDimIdentityMap () |
| AffineMap | getMultiDimIdentityMap (unsigned rank) |
| AffineMap | getSymbolIdentityMap () |
| AffineMap | getSingleDimShiftAffineMap (int64_t shift) |
| Returns a map that shifts its (single) input dimension by 'shift'. More... | |
| AffineMap | getShiftedAffineMap (AffineMap map, int64_t shift) |
| Returns an affine map that is a translation (shift) of all result expressions in 'map' by 'shift'. More... | |
Protected Member Functions | |
| RewriterBase (MLIRContext *ctx, OpBuilder::Listener *listener=nullptr) | |
| Initialize the builder. More... | |
| RewriterBase (const OpBuilder &otherBuilder) | |
| RewriterBase (Operation *op, OpBuilder::Listener *listener=nullptr) | |
| virtual | ~RewriterBase () |
Additional Inherited Members | |
| Static Public Member Functions inherited from mlir::OpBuilder | |
| static OpBuilder | atBlockBegin (Block *block, Listener *listener=nullptr) |
| Create a builder and set the insertion point to before the first operation in the block but still inside the block. More... | |
| static OpBuilder | atBlockEnd (Block *block, Listener *listener=nullptr) |
| Create a builder and set the insertion point to after the last operation in the block but still inside the block. More... | |
| static OpBuilder | atBlockTerminator (Block *block, Listener *listener=nullptr) |
| Create a builder and set the insertion point to before the block terminator. More... | |
| Protected Attributes inherited from mlir::OpBuilder | |
| Listener * | listener |
| The optional listener for events of this builder. More... | |
| Protected Attributes inherited from mlir::Builder | |
| MLIRContext * | context |
Detailed Description
This class coordinates the application of a rewrite on a set of IR, providing a way for clients to track mutations and create new operations.
This class serves as a common API for IR mutation between pattern rewrites and non-pattern rewrites, and facilitates the development of shared IR transformation utilities.
Definition at line 358 of file PatternMatch.h.
Constructor & Destructor Documentation
◆ RewriterBase() [1/3]
|
inlineexplicitprotected |
Initialize the builder.
Definition at line 726 of file PatternMatch.h.
◆ RewriterBase() [2/3]
|
inlineexplicitprotected |
Definition at line 729 of file PatternMatch.h.
◆ RewriterBase() [3/3]
|
inlineexplicitprotected |
Definition at line 731 of file PatternMatch.h.
◆ ~RewriterBase()
|
protectedvirtual |
Definition at line 106 of file PatternMatch.cpp.
Member Function Documentation
◆ cancelOpModification()
|
inlinevirtual |
This method cancels a pending in-place modification.
This can only be called on operations that were provided to a call to startOpModification.
Reimplemented in mlir::ConversionPatternRewriter.
Definition at line 606 of file PatternMatch.h.
◆ eraseBlock()
|
virtual |
This method erases all operations in a block.
Reimplemented in mlir::detail::ConversionPatternRewriterImpl::SingleEraseRewriter, and mlir::ConversionPatternRewriter.
Definition at line 229 of file PatternMatch.cpp.
References mlir::Block::erase(), eraseOp(), mlir::OpBuilder::listener, mlir::Operation::use_empty(), and mlir::IRObjectWithUseList< OperandType >::use_empty().
Referenced by mlir::detail::ConversionPatternRewriterImpl::SingleEraseRewriter::eraseBlock(), mlir::eraseUnreachableBlocks(), genCoIterateBranchNest(), inlineBlockBefore(), inlineIfCase(), inlineWhileCase(), mlir::gpu::WarpDistributionPattern::moveRegionToNewWarpOpAndReplaceReturns(), mlir::normalizeForallOp(), mlir::RewritePattern::Pattern(), replaceForAllWithNewSignature(), and replaceForOpWithNewSignature().
◆ eraseOp()
|
virtual |
This method erases an operation that is known to have no uses.
The uses of the given operation must be known to be dead.
Reimplemented in mlir::detail::ConversionPatternRewriterImpl::SingleEraseRewriter, and mlir::ConversionPatternRewriter.
Definition at line 157 of file PatternMatch.cpp.
References mlir::Operation::erase(), mlir::Operation::getRegions(), mlir::OpBuilder::listener, and mlir::Operation::use_empty().
Referenced by mlir::memref::allocToAlloca(), applyTilingToAll(), mlir::linalg::bufferizeToAllocation(), mlir::NVVM::PtxBuilder::buildAndReplaceOp(), mlir::coalesceLoops(), convertTransferWriteOp(), convertTransferWriteToStores(), convertYieldOp(), mlir::nvgpu::createAsyncGroups(), deleteDeadness(), eraseBlock(), mlir::memref::eraseDeadAllocAndStores(), mlir::detail::ConversionPatternRewriterImpl::SingleEraseRewriter::eraseOp(), mlir::arm_sme::eraseTriviallyDeadTileOps(), mlir::linalg::fuseElementwiseOps(), genCoIterateBranchNest(), genForeachOnSparseConstant(), inlineIfCase(), inlineWhileCase(), mlir::sparse_tensor::insertYieldOp(), AllocaScopeInliner::matchAndRewrite(), MultiBlockExecuteInliner::matchAndRewrite(), VectorizeConvolution::matchAndRewrite(), FoldConstantCase::matchAndRewrite(), mlir::linalg::LinalgCopyVTRForwardingPattern::matchAndRewrite(), mlir::linalg::LinalgCopyVTWForwardingPattern::matchAndRewrite(), mlir::memref::multiBuffer(), mlir::outlineSingleBlockRegion(), mlir::scf::pipelineForLoop(), mlir::scf::promote(), mlir::scf::replaceAndCastForOpIterArg(), replaceForOpWithNewSignature(), replaceOp(), replaceOpWithRegion(), replaceUsesAndPropagateType(), CopyBuilder::rewrite(), rewriteOneForallCommonImpl(), simplifyBrToBlockWithSinglePred(), mlir::vector::splitFullAndPartialTransfer(), mlir::scf::tileAndFuseConsumerOfSlices(), tileAndFuseFirstExtractUseThroughContainingOpBlockArgument(), mlir::scf::tileAndFuseProducerOfSlice(), mlir::linalg::tileReductionUsingForall(), and mlir::scf::tileUsingSCF().
◆ finalizeOpModification()
|
virtual |
This method is used to signal the end of an in-place modification of the given operation.
This can only be called on operations that were provided to a call to startOpModification.
Reimplemented in mlir::ConversionPatternRewriter.
Definition at line 244 of file PatternMatch.cpp.
References mlir::OpBuilder::listener.
Referenced by mlir::ConversionPatternRewriter::finalizeOpModification(), mlir::linalg::interchangeGenericOp(), RemoveUnusedLvlCrds::matchAndRewrite(), modifyOpInPlace(), padThroughLoopIterArg(), mlir::affine::reorderOperandsByHoistability(), and replaceUsesAndPropagateType().
◆ inlineBlockBefore() [1/2]
|
virtual |
Inline the operations of block 'source' into block 'dest' before the given position.
The source block will be deleted and must have no uses. 'argValues' is used to replace the block arguments of 'source'.
If the source block is inserted at the end of the dest block, the dest block must have no successors. Similarly, if the source block is inserted somewhere in the middle (or beginning) of the dest block, the source block must have no successors. Otherwise, the resulting IR would have unreachable operations.
Reimplemented in mlir::ConversionPatternRewriter.
Definition at line 287 of file PatternMatch.cpp.
References mlir::Block::empty(), mlir::Block::end(), eraseBlock(), mlir::Block::front(), mlir::Block::getArguments(), mlir::Block::getNumArguments(), mlir::Block::getOperations(), mlir::Block::hasNoPredecessors(), mlir::Block::hasNoSuccessors(), mlir::OpBuilder::listener, moveOpBefore(), and replaceAllUsesWith().
Referenced by mlir::coalesceLoops(), fuseIfLegal(), genForeachOnSparseConstant(), inlineBlockBefore(), mlir::sparse_tensor::insertYieldOp(), AllocaScopeInliner::matchAndRewrite(), FoldConstantCase::matchAndRewrite(), mergeBlocks(), mlir::scf::promote(), and replaceOpWithRegion().
◆ inlineBlockBefore() [2/2]
| void RewriterBase::inlineBlockBefore | ( | Block * | source, |
| Operation * | op, | ||
| ValueRange | argValues = {} |
||
| ) |
Inline the operations of block 'source' before the operation 'op'.
The source block will be deleted and must have no uses. 'argValues' is used to replace the block arguments of 'source'
The source block must have no successors. Otherwise, the resulting IR would have unreachable operations.
Definition at line 330 of file PatternMatch.cpp.
References mlir::Operation::getBlock(), and inlineBlockBefore().
◆ inlineRegionBefore() [1/2]
Definition at line 380 of file PatternMatch.cpp.
References mlir::Block::getParent(), and inlineRegionBefore().
◆ inlineRegionBefore() [2/2]
| void RewriterBase::inlineRegionBefore | ( | Region & | region, |
| Region & | parent, | ||
| Region::iterator | before | ||
| ) |
Move the blocks that belong to "region" before the given position in another region "parent".
Move the blocks that belong to "region" before the given position in another region.
The two regions must be different. The caller is responsible for creating or updating the operation transferring flow of control to the region and passing it the correct block arguments.
The two regions must be different. The caller is in charge to update create the operation transferring the control flow to the region and pass it the correct block arguments.
Definition at line 368 of file PatternMatch.cpp.
References mlir::Region::empty(), mlir::Region::front(), mlir::Region::getBlocks(), mlir::OpBuilder::listener, and moveBlockBefore().
Referenced by mlir::convertFuncOpToLLVMFuncOp(), createDecl(), mlir::linalg::dropUnitDims(), mlir::linalg::generalizeNamedOp(), inlineRegionBefore(), lowerAsEntryFunction(), MultiBlockExecuteInliner::matchAndRewrite(), mlir::GPUFuncOpLowering::matchAndRewrite(), mlir::gpu::WarpDistributionPattern::moveRegionToNewWarpOpAndReplaceReturns(), mlir::normalizeForallOp(), mlir::linalg::splitReduction(), mlir::linalg::splitReductionByScaling(), and wrapInExecuteRegion().
◆ mergeBlocks()
| void RewriterBase::mergeBlocks | ( | Block * | source, |
| Block * | dest, | ||
| ValueRange | argValues = {} |
||
| ) |
Inline the operations of block 'source' into the end of block 'dest'.
The source block will be deleted and must have no uses. 'argValues' is used to replace the block arguments of 'source'
The dest block must have no successors. Otherwise, the resulting IR would have unreachable operation.
Definition at line 335 of file PatternMatch.cpp.
References mlir::Block::end(), and inlineBlockBefore().
Referenced by addInitOperandsToLoopNest(), cloneToCollapsedOp< GenericOp >(), mlir::makeRegionIsolatedFromAbove(), movePaddingToFillOrGenericOp(), normalizeForallLoopOp(), mlir::outlineSingleBlockRegion(), populateOpPayload(), mlir::scf::replaceAndCastForOpIterArg(), replaceWithDifferentYield(), mlir::linalg::rewriteInDestinationPassingStyle(), and simplifyBrToBlockWithSinglePred().
◆ modifyOpInPlace()
|
inline |
This method is a utility wrapper around an in-place modification of an operation.
It wraps calls to startOpModification and finalizeOpModification around the given callable.
Definition at line 612 of file PatternMatch.h.
References finalizeOpModification(), and startOpModification().
Referenced by mlir::linalg::bufferizeToAllocation(), cloneAndFuseFirstUse(), mlir::coalesceLoops(), convertFuncOpTypes(), mlir::linalg::hoistRedundantVectorBroadcasts(), CollapseShapeOpMemRefCastFolder::matchAndRewrite(), mlir::GPUFuncOpLowering::matchAndRewrite(), FoldAddIntoDest::matchAndRewrite(), SortCommutativeOperands::matchAndRewrite(), mlir::gpu::WarpDistributionPattern::moveRegionToNewWarpOpAndReplaceReturns(), peelForLoop(), relinkBranch(), replaceAllUsesWith(), replaceAndPropagateMemRefType(), replaceUsesWithIf(), PadOpVectorizationWithTransferReadPattern::rewriteUser(), simplifyAffineMinMaxOp(), mlir::vector::splitFullAndPartialTransfer(), mlir::linalg::splitOp(), mlir::scf::tileAndFuseConsumerOfSlices(), tileAndFuseFirstExtractUse(), tileAndFuseFirstExtractUseThroughContainingOpBlockArgument(), mlir::linalg::tileReductionUsingForall(), updateDeallocIfChanged(), and mlir::scf::yieldReplacementForFusedProducer().
◆ moveBlockBefore() [1/2]
Unlink this block and insert it right before existingBlock.
Definition at line 384 of file PatternMatch.cpp.
References mlir::Block::getParent().
Referenced by inlineRegionBefore().
◆ moveBlockBefore() [2/2]
| void RewriterBase::moveBlockBefore | ( | Block * | block, |
| Region * | region, | ||
| Region::iterator | iterator | ||
| ) |
Unlink this block and insert it right before the location that the given iterator points to in the given region.
Definition at line 389 of file PatternMatch.cpp.
References mlir::Block::getParent(), mlir::OpBuilder::listener, mlir::Block::moveBefore(), and mlir::OpBuilder::Listener::notifyBlockInserted().
◆ moveOpAfter() [1/2]
| void RewriterBase::moveOpAfter | ( | Operation * | op, |
| Block * | block, | ||
| Block::iterator | iterator | ||
| ) |
Unlink this operation from its current block and insert it right after iterator in the specified block.
Definition at line 417 of file PatternMatch.cpp.
References mlir::Block::end(), and moveOpBefore().
◆ moveOpAfter() [2/2]
Unlink this operation from its current block and insert it right after existingOp which may be in the same or another block in the same function.
Definition at line 413 of file PatternMatch.cpp.
References mlir::Operation::getBlock().
Referenced by mlir::linalg::hoistRedundantVectorBroadcasts(), and hoistSubsetAtIterArg().
◆ moveOpBefore() [1/2]
| void RewriterBase::moveOpBefore | ( | Operation * | op, |
| Block * | block, | ||
| Block::iterator | iterator | ||
| ) |
Unlink this operation from its current block and insert it right before iterator in the specified block.
Definition at line 403 of file PatternMatch.cpp.
References mlir::Operation::getBlock(), mlir::OpBuilder::listener, mlir::Operation::moveBefore(), and mlir::OpBuilder::Listener::notifyOperationInserted().
◆ moveOpBefore() [2/2]
Unlink this operation from its current block and insert it right before existingOp which may be in the same or another block in the same function.
Definition at line 399 of file PatternMatch.cpp.
References mlir::Operation::getBlock().
Referenced by mlir::detail::ConversionPatternRewriterImpl::applySignatureConversion(), mlir::linalg::DecomposePadOpPattern::createFillOrGenerateOp(), getConsumerFromLoopUses(), hoistSubsetAtIterArg(), inlineBlockBefore(), moveOpAfter(), mlir::moveOperationDependencies(), mlir::moveValueDefinitions(), splitBlock(), and mlir::scf::tileAndFuseConsumerOfSlices().
◆ notifyMatchFailure() [1/4]
|
inline |
Definition at line 720 of file PatternMatch.h.
References notifyMatchFailure().
◆ notifyMatchFailure() [2/4]
|
inline |
Definition at line 715 of file PatternMatch.h.
References diag(), and notifyMatchFailure().
◆ notifyMatchFailure() [3/4]
|
inline |
Used to notify the listener that the IR failed to be rewritten because of a match failure, and provide a callback to populate a diagnostic with the reason why the failure occurred.
This method allows for derived rewriters to optionally hook into the reason why a rewrite failed, and display it to users.
Definition at line 700 of file PatternMatch.h.
References mlir::OpBuilder::listener.
Referenced by alignedConversionPrecondition(), areAllLLVMTypes(), baseInBufferAddrSpace(), mlir::linalg::blockPackMatmul(), canonicalizeAssociativeCommutativeBinaryOp(), mlir::tosa::checkHasDynamicBatchDims(), checkSourceOpTypes(), mlir::linalg::collapseOpIterationDims(), commonConversionPrecondition(), convertCastingOp(), convertConstantOpMmaSync(), convertContractOp(), convertContractOpToMmaSync(), convertElementwiseOp(), convertExtractStridedSlice(), mlir::convertFuncOpToLLVMFuncOp(), mlir::convertOpResultTypes(), convertRoundEvenOp(), convertRoundOp(), convertTransferReadOp(), convertTransferReadToLoads(), convertTransferWriteOp(), convertTransferWriteToStores(), createLinalgBodyCalculationForElementwiseOp(), createNonLdMatrixLoads(), creatLdMatrixCompatibleLoads(), mlir::affine::decompose(), mlir::linalg::dropUnitDims(), elementwiseMatchAndRewriteHelper(), emitElementwiseComputation(), mlir::linalg::fuseElementwiseOps(), fuseWithReshapeByExpansion(), mlir::linalg::generalizeNamedOp(), generateLoopNest(), generateLoopNestUsingForallOp(), generateLoopNestUsingForOp(), getLibraryCallSymbolRef(), getResultTilePosition(), getTiledImplementation(), getTypeConversionFailure(), getUntiledConsumerFromSlice(), getUntiledConsumerOperandsFromSlices(), insertCasts(), mlir::linalg::interchangeGenericOp(), isAsyncWithOneDependency(), legalizeBlockArguments(), linearizeConstAttr(), mlir::linalg::lowerPack(), mlir::scf::lowerToLoopsUsingSCFForOp(), YieldOpLowering::matchAndRewrite(), AssertOpLowering::matchAndRewrite(), mlir::GPUFuncOpLowering::matchAndRewrite(), mlir::GPUReturnOpLowering::matchAndRewrite(), GPUSubgroupReduceConversion::matchAndRewrite(), IndexSwitchOpLowering::matchAndRewrite(), FoldAddIntoDest::matchAndRewrite(), mlir::linalg::DecomposeOuterUnitDimsPackOpPattern::matchAndRewrite(), mlir::linalg::DecomposeOuterUnitDimsUnPackOpPattern::matchAndRewrite(), mlir::math::ErfcPolynomialApproximation::matchAndRewrite(), mlir::math::ErfPolynomialApproximation::matchAndRewrite(), mlir::spirv::ElementwiseOpPattern< Op, SPIRVOp >::matchAndRewrite(), InsertSliceOfInsertSliceFolder< OpTy >::matchAndRewrite(), mlir::OpToFuncCallLowering< SourceOp >::matchAndRewrite(), ConvertAccessChain::matchAndRewrite(), ConvertLoad::matchAndRewrite(), ConvertStore::matchAndRewrite(), ConcatSliceOptimization::matchAndRewrite(), PadSliceOptimization::matchAndRewrite(), SliceDynamicSizeCanonicalization::matchAndRewrite(), TransposeIsReshape::matchAndRewrite(), ConsolidateTransposeOptimization::matchAndRewrite(), mlir::linalg::LinalgCopyVTRForwardingPattern::matchAndRewrite(), mlir::linalg::LinalgCopyVTWForwardingPattern::matchAndRewrite(), TransposeOpLowering::matchAndRewrite(), mergeTilingResults(), mlir::moveOperationDependencies(), mlir::moveValueDefinitions(), notifyMatchFailure(), mlir::linalg::pack(), mlir::linalg::packMatmulGreedily(), mlir::linalg::packTranspose(), mlir::linalg::padAndHoistLinalgOp(), padOperandToSmallestStaticBoundingBox(), preconditionsFoldExtractOrInsertWithTransferOp(), preconditionsFoldSubViewOpImpl(), processParallelLoop(), reduceMatchAndRewriteHelper(), replaceWithLoadOrStore(), mlir::linalg::rewriteAsPaddedOp(), mlir::linalg::rewriteInDestinationPassingStyle(), mlir::linalg::rewriteInIm2Col(), mlir::impl::scalarizeVectorOp(), mlir::linalg::splitReduction(), mlir::linalg::splitReductionByScaling(), mlir::scf::tileAndFuseConsumerOfSlices(), mlir::scf::tileConsumerAndFuseProducersUsingSCF(), mlir::linalg::tileReductionUsingForall(), mlir::scf::tileUsingSCF(), mlir::linalg::transposeBatchMatmul(), mlir::linalg::transposeMatmul(), verifyOptions(), and yieldTiledValuesAndReplaceLoop().
◆ notifyMatchFailure() [4/4]
|
inline |
Definition at line 708 of file PatternMatch.h.
References mlir::Operation::getLoc(), and mlir::OpBuilder::listener.
◆ replaceAllOpUsesWith() [1/2]
Definition at line 118 of file PatternMatch.cpp.
References mlir::Operation::getResults(), mlir::OpBuilder::listener, and replaceAllUsesWith().
◆ replaceAllOpUsesWith() [2/2]
| void RewriterBase::replaceAllOpUsesWith | ( | Operation * | from, |
| ValueRange | to | ||
| ) |
Find uses of from and replace them with to.
Also notify the listener about every in-place op modification (for every use that was replaced) and that the from operation is about to be replaced.
Note: This function cannot be called replaceAllUsesWith because the overload resolution, when called with an op that can be implicitly converted to a Value, would be ambiguous.
Definition at line 110 of file PatternMatch.cpp.
References mlir::Operation::getResults(), mlir::OpBuilder::listener, and replaceAllUsesWith().
Referenced by FoldAddIntoDest::matchAndRewrite(), and replaceOp().
◆ replaceAllUsesExcept() [1/2]
| void RewriterBase::replaceAllUsesExcept | ( | Value | from, |
| Value | to, | ||
| const SmallPtrSetImpl< Operation * > & | preservedUsers | ||
| ) |
Definition at line 250 of file PatternMatch.cpp.
References mlir::detail::IROperandBase::getOwner(), and replaceUsesWithIf().
◆ replaceAllUsesExcept() [2/2]
|
inline |
Find uses of from and replace them with to except if the user is exceptedUser.
Also notify the listener about every in-place op modification (for every use that was replaced).
Definition at line 684 of file PatternMatch.h.
References mlir::detail::IROperandBase::getOwner(), and replaceUsesWithIf().
Referenced by mlir::coalesceLoops(), mlir::denormalizeInductionVariable(), denormalizeInductionVariableForIndexType(), and VectorizationState::maskOperation().
◆ replaceAllUsesWith() [1/3]
Definition at line 626 of file PatternMatch.h.
References mlir::IRObjectWithUseList< OperandType >::getUses(), and modifyOpInPlace().
◆ replaceAllUsesWith() [2/3]
Find uses of from and replace them with to.
Also notify the listener about every in-place op modification (for every use that was replaced).
Definition at line 620 of file PatternMatch.h.
References mlir::Value::getUses(), and modifyOpInPlace().
Referenced by applyTilingToAll(), dropRedundantArguments(), mlir::linalg::hoistRedundantVectorBroadcasts(), hoistSubsetAtIterArg(), inlineBlockBefore(), WrapFuncInClass::matchAndRewrite(), FoldLaunchArguments::matchAndRewrite(), mlir::dataflow::maybeReplaceWithConstant(), padThroughLoopIterArg(), peelForLoop(), mlir::scf::promote(), propagateSubViewOp(), pruneRedundantArguments(), replaceAllOpUsesWith(), replaceAllUsesWith(), replaceAndPropagateMemRefType(), replaceForAllWithNewSignature(), replaceForOpWithNewSignature(), replaceUnitMappingIdsHelper(), rewriteOneForallCommonImpl(), mlir::scf::tileAndFuseConsumerOfSlices(), and mlir::scf::tileAndFuseProducerOfSlice().
◆ replaceAllUsesWith() [3/3]
|
inline |
Definition at line 632 of file PatternMatch.h.
References replaceAllUsesWith().
◆ replaceOp() [1/2]
Replace the results of the given (original) operation with the specified new op (replacement).
This method replaces the results of the operation with the specified new op (replacement).
The result types of the two ops must match. The original op is erased.
The number of results of the two operations must match. The replaced op is erased.
Reimplemented in mlir::ConversionPatternRewriter.
Definition at line 143 of file PatternMatch.cpp.
References eraseOp(), mlir::Operation::getNumResults(), mlir::Operation::getResults(), and replaceAllOpUsesWith().
◆ replaceOp() [2/2]
|
virtual |
Replace the results of the given (original) operation with the specified list of values (replacements).
This method replaces the results of the operation with the specified list of values.
The result types of the given op and the replacements must match. The original op is erased.
The number of provided values must match the number of results of the operation. The replaced op is erased.
Reimplemented in mlir::ConversionPatternRewriter.
Definition at line 129 of file PatternMatch.cpp.
References eraseOp(), mlir::Operation::getNumResults(), and replaceAllOpUsesWith().
Referenced by addInitOperandsToLoopNest(), mlir::linalg::bufferizeToAllocation(), mlir::NVVM::PtxBuilder::buildAndReplaceOp(), mlir::coalesceLoops(), convertAcoshOp(), convertAffineApply(), convertAsinhOp(), convertAtanhOp(), convertCeilOp(), convertCoshOp(), convertCtlzOp(), convertExp2fOp(), convertFmaFOp(), convertFPowIOp(), convertPowfOp(), convertRoundEvenOp(), convertRoundOp(), convertSinhOp(), convertTanOp(), mlir::affine::decompose(), mlir::linalg::deduplicateOperandsAndRemoveDeadResults(), mlir::bufferization::dropEquivalentBufferResults(), mlir::bufferization::foldToBufferToTensorPair(), mlir::fuseIndependentSiblingForallLoops(), mlir::fuseIndependentSiblingForLoops(), mlir::linalg::generalizeNamedOp(), generateCollapsedIndexingRegion(), genForeachOnSparseConstant(), mlir::OperationFolder::insertKnownConstant(), mlir::LLVM::detail::intrinsicRewrite(), legalizeUnresolvedMaterialization(), mlir::affine::lowerAffineDelinearizeIndexOp(), mlir::affine::lowerAffineLinearizeIndexOp(), mlir::linalg::lowerPack(), mlir::linalg::lowerUnPack(), CanonicalizeContractAdd< AddOpType >::matchAndRewrite(), AllocaScopeInliner::matchAndRewrite(), AllocaScopeHoister::matchAndRewrite(), FoldTensorCastProducerOp::matchAndRewrite(), WrapFuncInClass::matchAndRewrite(), MultiBlockExecuteInliner::matchAndRewrite(), DecomposeNDExtractStridedSlice::matchAndRewrite(), ConvertSameRankInsertStridedSliceIntoShuffle::matchAndRewrite(), mlir::linalg::DecomposeOuterUnitDimsPackOpPattern::matchAndRewrite(), mlir::linalg::DecomposeOuterUnitDimsUnPackOpPattern::matchAndRewrite(), VectorizeConvolution::matchAndRewrite(), mlir::math::ErfcPolynomialApproximation::matchAndRewrite(), mlir::math::ErfPolynomialApproximation::matchAndRewrite(), mlir::linalg::FoldTensorCastPackOp::matchAndRewrite(), FoldConstantCase::matchAndRewrite(), mlir::linalg::ExtractSliceOfPadTensorSwapPattern::matchAndRewrite(), ClampIsNoOp::matchAndRewrite(), ConcatOptimization::matchAndRewrite(), MaxPool2dIsNoOp::matchAndRewrite(), ConcatSliceOptimization::matchAndRewrite(), SliceDynamicSizeCanonicalization::matchAndRewrite(), mlir::linalg::FoldTensorCastUnPackOp::matchAndRewrite(), mlir::linalg::LinalgCopyVTRForwardingPattern::matchAndRewrite(), TransposeOpLowering::matchAndRewrite(), mlir::gpu::WarpDistributionPattern::moveRegionToNewWarpOpAndAppendReturns(), normalizeForallLoopOp(), mlir::normalizeForallOp(), SliceCanonicalizer::operator()(), mlir::linalg::pack(), mlir::linalg::packTranspose(), mlir::linalg::padAndHoistLinalgOp(), mlir::scf::pipelineForLoop(), reifyOpResultShapes(), replaceIndexOpsByInductionVariables(), mlir::bufferization::replaceOpWithBufferizedValues(), replaceOpWithNewOp(), replaceOpWithPredicatedOp(), replaceOpWithRegion(), replaceWithDifferentYield(), mlir::linalg::DownscaleSizeOneWindowed2DConvolution< Conv2DOp, Conv1DOp >::returningMatchAndRewrite(), mlir::linalg::DownscaleConv2DOp::returningMatchAndRewrite(), mlir::linalg::DownscaleDepthwiseConv2DNhwcHwcOp::returningMatchAndRewrite(), mlir::linalg::rewriteAsPaddedOp(), mlir::linalg::rewriteInDestinationPassingStyle(), mlir::linalg::rewriteInIm2Col(), PadOpVectorizationWithTransferWritePattern::rewriteUser(), mlir::tensor::simplifyCollapseShapeWithRankReducingExtractSlice(), mlir::linalg::splitOp(), mlir::linalg::splitReduction(), mlir::linalg::splitReductionByScaling(), tileAndFuseFirstExtractUseThroughContainingOpBlockArgument(), mlir::linalg::tileReductionUsingForall(), mlir::linalg::transposeBatchMatmul(), mlir::linalg::transposeMatmul(), transposeOneLinalgOperandAndReplace(), mlir::OperationFolder::tryToFold(), updateExpandedGenericOpRegion(), mlir::linalg::vectorizeCopy(), and wrapInExecuteRegion().
◆ replaceOpUsesWithIf()
|
inline |
Definition at line 661 of file PatternMatch.h.
References mlir::Operation::getResults(), and replaceUsesWithIf().
Referenced by mlir::makeRegionIsolatedFromAbove(), and replaceOpUsesWithinBlock().
◆ replaceOpUsesWithinBlock()
|
inline |
Find uses of from within block and replace them with to.
Also notify the listener about every in-place op modification (for every use that was replaced). The optional allUsesReplaced flag is set to "true" if all uses were replaced.
Definition at line 671 of file PatternMatch.h.
References mlir::detail::IROperandBase::getOwner(), mlir::Block::getParentOp(), and replaceOpUsesWithIf().
◆ replaceOpWithNewOp()
|
inline |
Replace the results of the given (original) op with a new op that is created without verification (replacement).
The result values of the two ops must match. The original op is erased.
Definition at line 519 of file PatternMatch.h.
References mlir::Operation::getLoc(), and replaceOp().
Referenced by addInitOperandsToLoopNest(), mlir::memref::allocToAlloca(), canonicalizeAssociativeCommutativeBinaryOp(), canonicalizeMinMaxOp(), convertCastingOp(), convertRsqrtOp(), convertTanhOp(), createDecl(), mlir::createElementwiseOp(), dropSwitchCasesThatMatchDefault(), foldSwitch(), mlir::bufferization::foldToBufferToTensorPair(), genResult(), insertCasts(), mlir::linalg::interchangeGenericOp(), mlir::affine::lowerAffineLinearizeIndexOp(), matchAndReplaceDepthwiseConv(), MergeArithBitcast::matchAndRewrite(), SelectToExtUI::matchAndRewrite(), MergeComplexBitcast::matchAndRewrite(), CmpFIntToFPConst::matchAndRewrite(), mlir::ComposeCollapseOfExpandOp< CollapseOpTy, ExpandOpTy, CastOpTy, DimOpTy, TensorTy >::matchAndRewrite(), CollapseShapeOpMemRefCastFolder::matchAndRewrite(), mlir::ComposeExpandOfCollapseOp< ExpandOpTy, CollapseOpTy >::matchAndRewrite(), Convert1DExtractStridedSliceIntoShuffle::matchAndRewrite(), mlir::GPUReturnOpLowering::matchAndRewrite(), DecomposeDifferentRankInsertStridedSlice::matchAndRewrite(), ConvertSameRankInsertStridedSliceIntoShuffle::matchAndRewrite(), FoldTransposeWithTranspose::matchAndRewrite(), SwapTransposeWithBroadcast::matchAndRewrite(), mlir::linalg::LinalgOpToLibraryCallRewrite::matchAndRewrite(), MulExtendedFold< MulOp, IsSigned >::matchAndRewrite(), InsertSliceOfInsertSliceFolder< OpTy >::matchAndRewrite(), mlir::ComposeReassociativeReshapeOps< ReshapeOpTy, opKind >::matchAndRewrite(), ConvertAccessChain::matchAndRewrite(), ConvertAddressOf::matchAndRewrite(), IAddCarryFold::matchAndRewrite(), ConvertStore::matchAndRewrite(), UModSimplification::matchAndRewrite(), UMulExtendedOpXOne::matchAndRewrite(), DeduplicateAffineMinMaxExpressions< T >::matchAndRewrite(), MergeAffineMinMaxOp< T >::matchAndRewrite(), CanonicalizeAffineMinMaxOpExprAndTermOrder< T >::matchAndRewrite(), CanonicalizeSingleResultAffineMinMaxOp< T >::matchAndRewrite(), SwapExtractSliceOfFill::matchAndRewrite(), mlir::linalg::DecomposePadOpPattern::matchAndRewrite(), ClampClampOptimization::matchAndRewrite(), ConcatOptimization::matchAndRewrite(), PadSliceOptimization::matchAndRewrite(), TransposeIsReshape::matchAndRewrite(), ConsolidateTransposeOptimization::matchAndRewrite(), matchAndRewriteSortOp(), movePaddingToFillOrGenericOp(), SubViewCanonicalizer::operator()(), populateOpPayload(), reduceMatchAndRewriteHelper(), replaceUnitDimIndexOps(), replaceWithLoadOrStore(), rewriteFromElementsAsSplat(), mlir::linalg::rewriteInDestinationPassingStyle(), PadOpVectorizationWithInsertSlicePattern::rewriteUser(), PadOpVectorizationWithTransferWritePattern::rewriteUser(), mlir::tensor::simplifyCollapseShapeWithRankReducingExtractSlice(), simplifyPassThroughBr(), simplifyPassThroughSwitch(), simplifySwitchFromDefaultSwitchOnSameCondition(), simplifySwitchFromSwitchOnSameCondition(), simplifySwitchWithOnlyDefault(), and mlir::linalg::specializeGenericOp().
◆ replaceUsesWithIf() [1/2]
| void RewriterBase::replaceUsesWithIf | ( | Value | from, |
| Value | to, | ||
| function_ref< bool(OpOperand &)> | functor, | ||
| bool * | allUsesReplaced = nullptr |
||
| ) |
Find uses of from and replace them with to if the functor returns true.
Also notify the listener about every in-place op modification (for every use that was replaced). The optional allUsesReplaced flag is set to "true" if all uses were replaced.
Definition at line 258 of file PatternMatch.cpp.
References mlir::Value::getUses(), and modifyOpInPlace().
Referenced by mlir::makeRegionIsolatedFromAbove(), mlir::linalg::offsetIndices(), replaceAllUsesExcept(), replaceForAllWithNewSignature(), replaceOpUsesWithIf(), and replaceUsesWithIf().
◆ replaceUsesWithIf() [2/2]
| void RewriterBase::replaceUsesWithIf | ( | ValueRange | from, |
| ValueRange | to, | ||
| function_ref< bool(OpOperand &)> | functor, | ||
| bool * | allUsesReplaced = nullptr |
||
| ) |
Definition at line 272 of file PatternMatch.cpp.
References replaceUsesWithIf().
◆ splitBlock()
| Block * RewriterBase::splitBlock | ( | Block * | block, |
| Block::iterator | before | ||
| ) |
Split the operations starting at "before" (inclusive) out of the given block into a new block, and return it.
Definition at line 342 of file PatternMatch.cpp.
References mlir::Block::back(), mlir::Block::begin(), mlir::OpBuilder::createBlock(), mlir::Block::end(), mlir::Block::getParent(), mlir::OpBuilder::listener, moveOpBefore(), and mlir::Block::splitBlock().
Referenced by AssertOpLowering::matchAndRewrite(), and MultiBlockExecuteInliner::matchAndRewrite().
◆ startOpModification()
|
inlinevirtual |
This method is used to notify the rewriter that an in-place operation modification is about to happen.
A call to this function must be followed by a call to either finalizeOpModification or cancelOpModification. This is a minor efficiency win (it avoids creating a new operation and removing the old one) but also often allows simpler code in the client.
Reimplemented in mlir::ConversionPatternRewriter.
Definition at line 596 of file PatternMatch.h.
Referenced by mlir::linalg::interchangeGenericOp(), RemoveUnusedLvlCrds::matchAndRewrite(), modifyOpInPlace(), padThroughLoopIterArg(), mlir::affine::reorderOperandsByHoistability(), and replaceUsesAndPropagateType().
The documentation for this class was generated from the following files:
- include/mlir/IR/PatternMatch.h
- lib/IR/PatternMatch.cpp
