'quant' Dialect

Type constraint definition ¶

UniformQuantizedType ¶

Operation definition ¶

quant.const_fake_quant (::mlir::quant::ConstFakeQuant) ¶

Simulates the effect of uniform quantization with const range.

Given a const min, max, num_bits and narrow_range attribute, applies the same uniform quantization simulation as is done by the TensorFlow fake_quant_with_min_max_args op. See the fakeQuantAttrsToType() utility method and the quant-convert-simulated-quantization pass for further details.

Traits: SameOperandsAndResultType

Interfaces: InferTypeOpInterface, NoSideEffect (MemoryEffectOpInterface)

Effects: MemoryEffects::Effect{}

Attributes: ¶

Operands: ¶

Results: ¶

quant.const_fake_quant_per_axis (::mlir::quant::ConstFakeQuantPerAxis) ¶

Simulates the effect of per axis uniform quantization with const range.

Given a const min, max, num_bits and narrow_range attribute, applies the same per axis uniform quantization simulation as is done by the TensorFlow fake_quant_with_min_max_vars_per_channel op. See the fakeQuantAttrsToType() utility method and the quant-convert-simulated-quantization pass for further details.

Traits: SameOperandsAndResultType

Interfaces: InferTypeOpInterface, NoSideEffect (MemoryEffectOpInterface)

Effects: MemoryEffects::Effect{}

Attributes: ¶

Operands: ¶

Results: ¶

quant.coupled_ref (::mlir::quant::CoupledRefOp) ¶

Indicates that one point of the computation is coupled to another.

Ordinarily, relationships between ops for the purposes of determining compatible quantized types is explicit based on the use-def chain. However, in some situations, a use may be separated from its def by arbitrary external connections. In such a case, during analysis, all coupled_ref nodes in a module which share a coupledKey will be considered to be directly connected as via an identity op for the purpose of type inference.

Traits: SameOperandsAndResultType

Interfaces: InferTypeOpInterface

Attributes: ¶

Operands: ¶

Results: ¶

quant.dcast (::mlir::quant::DequantizeCastOp) ¶

Interfaces: NoSideEffect (MemoryEffectOpInterface)

Effects: MemoryEffects::Effect{}

Operands: ¶

Results: ¶

quant.qcast (::mlir::quant::QuantizeCastOp) ¶

Interfaces: NoSideEffect (MemoryEffectOpInterface)

Effects: MemoryEffects::Effect{}

Operands: ¶

Results: ¶

quant.region (::mlir::quant::QuantizeRegionOp) ¶

The `region` operation wraps high-precision ops as a logical low-precision
quantized kernel.

Traits: IsolatedFromAbove, SingleBlockImplicitTerminator

Interfaces: NoSideEffect (MemoryEffectOpInterface)

Effects: MemoryEffects::Effect{}

Attributes: ¶

Operands: ¶

Results: ¶

quant.return (::mlir::quant::ReturnOp) ¶

The `return` operation terminates a quantize region and returns values.

Traits: Terminator

Operands: ¶

quant.stats (::mlir::quant::StatisticsOp) ¶

Identity op which associates statistics with the value.

Associates statistics about the runtime ranges of values observed for evaluations of this node.

Statistics about the entire type are reported in the ‘layerStats’ attribute and those for each axis, in the (optional) axisStats attribute. The interpretation of each is determined by the last dimension of its shape. Currently, only dim=2 is supported, which is interpreted as [min, max].

layerStats must be a rank 1 tensor: [2] axisStats must be a rank 2 tensor: [N, 2], where N=the slice size splitted by the axis dimension. For example:

<?x?x3x2>, axis=3 => N=2
<?x?x3x2>, axis=2 => N=6

Traits: SameOperandsAndResultType

Interfaces: InferTypeOpInterface

Attributes: ¶

Operands: ¶

Results: ¶

quant.stats_ref (::mlir::quant::StatisticsRefOp) ¶

Indicates that statistics are resolved by reference.

This op acts as an identity that, when encountered at runtime, should result in statistics being collected about about the value of its operand/result. Such statistics will be stored with the provided key, allowing this node to later be converted to a ‘stats’ op if statistics with that key have been encountered.

Traits: SameOperandsAndResultType

Interfaces: InferTypeOpInterface

Attributes: ¶

Operands: ¶

Results: ¶

quant.scast (::mlir::quant::StorageCastOp) ¶

Interfaces: NoSideEffect (MemoryEffectOpInterface)

Effects: MemoryEffects::Effect{}

Operands: ¶

Results: ¶