Main Content

Quantization Workflow Prerequisites

This page describes the products required to quantize, simulate, and deploy deep learning networks using Deep Learning Toolbox Model Quantization Library. The prerequisites required depend on your selections at each stage of the quantization workflow.

Prerequisites for All Quantization Workflows

The following requirements apply to all stages of the quantization workflow.

Supported Networks and Layers

The following links describe the networks and layers supported for each execution environment.

Prerequisites for Calibration

The prerequisites for calibration depend on your selection of calibration environment.

  • Calibrate on host GPU

    • Parallel Computing Toolbox™

    • GPU Coder™ Interface for Deep Learning

    • CUDA® enabled NVIDIA® GPU with compute capability 3.5 or higher.

    • Supported C/C++ Compiler

      • On Windows®, the MinGW C/C++ compiler is not supported. Use Microsoft Visual C++ 2022, Microsoft Visual C++ 2019, or Microsoft Visual C++ 2017.

      • On Linux®, use a GCC C/C++ compiler.

        For a list of supported compilers, see Supported and Compatible Compilers.

  • Calibrate on host CPU

    • MATLAB® Coder™ Interface for Deep Learning or GPU Coder Interface for Deep Learning

Prerequisites for Quantization

To quantize your network for simulation in MATLAB using the quantize function or the Export > Export Quantized Network option in the Deep Network Quantizer app, no additional prerequisites are required.

Prerequisites for Validation

The following are required to validate your quantized network for deployment using the validate function or the Quantize and Validate button in the Deep Network Quantizer app.

Execution EnvironmentPrerequisites for Validation
GPU

FPGA

  • MATLAB Coder Interface for Deep Learning

  • Deep Learning HDL Toolbox™

  • Deep Learning HDL Toolbox Support Package for Xilinx® FPGA and SoC Devices

  • Deep Learning HDL Toolbox Support Package for Intel® FPGA and SoC Devices

  • hdlsetuptoolpath (HDL Coder)

CPU

MATLAB

  • N/A

For CPU and GPU deployment, the software generates code for a convolutional deep neural network by quantizing the weights, biases, and activations of the convolution layers to 8-bit scaled integer data types. The quantization is performed by providing the calibration result file produced by the calibrate function to the codegen (MATLAB Coder) command.

Code generation does not support quantized deep neural networks produced by the quantize function.

Validation on target hardware for CPU, FPGA, and GPU execution environments is not supported in MATLAB Online™. For FPGA and GPU execution environments, validation can be performed through emulation on the MATLAB Online host. GPU validation can also be performed if GPU support has been added to your MATLAB Online Server™ cluster. For more information on GPU support for MATLAB Online, see Configure GPU Support in MATLAB Online Server (MATLAB Online Server).

Related Topics