操作

开发自定义深度学习函数

对于大多数任务，您可以使用内置层。如果没有您的任务所需的内置层，则可以定义您自己的自定义层。您可以定义具有可学习参数和状态参数的自定义层。定义自定义层后，您可以检查该层是否有效，是否与 GPU 兼容，以及是否输出正确定义的梯度。要了解详细信息，请参阅定义自定义深度学习层。要查看支持的层的列表，请参阅深度学习层列表。

如果 trainingOptions 函数不提供任务所需的训练选项，或您有 trainnet 函数不支持的损失函数，您可以定义自定义训练循环。对于无法指定为由层组成的网络的模型，可以将模型定义为函数。要了解详细信息，请参阅定义自定义训练循环、损失函数和网络。

使用深度学习运算为自定义层、训练循环和模型函数开发 MATLAB^® 代码。

函数

全部展开

自动微分

`dlarray`	用于自定义的深度学习数组
`dims`	`dlarray` 对象的数据格式
`finddim`	Find dimensions with specified label
`stripdims`	Remove `dlarray` data format
`extractdata`	从 `dlarray` 中提取数据
`isdlarray`	Check if object is `dlarray` (自 R2020b 起)

深度学习运算

`dlconv`	Deep learning convolution
`dltranspconv`	Deep learning transposed convolution
`lstm`	Long short-term memory
`gru`	Gated recurrent unit (自 R2020a 起)
`attention`	Dot-product attention (自 R2022b 起)
`embed`	Embed discrete data (自 R2020b 起)
`fullyconnect`	Sum all weighted input data and apply a bias
`dlode45`	Deep learning solution of nonstiff ordinary differential equation (ODE) (自 R2021b 起)
`batchnorm`	Normalize data across all observations for each channel independently
`crosschannelnorm`	Cross channel square-normalize using local responses (自 R2020a 起)
`groupnorm`	Normalize data across grouped subsets of channels for each observation independently (自 R2020b 起)
`instancenorm`	Normalize across each channel for each observation independently (自 R2021a 起)
`layernorm`	Normalize data across all channels for each observation independently (自 R2021a 起)
`avgpool`	Pool data to average values over spatial dimensions
`maxpool`	Pool data to maximum value
`maxunpool`	Unpool the output of a maximum pooling operation

激活

`relu`	应用修正线性单元激活
`leakyrelu`	Apply leaky rectified linear unit activation
`gelu`	Apply Gaussian error linear unit (GELU) activation (自 R2022b 起)
`softmax`	Apply softmax activation to channel dimension
`sigmoid`	应用 sigmoid 激活

损失运算

`crossentropy`	Cross-entropy loss for classification tasks
`indexcrossentropy`	Index cross-entropy loss for classification tasks (自 R2024b 起)
`l1loss`	L₁ loss for regression tasks (自 R2021b 起)
`l2loss`	L₂ loss for regression tasks (自 R2021b 起)
`huber`	Huber loss for regression tasks (自 R2021a 起)
`ctc`	Connectionist temporal classification (CTC) loss for unaligned sequence classification (自 R2021a 起)
`mse`	Half mean squared error

函数加速

`dlaccelerate`	Accelerate deep learning function for custom training loops (自 R2021a 起)
`AcceleratedFunction`	Accelerated deep learning function (自 R2021a 起)
`clearCache`	Clear accelerated deep learning function trace cache (自 R2021a 起)

主题

自动微分

List of Functions with dlarray Support
View the list of functions that support dlarray objects.
Automatic Differentiation Background
Learn how automatic differentiation works.
Use Automatic Differentiation In Deep Learning Toolbox
How to use automatic differentiation in deep learning.
Define Custom Deep Learning Operations
Learn how to define custom deep learning operation.
Specify Custom Operation Backward Function
This example shows how to define the SReLU operation as a differentiable function and specify a custom backward function.
Train Model Using Custom Backward Function
This example shows how to train a deep learning model that contains an operation with a custom backward function.

模型函数

Train Network Using Model Function
This example shows how to create and train a deep learning network by using functions rather than a layer graph or a dlnetwork.
Update Batch Normalization Statistics Using Model Function
This example shows how to update the network state in a network defined as a function.
Make Predictions Using Model Function
This example shows how to make predictions using a model function by splitting data into mini-batches.
Initialize Learnable Parameters for Model Function
Learn how to initialize learnable parameters for custom training loops using a model function.

深度学习函数加速

Deep Learning Function Acceleration for Custom Training Loops
Accelerate model functions and model loss functions for custom training loops by caching and reusing traces.
Accelerate Custom Training Loop Functions
This example shows how to accelerate deep learning custom training loop and prediction functions.
Check Accelerated Deep Learning Function Outputs
This example shows how to check that the outputs of accelerated functions match the outputs of the underlying function.
Evaluate Performance of Accelerated Deep Learning Function
This example shows how to evaluate the performance gains of using an accelerated function.