Main Content

本页的翻译已过时。点击此处可查看最新英文版本。

深度学习自定义训练循环

自定义深度学习训练循环和损失函数

如果 trainingOptions 函数不提供任务所需的训练选项，或者自定义输出层不支持所需的损失函数，则您可以定义自定义训练循环。对于无法使用层次图创建的网络，可以将自定义网络定义为函数。要了解详细信息，请参阅定义自定义训练循环、损失函数和网络。

函数

全部展开

dlnetworkDeep learning network for custom training loops
forwardCompute deep learning network output for training
predictCompute deep learning network output for inference
adamupdateUpdate parameters using adaptive moment estimation (Adam)
rmspropupdate Update parameters using root mean squared propagation (RMSProp)
sgdmupdate Update parameters using stochastic gradient descent with momentum (SGDM)
dlupdate Update parameters using custom function
minibatchqueueCreate mini-batches for deep learning
onehotencodeEncode data labels into one-hot vectors
onehotdecodeDecode probability vectors into class labels
padsequencesPad or truncate sequence data to same length
initializeInitialize learnable and state parameters of a dlnetwork
dlarrayDeep learning array for custom training loops
dlgradientCompute gradients for custom training loops using automatic differentiation
dlfevalEvaluate deep learning model for custom training loops
dimsDimension labels of dlarray
finddimFind dimensions with specified label
stripdimsRemove dlarray data format
extractdataExtract data from dlarray
isdlarrayDetermine whether input is dlarray
functionToLayerGraphConvert deep learning model function to a layer graph
dlconvDeep learning convolution
dltranspconvDeep learning transposed convolution
lstmLong short-term memory
gruGated recurrent unit
embedEmbed discrete data
fullyconnectSum all weighted input data and apply a bias
reluApply rectified linear unit activation
leakyreluApply leaky rectified linear unit activation
batchnormNormalize data across all observations for each channel independently
crosschannelnormCross channel square-normalize using local responses
groupnormNormalize data across grouped subsets of channels for each observation independently
instancenormNormalize across each channel for each observation independently
layernormNormalize data across all channels for each observation independently
avgpoolPool data to average values over spatial dimensions
maxpoolPool data to maximum value
maxunpoolUnpool the output of a maximum pooling operation
softmaxApply softmax activation to channel dimension
sigmoidApply sigmoid activation
crossentropyCross-entropy loss for classification tasks
huberHuber loss for regression tasks
mseHalf mean squared error
ctcConnectionist temporal classification (CTC) loss for unaligned sequence classification
dlaccelerateAccelerate deep learning function for custom training loops
AcceleratedFunctionAccelerated deep learning function
clearCacheClear accelerated deep learning function trace cache

主题

自定义训练循环

Train Deep Learning Model in MATLAB

Learn how to training deep learning models in MATLAB®.

定义自定义训练循环、损失函数和网络

了解如何使用自动微分来定义和自定义深度学习训练循环、损失函数和网络。

Train Network Using Custom Training Loop

This example shows how to train a network that classifies handwritten digits with a custom learning rate schedule.

Specify Training Options in Custom Training Loop

Learn how to specify common training options in a custom training loop.

Define Model Gradients Function for Custom Training Loop

Learn how to define a model gradients function for a custom training loop.

Update Batch Normalization Statistics in Custom Training Loop

This example shows how to update the network state in a custom training loop.

Make Predictions Using dlnetwork Object

This example shows how to make predictions using a dlnetwork object by splitting data into mini-batches.

Train Network on Image and Feature Data

This example shows how to train a network that classifies handwritten digits using both image and feature input data.

Train Network with Multiple Outputs

This example shows how to train a deep learning network with multiple outputs that predict both labels and angles of rotations of handwritten digits.

Classify Videos Using Deep Learning with Custom Training Loop

This example shows how to create a network for video classification by combining a pretrained image classification model and a sequence classification network.

Train Image Classification Network Robust to Adversarial Examples

This example shows how to train a neural network that is robust to adversarial examples using fast gradient sign method (FGSM) adversarial training.

Train Robust Deep Learning Network with Jacobian Regularization

This example shows how to train a neural network that is robust to adversarial examples using a Jacobian regularization scheme [1].

模型函数

Train Network Using Model Function

This example shows how to create and train a deep learning network by using functions rather than a layer graph or a dlnetwork.

Update Batch Normalization Statistics Using Model Function

This example shows how to update the network state in a network defined as a function.

Make Predictions Using Model Function

This example shows how to make predictions using a model function by splitting data into mini-batches.

Initialize Learnable Parameters for Model Function

Learn how to initialize learnable parameters for custom training loops using a model function.

自动微分

List of Functions with dlarray Support

View the list of functions that support dlarray objects.

Automatic Differentiation Background

Learn how automatic differentiation works.

Use Automatic Differentiation In Deep Learning Toolbox

How to use automatic differentiation in deep learning.

深度学习函数加速

Deep Learning Function Acceleration for Custom Training Loops

Accelerate model functions and model gradients functions for custom training loops by caching and reusing traces.

Accelerate Custom Training Loop Functions

This example shows how to accelerate deep learning custom training loop and prediction functions.

Check Accelerated Deep Learning Function Outputs

This example shows how to check that the outputs of accelerated functions match the outputs of the underlying function.

Evaluate Performance of Accelerated Deep Learning Function

This example shows how to evaluate the performance gains of using an accelerated function.

特色示例

训练生成对抗网络 (GAN)

训练生成对抗网络 (GAN)

此示例说明如何训练生成对抗网络来生成图像。

打开实时脚本
Train Conditional Generative Adversarial Network (CGAN)

Train Conditional Generative Adversarial Network (CGAN)

Train a conditional generative adversarial network to generate images.

打开实时脚本
Train Fast Style Transfer Network

Train Fast Style Transfer Network

Train a network to transfer the style of an image to a second image. It is based on the architecture defined in [1].

打开实时脚本
Train Network Using Custom Training Loop

Train Network Using Custom Training Loop

Train a network that classifies handwritten digits with a custom learning rate schedule.

打开实时脚本
Train Network Using Model Function

Train Network Using Model Function

Create and train a deep learning network by using functions rather than a layer graph or a dlnetwork. The advantage of using functions is the flexibility to describe a wide variety of networks. The disadvantage is that you must complete more steps and prepare your data carefully. This example uses images of handwritten digits, with the dual objectives of classifying the digits and determining the angle of each digit from the vertical.

打开实时脚本
Train a Siamese Network for Dimensionality Reduction

Train a Siamese Network for Dimensionality Reduction

Train a Siamese network to compare handwritten digits using dimensionality reduction.

打开实时脚本
Train a Siamese Network to Compare Images

Train a Siamese Network to Compare Images

Train a Siamese network to identify similar images of handwritten characters.

打开实时脚本
Image Captioning Using Attention

Image Captioning Using Attention

Train a deep learning model for image captioning using attention.

打开实时脚本
Multilabel Text Classification Using Deep Learning

Multilabel Text Classification Using Deep Learning

Classify text data that has multiple independent labels.

打开实时脚本
Sequence-to-Sequence Translation Using Attention

Sequence-to-Sequence Translation Using Attention

Convert decimal strings to Roman numerals using a recurrent sequence-to-sequence encoder-decoder model with attention.

打开实时脚本
Sequence-to-Sequence Classification Using 1-D Convolutions

Sequence-to-Sequence Classification Using 1-D Convolutions

Classify each time step of sequence data using a generic temporal convolutional network (TCN).

打开实时脚本
Train Network in Parallel with Custom Training Loop

Train Network in Parallel with Custom Training Loop

Set up a custom training loop to train a network in parallel. In this example, parallel workers train on portions of the overall mini-batch. If you have a GPU, then training happens on the GPU. During training, a DataQueue object sends training progress information back to the MATLAB client.

打开实时脚本
训练变分自编码器 (VAE) 以生成图像

训练变分自编码器 (VAE) 以生成图像

此示例说明如何在 MATLAB 中创建一个变分自编码器 (VAE) 以生成数字图像。VAE 生成 MNIST 数据集样式的手写数字。

打开实时脚本
Train Network Using Cyclical Learning Rate for Snapshot Ensembling

Train Network Using Cyclical Learning Rate for Snapshot Ensembling

Train a network to classify images of objects using a cyclical learning rate schedule and snapshot ensembling for better test accuracy. In the example, you learn how to use a cosine function for the learning rate schedule, take snapshots of the network during training to create a model ensemble, and add L2-norm regularization (weight decay) to the training loss.

打开实时脚本
Solve Partial Differential Equations Using Deep Learning

Solve Partial Differential Equations Using Deep Learning

Solve Burger's equation using deep learning.

打开实时脚本
Solve Partial Differential Equation with LBFGS Method and Deep Learning

Solve Partial Differential Equation with LBFGS Method and Deep Learning

Train a Physics Informed Neural Network (PINN) to numerically compute the solution of the Burger's equation by using the limited-memory BFGS (LBFGS) algorithm.

打开实时脚本
Dynamical System Modeling Using Neural ODE

Dynamical System Modeling Using Neural ODE

Train a neural network with neural ordinary differential equations (ODEs) to learn the dynamics of a physical system.

打开实时脚本
Node Classification Using Graph Convolutional Network

Node Classification Using Graph Convolutional Network

Classify nodes in a graph using Graph Convolutional Network (GCN).

打开实时脚本
Train Network Using Federated Learning

Train Network Using Federated Learning

Train a network using federated learning. Federated learning is a technique that enables you to train a network in a distributed, decentralized way [1].

打开实时脚本

Deep Learning Toolbox 文档

支持

Introducing Deep Learning with MATLAB

Introducing Deep Learning with MATLAB

Download ebook