Main Content

TrainingInfo

Neural network training information

Since R2023b

expand all in page

    Description

    Neural network training information including validation and loss information.

    Creation

    Create a TrainingInfo object using the second output of the trainnet.

    Properties

    expand all

    Information about training iterations, returned as a table.

    The table contains these variables:

    • Iteration — Iteration number

    • Loss — Training loss

    • Metrics specified by the Metrics training option.

    If you train with a stochastic solver (SGDM, Adam, or RMSProp), then the table has these additional variables:

    • Epoch — Epoch number

    • LearnRate — Learning rate

    If you train with the L-BFGS solver, then the table has these additional variables:

    • GradientNorm — Norm of the gradients

    • StepNorm — Norm of the steps

    Data Types: table

    Information about validation iterations, returned as a table.

    The table contains these variables:

    • Iteration — Iteration number

    • Loss — Training loss

    • Metrics specified by the Metrics training option.

    Data Types: table

    Iteration that corresponds to the returned network, returned as a positive integer.

    Data Types: double

    Reason for stopping training, returned as one of these values:

    • "Max epochs completed" — Training reached the number of epochs specified by the MaxEpochs training option.

    • "Max iterations completed" — Training reached the number of iterations specified by the MaxIterations training option.

    • "Stopped by OutputFcn" — Function specified by the OutputFcn training option returned 1 (true).

    • "Met validation criterion" — Validation loss is not lowest for ValidationPatience times.

    • "Stopped manually" — Stop button pressed.

    • "Error occurred" — The software threw an error.

    • "Training loss is NaN" — Training loss is NaN.

    • "Gradient tolerance reached" — Norm of the gradients is lower than the GradientTolerance training option.

    • "Step tolerance reached" — Norm of the steps is lower than the StepTolerance training option.

    • "Suitable learning rate not found" — Line search unable to find suitable learning rate.

    Data Types: string

    Object Functions

    showShow training information plot
    closeClose training information plot

    Examples

    collapse all

    Open Live Script

    Unzip the digit sample data and create an image datastore. The imageDatastore function automatically labels the images based on folder names.

    unzip("DigitsData.zip")
imds = imageDatastore("DigitsData", ...
    IncludeSubfolders=true, ...
    LabelSource="foldernames");

    Define the convolutional neural network architecture. Specify the size of the images in the input layer of the network and the number of classes in the final fully connected layer. Each image is 28-by-28-by-1 pixels.

    inputSize = [28 28 1];
numClasses = numel(categories(imds.Labels));

layers = [
    imageInputLayer(inputSize)
    convolution2dLayer(5,20)
    batchNormalizationLayer
    reluLayer
    fullyConnectedLayer(numClasses)
    softmaxLayer];

    Specify the training options.

    • Train for four epochs using the SGDM solver.

    • Monitor the accuracy metric.

    options = trainingOptions("sgdm", ...
    MaxEpochs=4, ...
    Metrics="accuracy");

    Train the neural network. For classification, use cross-entropy loss. Return the trained network and the training information.

    [net,info] = trainnet(imds,layers,"crossentropy",options);
        Iteration    Epoch    TimeElapsed    LearnRate    TrainingLoss    TrainingAccuracy
    _________    _____    ___________    _________    ____________    ________________
            1        1       00:00:00         0.01          2.7615              3.9062
           50        1       00:00:07         0.01         0.48211              85.938
          100        2       00:00:12         0.01         0.16471              96.094
          150        2       00:00:18         0.01         0.10177              96.094
          200        3       00:00:25         0.01        0.057216                 100
          250        4       00:00:33         0.01        0.031815                 100
          300        4       00:00:39         0.01        0.021116                 100
          312        4       00:00:40         0.01        0.029253              99.219
Training stopped: Max epochs completed

    View the training information.

    info
    info = 
  TrainingInfo with properties:

           TrainingHistory: [312x5 table]
         ValidationHistory: [0x0 table]
    OutputNetworkIteration: 312
                StopReason: "Max epochs completed"

    Display the training information in a plot using the show function.

    show(info)

    Close the plot using the close function.

    close(info)

    Version History

    Introduced in R2023b

    See Also

    | | |

    Topics