For most tasks, you can control the training algorithm details using the trainingOptions and trainNetwork functions. If the trainingOptions function does not provide the options you need for your task (for example, a custom learn rate schedule), then you can define your own custom training loop using automatic differentiation.
For an example showing how to train a network with a custom learn rate schedule, see Train Network Using Custom Training Loop.
