spectralConvolution1dLayer

1-D spectral convolutional layer

Since R2026a

Description

A 1-D spectral convolutional layer performs convolution on 1-D input using frequency domain transformations. The layer convolves the input by using the frequency domain representation, where convolution becomes multiplication via the Fourier theorem.

The dimension that the layer convolves over depends on the layer input:

For time series and vector sequence input (data with three dimensions corresponding to the channels, observations, and time steps), the layer convolves over the time dimension.
For 1-D image input (data with three dimensions corresponding to the spatial pixels, channels, and observations), the layer convolves over the spatial dimension.
For 1-D image sequence input (data with four dimensions corresponding to the spatial pixels, channels, observations, and time steps), the layer convolves over the spatial dimension.

Creation

Syntax

layer = spectralConvolution1dLayer(numModes,hiddenSize)

layer = spectralConvolution1dLayer(numModes,hiddenSize,Name=Value)

Description

layer = spectralConvolution1dLayer(numModes,hiddenSize) creates a 1-D spectral convolutional layer and sets the NumModes and HiddenSizes properties.

example

layer = spectralConvolution1dLayer(numModes,hiddenSize,Name=Value) also specifies options using one or more name-value arguments. For example, Name="spec" specifies that the layer has the name "spec".

Input Arguments

expand all

`numModes` — Number of modes
positive integer

Number of modes, specified as a positive integer.

The layer computes the Fourier transform of the input data, extracts the first NumModes frequency components, and then performs convolution using the Weights property in the frequency domain.

The number of modes must be less than or equal to (convDimSize + 1)/2, where convDimSize is the size of the input in the convolution dimension.

This argument sets the NumModes property.

`hiddenSize` — Hidden size
positive integer

Hidden size, specified as a positive integer.

The hidden size specifies the number of convolutional filters that the layer applies in the frequency domain.

This argument sets the HiddenSize property.

Name-Value Arguments

expand all

Specify optional pairs of arguments as Name1=Value1,...,NameN=ValueN, where Name is the argument name and Value is the corresponding value. Name-value arguments must appear after other arguments, but the order of the pairs does not matter.

Example: spectralConvolution1dLayer(16,32,Name="spec") creates a 1-D spectral convolutional layer with 16 modes, a hidden size of 32, and the name "spec".

`WeightsInitializer` — Function to initialize weights
`"complex-glorot-normal"` (default) | `"complex-glorot-uniform-square"` | `"complex-he-normal"` | `"complex-he-uniform-square"` | `"complex-narrow-normal"` | `"zeros"` | `"ones"` | function handle

Function to initialize the weights, specified as one of these:

"complex-glorot-normal" — Initialize the weights using the complex-valued Glorot initializer [2] (also known as the complex-valued Xavier initializer). This initializer independently samples the real and imaginary parts of the weights from a normal distribution with a mean of zero and a variance of 2/(numIn + numOut), where numIn and numOut correspond to the InputSize and HiddenSize properties, respectively.
"complex-glorot-uniform-square" — Initialize the weights using the complex-valued Glorot uniform square initializer (also known as the complex-valued Xavier uniform square initializer). This initializer independently samples the real and imaginary parts of the weights from a uniform distribution with bounds at -2/(numIn + numOut) and 2/(numIn + numOut), where numIn and numOut correspond to the InputSize and HiddenSize properties, respectively.
"complex-he-normal" — Initialize the weights using the complex-valued He initializer [3]. This initializer independently samples the real and imaginary parts of the weights from a normal distribution with a mean of zero and a variance of 2/numIn, where numIn corresponds to InputSize.
"complex-he-uniform-square" — Initialize the weights using the complex-valued He uniform square initializer. This initializer independently samples the real and imaginary parts of the weights from a uniform distribution with bounds at -2/numIn and 2/numIn, where numIn corresponds to the InputSize property.
"complex-narrow-normal" — Initialize the real and imaginary parts of the weights by independently sampling from a normal distribution with a mean of zero and a standard deviation of 0.01.
"zeros" — Initialize the weights with zeros.
"ones" — Initialize the weights with ones.
Function handle — Initialize the weights with a custom function. If you specify a function handle, then the function syntax must be of the form weights = func(sz), where sz is the size of the weights. For an example, see Specify Custom Weight Initialization Function.

The layer initializes the weights only when the Weights property is empty.

This argument sets the WeightsInitializer property.

Data Types: char | string | function_handle

`Weights` — Layer weights
`[]` (default) | numeric array

Layer weights for the convolution operation, specified as a NumModes-by-InputSize-by-HiddenSize numeric array or [].

The layer weights are learnable parameters. You can specify the initial value of the weights directly using the Weights property of the layer. When you train a network, if the Weights property of the layer is nonempty, then the trainnet function uses the Weights property as the initial value. If the Weights property is empty, then the software uses the initializer specified by the WeightsInitializer property of the layer.

This argument sets the Weights property.

Data Types: single | double
Complex Number Support: Yes

`WeightLearnRateFactor` — Learning rate factor for weights
`1` (default) | nonnegative scalar

Learning rate factor for the weights, specified as a nonnegative scalar.

The software multiplies this factor by the global learning rate to determine the learning rate for the weights in this layer. For example, if WeightLearnRateFactor is 2, then the learning rate for the weights in this layer is twice the current global learning rate. The software determines the global learning rate based on the settings you specify using the trainingOptions function.

This argument sets the WeightLearnRateFactor property.

`WeightL2Factor` — L₂ regularization factor for weights
`1` (default) | nonnegative scalar

L₂ regularization factor for the weights, specified as a nonnegative scalar.

The software multiplies this factor by the global L₂ regularization factor to determine the L₂ regularization for the weights in this layer. For example, if WeightL2Factor is 2, then the L₂ regularization for the weights in this layer is twice the global L₂ regularization factor. You can specify the global L₂ regularization factor using the trainingOptions function.

This argument sets the WeightL2Factor property.

`Name` — Layer name
`""` (default) | character vector | string scalar

Layer name, specified as a character vector or a string scalar. For Layer array input, the trainnet and dlnetwork functions automatically assign names to unnamed layers.

This argument sets the Name property.

Data Types: char | string

Properties

expand all

1-D Spectral Convolution

`NumModes` — Number of modes
positive integer

This property is read-only after object creation. To set this property, use the corresponding positional input argument when you create the SpectralConvolution1DLayer object.

Number of modes, specified as a positive integer.

The layer computes the Fourier transform of the input data, extracts the first NumModes frequency components, and then performs convolution using the Weights property in the frequency domain.

Data Types: double

`HiddenSize` — Hidden size
positive integer

This property is read-only after object creation. To set this property, use the corresponding positional input argument when you create the SpectralConvolution1DLayer object.

Hidden size, specified as a positive integer.

The hidden size specifies the number of convolutional filters that the layer applies in the frequency domain.

Data Types: double

`InputSize` — Input size
Read-only: `'auto'` (default) | positive integer

This property is read-only.

Input size for the layer, specified as a positive integer or 'auto'. If InputSize is 'auto', then the software automatically determines the input size during training.

Data Types: double | char

Parameters and Initialization

`WeightsInitializer` — Function to initialize weights
`'complex-glorot-normal'` (default) | `'complex-glorot-uniform-square'` | `'complex-he-normal'` | `'complex-he-uniform-square'` | `'complex-narrow-normal'` | `'zeros'` | `'ones'` | function handle

Function to initialize the weights, specified as one of these:

'complex-glorot-normal' — Initialize the weights using the complex-valued Glorot initializer [2] (also known as the complex-valued Xavier initializer). This initializer independently samples the real and imaginary parts of the weights from a normal distribution with a mean of zero and a variance of 2/(numIn + numOut), where numIn and numOut correspond to the InputSize and HiddenSize properties, respectively.
'complex-glorot-uniform-square' — Initialize the weights using the complex-valued Glorot uniform square initializer (also known as the complex-valued Xavier uniform square initializer). This initializer independently samples the real and imaginary parts of the weights from a uniform distribution with bounds at -2/(numIn + numOut) and 2/(numIn + numOut), where numIn and numOut correspond to the InputSize and HiddenSize properties, respectively.
'complex-he-normal' — Initialize the weights using the complex-valued He initializer [3]. This initializer independently samples the real and imaginary parts of the weights from a normal distribution with a mean of zero and a variance of 2/numIn, where numIn corresponds to InputSize.
'complex-he-uniform-square' — Initialize the weights using the complex-valued He uniform square initializer. This initializer independently samples the real and imaginary parts of the weights from a uniform distribution with bounds at -2/numIn and 2/numIn, where numIn corresponds to the InputSize property.
'complex-narrow-normal' — Initialize the real and imaginary parts of the weights by independently sampling from a normal distribution with a mean of zero and a standard deviation of 0.01.
'zeros' — Initialize the weights with zeros.
'ones' — Initialize the weights with ones.
Function handle — Initialize the weights with a custom function. If you specify a function handle, then the function syntax must be of the form weights = func(sz), where sz is the size of the weights. For an example, see Specify Custom Weight Initialization Function.

Data Types: char | function_handle

`Weights` — Layer weights
`[]` (default) | numeric array

Layer weights for the convolution operation, specified as a NumModes-by-InputSize-by-HiddenSize numeric array or [].

Data Types: single | double
Complex Number Support: Yes

Learning Rate and Regularization

`WeightLearnRateFactor` — Learning rate factor for weights
`1` (default) | nonnegative scalar

Learning rate factor for the weights, specified as a nonnegative scalar.

Data Types: double

`WeightL2Factor` — L₂ regularization factor for weights
`1` (default) | nonnegative scalar

L₂ regularization factor for the weights, specified as a nonnegative scalar.

Data Types: double

Layer

`Name` — Layer name
`''` (default) | character vector

Layer name, specified as a character vector. For Layer array input, the trainnet and dlnetwork functions automatically assign names to unnamed layers.

Data Types: char

`NumInputs` — Number of inputs
Read-only: `1` (default)

This property is read-only.

Number of inputs to the layer, stored as 1. This layer accepts a single input only.

Data Types: double

`InputNames` — Input names
Read-only: `{'in'}` (default)

This property is read-only.

Input names, stored as {'in'}. This layer accepts a single input only.

Data Types: cell

`NumOutputs` — Number of outputs
Read-only: `1` (default)

This property is read-only.

Number of outputs from the layer, stored as 1. This layer has a single output only.

Data Types: double

`OutputNames` — Output names
Read-only: `{'out'}` (default)

This property is read-only.

Output names, stored as {'out'}. This layer has a single output only.

Data Types: cell

Examples

collapse all

Create 1-D Spectral Convolution Layer

Open Live Script

Create a 1-D spectral convolution layer with 16 modes and a hidden size of 32.

layer = spectralConvolution1dLayer(16,32)

layer = 
  SpectralConvolution1DLayer with properties:

          Name: ''

   Hyperparameters
      NumModes: 16
     InputSize: 'auto'
    HiddenSize: 32

   Learnable Parameters
       Weights: []

  Show all properties

Create 1-D Fourier Layer

Open Live Script

Create a networkLayer object that represents a 1-D Fourier layer.

Define a function that creates the network layer.

function layer = fourier1dLayer(numModes,hiddenSize,args)

arguments
    numModes
    hiddenSize
    args.Name = ""
end
name = args.Name;

net = dlnetwork;

layers = [
    identityLayer(Name="in")
    spectralConvolution1dLayer(numModes,hiddenSize,Name="specConv")
    additionLayer(2,Name="add")];

net = addLayers(net,layers);

layer = convolution1dLayer(1,hiddenSize,Name="fc");
net = addLayers(net,layer);

net = connectLayers(net,"in","fc");
net = connectLayers(net,"fc","add/in2");

layer = networkLayer(net,Name=name);

end

Create a 1-D Fourier neural operator (FNO) network that contains a Fourier layer.

numModes = 16;
hiddenSize = 64;

layers = [
    inputLayer([NaN hiddenSize 2],"BSC")
    convolution1dLayer(1,hiddenSize)
    fourier1dLayer(numModes,hiddenSize)
    reluLayer
    convolution1dLayer(1,128)
    reluLayer
    convolution1dLayer(1,1)]

layers = 
  7×1 Layer array with layers:

     1   ''   Input             NaN×64×2 input with format "BSC"
     2   ''   1-D Convolution   64 1 convolutions with stride 1 and padding [0  0]
     3   ''   Network Layer     Network with 4 layers, 1 input and 1 output.
     4   ''   ReLU              ReLU
     5   ''   1-D Convolution   128 1 convolutions with stride 1 and padding [0  0]
     6   ''   ReLU              ReLU
     7   ''   1-D Convolution   1 1 convolutions with stride 1 and padding [0  0]

Algorithms

expand all

1-D Spectral Convolution

A 1-D spectral convolutional layer performs convolution on 1-D input using frequency domain transformations.

The layer computes the Fourier transform of the input data, extracts the first NumModes frequency components, and then performs convolution using the Weights property in the frequency domain.

The dimension that the layer convolves over depends on the layer input:

For time series and vector sequence input (data with three dimensions corresponding to the channels, observations, and time steps), the layer convolves over the time dimension.
For 1-D image input (data with three dimensions corresponding to the spatial pixels, channels, and observations), the layer convolves over the spatial dimension.
For 1-D image sequence input (data with four dimensions corresponding to the spatial pixels, channels, observations, and time steps), the layer convolves over the spatial dimension.

Layer Input and Output Formats

Most layers in a layer array or layer graph pass data to subsequent layers as formatted dlarray objects. The format of a dlarray object is a string of characters in which each character describes the corresponding dimension of the data. The format consists of one or more of these characters:

"S" — Spatial
"C" — Channel
"B" — Batch
"T" — Time
"U" — Unspecified

For example, you can represent vector sequence data as a 3-D array, in which the first dimension corresponds to the channel dimension, the second dimension corresponds to the batch dimension, and the third dimension corresponds to the time dimension. This representation is in the format "CBT" (channel, batch, time).

You can interact with these dlarray objects in automatic differentiation workflows, such as those for:

developing a custom layer
using a functionLayer object
using the forward and predict functions with dlnetwork objects

This table shows the supported input formats of SpectralConvolution1DLayer objects and the corresponding output format. If the software passes the output of the layer to a custom layer that does not inherit from the nnet.layer.Formattable class, or to a FunctionLayer object with the Formattable property set to 0 (false), then the layer receives an unformatted dlarray object with dimensions ordered according to the formats in this table. The formats listed here are only a subset of the formats that the layer supports. The layer might support additional formats, such as formats with additional "S" (spatial) or "U" (unspecified) dimensions.

Input Format	Output Format
`"SCB"` (spatial, channel, batch)	`"SCB"` (spatial, channel, batch)
`"CBT"` (channel, batch, time)	`"CBT"` (channel, batch, time)
`"SCBT"` (spatial, channel, batch, time)	`"SCBT"` (spatial, channel, batch, time)
`"SC"` (spatial, channel)	`"SC"` (spatial, channel)
`"CT"` (channel, time)	`"CT"` (channel, time)
`"SCT"` (spatial, channel, time)	`"SCT"` (spatial, channel, time)

References

[1] Li, Zongyi, Nikola Kovachki, Kamyar Azizzadenesheli, Burigede Liu, Kaushik Bhattacharya, Andrew Stuart, and Anima Anandkumar. "Fourier Neural Operator for Parametric Partial Differential Equations." arXiv, May 17, 2021. https://doi.org/10.48550/arXiv.2010.08895.

[2] Glorot, Xavier, and Yoshua Bengio. "Understanding the Difficulty of Training Deep Feedforward Neural Networks." In Proceedings of the Thirteenth International Conference on Artificial Intelligence and Statistics, 249–356. Sardinia, Italy: AISTATS, 2010. https://proceedings.mlr.press/v9/glorot10a/glorot10a.pdf

[3] He, Kaiming, Xiangyu Zhang, Shaoqing Ren, and Jian Sun. "Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classification." In 2015 IEEE International Conference on Computer Vision (ICCV), 1026–34. Santiago, Chile: IEEE, 2015. https://doi.org/10.1109/ICCV.2015.123

Extended Capabilities

expand all

C/C++ Code Generation
Generate C and C++ code using MATLAB® Coder™.

Usage notes and limitations:

You can generate generic C/C++ code that does not depend on third-party libraries and deploy the generated code to hardware platforms.

GPU Code Generation
Generate CUDA® code for NVIDIA® GPUs using GPU Coder™.

Usage notes and limitations:

You can generate CUDA code that is independent of deep learning libraries and deploy the generated code to platforms that use NVIDIA^® GPU processors.

Version History

Introduced in R2026a

spectralConvolution1dLayer

Description

Creation

Syntax

Description

Input Arguments

numModes — Number of modes positive integer

hiddenSize — Hidden size positive integer

Name-Value Arguments

WeightsInitializer — Function to initialize weights "complex-glorot-normal" (default) | "complex-glorot-uniform-square" | "complex-he-normal" | "complex-he-uniform-square" | "complex-narrow-normal" | "zeros" | "ones" | function handle

Weights — Layer weights [] (default) | numeric array

WeightLearnRateFactor — Learning rate factor for weights 1 (default) | nonnegative scalar

WeightL2Factor — L2 regularization factor for weights 1 (default) | nonnegative scalar

Name — Layer name "" (default) | character vector | string scalar

Properties

1-D Spectral Convolution

NumModes — Number of modes positive integer

HiddenSize — Hidden size positive integer

InputSize — Input size Read-only: 'auto' (default) | positive integer

Parameters and Initialization

WeightsInitializer — Function to initialize weights 'complex-glorot-normal' (default) | 'complex-glorot-uniform-square' | 'complex-he-normal' | 'complex-he-uniform-square' | 'complex-narrow-normal' | 'zeros' | 'ones' | function handle

Weights — Layer weights [] (default) | numeric array

Learning Rate and Regularization

WeightLearnRateFactor — Learning rate factor for weights 1 (default) | nonnegative scalar

WeightL2Factor — L2 regularization factor for weights 1 (default) | nonnegative scalar

Layer

Name — Layer name '' (default) | character vector

NumInputs — Number of inputs Read-only: 1 (default)

InputNames — Input names Read-only: {'in'} (default)

NumOutputs — Number of outputs Read-only: 1 (default)

OutputNames — Output names Read-only: {'out'} (default)

Examples

Create 1-D Spectral Convolution Layer

Create 1-D Fourier Layer

Algorithms

1-D Spectral Convolution

Layer Input and Output Formats

References

Extended Capabilities

C/C++ Code Generation Generate C and C++ code using MATLAB® Coder™.

GPU Code Generation Generate CUDA® code for NVIDIA® GPUs using GPU Coder™.

Version History

See Also

Topics

`numModes` — Number of modes
positive integer

`hiddenSize` — Hidden size
positive integer

`WeightsInitializer` — Function to initialize weights
`"complex-glorot-normal"` (default) | `"complex-glorot-uniform-square"` | `"complex-he-normal"` | `"complex-he-uniform-square"` | `"complex-narrow-normal"` | `"zeros"` | `"ones"` | function handle

`Weights` — Layer weights
`[]` (default) | numeric array

`WeightLearnRateFactor` — Learning rate factor for weights
`1` (default) | nonnegative scalar

`WeightL2Factor` — L₂ regularization factor for weights
`1` (default) | nonnegative scalar

`Name` — Layer name
`""` (default) | character vector | string scalar

`NumModes` — Number of modes
positive integer

`HiddenSize` — Hidden size
positive integer

`InputSize` — Input size
Read-only: `'auto'` (default) | positive integer

`WeightsInitializer` — Function to initialize weights
`'complex-glorot-normal'` (default) | `'complex-glorot-uniform-square'` | `'complex-he-normal'` | `'complex-he-uniform-square'` | `'complex-narrow-normal'` | `'zeros'` | `'ones'` | function handle

`Weights` — Layer weights
`[]` (default) | numeric array

`WeightLearnRateFactor` — Learning rate factor for weights
`1` (default) | nonnegative scalar

`WeightL2Factor` — L₂ regularization factor for weights
`1` (default) | nonnegative scalar

`Name` — Layer name
`''` (default) | character vector

`NumInputs` — Number of inputs
Read-only: `1` (default)

`InputNames` — Input names
Read-only: `{'in'}` (default)

`NumOutputs` — Number of outputs
Read-only: `1` (default)

`OutputNames` — Output names
Read-only: `{'out'}` (default)

C/C++ Code Generation
Generate C and C++ code using MATLAB® Coder™.

GPU Code Generation
Generate CUDA® code for NVIDIA® GPUs using GPU Coder™.