Asynchronous Parallel Programming

Evaluate functions in the background using parfeval

You can evaluate a function in the background without waiting for it to complete, using parfeval. In many cases, it can be convenient to break out of a for loop early. For example, in an optimization procedure, you can stop the loop early when the result is good enough. You can do this on one or all parallel pool workers, using parfeval or parfevalOnAll. This can be useful if you want to be able to plot intermediate results. Note that this is different from using parfor, where you have to wait for the loop to complete.

Use send and poll together to send and poll for messages or data from different workers using a data queue. You can use afterEach to add a function to call when new data is received from a data queue.

Use afterEach and afterAll to automatically invoke functions after each or after all elements of a Future array complete. This array can contain futures returned by parfeval, parfevalOnAll, afterEach or afterAll.

Functions

expand all

Functions and Classes

`parfeval`	Run function on parallel pool worker
`parfevalOnAll`	Run function asynchronously on all workers in parallel pool
`ticBytes`	Start counting bytes transferred within parallel pool
`tocBytes`	Read how many bytes have been transferred since calling `ticBytes`
`send`	Send data between clients and workers using a data queue
`poll`	Retrieve data sent to a pollable data queue
`afterEach`	Define a function to call when new data is received on a data queue
`afterEach`	Run function after each function finishes running in the background
`afterAll`	Run function after all functions finish running in the background
`fetchOutputs`	Retrieve results from function running in the background
`fetchNext`	Retrieve next unread outputs from `Future` array
`cancel`	Stop function running in the background
`cancelAll`	Cancel all jobs or tasks (Since R2022a)
`wait`	Wait for futures to complete
`Future`	Function scheduled to run
`parallel.Pool`	Parallel pool of workers
`parallel.pool.DataQueue`	Send and listen for data between client and workers
`parallel.pool.PollableDataQueue`	Send and poll data between client and workers

Topics

Evaluate Functions in the Background Using parfeval
Break out of an optimizing loop early and collect results as they become available.
Query and Cancel parfeval Futures
This example shows how to query the state of parfeval futures and cancel them.
Use afterEach and afterAll to Run Callback Functions
Automatically run functions after Future objects finish running on parallel pools.
Plot During Parameter Sweep with parfeval
This example shows how to perform a parallel parameter sweep with parfeval and send results back during computations with a DataQueue object.
Update User Interface Asynchronously Using afterEach and afterAll
This example shows how to update a user interface as computations complete.
Perform Webcam Image Acquisition in Parallel with Postprocessing
This example shows how to perform frame acquisition from a webcam in parallel with data postprocessing.
Perform Image Acquisition and Parallel Image Processing
This example shows how to perform image acquisition from a webcam and postprocess data in parallel.
Train Deep Learning Networks in Parallel (Deep Learning Toolbox)
This example shows how to run multiple deep learning experiments on your local machine.
Use parfeval to Train Multiple Deep Learning Networks (Deep Learning Toolbox)
This example shows how to use parfeval to perform a parameter sweep on the depth of the network architecture for a deep learning network and retrieve data during training.
Choose Between spmd, parfor, and parfeval
Compare and contrast spmd against other parallel computing functionality such as parfor and parfeval.
Receive Communication on Workers
This example shows how to setup a data queue on the workers to receive data. (Since R2023b)
Interactively Import and Process Data in Parallel
This example shows how to import and process data simultaneously in an interactive parallel pool. (Since R2023b)

Featured Examples

Plot During Parameter Sweep with parfeval

Perform a parallel parameter sweep with parfeval and send results back during computations with a DataQueue object.

Open Live Script

Train Deep Learning Networks in Parallel

Run multiple deep learning experiments on your local machine. Using this example as a template, you can modify the network layers and training options to suit your specific application needs. You can use this approach with a single or multiple GPUs. If you have a single GPU, the networks train one after the other in the background. The approach in this example enables you to continue using MATLAB® while deep learning experiments are in progress.

(Deep Learning Toolbox)