Whiplash Gradient Descent Algorithm

First Order Gradient Descent Algorithm for Stiff-systems.
129.0 次下载
更新时间 2023/6/12
Whiplash Gradient Descent: A Closed Loop Gradient Descent Algorithm applied to Rosenbrock's function. Please find the paper here: https://arxiv.org/abs/2108.12883.
We introduce a novel adaptive damping technique for an inertial gradient system which finds application as a gradient descent algorithm for unconstrained optimisation. In an example using the non-convex Rosenbrock's function, we show an improvement on existing momentum-based gradient optimisation methods. Also using Lyapunov stability analysis, we demonstrate the performance of the continuous-time version of the algorithm. Using numerical simulations, we consider the performance of its discrete-time counterpart obtained by using the symplectic Euler method of discretisation.
This file contains a live MATLAB example and a Simulink simulation by Mr. Subhransu Sekhar Bhattacharjee, U7143478, ANU, developed under the supervision of Prof. Dr. Ian R. Petersen FAA, College of Engineering and Computer Science, ANU. Please direct any queries regarding the code to Mr. Subhransu Bhattacharjee at u7143478@anu.edu.au. Please use MATLAB version 2021a for running the .mlx file.

引用格式

Subhransu Sekhar Bhattacharjee & Ian R Petersen, A Closed Loop Gradient Descent Algorithm applied to Rosenbrock's function, Proceedings of the ANZCC 2021, IEEE Xplore, https://github.com/SubhransuSekharBhattacharjee-01/Whiplash, GitHub.

MATLAB 版本兼容性
创建方式 R2021a
兼容任何版本
平台兼容性
Windows macOS Linux

Community Treasure Hunt

Find the treasures in MATLAB Central and discover how the community can help you!

Start Hunting!

无法下载基于 GitHub 默认分支的版本

版本 已发布 发行说明
2.3

citation updated

2.2

Note

2.1

paper link added

2.0.3

Description

2.0.2

Summary

2.0.1

Notes

2.0.0

Fixed README

1.0.0

要查看或报告此来自 GitHub 的附加功能中的问题,请访问其 GitHub 仓库
要查看或报告此来自 GitHub 的附加功能中的问题,请访问其 GitHub 仓库