Optimization Techniques

This repository contains implementations of various optimization techniques outlined in the book "Optimization of Engineering Design: Algorithms and Examples" by Prof. Kalyanmoy Deb. Each technique provides a visual representation by plotting both the function and the approximate minimum point (marked as 'o').

Techniques Included

1. Exhaustive Search Method

   • Description: The exhaustive search method is a brute-force approach to finding the minimum of a function within a specified range.
   • Versions available for both Python and MATLAB:
     • Python Code
     • MATLAB Code

2. Golden Section Search

   • Description: The Golden Section Search is an iterative method that narrows down the search space to find the minimum of an unimodal function.
   • Versions available for both Python and MATLAB:
     • Python Code
     • MATLAB Code

3. Bounding Phase Method

   • Description: The Bounding Phase Method is an optimization technique that involves narrowing down the search interval to find the minimum of an unimodal function.
   • Versions available for both Python and MATLAB:
     • Python Code
     • MATLAB Code

4. Interval Halving Method

   • Description: The Interval Halving Method is an iterative approach for finding the minimum of a function within a specified interval.
   • Versions available for both Python and MATLAB:
     • Python Code
     • MATLAB Code

5. Fibonacci Search Method

   • Description: The Fibonacci Search Method is another iterative approach for finding the minimum of a function within a specified interval.
   • Version available for Python:
     • Python Code
     • MATLAB Code

6. Quadratic Estimation Method

   • Description: The Quadratic Estimation Method is the simplest of all the polynomial interpolation approaches for finding the minimum of a function within a specified interval.
   • Version available for Python:
     • Python Code
     • MATLAB Code

7. Successive Quadratic Estimation Method

   • Description: It is the more refined form of the Quadratic Estimation Method, which iteratively finds the minimum of a function within a specified interval.
   • Version available for Python:
     • Python Code
     • MATLAB Code

8. Newton-Raphson Method

   • Description: It is a very simple gradient-based method, suitable for unconstrained optimization problems.
   • Version available for Python:
     • Python Code
     • MATLAB Code

9. Bisection Method

   • Description: This version of the Bisection Method, does not need the two endpoints, of the search space to have function values of opposite values. Rather, the algorithm is based on the first derivative of the function within the search space. The search space reduces with every iteration.
   • Version available for Python:
     • Python Code
     • MATLAB Code

10. Secant Method

• Description: Secant Method is a modification of the Bisection Method. Here the point 'z', of the search space, is not the mid-point, rather it depends on the values of first derivative of the function.
• Version available for Python:
  • Python Code

11. Cubic Search Method

• Description: Cubic Search Method is used to find the minimum of an unimodal function, iteratively. It is similar to the successive quadratic point-estimation method.
• Versions available for both Python and MATLAB:
  • Python Code
  • MATLAB Code

About the Author

I am currently working as an Assistant Professor in the Department of Mechanical Engineering at Mandsaur University. If you come across any bugs or have suggestions for improvement, feel free to reach out at soumyabrata111@gmail.com. I am also available for freelancing work in the field of Optimization Algorithms, Machine Learning, and Deep Learning. My current research work is in time series analysis and classification algorithms.

Get the Latest MATLAB Files