Using a Complete Poll in a Generalized Pattern Search

As an example, consider the following function.

The following figure shows a plot of the function.

 Code for generating the figure

[X,Y] = meshgrid(-6:.1:6,-6:.1:14);
Z = zeros(size(X));
for i = 1:size(X,1)
for j=1:size(X,2)
Z(i,j) = poll_example([X(i,j),Y(i,j)]);
end;end;
surf(X,Y,Z,'LineStyle','none');
view([-60,30])
annotation('textarrow',[0.24 0.38],...
    [0.11 0.47],'String',{'Local minimum at [0,9]'});
annotation('textarrow',[0.68 0.6],...
    [0.15 0.26],'String',{'Global minimum at [0,0]'});

The global minimum of the function occurs at (0, 0), where its value is -25. However, the function also has a local minimum at (0, 9), where its value is -16.

To create a file that computes the function, copy and paste the following code into a new file in the MATLAB^® Editor.

function z = poll_example(x)
if x(1)^2 + x(2)^2 <= 25
    z = x(1)^2 + x(2)^2 - 25;
elseif x(1)^2 + (x(2) - 9)^2 <= 16
    z = x(1)^2 + (x(2) - 9)^2 - 16;
else z = 0;
end

Save the file as poll_example.m in a folder on the MATLAB path.

To run a pattern search on the function, enter the following.

options = optimoptions('patternsearch','Display','iter');
[x,fval] = patternsearch(@poll_example,[0,5],...
    [],[],[],[],[],[],[],options)

MATLAB returns a table of iterations and the solution.

x =

     0     9


fval =

   -16

The algorithm begins by a=evaluating the function at the initial point, f(0, 5) = 0. The poll evaluates the following during its first iterations.

As soon as the search polls the mesh point (0, 6), at which the objective function value is less than at the initial point, it stops polling the current mesh and sets the current point at the next iteration to (0, 6). Consequently, the search moves toward the local minimum at (0, 9) at the first iteration. You see this by looking at the first two lines of the command line display.

Iter     f-count     f(x)      MeshSize     Method
    0        1         0             1      
    1        3        -7             2     Successful Poll

Note that the pattern search performs only two evaluations of the objective function at the first iteration, increasing the total function count from 1 to 3.

Next, set UseCompletePoll to true and rerun the optimization.

options.UseCompletePoll = true;
[x,fval] = patternsearch(@poll_example,[0,5],...
    [],[],[],[],[],[],[],options);

This time, the pattern search finds the global minimum at (0, 0). The difference between this run and the previous one is that with UseCompletePoll set to true, at the first iteration the pattern search polls all four mesh points.

Because the last mesh point has the lowest objective function value, the pattern search selects it as the current point at the next iteration. The first two lines of the command-line display show this.

Iter     f-count     f(x)      MeshSize     Method
    0        1         0             1      
    1        5        -9             2     Successful Poll

In this case, the objective function is evaluated four times at the first iteration. As a result, the pattern search moves toward the global minimum at (0, 0).

The following figure compares the sequence of points returned when Complete poll is set to Off with the sequence when Complete poll is On.

 Code for generating the figure

function graph_poll_example

[X,Y] = meshgrid(-6:.1:14,-6:.1:14);
Z = zeros(size(X));
for i = 1:size(X,1)
    for j=1:size(X,2)
        Z(i,j) = poll_example([X(i,j),Y(i,j)]);
    end;
end;
contour(X,Y,Z);
hold on

h = plot(0,5,'ko');

opts = optimoptions('patternsearch','OutputFcn',@plotpnt,'UseCompletePoll',false);
[thex,thefv] = patternsearch(@poll_example,[0,5],...
    [],[],[],[],[],[],[],opts);

opts = optimoptions('patternsearch','OutputFcn',@plotpnt,'UseCompletePoll',true);
[thex,thefv] = patternsearch(@poll_example,[0,5],...
    [],[],[],[],[],[],[],opts);
hold off

legend([h,ff,tt],'Initial point','Complete poll off','Complete poll on')

line([0,6],[9,6],'Color','k','LineStyle','--')
line([0,6],[0,3],'Color','k','LineStyle','--')

text(6,6,'Local minimum')
text(6,3,'Global minimum')

function [stop,opts,optchanged] = plotpnt(optimvalues,opts,flag)
    if strcmp(flag,'iter')
        if isequal(opts.UseCompletePoll,true)
            tt = plot(optimvalues.x(1),optimvalues.x(2),'r+');
        else
            ff = plot(optimvalues.x(1),optimvalues.x(2),'b*');
        end
    end
stop = false;
optchanged = false;
end

end

Compare the Efficiency of Poll Options

This example shows how several poll options interact in terms of iterations and total function evaluations. The main results are:

[outputgps2noff.funccount,outputgps2noff.iterations]

ans =

        1462         136