The function creates a surface, and the integral has only a scalar value, so perhaps something like this —
F = @(x,y) y.*sqrt(x.^2 - y.^2);
ymax = @(x)x;
q= integral2(F,1,2,0,ymax)
x = linspace(1, 2, 10);
y = linspace(0, ymax(max(x)), 10);
[X,Y] = ndgrid(x,y);
% cplxsurf = F(X,Y)
figure
surf(X, Y, real(F(X,Y)))
hold on
surf(X, Y, imag(F(X,Y)))
hold off
grid on
colormap(turbo)
title('Complex')
figure
surf(X, Y, abs(F(X,Y)))
grid on
colormap(turbo)
title('Absolute Value')
Make appropriate changes to get the desired result.
.


