Explanation of Active Appearance Model MATLAB codes (need help)

3 次查看（过去 30 天）
Abdulmu'min Musa
Abdulmu'min Musa 2018-6-24
编辑： Walter Roberson 2018-8-26
In the process of searching for Active Appearance Model matlab codes, i wasn't opportune to get much answers but i was able get one in which i could not understand some part of it very well, especially the first line that goes like this
function AAM = train_AAM(where, folder, what, AAM)
i don't know what "where", "folder", "what" and "AAM" means? What am i to input there.
Here is the full code
function AAM = train_AAM(where, folder, what, AAM)
% function AAM = train_AAM(where, folder, what, AAM)
% Training an AAM consists of the following steps
% A. Read shapes and apply Procrustes to remove similarity transforms (scale-rotation-translation)
% This step produces: (i) the mean shape and (ii) the similarity-free shapes
% B. Create shape model by appying PCA on the similarity-free shapes
% C. Create the coordinate frame of the AAM. This is where all calculations take place.
% We create one coordinate frame for every scale (i.e resolution)
% D. Read images and warp them to mean shape using a piecewise affine warp. This will
% create the shape-free textures
% E. Create texture model by appying PCA on the shape-free textures
num_of_scales = length(AAM.scales);
image_list = dir([where '/' folder '/*.' what]);
pts_files = dir([where '/' folder '/*.pts']);
num_of_samples = length(image_list);
%%A.Read shapes and Apply Procrustes to remove scale-rotation-translation from shapes
shapes = zeros(AAM.num_of_points, 2, num_of_samples);
for i=1:length(image_list)
shapes(:,:,i) = read_shape([where '/' folder '/' pts_files(i).name], AAM.num_of_points);
end
% shapes_normal: the similarity-free shapes
% AAM.s0: the mean shape
shapes_normal = Procrustes_analysis(shapes);
AAM.shape.s0 = mean(shapes_normal, 3);
%%B.Create the shape model
shapes_normal = reshape(shapes_normal, [], num_of_samples);
rep_s0 = repmat(AAM.shape.s0(:), 1, num_of_samples);
% apply PCA on similarity free shapes
S = myPCA(shapes_normal - rep_s0, AAM.shape.max_n);
% Create similarity eigs
[AAM.shape.S AAM.shape.Q] = create_similarity_eigs(AAM.shape.s0, S);
%%C.Create the coordinate frame of the AAM
% triangulated mesh is obtained using Delauny's method on the mean shape
triangles = delaunay(AAM.shape.s0(:,1), AAM.shape.s0(:,2));
for ii = 1:num_of_scales
AAM.coord_frame{ii}.triangles = triangles;
end
% create base shape and base texture, and masks for each resolution
sc = 2.^(AAM.scales-1);
for ii = 1:length(sc)
s0_sc = AAM.shape.s0/sc(ii);
% Create base shape: this is the mean shape scaled (for each resolution)
% and shifted so that all of its coordinates are positive
mini = min(s0_sc(:, 1));
minj = min(s0_sc(:, 2));
maxi = max(s0_sc(:, 1));
maxj = max(s0_sc(:, 2));
AAM.coord_frame{ii}.base_shape = s0_sc - repmat([mini - 2, minj - 2], [AAM.num_of_points, 1]);
AAM.coord_frame{ii}.resolution = [ceil(maxj - minj + 3) ceil(maxi - mini + 3)];
% base_texture is used to index all pixels in each triangle of base_shape efficiently.
AAM.coord_frame{ii}.base_texture = create_texture_base(AAM.coord_frame{ii}.base_shape, AAM.coord_frame{ii}.triangles, AAM.coord_frame{ii}.resolution);
% Masking: This is an implementation detail, but quite important.
% When we warp the images to the mean shape below, we may want to mask out 1
% boundary pixel. This is because there might be error in the annotations,
% and usually boundary pixels might belong to the background of the
% image and not the face.
mask = AAM.coord_frame{ii}.base_texture; mask(mask>0) = 1; mask = double(mask);
mask = imerode(mask, strel('square',3));
AAM.coord_frame{ii}.mask = mask;
AAM.coord_frame{ii}.ind_in = find(mask == 1);
AAM.coord_frame{ii}.ind_out = find(mask == 0);
% Also, when we compute the Jacobian of the template from gradT * [dW_dp]
% using derivative operator [-1 0 1]/2, the gradient at the
% boundary will be wrong. So we have to remove it. So mask2
% removes one extra pixel
mask2 = imerode(mask, strel('square', 3));
AAM.coord_frame{ii}.mask2 = mask2;
AAM.coord_frame{ii}.ind_in2 = find(mask2 == 1);
AAM.coord_frame{ii}.ind_out2 = find(mask2 == 0);
end
%%D. Read images and get shape-free textures textures
textures = cell(1, num_of_scales);
for ii = 1:num_of_scales
textures{ii} = zeros(length(AAM.coord_frame{ii}.ind_in), num_of_samples);
end
zeros(num_of_scales, length(image_list));
count = 0;
for jj = 1:length(image_list)
I = imread([where '/' folder '/' image_list(jj).name]);
if size(I, 3) == 3
I = double(rgb2gray(I));
else
I = double((I));
end
current_shape(:, 1) = shapes(:, 1, jj);
current_shape(:, 2) = shapes(:, 2, jj);
count = count + 1;
for ii = 1:num_of_scales
try
Iw = warp_image(AAM.coord_frame{ii}, current_shape, I);
% mask out 1 boundary pixel
Iw(AAM.coord_frame{ii}.ind_out) = 0;
Iw(AAM.coord_frame{ii}.ind_out) = [];
% check if warped data is fine
temp = sum(isnan(Iw));
% all images should be also in the range [0, 255]
if ((temp == 0) && max(Iw) < 256)
textures{ii}(:, count) = Iw;
else
textures{ii}(:, count) = zeros(size(Iw));
end
catch me
aa = 1;
end
end
end
%%E. Create the texture model
for ii = 1:num_of_scales
A0 = mean(textures{ii}, 2);
textures{ii} = textures{ii} - repmat(A0, 1, size(textures{ii}, 2));
AAM.texture{ii}.A0 = A0;
AAM.texture{ii}.A = myPCA(textures{ii}, AAM.texture{ii}.max_m);
% During fitting we will need the subspace defined inside mask2 (i.e. after
% removing 1 additional pixel). We call this subspace AA. To compute AA
% we remove 1 pixel from A and re-othormalise such that A^T = A^(-1), and A^T*A = I.
t = zeros(AAM.coord_frame{ii}.resolution(1)*AAM.coord_frame{ii}.resolution(2), 1);
t(AAM.coord_frame{ii}.ind_in) = A0;
U = zeros(AAM.coord_frame{ii}.resolution(1)*AAM.coord_frame{ii}.resolution(2), AAM.texture{ii}.max_m);
for kk = 1:size(U, 2)
U(AAM.coord_frame{ii}.ind_in, kk) = AAM.texture{ii}.A(:, kk);
end
t(AAM.coord_frame{ii}.ind_out2) = [];
U(AAM.coord_frame{ii}.ind_out2, :) = [];
U = gs_orthonorm(U);
AAM.texture{ii}.AA0 = t;
AAM.texture{ii}.AA = U;
end
function shapes_normal = Procrustes_analysis(shapes)
% align all shapes to the mean shape
% shapes_normal : aligned shapes
% Translate each shape to the origin
shapes_normal = shapes - repmat(mean(shapes, 1), size(shapes, 1), 1);
mean_shape = mean(shapes_normal, 3);
iteration = 0;
max_iteration = 100;
while (iteration<=max_iteration)
% Align all shapes with current mean shape
for i=1:size(shapes,3)
[~, shapes_normal(:,:,i)] = procrustes(mean_shape, shapes_normal(:,:,i));
end
% Update mean shape
mean_shape_new = mean(shapes_normal, 3);
[~, mean_shape_new] = procrustes(mean_shape, mean_shape_new);
mean_shape = mean_shape_new;
iteration = iteration + 1;
end
function base_texture = create_texture_base(vertices, triangles, resolution)
% base_texture to warp image
base_texture = zeros(resolution(1), resolution(2));
for i=1:size(triangles,1)
% vertices for each triangle
X = vertices(triangles(i,:),1);
Y = vertices(triangles(i,:),2);
% mask for each traingle
mask = poly2mask(X,Y,resolution(1), resolution(2)) .* i;
% the complete base texture
base_texture = max(base_texture, mask);
end

请先登录，再回答此问题。

采纳的回答

Walter Roberson
Walter Roberson 2018-6-24
The first parameter "where" and the second parameter "folder" work together to designate the directory to look in to find the data. I do not see why they did not just use one input. Anyhow, "folder" should be the last component of the name of the folder that contains the images, and "where" should be the complete path of that folder above that point. For example, "where" might be C:\Users\amusa\Documents\MATLAB\Project7" and "folder" might be "EyeImages3"
"what" should be the extension of the kinds of images to look for, without the leading "." . For example, "what"might be 'png' .
"AAM" should be an already initialized Active Appearance Model. It must be initialized: this code cannot create a new AAM for you.

更多回答（1 个）

Abdulmu'min Musa
Abdulmu'min Musa 2018-7-12
Please what do you mean by this quote ""AAM" should be an already initialized Active Appearance Model. It must be initialized: this code cannot create a new AAM for you". Shed more lights to it please.
  6 个评论
显示 4更早的评论
Walter Roberson
Walter Roberson 2018-7-20
I do not know much about AAM, so you would need to ask specific questions.
Abdulmu'min Musa
Abdulmu'min Musa 2018-8-26
编辑：Walter Roberson 2018-8-26
This is what i have done so far, and i am getting some errors.
clear; clc; close all;
% addpath functions
%%Train
% should you change any of the parameters below, set flag_train = 1;
flag_train = 1;
where = 'C:\Users\ENGR. KAYODE\Desktop\IMM DB4';
folder = 'IMM DB4';
what = 'jpg';
AAM.num_of_points = 58;
% scales refers to the resolution that fitting is taking place.
% if scale is 1, then we fit in 1/(2^(1-1)) = 1 i.e. in the original image resolution
% if scale is 2, then we fit in 1/(2^(2-1)) = 1/2 i.e. half the original resolution
% Multi-resolution fitting is a heuristic for improving fitting.
AAM.scales = [1 2];
% max_n and max_m refers to the number of components
% that we keep after we apply PCA on the similarity-free shapes and shape-free textures
AAM.shape.max_n = 136;
num_of_scales = length(AAM.scales);
AAM.texture = cell(1, num_of_scales);
for ii = 1:num_of_scales
AAM.texture{ii}.max_m = 550;
end
When i run it line by line, it works till i reach here (AAM.texture{ii}.max_m = 550) where it is now giving me error as
Scalar cell array indices required in this assignment.
Also this part
AAM = train_AAM1(['C:\Users\ENGR. KAYODE\Desktop\IMM DB4','jpg';AAM])
which is the last part of initializing the AAM is giving me error as
Error using vertcat
The following error occurred converting from char to struct:
Error using struct
Conversion to struct from char is not possible.
Please help me out.

请先登录，再进行评论。

类别

在 Help Center 和 File Exchange 中查找有关 Dimensionality Reduction and Feature Extraction 的更多信息

标签

Community Treasure Hunt

Find the treasures in MATLAB Central and discover how the community can help you!

Start Hunting!

Translated by