How can I align an image according to another image?

Question

Vic 2013-1-27

0
链接

此问题的直接链接

https://ww2.mathworks.cn/matlabcentral/answers/59987-how-can-i-align-an-image-according-to-another-image

I am trying to align an image according to a base image and according to the position of 2 circles on the left of each page.

The link for base image: http://tinypic.com/view.php?pic=nmi053&s=6

The link for unregistered image: http://tinypic.com/view.php?pic=2zsbmuu&s=6

The code I have so far is listed below but the only thing I have a problem with is how to use imtransfrom function to register the image.

1 个评论
显示 -1更早的评论隐藏 -1更早的评论

Vic 2013-1-27

I1 = imread('C:\Users\Victoras\Desktop\answertest.bmp');

J1= imread('C:\Users\Victoras\Desktop\studenttest.bmp');

I2= rgb2gray(I1); %convert colour images to grayscale

J2= rgb2gray(J1);

BWI = im2bw(I2);% convert grayscale images to binary

BWJ = im2bw(J2);

IMI = imcomplement(BWI); % invert colours, black to white and white to black

IMJ = imcomplement(BWJ);

%imshow(IMI);

%imshow(IMJ);

BWIremove = bwareaopen(IMI, 5000); % remove objects less that 4500 pixels

BWJremove = bwareaopen(IMJ, 5000);

%imshow(BWIremove);

%imshow(BWJremove);

[LI, numI] = bwlabel(BWIremove);

[LJ, numJ] = bwlabel(BWJremove);

centroidsI = regionprops(LI,'Centroid');

centroidsJ = regionprops(LJ,'Centroid');

% Create a transformation structure for an affine % transformation.

t_concord = cp2tform(centroidsI,centroidsJ,'affine');

% Get the width and height of the orthophoto and perform % the transformation.

info = imfinfo(I1);

registered = imtransform(IMJ,t_concord,'XData',[1 info.Width], 'YData',[1 info.Height]);

figure, imshow(registered)

请先登录，再进行评论。

请先登录，再回答此问题。

Answer 1

Image Analyst 2013-1-27

0
链接

此回答的直接链接

https://ww2.mathworks.cn/matlabcentral/answers/59987-how-can-i-align-an-image-according-to-another-image#answer_72527

Have you tried imregister()? It will condense all that code down into a single line of code. Go ahead, make it easy on yourself.

11 个评论
显示 9更早的评论隐藏 9更早的评论

Image Analyst 2013-1-27

在 MATLAB Online 中打开

I don't know how you went wrong. I just adapted the example in the help and it worked beautifully. Maybe I just have a magic touch. Here is my code:

clc;    % Clear the command window.
close all;  % Close all figures (except those of imtool.)
workspace;  % Make sure the workspace panel is showing.
fontSize = 20;
format compact;
% Read in a standard MATLAB gray scale demo image.
folder = 'C:\Users\Vic\Documents\Temporary';
baseFileName = 'straight_sheet.jpg';
% Get the full filename, with path prepended.
fullFileName = fullfile(folder, baseFileName);
% Check if file exists.
if ~exist(fullFileName, 'file')
  % File doesn't exist -- didn't find it there.  Check the search path for it.
  fullFileName = baseFileName; % No path this time.
  if ~exist(fullFileName, 'file')
    % Still didn't find it.  Alert user.
    errorMessage = sprintf('Error: %s does not exist in the search path folders.', fullFileName);
    uiwait(warndlg(errorMessage));
    return;
  end
end
straightImage = imread(fullFileName);
% Get the dimensions of the image.  
% numberOfColorBands should be = 1.
[rows columns numberOfColorBands] = size(straightImage)
% Display the original gray scale image.
subplot(2, 2, 1);
imshow(straightImage, []);
title('Original Color Image', 'FontSize', fontSize);
% Enlarge figure to full screen.
set(gcf, 'units','normalized','outerposition',[0 0 1 1]);
% Give a name to the title bar.
set(gcf,'name','Demo by ImageAnalyst','numbertitle','off') 
baseFileName = 'tilted_sheet.jpg';
% Get the full filename, with path prepended.
fullFileName = fullfile(folder, baseFileName);
tiltedImage = imread(fullFileName);
% Get the dimensions of the image.  
% numberOfColorBands should be = 1.
[rows2 columns2 numberOfColorBands2] = size(tiltedImage)
% Display the original gray scale image.
subplot(2, 2, 2);
imshow(tiltedImage, []);
title('Tilted Color Image', 'FontSize', fontSize);
% Enlarge figure to full screen.
set(gcf, 'units','normalized','outerposition',[0 0 1 1]);
% Give a name to the title bar.
set(gcf,'name','Demo by ImageAnalyst','numbertitle','off') 
% View the misaligned images.
subplot(2, 2, 3);
% figure;
imshowpair(straightImage, tiltedImage, 'Scaling', 'joint');
drawnow;
% imregister works on gray scale images so we need to do it one channel at a time.
% Extract the individual red, green, and blue color channels.
straightRedChannel = straightImage(:, :, 1);
straightGreenChannel = straightImage(:, :, 2);
straightBlueChannel = straightImage(:, :, 3);
tiltedRedChannel = tiltedImage(:, :, 1);
tiltedGreenChannel = tiltedImage(:, :, 2);
tiltedBlueChannel = tiltedImage(:, :, 3);
promptMessage = sprintf('Now I will alight them.\nThis will take about 50 sweconds.\nDo you want to Continue processing,\nor Cancel to abort processing?');
titleBarCaption = 'Continue?';
button = questdlg(promptMessage, titleBarCaption, 'Continue', 'Cancel', 'Continue');
if strcmpi(button, 'Cancel')
  return;
end
% Create a configuration suitable for registering imagesfrom the same sensor. 
[optimizer, metric] = imregconfig('monomodal')
% Now modify the optimizer configuration to get more precision.
optimizer.MaximumIterations = 300;
optimizer.MinimumStepLength = 5e-4;
% Perform the registration.
alignedRedChannel = imregister(tiltedRedChannel, straightRedChannel, 'rigid',optimizer,metric);
% View registered images.
figure
imshowpair(straightRedChannel, alignedRedChannel,'Scaling','joint');
title('Aligned image superimposed with straight image');
% Enlarge figure to full screen.
set(gcf, 'units','normalized','outerposition',[0 0 1 1]);
helpdlg('Done with demo.  Now do the same with the green and blue channels.');

Image Analyst 2013-1-27

That said, if you could figure out a transform, tformfwd() would probably be faster than calling imregister() three times.

Matt J 2013-1-27

编辑：Matt J 2013-1-27

Seems like a fluke to me. What if all the 'A' answers had been filled out in the first image and all the 'D' Answers had been filled out in the second? The alignment of the blue channels would have been heavily inconsistent with the other channels.

请先登录，再进行评论。

Answer 2

Matt J 2013-1-27

0
链接

此回答的直接链接

https://ww2.mathworks.cn/matlabcentral/answers/59987-how-can-i-align-an-image-according-to-another-image#answer_72560

编辑：Matt J 2013-1-27

在 MATLAB Online 中打开

Here's a modification of the original approach using ABSOR, available here

    [LI, numI] = bwlabel( imfill(BWIremove,'holes') );
    [LJ, numJ] = bwlabel( imfill(BWJremove,'holes')  );
    centroidsI = regionprops(LI,'Centroid');
    centroidsJ = regionprops(LJ,'Centroid');
    % Create a transformation structure for an affine % transformation.
     cI=vertcat(centroidsI.Centroid);
     cJ=vertcat(centroidsJ.Centroid);
     S=absor(cJ.', cI.');
     t_concord=maketform('affine', S.M(1:2,:).');
     registered = imtransform(IMJ,t_concord,....);

Because you're only using 2 landmarks to perform the registration, the alignment will probably not be as perfect as with imregister, although as I've said, I have my doubts about how well imregister would work across a larger population of questionnaires.

There are things you could do to improve the tilt angle estimate though, like find more landmarks, or use regionprops(...,'Orientation') on the answer boxes.