How to improve imregister for rigid 3D image registration of very small images?

Question

Hello Matlab 2018-7-15

1
链接

此问题的直接链接

https://ww2.mathworks.cn/matlabcentral/answers/410442-how-to-improve-imregister-for-rigid-3d-image-registration-of-very-small-images

评论： Hello Matlab 2018-7-22

I have 3D image stacks of a dendrite over time and want to register every image stack to the first one of the series. I found the function imregister and want to use it, but the resulting alignment is not very well. Please find two example images and a registration attempt attached. The images are created using two-photon microscopy.

I played around with the parameters but I feel like I can do this forever and I still have Mean-Squared Errors around 380. The images are also quite small, voxel size of 0.007 microns in X&Y and 0.6 microns in Z; image size = 512x512x22. The 3D array has values from 0-255.

So I wanted to ask for some experience/tips in choosing parameters especially for such an image size, or if you spot any error in my code. How should I proceed?

Here is my code

fixed = get3DImage(<fixedImage>);   %returns 3D array containing my image, uint8
moving = get3DImage(<movingImage>);
Rfixed = imref3d(size(fixed),0.000007,0.000007,0.0006);   %Pixel extent in world parameters
Rmoving = imref3d(size(moving),0.000007,0.000007,0.0006);
[optimizer, metric] = imregconfig('monomodal');
optimizer.MaximumStepLength = 6.25e-05; 
optimizer.MinimumStepLength = 0.9e-05;
optimizer.MaximumIterations = 1000;
movingRegistered = imregister(moving,Rmoving, fixed, Rfixed, 'rigid', optimizer, metric);

Any help appreciated! Thanks

0 个评论
显示 -2更早的评论隐藏 -2更早的评论

请先登录，再进行评论。

请先登录，再回答此问题。

Answer 1

Matt J 2018-7-15

2
链接

此回答的直接链接

https://ww2.mathworks.cn/matlabcentral/answers/410442-how-to-improve-imregister-for-rigid-3d-image-registration-of-very-small-images#answer_328914

编辑：Matt J 2018-7-15

I recommend that you use imregtform instead, since it will output the transformation as a result, instead of just the registered image. I also recommend that you use the 'InitialTransformation' option to initialize the registration with the immediately preceding registration result in the series. Assuming the motion is gradual over time, this will make it easier for the solver to deal with very large displacements relative to the fixed image.

Finally, are you sure that a 'rigid' motion model is a good one for dendrites? I thought the only biological tissue that moved rigidly was bone, but then again I'm not a biologist.

11 个评论
显示 9更早的评论隐藏 9更早的评论

Matt J 2018-7-17

编辑：Matt J 2018-7-17

在 MATLAB Online 中打开

It's not possible to look at the regmex implementation. It's a dll. But looking at your images, it is far more likely that the problem is in the initial tform guess, or the assumption of a rigid object, rather than the algorithm implementation. Registration algorithms typically depend on partial overlap between structures in the fixed and moving images to get a foothold in the search. Considering how spatially varying your image structures are, I'm betting you have very little overlap (I see none in the images you've posted). Without a good initial guess, this makes the solution very hard for imregtform to find.

I think the place to start is to try to manually obtain a good initial guess of the rototranslation and use it to test the assumption of rigid motion.

If you manually pick out some corresponding landmarks in each image, you can register their coordinates using ABSOR. You can then convert the output of absor to an initial tform guess by doing

tform = affine3d(reg.M.');

If this doesn't get you into a regime where imregtform performs well, the chances are pretty good that a rigid registration model doesn't fit very well. Incidentally, if the registration error given by absor

[reg,~,errors]=absor(A,B)

is large, that would also be a sign that a rigid model is bad.

Matt J 2018-7-18

编辑：Matt J 2018-7-18

errlsq: 15.8247, errmax: 12.6509

What units are these? Millimeters? Voxels? And are your voxels isotropic (equal lengths in x,y, and z)? ABSOR assumes you have common units for the x,y, and z coordinates.

Also, it would be informative to examine the distances between your landmarks in both images. If the motion is rigid, the inter-landmark distances should be preserved.

Likewise with angles. If the triangle formed by any three landmarks have nearly the same angles in both images, it is evidence that the transformation is rigid. And if not, that it is not rigid.

Also, picking the landmark points is really hard

I didn't intend for the final solution to be a landmark-based registration. As far as I was concerned, this was just for the purposes of analysis and setting performance baselines.

There is no generic way of doing automatic landmark detection that I know of, but if you think you can design something based on your insights into this class of objects, it could be something to pursue. regionprops3() gives a variety of segmentation tools.

Matt J 2018-7-20

在 MATLAB Online 中打开

The three Eigenvectors form the rows of a rotation matrix whose Euler angle (or Tait-Bryan angle?) decomposition gives Orientation. How that decomposition works is something you probably understand better than anyone else, since you explained how it works here.

But I don't see why you would need to analyze things in terms of angles. If E1 and E2 are the 3x3 eigenvector matrices of Image 1 and Image 2, then they will be related by a rotation matrix R

E1*R=E2

which you can just solve for by matrix algebra,

R=E1.'*E2

Hello Matlab 2018-7-22

Aaah, now I see that connection! One matrix multiplication is indeed easier than rotating manually by the angles. Especially when axes are unclear.

Now I use a transformation object (rotation matrix from eigenvectors and weighted centroids diff for translation) as Initial Transformation. Mean-Square Errors are still pretty high, though, and the registered images not euqally aligned. This will take a little longer

You helped me a lot, Matt, thank you.

请先登录，再进行评论。