3D U-Net Semantic Segmentation on custom CT dataset

8 次查看（过去 30 天）
Vineet Sharma
Vineet Sharma 2019-8-3
回答： Chahira Mahjoub 2024-5-16
Hello:
I am trying to apply the concept and sample code of the tutorial "3D brain tumor segmentation using deep learning" found on the below link -
https://in.mathworks.com/help/deeplearning/examples/segment-3d-brain-tumor-using-deep-learning.html
to a custom CT dataset in order to segment the lymph nodes. In my use case also there are 2 classes i.e background and lymph nodes. The current dataset has less data points (70 in total) and the split after preprocessing is 56 for train, 10 for validation and 4 for test.
I have modified the preprocessing code to accept the custom dataset and am cropping the ROI (i.e. the cubiod region around the abdomen which has the ground truth for the lumph nodes from the full CT Torso Volume)
I have visualized the patches that are extracted by the randomPatchExtractorDatastore and found that there is a class imbalance i.e. 4 out of 5 times the extracted patch has a Lymph node portion and 1 out of 5 times - it has the background portion. So, this may be causing an issue is what I am suspecting. (The dice accuracy suggest the same - as mentioed at the later part of this text)
In my case the volume image are 1 channel where as in the tutorial the volume image are 4 channel, so I have changed the input_layer to [64 64 64 1]
The code is working and there are no errors. The training process is also working but the accuracy starts at 100% and the loss starts at approx 1. So, this is unlike the graph shown in the tutorial where the accuracy gradually increase and reaches about 72 %. To train 1 EPOCH it takes like 75 mins on RTX 2080Ti so I tried training for 10 epochs as I was suspicious about the class imbalance of the randomly extracted patches.
I used PatchPerImage = 32 and the initial learning rate at 0.001 for the 1st 5 EPOCHs. The validation freq is 10.
Training Graph is as below -
11 Final after 10 EPOCHs.png
The segmentation test shows that the model is just identifing the background and not learning to segment the lymph node. The Quantify Segmentation Accuracy section of the code suggest the same thing that the lymph nodes are not identified by the newtork.
Average Dice Score of the background across 4 test volumes = 0.99685 and
Average Dice Score of the lymph nodes across 4 test volumes = 0
Box plot of the Dice Score is as below -
Test Set Dice Accuracy.png
I need some help and guidance on the following -
So, what can be the reason for this. Is class imbalance the reason or lack of training or few datapoint ?
How can i ensure that the patches in the randomPatchExtractorDatastore are equally balance accross both the classes i.e. Background and Lymph Nodes ?
Also, should i train the network for more epochs (like 50 or 100) before evaluating its efficacy ?
Is the limited data point the problem. I only have 175 total datapoints in the comprehensive dataset. So, should i use a higher patchPerImage value like 64 (instead of 16 as used in the tutorial)
Thanks for your guidance.

请先登录，再回答此问题。

回答（2 个）

Ying Liang
Ying Liang 2019-8-9
What loss function you used?
  3 个评论
显示 1更早的评论
Ying Liang
Ying Liang 2019-8-12
I had the similar issues with you. I found several tricky things you should be aware of when playing with 3D u-net using your own data.
The quick reply is Matlab will transpose your ground truth contour during training. You can set a break point in the forwardLoss function in the customized dicePixelClassification3DLayer and check the variable "T".
Also, the formular for calcuating loss in the dicePixelClassification3DLayer is problemitc. But this is not as fatal as the previous issue.
Hope this helps. I will give more details in a few day when I have some free time.
Vineet Sharma
Vineet Sharma 2019-8-13
Thanks for the guidance. I will look into the suggestions.
Please also provide other details once you find some free time.
Thanks for the help. Really appreciate it !

请先登录，再进行评论。

Chahira Mahjoub
Chahira Mahjoub 2024-5-16
Hello, I have the same errors; please help me to resolve it !!!!
Thanks in advance !

类别

在 Help Center 和 File Exchange 中查找有关 Semantic Segmentation 的更多信息

标签

产品


版本

R2019a

Community Treasure Hunt

Find the treasures in MATLAB Central and discover how the community can help you!

Start Hunting!

Translated by