You can subtract any RGB image from any other RGB image. Just do that. I don't recommend using imsubtract. Just cast to double, subtract, and continue on.
differenceImage = double(rgbImage) - double(yourImageWithYellowInIt);
Find the treasures in MATLAB Central and discover how the community can help you!
Start Hunting!