Depending on the desired result, either use the rms function with the entire matrix (using the (:) convention to force it to be a vector) or take the rms values across a specific dimension.
Z = randn(10);
rms_all = rms(Z(:))
rms_across_rows = rms(Z,2)
.
