Regularized Least Square (Tikhonov regularization) and ordinary least square solution for a system of linear equation involving Hilbert matrix is computed using Singular value decomposition and are compared. Since Hilbert matrices are inherently ill-conditioned systems, the stability of regularization over the slightly perturbed system is demonstrated.