Stability of convergence is the main reason to supply an analytic Jacobian.
For computation time, it depends on the complexity of the analytical derivatives whether numerical or analytical Jacobian is more time-intensive. It may be the case that supplying an analytical Jabobian makes the computation slower than using the numerical alternative.