The start point is one of a few things you can change to influence the solver. There are other options (tolerances, etc) that may change the behavior as well.
However, it sounds like there may be multiple minima in your problem. Which of the different start points (positive or negative) gives the smallest residual?
You may opt to try many different start points to find the best solution.