This could easily be caused by the majority of vertices being outside the frame, or it could be due to a bunch of points being colinear or nearly colinear. Why would vertices be out of frame? It could also be caused by x and y components (of either the vertices or grid pairs) being transposed at some point, or it could be because the named x and y vectors are not in units of pixels, but are in some data units instead. It could also just be that the data points are simply not in range for some unforeseeable other reason.
It's not impossible to have the described result. Without the data or the code that defines the units of rx, ry, x, and y, answering the question is all just guesswork.