Okay, so I am not sure what point I updated from, but I grabbed the newest nightly tried to recompile my code to find
callback.getRayFromWorld().setValue(rayFrom.x, rayFrom.y, rayFrom.z);
callback.getRayToWorld().setValue(rayTo.x, rayTo.y, rayTo.z);
was broken, so I tried
callback.getRayFromWorld(rayFrom);
callback.getRayToWorld(rayTo);
to no avail. checking the libgdx github I couldn't understand what had changed. Any ideas?