bahaha it was fun appart from the camera thread breaking so often

Camera thread only breaks when objects are moved.
When we were up near 1,000,000, the issue is that in floating point, 1000000 + 0.001 = 1000000. Well, that's the idea anyway.
If you were seeing a real camera thread crash and no objects were being moved nearby then I'd be interested to see those logs.