Exactly. It's that old inertia law of Newton's, the same law that makes gyroscopes and children's tops so fascinating.
All motion is relative though - that's why a machine gun firing from the left side of a helicopter has different ballistic characteristics than one firing from the right, which I guess is about as far away from the original topic as I'm willing to take THIS one.