Doing some more work on the goggles.
I'm now aiming to swing the upper part of the frame aroun a centimeter over the lower part, above the nose. This may look funny. The goal here is to apply pressure back against that more protected part of the face, instead of against the sensitive part of the face right above the nose. The latter location, where most glasses rest, applies pressure on the sinuses, making for nasal discomfort.
