Men have darker skin because of higher levels of hemoglobin (partly due to not bleeding every month). Maybe that makes the skin in the face more ruddy, decreasing contrast with the lips and eyes.