This wouldn't be a genetic argument then.
Testosterone in your body fluctuates throughout the course of a single day, based on what happens to you in that day.
So at a societal level, we'd expect some general zeitgeist based average to fall out of other factors, potentially.