Exactly, that's just what I think. Either the X vs. Y are coming out with some advantage healthwise, or they are "talking" to each other somehow and some are staying dormant while the others go onto fertilize the egg.

We do have undeniable evidence that men in several different jobs that are bad for sperm all have more daughters, so we know something has to be happening.