I think the HE diet works pretty quick so I don't think it's in any way necessary to start the diet as far out as the girl swayers do.
It can take fully fertile couples doing nothing to sway 3-6 months to get pregnant under ideal circumstances. I believe blue swayers should get pg more quickly than pink, but it may still take a few months. :)