I really think you should restart them, it is never a good idea to stop vitamins suddenly and especially not when swaying blue.
CD 23 is really not that late as O goes (I mean, that's hardly out of the norm!!!!) If you are 110% sure you're not pg and just want to get the show on the road, I would call my doctor and see if s/he can give you something to bring on AF and that will act like a reset button and things will start over again.