Hi! Just wanted to encourage you and to say that you still have a lot of things to try (higher dose, injectibles, IUI) before needing IVF, so at this point I don't think you need to be worried about IVF. But I'm glad you have an appointment for an RE.
Gynecologists are useful if all you need is a prescription of Clomid/Femara and then you get pregnant. But for anything more complicated than that you should go to an RE.

