I have a name picked for both sexes. Dh says he is not sure about either name and I say I am dead set on them. I don't worry too much since he said the same about our first two kids' names which I picked early on in the pregnancy as well!
Maybe you could just start calling him by that name and DH will come to love it by force, haha!