When you think about the life you want to give your future kids I'm sure it includes a great father. One who knows how to love, who knows patience, who is giving, sacrificial, protective, kind and good in his heart, who can communicate. A good man is worth the wait. Less for you and more for your babies. A distant Dad, a mean Dad, an abusive Dad, a passive Dad, those are impossible things for a baby to process. You can. You can tell yourself it’s not your fault, you can handle it. The baby can’t. The baby will grow up and still be trying to figure it out. The baby will get older and run into the arms of someone just like Dad. You owe it to your babies unborn to let go of the bad ones even if you're afraid the good one won’t come. You may even have to let go of a good one because you know they aren’t the one. Tell God what you want and then listen to him when you sense the noes and the yeses. They feel like anxiety (no) and peace (yes). It is simple but not always easy. Remember that.
In the meantime try not to worry about it. God made you. He really did. And if you follow Him He will always lead you to good things. Always.