Many men often feel at a loss or insecure about what to say, when their wife comes to them with these kinds of concerns/problems/complaints.
his responding with saying you "don't have any faith in him" or that he is "doing the best he can", is the clue. Granted, he works very long hours and he comes home to be a great father and has done as much as he can to help you get the sleep and care you have needed with this pregnancy. BUT you both have never been on a "date" in awhile.
To each person, "love" & expectations is shown in different ways. To him probably, he IS doing a good job of being a Husband and partner. He does after all, seem to be doing his share of being a member of the family, a Dad, and a Husband in "caring" for you and the kids. Lots of men do "not" do this and are not so attentive. So that is commendable of your Husband. Give him praise for that... Men, need that. They need feedback too, on what makes us "happy."
But you feel upset about him not going out with you on dates. That is also understandable and natural to feel. I think basically, the 2 of you need time away...just to be by yourselves... so get a babysitter, plan it, put it in your calendar schedule every month even, and have a date. YOU can plan it too... since your Hubby seems not very adept at it. And that's fine.
Lots of times I find, that couples have differences in their "ideals" of what "love" is, and what "they" need to feel special and noticed. So, just allow for these differences, while at the same time being a "team" about it... and accepting the advances and gestures that your spouse DOES do... otherwise, if a spouse feels that they are not noticed for their good "deeds" then they won't do them anymore or will just feel under appreciated. You don't want that to creep into a marriage. So just appreciate what he DOES do...then simply add to it in a positive way... and you may very well have to be the one that plans your "date" nights. It's okay. Some men work and toil so much that they literally cannot think or come up with ideas because they are so busy in their heads with being the bread-winner. It's okay.
So YOU just make the "date" plans, and then get the babysitter, and then you both go and have fun. BUT keep in mind that having a "date" when there wasn't many before, can take "practice" and you will both probably have to get to know each other again, without the kids, and ease into it. Do NOT expect to be swept off your feet right away... just savor any moment you can on your dates... and just enjoy being in the moment. I find, that if you expect a miraculous dream of a "date" right away... you may be in for a let down... because Hubby has to transition too, to another role of being the focus of attention too, and of needing to just "be" the two of you.
Good luck, no fret, and it will be okay. Just allow for it to be and create a date to happen.
All the best,