M.M.
I can only tell you my experience: I quit a full-time job that I loved to be with my children when they were born. I eventually went back to the same job part-time and had the best of both worlds.
Money was tight and my husband kept telling me to get a "better paying" secretarial job (which is what I was originally trained in) but I had done that and there is NO WAY I could be happy doing that.
I told my husband I'd rather make less and enjoy what I'm doing than be unhappy making more money in a job I didn't like. MONEY ISN'T EVERYTHING...and there are ways to increase income without sacrificing yourself or your family!
I eventually went back full-time to the job that I had loved but I have changed so much over the 8+ years I stayed home with my girls and now I find myself unhappy again because I can't be with them more. I'm thinking of going back part-time.
It sounds like you are feeling negative emotion because you are fighting against something that you want. It's not a matter of what you think you SHOULD do but what you WANT to do. What would make you happy? Money doesn't make you a better parent.
Allow yourself to have what you want and don't let others make your decisions. Find ways to cut back spending at home if that is what you have to do. Find a way to make a little extra online or at home (be careful of scams) - I make goat milk soap and sell mineral makeup.
The money will be there when you need it. :)