I have read the other responses and the advice I have to add is to theirs is to, look up the benefits of children having siblings and add that to your position of having another child, and look into the underlying issues behind his statement. A counselor may well be a good idea!
If the benefits of having siblings does not convince him and he is dead set against another child and you are set on having another child, it leaves you in an uncomfortable position with some uncomfortable and painful choices to make. You are correct it is your body and your choice if you wish to have a child despite the dangers. However you also do not have the right to force him to have a child of his body without his consent.
It also seems that he has other issues, judging by his response. I am assuming that you did not leave out a "Not" in the sentence:
"whatever we will but not for a while since you are going to get pregnant with our without my consent....or with or without me."
which with the "not" would read:
"whatever we will but not for a while since you are NOT going to get pregnant with our without my consent....or with or without me."
Those are two very different statements.
Assuming you did not leave out the "Not" it does sound like he is attacking you verbally. Stating w/out saying that you will get pregnant w/ or w/out him and/or his consent, could very well imply a trust issue between you two. Ask him what he meant by that statement and see what his underlying issue is regarding your desire to have another baby, if one exists.
If the "not" was supposed to be in there then address that statement. I recall you saying that he is more of an "arguer", I cannot tell by your comment if that means logical, rational debates, or screaming matches. Your response will vary depending on the answer, but I suggest that if he is the second, that you look up communication styles and ways to kindly suggest to him that talking things out is far more productive and enjoyable than screaming matches :)