Something my grandmother (who had 7 children) told me when my oldest daughter was born, was that dads may have a completely different way of dealing with babies and children, but it is critical that they are allowed to parent their children in their own way. She told me that when my husband was holding our baby and I saw him doing something that I wouldn't do, to just SHUT MY MOUTH and go do something else. This was some of the best advice I ever got! Because it's true, he would hold her in a different way than I would, and my first instinct would be to tell him, "Don't do it that way, do it this way!" - but I didn't. I just let him figure it out. He was the one who figured out that during her fussy time of night, the best way to quiet her down was to hold her face down over his arm. I'd never have figured that out!
So my point is, back off (as hard as that is) and let your husband be a dad. It's ok if the baby cries; dad is a new person to your son because you're the one who is with the baby all day long. With time your husband will bond with the baby and they will develop their own special relationship. You just have to let them. Once your baby realizes that sometimes dad is going to hold him and that's perfectly ok, he'll relax and learn to enjoy his time with dad so you can have some time to yourself. It's critical that you have a little time off every day, too.
Good luck and enjoy your little one!