V.W.
Do the rest like your doctor says. My son had pneumonia in March (he is 11) and we kept him out of school for a complete week, then restricted him from exercise (karate class) for another week after that. He felt WAY better after 2 days at home... but it didn't take much for him to become winded. The thing was... HE wouldn't notice he was winded. I noticed it when he would sit down beside me and be breathing was faster/louder than he should have been for the activity level he was at.
Your body needs to recover. Take it EASY. For a MINIMUM of a solid week. Maybe do a little bit the 2nd week.. but still stay at less than your normal activity level-- no trying to catch up everything. It's not worth a relapse.