Breasts Need to Dry Up

This is similar to what I did but instead of the tight bra I wrapped my breast tight with gauze bandages. It only took a few days for the supply to dry up. I did use cabbage leaves under the bandages also.
I found this on the internet at eHow.com:

Step 1 Choose your bra carefully! A tight fitting bra will not only help deplete your milk supply, but, more importantly, it will keep you from getting an infection in your milk ducts. No infection, less pain!

•Step 2 Cabbage- that's right, CABBAGE! Cabbage is perfectly shaped to fit into your bra. Cut it to size and slip it into your tightly fitting bra. Not only will the cool cabbage against your breast provide instant relief to sore nipples, but it will dry up your milk quickly. When the leaves have wilted it's time for a fresh new leaf. If you are in need of more of a drying effect for the milk that squeezes out and into your bra, try crushing the leaves just a bit before placing them into your bra.

•Step 3 Don't Touch! No stimulation is the key to keeping your milk from replenishing. Aside from manually expelling your milk if your engorged, you shouldn't have much interaction with your breasts. When your resting try not to let your breast be brushed very much by the mattress, pillows, or blankets. When showering don't let the flow of water hit them directly. Even ask your husband not to get too close until you've gotten rid of all of your milk.

The problem with that is, the more you use em the more the produce.
If you are really uncomfortable you can pump & dump.
Now you will still produce milk for a little while even while pumping, but since it's not the "real thing" your production should slow.

Otherwise just wait it out? I know sucky options :)

I did the cabbage leave thing too and I also would just pump for a minute or two to relieve the engorgement, but not enough to empty the breast.

I know that people recommend Benedryl or other drying drugs, but for me, it was just time. It took about 2-3 weeks.

Did you just stop cold turkey? If so, I'd suggest you continue pumping and each week drop a feeding/session so that your breasts can slowly and comfortably adjust their supply down. I did this with my first, and it worked great for me. Hope that helps!

Tha cabbage leaf thing is AMAZING!!!