Okay you can take or toss my advice...he is just barely two, right (?), birthday in May.
My son was over 3 before the whole potty training thing really clicked for him. We had quite a few false starts and I had to stop trying because I was the one being trained not him. And I was sick of cleaning up the pee and poop.
My suggestion would be to stop the training for the moment and just get him back in a diaper, nip the control issue in the bud. Then try again in a month or so if he seems ready.
Duct tape will keep the diaper on if he keeps taking it off.
Like I said take it or leave it...but I personally could only handle so much of the clean up. HUGS!!