Yep--that pretty much describes most kids in their first year of tball, I remember when my son (and his team) was 4, they'd be in the outfield swatting bugs, sitting in the grass, digging in the dirt behind the backstop--LOL I think it's adorable. They're too young to be expected to pay total attention to the whole game at that age and he's doing good if he's running to first base after a hit and retrieving the ball if he's in the field. If he likes it, let him keep going. I'd let the manager and the coach deal with him while he's playing. Just sit on the bleachers and watch.
My son is now 7 and is chomping for his first baseball practice tomorrow night. You'll be amazed at the difference between this year and next year!