Don't worry that is. Both of my children had their bottles until 3 to 3 1/2. One is 22 and beautiful with perfect mouth and teeth. The other is nine and most of baby teeth gone and perfect mouth and teeth. So it's fine it's his bottle and he'll get rid of it when he's ready.
Hope this helps,