My dad is a retired construction Superintendent who's worked in TX, NJ, and VA. I asked him, he says, no, you can't move in. The issuing of the permit shows that the county agrees that the house is safe to be occupied. Also, many times you can't close on the loan until the title company has the permit.
If you are worried, you can call the county division for building permits and find out their point of view.