Family dental experts warn against leaving a bottle in a baby's mouth after they've gone to sleep. During sleeping, saliva production decreases, allowing bacterial growth to advance. If there's even a tiny bit of milk or juice left dribbling into baby's mouth, it could lead to rapid tooth decay.