Elisa,
I hope you can still find this info useful. As a dentist I'll just say
it's not crazy!
When a baby is born with teeth they are called neonatal teeth and can be
supranumerary (part of a third set) or the deciduous teeth themselves.
The first thing that should be done
is check mobility. If they are very mobile, there* is* a danger of
aspiration, they should be taken out. This can be done very simply by a
Pedodontist holding on to them with  a gauze, while baby is held in
mothers arms. This usually is done without even local anesthesia. It is
only important to make sure this baby got his vitamin K after birth,
because it can bleed a little. The ped will try to take an X-ray first,
as this is the only way to determine if there are deciduous teeth buds
underneath and so the benefit/risk is worthwhile. When you have this
information you can decide to take them out or not. If they have to be
taken out and there are no deciduous buds, it's important the parents
know that the baby will be teethless in this small region untill the age
of  6-7 when the permanent teeth come in. If they are not mobile, and
don't interfere with bf I don't see a problem.
Gina wellner-Weissman, DMD  LLLL
Be'erotayim, Israel.