Goat's milk is no more appropriate to give a human infant than is cow's milk.
The formulas are at least an attempt to provide a more nutritionally complete
product.  Soy formula is not better than cow milk based formula--it has a high
aluminum content and loads of estrogenic substances not found in human milk,
plus is missing some micronutrients that have now been added to cow milk based
formula.  Soy is just as allergenic as cow milk, too.  The mom should use her
stored breastmilk; then if the infant is over 6 months of age, supplementary
foods can be given (after six months supplementing with small amounts of cow,
goat, or soy milk is also less of a problem, by the way, providing the baby is
still nursing for most of his/her milk intake).  Before six months, I would
recommend either milk banked human milk or formula as a supplement.
Linda L. Shaw MD FAAP