While it may be tempting to feed your new calf all your extra goat milk ... calves will start on a bottle pretty easily. Gently open their mouth with your hand and guide the nipple in.