Why did the Spaniards pass their diseases on to the Incas and not the other way around?

The Inca did not have the same history of contact with farm animals. They has llamas, but llamas aren't the same as cows and sheep. Llamas are not milked, kept in herds, or housed.