Passing through the digestive tract of a mobile animal is a good way for plants to disperse seeds and reproduce. It makes sense that some plants would be naturally repulsive to some animals and attractive to others.

Also the plants and the animals evolved together. If you're the only animal in the desert that can chomp on a cactus, you're going to survive and pass on your genes.