Ironically, it's not the radiation that makes uranium dangerous here. Uranium is a heavy metal, and toxic in its own right. Enough can transfer to the food to give heavy metal poisoning, akin to eating off of plates with lead paint.