Poisonous flowers

I would like to know if Peony flowers are poisonous. Would it be just the stem or the flowers? Could a peony go on a cake?…