Caterpillars can usually be handpicked. They are repelled by wormwood spray or insect spray. Rust appears as bright orange markings on the foliage of herbs such as mint and chives. Destroy all affected foliage. Do not place diseased plants or foliage in the compost bin. If a mild commercial copper spray does not curb the disease, destroy the plants.