Wash and remove blossom ends of crab apples; do not remove stems. Prick each apple in several places.
Bring vinegar, water and sugar to a boil. Add spices tied in bag.
Cook half of the crab apples in the syrup for 2 minutes; remove. Repeat until all the crab apples are cooked. Pour syrup with spice bag over apples; let stand overnight.