Drain juice from peaches, reserving fruit and 1 cup of juice.
In a saucepan, combine vinegar, sugar, cinnamon, cloves and 1 cup juice reserved from peaches.
Place pan over medium-high heat and bring to a boil.
Boil until liquid is reduced by about half.
Remove spices from mixture; reserving cloves.
Set liquid aside.
Stick cloves into peach halves and pour prepared liquid over peaches.
Cover and refrigerate overnight.