Combine all of the ingredients in a pot and bring to a slow boil, stirring occasionally. Do not boil too quickly or stir aggressively in order to keep the integrity of the huckleberries as much as possible (they burst easily). Turn the heat off.
Cool the huckleberry compote over an ice bath. Adjust the sweetness by adding more sugar if necessary.