In a small saucepan, boil the sugar and water over medium-high heat for 5 minutes. Add the pepper flakes and lemon juice. Let cool a bit.
Cut off all the white pith from the oranges and grapefruit with a small knife. Then remove the segments by cutting between the membranes. Place the segments in a large bowl and add all the remaining ingredients except the syrup. To