Combine the lemon juice, lime juice, lemon zest, and lime zest. Stir into the yogurt. Add enough of the simple syrup to bring the mixture to between 16° and 20° Baumé.
Process in a ice cream freezer according to the manufacturer’s directions. Transfer to a chilled bowl and store, covered, in the freezer.