The outer skin of the orange and lemon. With a potato peeler, or very sharp knife, remove only the colored layer from the fruit, leaving the white layer attached to the fruit. This layer of colored skin should be as thin as paper and with no white. When grating zest directly from the fruit be very careful not to grate too deeply into the fruit.