Rinse the capers and anchovy fillets under cold running water. Drain and coarsely chop.
In a small bowl, combine the chopped capers and anchovies with the scallions, parsley, chives, tarragon or chervil, and lemon zest. Stir in the olive oil, lemon juice, and vinegar. Season with salt and pepper to taste and let stand at room temperature.