To make the Filling, mix the egg yolks and condensed milk in a double boiler. Simmer, stirring constantly until the mixture starts to thicken, about 20 minutes. Add the butter and sugar and continue stirring for 5 more minutes.
Fold the lime or lemon zest into the mixture. Continue stirring over simmering water until the mixture turns light orange and thickens,