Place the poppy seeds in a saucepan and add the milk and honey. Cook over low heat, stirring occasionally, until enough moisture has evaporated to thicken the mixture. Stir in the raisins and the lemon zest.
Remove from the heat and mix into the almond paste. Chill before using.