In a large bowl, whisk the sugar and egg yolks until thick and very pale in colour.
Add the bourbon and brandy in small amounts, beating between additions (if added too quickly, the alcohol will thin the yolk mixture and it will separate). Cover with plastic wrap and chill for 20 minutes.
Just before serving, stir in the milk and nutmeg. In a clean, d