Rinse a medium saucepan and leave it wet. Add the milk, vanilla seeds, and ginger. Turn the heat to medium-high and bring just to a boil, stirring. Cover and let sit for about 10 minutes.
Beat the yolks and sugar together until thick and slightly lightened in color. Strain the milk, then stir about ½