Put the butter, brown sugar, and granulated sugar in a large bowl. Using a handheld mixer, beat together until creamy. Beat in the molasses, grated ginger, egg, egg yolk, brandy, and orange zest until well combined.
Sift together the flour, baking powder, ground ginger, cinnamon, and black pepper. Slowly add the dry ingredients to the butter mixture, stirring just enough to incorporate. Fold in the candied ginger and chill the mixture until firm.
Put the dough on a floured surface and knead into a long log approximately
Heat the oven to 375°F. With a sharp thin-bladed knife, cut the dough into