Combine the lemon zest, orange zest, lemon juice, and orange juice. Set aside.
Mix the cornstarch into the sugar. Beat the eggs and the sugar mixture for a few seconds, just to combine, in a heavy saucepan made of stainless steel or another noncorrosive material; do not use aluminum. Add the juice and zest mixture, then the butter and heavy cream.