To make the pastry cream, add the sugar and half of the milk to a pot. Then, bring it to a simmer over medium-high heat. In a separate small bowl, place corn starch, egg yolks, vanilla extract, heavy whipping cream, and the rest of the milk. Mix it very well. Then, pour the egg mixture into a medium saucepan and cook it over medium heat.