Combine milk with pumpkin puree, pumpkin spice, powdered sugar, and cocoa powder in a medium sauce pot and whisk together until combined. Heat over medium heat until the sugar has dissolved and the milk is warm.
Remove from heat and portion into two cups. Top with whipped cream, mini marshmallows, and a sprinkle of cinnamon. Serve immediately.