In a small saucepan, combine cocoa and sugar.
Pour in about 1/4 cup of milk, stirring to form a smooth paste.
Gradually stir in remaining milk.
Heat over low heat but do not boil.
Remove from heat.
Beat until foamy.
Pour into 3 cups.
Top each with a marshmallow, if desired.