1) Mix together coffee, milk, sugar, and vanilla and stir until sugar dissolves.
2) Refrigerate to chill until ready to serve.
3) Stir in whipping cream and rum to coffee mixture immediately before serving.
4) Take a punch bowl and scoop ice cream into it and pour the coffee mixture slowly over ice cream.
5) If wished, top with marshmallows.