Combine coffee, milk, sugar, and vanilla in a large bowl; stir until sugar dissolves. Chill thoroughly.
Pour chilled coffee mixture and Kahlua into a punch bowl, stirring gently. Scoop ice creams into punch bowl. Garnish with shaved semisweet chocolate, if desired.