Stir sweetened condensed milk, coconut, powdered sugar, and vanilla together in a large bowl. Mixture will be thick and sticky.

Turn Madeleines upside down so that they lay somewhat steady. Scoop 2 tablespoons of the coconut mixture onto each madeleine. Add an almond to the top of each. Chill for 30 minutes.

Melt your chocolate (work with one bag at a time and melt more as you need it). Place the coconut covered madeleines on a wax paper lined cookie sheet. Scoop a spoonful of chocolate onto the top of the madeleine, covering as much of it as possible. If needed, help the chocolate to spread with an offset spatula.

Chill until hardened (about 1 hour, depending on the heat in your house.)