Don't let them fall on to hard surfaces (like concrete) from a height – they may shatter into sharp pieces ... to the moving magnetic field of the falling neodymium magnet.
Note that this magnetic field opposes the original change. For example, if a magnet is moved into a coil of wire, the induced magnetic field tends to repel the magnet back out of the coil.