The particles in a solid are held in place by bonds between atoms. These bonds are forces that keep them together. No one knows for sure why bonds do what they do, but it has to do with lowering the overall energy of the solid. However, even in a solid the atoms are actually moving a lot, but it is too small for you to notice with your eyes. They vibrate like springs and in some case are also rotating on their axis.
