Does "insanity" really constitute exemption from the law?

People who commit crimes and say they were "temporarily insane" or whatever, should they really be exempt from the full extent of the law? They still commited a crime.