Defences to crime.

The law recognizes certain defences to crime. In those cases, even when an individual has committed the guilty act (actus reus) of an offense, they are not guilty of the crime charged. Why shouldn't those who commit the guilty act always be held accountable for their actions?