In sinning, each man sins against all, and each man is at least partly guilt for another's sin. There is no isolated sin.
The man who has a conscience suffers whilst acknowledging his sin. That is his punishment.