A person will be called to account on Judgement Day for every permissible thing he might have enjoyed but did not.
The Talmud