I think that the un-acted-on attraction needs to be explicitly let off the hook as a potential sin, since believing that one's nature is especially sinful (more sinful than the natures of other people) results in self-hatred.