Agreed. Interestingly enough it's an essential point because the temptation is to carry guilt as a way of walling ourselves up against the acceptance of the loving mercy of God. Perhaps because we prefer to carry our own burdens but also because we find it so hard to understand that we are loved enough to be forgiven.
Psychoanalysts like to talk about this a lot.
This reminds me of those parables of Jesus in which he bangs on again and again about the other-than-human nature of God's love: the lost sheep, the lost penny, and, of course, the prodigal son.
What shepherd in his right mind would leave 99 sheep alone and go in search of 1 lost one? What person in their right mind would throw a party because they found a penny? You see what I mean . . . .