Imagine if someone called to be a pastor made a pact with God that he would never seek to lead a congregation but that if he were to be put in charge of one without having done any work towards that, he would gladly lead it.

Imagine if someone with a musical talent made a pact with God that he would never practice his instrument or put forth the effort to become a musician, but that if God wants him to be one, he would gladly accept such a position if God miraculously puts him in it.

Granted, you may not have a gift for mentoring boys or a calling in that area at all; I wouldn't know if you do. It may be that in your situation, your decision was wise. But with the little amount of information I have, it's difficult not to see your "pact" as little more than a demand that God hand you what you want on a silver platter or else you will bury your talents in the ground.