I've done that a lot myself. It's natural for people to spend time with people, and kids are just little people. There's nothing wrong with spending time with them. In the past I've invited some of my closer non-BL adult friends to go the park with my YFs and I, play baseball, etc. It's natural, normal, and quite appropriate I think.