I suggest being a little more paranoid. Unless he has outlined his confidentiality policies to you in no uncertain terms, you don't know what this person is going to do with this information.

Make sure your computers and bookshelves could pass a police inspection if need be.

This person thinks you have chosen a lifestyle of illegal attraction. That's very different from someone who thinks you are stuck with it as a fluke of biology. The person may put 2 + 2 together out of their own logic and imagine you have confessed to criminal intentionality.

Sorry to feel obliged to say this unpleasant thing to you. May the Lord, your shepherd, protect you.