You leave the visit with the knowledge that your time was spent wisely. When we have had the kids along on these visits, they express appreciation for the visit, even though it was an "adult talk" time. Everyone knows that they would like to do it again sometime soon.
This is the way the Lord Jesus Christ expresses Himself to us: Through others who have been gifted by Him to help reveal Himself to us and point us to Himself with words of grace, truth and peace.
If you met with someone, it was entirely good, you feel like you have been in the Lord's presence and heard things that you know are from HIM, that would be the mark of a true pastor.