Definitely not meant as a dig.
Imagine being held accountable for one’s time, as you’d be to an employer but self-managed in the day to day. If I have an appointment with a client but don’t put it on my calendar, when my boss or my assistant try to verify how many meetings I took, it won’t matter if I made the deal happen with that client: they want a paper trail.
I am implying the same logic works—if it was casual and not in the record of transactions, there is no way for the assistant or boss to know, NOR could you accurately recall taking a particular meeting two months ago, when you have three meetings per day in a different city each week.