I currently just keep notes of any encounters I have with contacts in the Notes section of my contacts (managed/exploited by Google), in the format year-month-day: description. Works fine for now, but I wonder if I'll need to create a proper relational database for this in the future…