There are a few CRMs that do what you describe. Streak (I'm the founder) connects to Gmail's APIs to automatically index the conversation history of contacts you've added. We go one step further and also show you the conversation history between your contacts and anyone on your team, not just you.