Hi..
As I understood " Just emails received from my contact not as a response to a CRM email are not tracked."
I believe you need to look into your personal options ... File >> Options >> Email Tab
Check the track settings for the incoming email.
thanks a lot.