Outlook client tracking

I have Configured my outlook client to track all emails from Accounts , contacts and leads . When I receive an email from  let's say a contact who is in Crm the email does not automatically track unless I manually track the email. Do you have to manually track the first email from a contact before it starts automatically tracking with the outlook client? Thanks in advance