CRM contacts appearing in my outlook address book

We use CRM for Outlook in order to work offline.

I was sending a mail in my outlook today and I have noticed that all the CRM contacts are appearing in my Outlook address book?

How can I prevent this from happening??

Thanks in advance