"Required" attendee when creating an Appointment from an Opportunity

When you create an appointment directly from within an Opportunity it defaults the required attendee to the Account associated with the Opportunity. How can we disable this "feature" as oftentimes the appointment is for the Sales Rep's sake and we do not need to or want to be emailing the Account that is associated.