Hi xris667,
Are there any workflows created for the contact entity? If Yes, then check at what conditions are they getting triggered.
If no, then you could add this condition in your 'on create' workflow for the contact entity... "Last Mofidied by IS NOT EQUAL TO" system admin. [Try this and test it for a record and see if the notification is sent or not]