The answer is: it is NOT possible with an 1:N realtion between a custom and a system entity (without programming). I removed the 1:N and replaced it with an N:N (which works for me as well) and not the refernces can be removed with ribbon functionality.
Thanks for your efforts.