To reproduce:
In a private group, select "All Messages" under Notification Settings->Email
Buggy Result:
You get an email with the subject "You have been mentioned by [user] in #[channel]"
Expected Result:
You get an email with the subject "New message by [user] in #[channel]" . Only send the You have been mentioned" subject when the user is actually mentioned.