Hotmail Improves Yet Again, This Time with Newsletter Filtering

Just days after I discussed my move from Gmail to Hotmail for all of my personal email, Microsoft revealed yet another improvement to its web-based email service. To be clear, Hotmail has been on a rapid update cycle of late, and if you are using this service, I suspect you've noticed the improvements over the past year especially.

This week's update concerns an improvement to Hotmail's SmartScreen feature, which is used to identify and separate junk email from legitimate email. But with this update, SmartScreen does even more: Now it also separates email newsletters from other email.

"The latest release of Hotmail uses SmartScreen to automatically identify more than a billion newsletters every day," Microsoft's Dick Craddock wrote in a blog post explaining the update. "Since newsletters account for more than a quarter of all the mail in a typical inbox, having them automatically categorized is a big time-saver."

The evolution of Hotmail generally and SmartScreen specifically has followed a similar evolution in the makeup of the email that goes through the system each day. As the post explains, in 2006, email could simply be broken down into two groups, spam and everything else. But email has evolved, and today Hotmail must contend with graymail--email that you may or may not want--as well as legitimate email, true spam, and more. 

Graymail is obviously tricky because it's a mix of wanted and unwanted email. Microsoft categorizes graymail into categories like newsletters and deals, social updates, person to person, groups and notifications, shopping, and the like. And the company previously added features to Hotmail specifically to help users manage graymail, such as Sweep, Scheduled Cleanup, special inbox views of the inbox, and so on.

With this update, however, Microsoft is addressing the biggest component of graymail: The company says that fully 50 percent of graymail comes in the form of email newsletters. (And graymail itself is 82 percent of all mail that comes in to Hotmail, which explains recent efforts in this area.)

"Every day the average person’s inbox is flooded with messages from thousands of different retailers, clubs, societies, and schools, or with coupons, deals, and notifications from deal aggregators talking about all the exciting things that people need to be buying, doing, or seeing," Craddock writes. "Newsletters can be extremely diverse. Anyone can send newsletters, and newsletters can include any format or content they like. Dealing with that diversity meant we needed to take a different approach."

That approach is a filter that uses machine learning to understand what is and is not a newsletter. It's been tested against a random sample of emails internally at Microsoft since September and given its 97 percent success rate is now ready for the public. You can also improve your own results by using Hotmail's categorization tool to mark email as a newsletter (or not), and since SmartScreen learns from users' habits, it will only get better over time.

I noticed today, for example, that my own WinInfo Daily News newsletter was correctly categorized as a newsletter by Hotmail:

newsletter_filtered


"With the newsletter filter now in the hands of all our customers, we will continue adding new categories and features that enable you to get the most out of them," Craddock concludes. "We're investigating ways to more effectively present and manage email-based receipts, bank statements, and more. We hope the newsletter filter can be a helpful tool in your own war on graymail. We love getting your feedback, so let us know how it’s working for you, and, as always, Thanks for using Hotmail."

Be sure to read the original post.

Discuss this Article 5

Bruno H
on Jan 13, 2012
Thats all fine. But when will Hotmail get activity logging like Gmail does? The other day my wifes hotmail account was hijacked and sent spam to all her friends. And there was nothing I could do about it more than get her to change password. That sucks Microsoft. I would really had liked to find out who accessed her account and at what time. This incident makes me thinking about jumping of Hotmail after more than 10 years using it.
Waethorn
on Jan 13, 2012
@Bruno H If it's not in her Sent Items, it was never hijacked in the first place. Script kiddies can Telnet into mail servers with a few commands and script spam to be sent out with random valid email addresses to contacts in their contact lists without even knowing what those email addresses are in the first place. It happens to every email server from time to time. Changing her password doesn't help because the attack likely never came from her email account either. If there is a possibility that it did originate from her account and the account password was changed by someone else to lock her out of it, it's likely because she used it to log in via a third-party sign-on service. Anybody that used eBuddy on their iPhone to access WL Messenger could've got stung by that because the company that makes eBuddy sells account credentials to spammers. Be aware of this the next time you give a third-party any account credentials.
cwmcgowen
on Jan 13, 2012
Now if I could tell Hotmail to use it's Rules to move all Newsletters to the Newsletters folder that would make this useful.
JimmyFal
on Jan 13, 2012
This incident you describe about your wifes hotmail account is VERY typical on yahoo, aol, and any account that has been in existence for a long time without a password change I'm guessing. Certainly not exclusive to Hotmail at all. I still am not able to correctly tell a customer exactly what has happened, when that happens. I mean if it was actually "hacked" would the hacker not change the password as well? I'm guessing you were able to change the password, so that suggests that it was a bot that hacked the password, or maybe just something that "masked". If Paul knows anything about exactly what happens when this happens, I would love to see an article on that. Paul how about an interview with an actual hacker while your at it, and ask them what there f-ing problem is when the interview is done. I have been trying to find out exactly how this "hacking" occurs, but NO ONE can give me a straight answer on that.
Waethorn
on Jan 13, 2012
@CWM: Huh? I used to do that years ago on Hotmail. It's too bad that you don't get access to the Exchange ActiveSync properties for filtering though.

Please or Register to post comments.

IT/Dev Connections

Las Vegas
September 30th - October 4th

Paul ThurottYou'll have the opportunity to experience:
• 120 Technical
Sessions
• Networking with Peers
• Expert Speakers


Come See Paul Thurrott & Mary Jo Foley in Person!

Register Now

Office 365 InfoCenter

Get the latest insight and info from Paul

Read Now!

What I Use