Just another site

Thought this was cool: Machine Learning that Matters

leave a comment »

A quick note today to plug my colleague and friend, Kiri Wagstaff’s, new ICML paper on Machine Learning that Matters.

It’s an excellent critique of the way that ML research is currently practiced and some things we can and should be doing to improve that.  Specifically, Kiri advocates that we focus more on problems that have impact outside the field of ML itself.  If the clever learning methods that we invent are not gaining penetration into “domain fields” and are not being used to solve real problems, do they really matter at all?

I’d like to write a long and glowing review of her paper, but I don’t have time right now.  But it’s an excellently written and very accessible paper — I encourage everybody to read it.  One bit that I would like to call out, though, is her set of proposed “Machine Learning Impact Challenges”:

  1. Discovery of a new physical law leading to a published, referred scientific article.
  2. Improvement of 500 USCF/FIDE chess rating points over a class B level start.
  3. Improvement in planning performance of 100 fold in two different domains.
  4. Investment earnings of $1M in one year.
  5. Outperforming a hand-built NLP system on a task such as translation.
  6. Outperforming all hand-built medical diagnosis systems with an ML solution that is deployed and regularly used at at least two institutions.
Many other challenges are possible, but these are an exciting starting point.  The important thing about them, in my mind, is the focus on impact on their respective fields, rather than on algorithmic/ML innovations (or academic publications).  ML innovations are important as well, of course (and I think that all of these require such innovations), but her call requires us ML researchers to put in the real effort to turn our ML innovations into real-world impact.
Kiri has also set up a discussion forum to promote discussion on these ideas and propose new challenges and good steps forward.  Please check it out and contribute to the discussion!

from Ars Experientia:


Written by cwyalpha

六月 15, 2012 在 3:41 下午

发表在 Uncategorized


Fill in your details below or click an icon to log in: 徽标

You are commenting using your account. Log Out /  更改 )

Google+ photo

You are commenting using your Google+ account. Log Out /  更改 )

Twitter picture

You are commenting using your Twitter account. Log Out /  更改 )

Facebook photo

You are commenting using your Facebook account. Log Out /  更改 )


Connecting to %s

%d 博主赞过: