Thursday 9 July 2009

Human computation

Manual data annotation methods need much efforts in terms of time-consuming, labor-intensive and error-prone process. Recently, human computation has emerged as a viable synergy for data annotation of which idea is to harness what humans are good at but machines are poor at. Currently, many tasks are trivial for humans but continue to challenge even the most sophisticated computer programs. Thus, the intelligent combination between computers and humans in terms of human computation to solve complex tasks is becoming a promising approach. Two typical frameworks representing human computation for data annotation are Games With A Purpose (GWAP) and Amazon Mechanical Turk (AMT).

During my earlier research at SoC@NUS, I had a chance to undertake an analysis survey on human computation. I will post it on here as soon as possible for your quick reference.

I think that human computation can become a primary research tool for quickly creating evaluation data in the future.

--
Cheers,
Vu

No comments:

Post a Comment