How clips validation works?

We use a 2 out of 3 rule. Is two people say it’s good/bad, we go with that. This comes from some crowdsourcing research we did. For some reading on this see the following:

http://www.aclweb.org/anthology/W10-0706

http://e2953b6e947ea30a22403bfd.dnwkqcxbcr.maxcdn-edge.com/wp-content/uploads/2012/02/CeDER-10-01.pdf?x45159