Measuring the Effectiveness of Public Search Engines on Thai Queries

S. Tongchim, V. Sornlertlamvanich, and H. Isahara (Thailand)

Keywords

Web search engine, Blind evaluation, Thai queries

Abstract

This paper compares the retrieval performance of seven public search engines on Thai queries by using a blind eval uation. Two of the engines used in this study are Thai focused search services, while the remaining engines are large, commercial search engines that have wider collec tions of web data and support several languages. The re sults are compared by Mean average precision (MAP) and Mean reciprocal rank of the first correct answer (MRR). These results are calculated from binary relevance judg ments of the first 20 returned results, using 56 topics. Sta tistical testing shows that there are significant differences among engines.

Important Links:



Go Back