Abstract

In this article, the impact of the number of query words on information retrieval effectiveness of image search engines was investigated. First of all, three popular search engines, namely, Google, Yahoo and MSN, were selected. Then, 40 queries were extracted from the list of Wordtracker and categorized in four groups as one-, two-, three- and four-word queries. After every query was run on the selected image search engines and binary human relevance judgments were done, the performance evaluation of image search engines was carried out on two cut-off points (first 10 and first 20 retrievals) in terms of precision and normalized recall. In general, the information retrieval effectiveness of image search engines decreases as the number of query words increases. Retrieval performance of image search engines needs to be improved.

Keywords: Image search engines, Number of query words, Performance evaluation, Precision, Normalized ranking

References

  1. Bitirim, Y., Tonta, Y. ve Sever, H. (2002). Information retrieval effectiveness of Turkish search engines. T. Yakhno (Ed.), Advances in Information Systems: Second International Conference, ADVIS 2002, İzmir, Turkey, October 23-25, 2002, Proceedings içinde (s. 93-103). Berlin: Springer-Verlag.
  2. Brilakis, I., ve Soibelman, L. (2005). Content-based search engines for construction image databases. Automation in Construction, 14, 537-550.
  3. Fukumoto, T. (2006). An analysis of image retrieval behavior for metadata type image database. Information Processing & Management, 42, 723-728.
  4. Jansen, B.J. ve Spink, A. (2003). An analysis of web information retrieved and viewed. H.R. Arabnia ve Y. Mun (Ed.), Proceedings of the International Conference on Internet Computing, IC ’03, Las Vegas, Nevada, June 23-26, 2003 (2 vols.) içinde (s. 65-69). Las Vegas: CSREA. 21 Temmuz 2007 tarihinde http://www.viktoria.se/~dixi/BISON/resources/jansen spink-2003.pdf adresinden erişildi.
  5. Kuwabara, A. ve Tanaka, K. (2005). RelaxImage: A cross-media meta search engine for searching images from web based on query relaxation. Proceedings of the 21st International Conference on Data Engineering, ICDE 2005, April 5-8, 2005, Tokyo, Japan içinde (s. 1102-1103). Tokyo: IEEE Computer Society.
  6. Stevenson, K. ve Leung, C. (2005). Comparative evaluation of web image search engines for multimedia applications. H.Ip.A. Smeaton, J. Smith ve A.W.M. Smeulders (Ed.), Proceedings of the International Conference on Multimedia and Expo, July 6-8, 2005, Amsterdam, The Netherlands içinde (s. 4). Amsterdam: IEEE Press.
  7. Van Rijsbergen, C.J. (1979). Information retrieval (2nd ed.). London: Butterworths.
  8. Vaughan, L. (2004). New measurements for search engine evaluation proposed and tested. Information Processing & Management, 40, 677–691.
  9. Yao, Y.Y. (1995). Measuring retrieval effectiveness based on user preference of documents. Journal of the American Society for Information Science, 46, 133-145.
  10. Zhang, J. ve Mostafa, J. (2002). Examining the relationships among user involvement, profile quality, and information filtering performance. Proceedings of the American Society for Information Science and Technology Annual Meeting, 39, 298-306.

License

Copyright (c) 2008 The author(s). This is an open access article distributed under the Creative Commons Attribution License (CC BY), which permits unrestricted use, distribution, and reproduction in any medium or format, provided the original work is properly cited.

How to Cite

Emirzade, E., & Bitirim, Y. (2008). Performance Evaluation of Image Search Engines Based on the Number of Query Words. Information World, 9(1), 126-139. https://doi.org/10.15612/BD.2008.330