SIGIR'98 demonstrations: Fast Speculative Search Engine on the Highly Parallel Computer EM-X

Fast Speculative Search Engine on the Highly Parallel Computer EM-X


Hayato Yamana
Computer Science Div., Electrotechnical Laboratory, Tsukuba, Ibaraki, 305-8568, Japan.

Hanpei Koike
Computer Science Div., Electrotechnical Laboratory, Tsukuba, Ibaraki, 305-8568, Japan.

Yuetsu Kodama
Computer Science Div., Electrotechnical Laboratory, Tsukuba, Ibaraki, 305-8568, Japan.

Hirofumi Sakane
Computer Science Div., Electrotechnical Laboratory, Tsukuba, Ibaraki, 305-8568, Japan.

Yoshinori Yamaguchi
Computer Science Div., Electrotechnical Laboratory, Tsukuba, Ibaraki, 305-8568, Japan.


Abstract

This demonstration presents the new World Wide Web search engine called "Fast Speculative Search Engine" that uses speculative execution on multiprocessor systems to shorten the total time to retrieve information from the WWW.

The proposed search engine predicts users' next queries and initiates the searches with the predicted queries before receiving them to accelerate narrowing the search space.

We have implemented the fast speculative search engine using the data speculation on the EM-X which consists of 80 processors. On the EM-X, idling processors are used to predict the next queries and no predictions are made when all processors are busy. Thus, we can provide minimum search service at busy time when there are many search requests, and provide maximum search service at free time when there are small number of search requests. We call such controlling scheme as Unlimited Speculative Execution.

The experimental results, using the data set of WWW pages in our organization, show that the 42% of users' queries hit on the speculative searched results.


SIGIR'98
24-28 August 1998
Melbourne, Australia.
sigir98@cs.mu.oz.au.