A Two-Tier Distributed Full-Text Indexing System

Authors

Wei-Zhe Zhang, School of Computer Science and Technology, Harbin Institute of Technology, Harbin150001, ChinaFollow
Hui-Xiang Chen
Hui He
Gui Chen

Author Country (or Countries)

China

Abstract

The performance of indexing systems is very important for a search engine. Usually, indexing systems on large-scale clusters can provide high search efficiency, but it brings expensive hardware costs. The costs would be greatly reduced if a distributed indexing system runs on small-scale clusters connected by the Internet. Two current inverted file partitioning schemes: document partitioning and term partitioning, have their merits individually. A two-tier distributed full-text indexing system is implemented, which uses document partitioning among the clusters and term partitioning inside each cluster. Our experiments show that the system performs well in search efficiency, resource consuming and load balance.

Suggested Reviewers

N/A

Digital Object Identifier (DOI)

http://dx.doi.org/10.18576/amis/080139

Recommended Citation

Zhang, Wei-Zhe; Chen, Hui-Xiang; He, Hui; and Chen, Gui (2014) "A Two-Tier Distributed Full-Text Indexing System," Applied Mathematics & Information Sciences: Vol. 08: Iss. 1, Article 39.
DOI: http://dx.doi.org/10.18576/amis/080139
Available at: https://digitalcommons.aaru.edu.jo/amis/vol08/iss1/39