The Design and Implementation of a Distributed Data Gathering System

• Main Authors: Tyng-Jaw Sheu, 許廷兆
• Other Authors: Sun Wu
• Format: Others
• Language: en_US
• Published: 2000
• Online Access: http://ndltd.ncl.edu.tw/handle/47375100033048586332

碩士 === 國立中正大學 === 資訊工程研究所 === 88 === In recent years, the Internet user becomes more and more especially in using World-Wide Web. Because the exploding growth of information amount on WWW, search engines become one of the most important tools. Data Gathering System plays an important role in general search engines. It can affect the efficiency and the correctness in search engine. With the rapid growth of data, traditional data gathering system has many problems, for example, the huge data causing the wasting of the network bandwidth and retrieval time. HTTP Server will get high load while retriever gets documents in it, etc. This thesis provides a new approach to solve problems that we mentioned above. This approach uses distributed system and some techniques such as Persistent Connection to save bandwidth and improve the efficiency of data gathering.