Chinese Word Segmentation Algorithm Base on Hybrid Statistical and Dictionary Methods

• Main Authors: Yu Tang Chang, 張郁堂
• Other Authors: H. T. Chang
• Format: Others
• Published: 2015
• Online Access: http://ndltd.ncl.edu.tw/handle/27751759058705696752

碩士 === 長庚大學 === 資訊工程學系 === 103 === Due to the rapid development of China, Chinese Internet daily amount of information and increase with age, the search engine has become a very important part of the for Access to knowledge, people want to find information through search engines, especially now that most people start use the Internet network to watch the news and get entertainment news, just to get relevant information in the search field, enter the string you want to query in search engines, in fact, these strings must through the word segmentation processing, cut the entered strings according to semantic reasonable combination, can easily get the information they want from the search engines. Currently English word segmentation technology has well-developed, however, the English differ very much on the writing and usage, resulting in complex grammatical structure of Chinese, there are ambiguous words and unknown words, leading to difficult to complete an Chinese word segmentation algorithms. We use dynamic programming algorithm as the core design a statistical method with lexicon to improve accuracy, finally, we got efficient and accurate of word segmentation.