Deep Web Search Interface Identification: A Semi-Supervised Ensemble Approach

• Main Authors: Hong Wang, Qingsong Xu, Lifeng Zhou
• Format: Article
• Language: English
• Published: MDPI AG 2014-12-01
• Series: Information
• Subjects: semi-supervised learning; Deep Web mining; search interface identification; ensemble learning
• Online Access: http://www.mdpi.com/2078-2489/5/4/634

To surface the Deep Web, one crucial task is to predict whether a given web page has a search interface (searchable HyperText Markup Language (HTML) form) or not. Previous studies have focused on supervised classification with labeled examples. However, labeled data are scarce, hard to get and requires tediousmanual work, while unlabeled HTML forms are abundant and easy to obtain. In this research, we consider the plausibility of using both labeled and unlabeled data to train better models to identify search interfaces more effectively. We present a semi-supervised co-training ensemble learning approach using both neural networks and decision trees to deal with the search interface identification problem. We show that the proposed model outperforms previous methods using only labeled data. We also show that adding unlabeled data improves the effectiveness of the proposed model.