Centralized and MapReduce Algorithms for Dynamic Group Formation on Hadoop

碩士 === 國立東華大學 === 資訊工程學系 === 101 === Social network services become mature these years. The main purpose is to build an online community and provide communication service for people who have the same preference, job or personality. There is a request that people who has the same proximity will be fo...

Full description

Bibliographic Details
Main Authors: An-Te Huang, 黃安德
Other Authors: Shiow-Yang Wu
Format: Others
Published: 2013
Online Access:http://ndltd.ncl.edu.tw/handle/41031715184313343937
id ndltd-TW-101NDHU5392086
record_format oai_dc
spelling ndltd-TW-101NDHU53920862016-02-21T04:20:16Z http://ndltd.ncl.edu.tw/handle/41031715184313343937 Centralized and MapReduce Algorithms for Dynamic Group Formation on Hadoop 基於Hadoop的動態群組形成之集中式和MapReduce演算法研究 An-Te Huang 黃安德 碩士 國立東華大學 資訊工程學系 101 Social network services become mature these years. The main purpose is to build an online community and provide communication service for people who have the same preference, job or personality. There is a request that people who has the same proximity will be formed into a group temporarily. We call the kind of request as Dynamic Group Formation Problem. This goal of the research studies how to solve dynamic group formation problem, like groupon, car-sharing, and temporarily form a tour group. We will define these problems to a graph theory problem. We propose two approaches to solve dynamic group formation problem, centralized algorithm and distributed MapReduce algorithm. Centralized approach decides how to assign a user into a group which depends on the timing and the locations of groups and the preference of users. With the characteristic of MapReduce, distributed approach assigns users into groups according to their preference simultaneously. We expect to feature the advantage of distributed system in the situation of a large sum of groups and users. In this research, we implemented MapReduce algorithm by using Hadoop and HBase and compared to centralized algorithm in different amount of groups and users. For the largest CPU execution time in our experiment, distributed approach has 75% execution time less than centralized approach. Although the group complete rate and group satisfied rate for distributed approach are not as well as centralize approach, both rates can be 100% when the data become large. Shiow-Yang Wu 吳秀陽 2013 學位論文 ; thesis 62
collection NDLTD
format Others
sources NDLTD
description 碩士 === 國立東華大學 === 資訊工程學系 === 101 === Social network services become mature these years. The main purpose is to build an online community and provide communication service for people who have the same preference, job or personality. There is a request that people who has the same proximity will be formed into a group temporarily. We call the kind of request as Dynamic Group Formation Problem. This goal of the research studies how to solve dynamic group formation problem, like groupon, car-sharing, and temporarily form a tour group. We will define these problems to a graph theory problem. We propose two approaches to solve dynamic group formation problem, centralized algorithm and distributed MapReduce algorithm. Centralized approach decides how to assign a user into a group which depends on the timing and the locations of groups and the preference of users. With the characteristic of MapReduce, distributed approach assigns users into groups according to their preference simultaneously. We expect to feature the advantage of distributed system in the situation of a large sum of groups and users. In this research, we implemented MapReduce algorithm by using Hadoop and HBase and compared to centralized algorithm in different amount of groups and users. For the largest CPU execution time in our experiment, distributed approach has 75% execution time less than centralized approach. Although the group complete rate and group satisfied rate for distributed approach are not as well as centralize approach, both rates can be 100% when the data become large.
author2 Shiow-Yang Wu
author_facet Shiow-Yang Wu
An-Te Huang
黃安德
author An-Te Huang
黃安德
spellingShingle An-Te Huang
黃安德
Centralized and MapReduce Algorithms for Dynamic Group Formation on Hadoop
author_sort An-Te Huang
title Centralized and MapReduce Algorithms for Dynamic Group Formation on Hadoop
title_short Centralized and MapReduce Algorithms for Dynamic Group Formation on Hadoop
title_full Centralized and MapReduce Algorithms for Dynamic Group Formation on Hadoop
title_fullStr Centralized and MapReduce Algorithms for Dynamic Group Formation on Hadoop
title_full_unstemmed Centralized and MapReduce Algorithms for Dynamic Group Formation on Hadoop
title_sort centralized and mapreduce algorithms for dynamic group formation on hadoop
publishDate 2013
url http://ndltd.ncl.edu.tw/handle/41031715184313343937
work_keys_str_mv AT antehuang centralizedandmapreducealgorithmsfordynamicgroupformationonhadoop
AT huángāndé centralizedandmapreducealgorithmsfordynamicgroupformationonhadoop
AT antehuang jīyúhadoopdedòngtàiqúnzǔxíngchéngzhījízhōngshìhémapreduceyǎnsuànfǎyánjiū
AT huángāndé jīyúhadoopdedòngtàiqúnzǔxíngchéngzhījízhōngshìhémapreduceyǎnsuànfǎyánjiū
_version_ 1718192602650509312