Centralized and MapReduce Algorithms for Dynamic Group Formation on Hadoop
碩士 === 國立東華大學 === 資訊工程學系 === 101 === Social network services become mature these years. The main purpose is to build an online community and provide communication service for people who have the same preference, job or personality. There is a request that people who has the same proximity will be fo...
Main Authors: | , |
---|---|
Other Authors: | |
Format: | Others |
Published: |
2013
|
Online Access: | http://ndltd.ncl.edu.tw/handle/41031715184313343937 |
id |
ndltd-TW-101NDHU5392086 |
---|---|
record_format |
oai_dc |
spelling |
ndltd-TW-101NDHU53920862016-02-21T04:20:16Z http://ndltd.ncl.edu.tw/handle/41031715184313343937 Centralized and MapReduce Algorithms for Dynamic Group Formation on Hadoop 基於Hadoop的動態群組形成之集中式和MapReduce演算法研究 An-Te Huang 黃安德 碩士 國立東華大學 資訊工程學系 101 Social network services become mature these years. The main purpose is to build an online community and provide communication service for people who have the same preference, job or personality. There is a request that people who has the same proximity will be formed into a group temporarily. We call the kind of request as Dynamic Group Formation Problem. This goal of the research studies how to solve dynamic group formation problem, like groupon, car-sharing, and temporarily form a tour group. We will define these problems to a graph theory problem. We propose two approaches to solve dynamic group formation problem, centralized algorithm and distributed MapReduce algorithm. Centralized approach decides how to assign a user into a group which depends on the timing and the locations of groups and the preference of users. With the characteristic of MapReduce, distributed approach assigns users into groups according to their preference simultaneously. We expect to feature the advantage of distributed system in the situation of a large sum of groups and users. In this research, we implemented MapReduce algorithm by using Hadoop and HBase and compared to centralized algorithm in different amount of groups and users. For the largest CPU execution time in our experiment, distributed approach has 75% execution time less than centralized approach. Although the group complete rate and group satisfied rate for distributed approach are not as well as centralize approach, both rates can be 100% when the data become large. Shiow-Yang Wu 吳秀陽 2013 學位論文 ; thesis 62 |
collection |
NDLTD |
format |
Others
|
sources |
NDLTD |
description |
碩士 === 國立東華大學 === 資訊工程學系 === 101 === Social network services become mature these years. The main purpose is to build an online community and provide communication service for people who have the same preference, job or personality. There is a request that people who has the same proximity will be formed into a group temporarily. We call the kind of request as Dynamic Group Formation Problem.
This goal of the research studies how to solve dynamic group formation problem, like groupon, car-sharing, and temporarily form a tour group. We will define these problems to a graph theory problem. We propose two approaches to solve dynamic group formation problem, centralized algorithm and distributed MapReduce algorithm. Centralized approach decides how to assign a user into a group which depends on the timing and the locations of groups and the preference of users. With the characteristic of MapReduce, distributed approach assigns users into groups according to their preference simultaneously. We expect to feature the advantage of distributed system in the situation of a large sum of groups and users.
In this research, we implemented MapReduce algorithm by using Hadoop and HBase and compared to centralized algorithm in different amount of groups and users. For the largest CPU execution time in our experiment, distributed approach has 75% execution time less than centralized approach. Although the group complete rate and group satisfied rate for distributed approach are not as well as centralize approach, both rates can be 100% when the data become large.
|
author2 |
Shiow-Yang Wu |
author_facet |
Shiow-Yang Wu An-Te Huang 黃安德 |
author |
An-Te Huang 黃安德 |
spellingShingle |
An-Te Huang 黃安德 Centralized and MapReduce Algorithms for Dynamic Group Formation on Hadoop |
author_sort |
An-Te Huang |
title |
Centralized and MapReduce Algorithms for Dynamic Group Formation on Hadoop |
title_short |
Centralized and MapReduce Algorithms for Dynamic Group Formation on Hadoop |
title_full |
Centralized and MapReduce Algorithms for Dynamic Group Formation on Hadoop |
title_fullStr |
Centralized and MapReduce Algorithms for Dynamic Group Formation on Hadoop |
title_full_unstemmed |
Centralized and MapReduce Algorithms for Dynamic Group Formation on Hadoop |
title_sort |
centralized and mapreduce algorithms for dynamic group formation on hadoop |
publishDate |
2013 |
url |
http://ndltd.ncl.edu.tw/handle/41031715184313343937 |
work_keys_str_mv |
AT antehuang centralizedandmapreducealgorithmsfordynamicgroupformationonhadoop AT huángāndé centralizedandmapreducealgorithmsfordynamicgroupformationonhadoop AT antehuang jīyúhadoopdedòngtàiqúnzǔxíngchéngzhījízhōngshìhémapreduceyǎnsuànfǎyánjiū AT huángāndé jīyúhadoopdedòngtàiqúnzǔxíngchéngzhījízhōngshìhémapreduceyǎnsuànfǎyánjiū |
_version_ |
1718192602650509312 |