A Group Mining Method for Big Data on Distributed Vehicle Trajectories in WAN
A distributed parallel clustering method MCR-ACA is proposed by integrating the ant colony algorithm with the computing framework Map-Combine-Reduce for mining groups with the same or similar features from big data on vehicle trajectories stored in Wide Area Network. The heaviest computing burden of...
Saved in:
Main Authors: | , , , |
---|---|
Format: | Article |
Language: | English |
Published: |
Wiley
2015-08-01
|
Series: | International Journal of Distributed Sensor Networks |
Online Access: | https://doi.org/10.1155/2015/756107 |
Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
_version_ | 1832547804001599488 |
---|---|
author | Jie Yang Xiaoping Li Dandan Wang Jia Wang |
author_facet | Jie Yang Xiaoping Li Dandan Wang Jia Wang |
author_sort | Jie Yang |
collection | DOAJ |
description | A distributed parallel clustering method MCR-ACA is proposed by integrating the ant colony algorithm with the computing framework Map-Combine-Reduce for mining groups with the same or similar features from big data on vehicle trajectories stored in Wide Area Network. The heaviest computing burden of clustering is conducted in parallel at local nodes, of which the results are merged to small size intermediates. The intermediates are sent to the central node and clusters are generated adaptively. The great overhead of transferring big volume data is avoided by MCR-ACA, which improves the computing efficiency and guarantees the correctness of clustering. MCR-ACA is compared with an existing parallel clustering algorithm on practical big data collected by the traffic monitoring system of Jiangsu province in China. Experimental results demonstrate that the proposed method is effective for group mining by clustering. |
format | Article |
id | doaj-art-bb61bd3de6bc4fd8945bd016e021c789 |
institution | Kabale University |
issn | 1550-1477 |
language | English |
publishDate | 2015-08-01 |
publisher | Wiley |
record_format | Article |
series | International Journal of Distributed Sensor Networks |
spelling | doaj-art-bb61bd3de6bc4fd8945bd016e021c7892025-02-03T06:43:15ZengWileyInternational Journal of Distributed Sensor Networks1550-14772015-08-011110.1155/2015/756107756107A Group Mining Method for Big Data on Distributed Vehicle Trajectories in WANJie Yang0Xiaoping Li1Dandan Wang2Jia Wang3 Public Security Bureau of Jiangsu Province, Nanjing 210024, China School of Computer Science and Engineering, Southeast University, Nanjing 211189, China School of Computer Science and Engineering, Southeast University, Nanjing 211189, China School of Computer Science and Engineering, Southeast University, Nanjing 211189, ChinaA distributed parallel clustering method MCR-ACA is proposed by integrating the ant colony algorithm with the computing framework Map-Combine-Reduce for mining groups with the same or similar features from big data on vehicle trajectories stored in Wide Area Network. The heaviest computing burden of clustering is conducted in parallel at local nodes, of which the results are merged to small size intermediates. The intermediates are sent to the central node and clusters are generated adaptively. The great overhead of transferring big volume data is avoided by MCR-ACA, which improves the computing efficiency and guarantees the correctness of clustering. MCR-ACA is compared with an existing parallel clustering algorithm on practical big data collected by the traffic monitoring system of Jiangsu province in China. Experimental results demonstrate that the proposed method is effective for group mining by clustering.https://doi.org/10.1155/2015/756107 |
spellingShingle | Jie Yang Xiaoping Li Dandan Wang Jia Wang A Group Mining Method for Big Data on Distributed Vehicle Trajectories in WAN International Journal of Distributed Sensor Networks |
title | A Group Mining Method for Big Data on Distributed Vehicle Trajectories in WAN |
title_full | A Group Mining Method for Big Data on Distributed Vehicle Trajectories in WAN |
title_fullStr | A Group Mining Method for Big Data on Distributed Vehicle Trajectories in WAN |
title_full_unstemmed | A Group Mining Method for Big Data on Distributed Vehicle Trajectories in WAN |
title_short | A Group Mining Method for Big Data on Distributed Vehicle Trajectories in WAN |
title_sort | group mining method for big data on distributed vehicle trajectories in wan |
url | https://doi.org/10.1155/2015/756107 |
work_keys_str_mv | AT jieyang agroupminingmethodforbigdataondistributedvehicletrajectoriesinwan AT xiaopingli agroupminingmethodforbigdataondistributedvehicletrajectoriesinwan AT dandanwang agroupminingmethodforbigdataondistributedvehicletrajectoriesinwan AT jiawang agroupminingmethodforbigdataondistributedvehicletrajectoriesinwan AT jieyang groupminingmethodforbigdataondistributedvehicletrajectoriesinwan AT xiaopingli groupminingmethodforbigdataondistributedvehicletrajectoriesinwan AT dandanwang groupminingmethodforbigdataondistributedvehicletrajectoriesinwan AT jiawang groupminingmethodforbigdataondistributedvehicletrajectoriesinwan |