A Group Mining Method for Big Data on Distributed Vehicle Trajectories in WAN

A distributed parallel clustering method MCR-ACA is proposed by integrating the ant colony algorithm with the computing framework Map-Combine-Reduce for mining groups with the same or similar features from big data on vehicle trajectories stored in Wide Area Network. The heaviest computing burden of...

Full description

Saved in:
Bibliographic Details
Main Authors: Jie Yang, Xiaoping Li, Dandan Wang, Jia Wang
Format: Article
Language:English
Published: Wiley 2015-08-01
Series:International Journal of Distributed Sensor Networks
Online Access:https://doi.org/10.1155/2015/756107
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1832547804001599488
author Jie Yang
Xiaoping Li
Dandan Wang
Jia Wang
author_facet Jie Yang
Xiaoping Li
Dandan Wang
Jia Wang
author_sort Jie Yang
collection DOAJ
description A distributed parallel clustering method MCR-ACA is proposed by integrating the ant colony algorithm with the computing framework Map-Combine-Reduce for mining groups with the same or similar features from big data on vehicle trajectories stored in Wide Area Network. The heaviest computing burden of clustering is conducted in parallel at local nodes, of which the results are merged to small size intermediates. The intermediates are sent to the central node and clusters are generated adaptively. The great overhead of transferring big volume data is avoided by MCR-ACA, which improves the computing efficiency and guarantees the correctness of clustering. MCR-ACA is compared with an existing parallel clustering algorithm on practical big data collected by the traffic monitoring system of Jiangsu province in China. Experimental results demonstrate that the proposed method is effective for group mining by clustering.
format Article
id doaj-art-bb61bd3de6bc4fd8945bd016e021c789
institution Kabale University
issn 1550-1477
language English
publishDate 2015-08-01
publisher Wiley
record_format Article
series International Journal of Distributed Sensor Networks
spelling doaj-art-bb61bd3de6bc4fd8945bd016e021c7892025-02-03T06:43:15ZengWileyInternational Journal of Distributed Sensor Networks1550-14772015-08-011110.1155/2015/756107756107A Group Mining Method for Big Data on Distributed Vehicle Trajectories in WANJie Yang0Xiaoping Li1Dandan Wang2Jia Wang3 Public Security Bureau of Jiangsu Province, Nanjing 210024, China School of Computer Science and Engineering, Southeast University, Nanjing 211189, China School of Computer Science and Engineering, Southeast University, Nanjing 211189, China School of Computer Science and Engineering, Southeast University, Nanjing 211189, ChinaA distributed parallel clustering method MCR-ACA is proposed by integrating the ant colony algorithm with the computing framework Map-Combine-Reduce for mining groups with the same or similar features from big data on vehicle trajectories stored in Wide Area Network. The heaviest computing burden of clustering is conducted in parallel at local nodes, of which the results are merged to small size intermediates. The intermediates are sent to the central node and clusters are generated adaptively. The great overhead of transferring big volume data is avoided by MCR-ACA, which improves the computing efficiency and guarantees the correctness of clustering. MCR-ACA is compared with an existing parallel clustering algorithm on practical big data collected by the traffic monitoring system of Jiangsu province in China. Experimental results demonstrate that the proposed method is effective for group mining by clustering.https://doi.org/10.1155/2015/756107
spellingShingle Jie Yang
Xiaoping Li
Dandan Wang
Jia Wang
A Group Mining Method for Big Data on Distributed Vehicle Trajectories in WAN
International Journal of Distributed Sensor Networks
title A Group Mining Method for Big Data on Distributed Vehicle Trajectories in WAN
title_full A Group Mining Method for Big Data on Distributed Vehicle Trajectories in WAN
title_fullStr A Group Mining Method for Big Data on Distributed Vehicle Trajectories in WAN
title_full_unstemmed A Group Mining Method for Big Data on Distributed Vehicle Trajectories in WAN
title_short A Group Mining Method for Big Data on Distributed Vehicle Trajectories in WAN
title_sort group mining method for big data on distributed vehicle trajectories in wan
url https://doi.org/10.1155/2015/756107
work_keys_str_mv AT jieyang agroupminingmethodforbigdataondistributedvehicletrajectoriesinwan
AT xiaopingli agroupminingmethodforbigdataondistributedvehicletrajectoriesinwan
AT dandanwang agroupminingmethodforbigdataondistributedvehicletrajectoriesinwan
AT jiawang agroupminingmethodforbigdataondistributedvehicletrajectoriesinwan
AT jieyang groupminingmethodforbigdataondistributedvehicletrajectoriesinwan
AT xiaopingli groupminingmethodforbigdataondistributedvehicletrajectoriesinwan
AT dandanwang groupminingmethodforbigdataondistributedvehicletrajectoriesinwan
AT jiawang groupminingmethodforbigdataondistributedvehicletrajectoriesinwan