Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
10.1145/1601966.1601977acmconferencesArticle/Chapter ViewAbstractPublication PageskddConference Proceedingsconference-collections
research-article

Mining in a mobile environment

Published: 28 June 2009 Publication History

Abstract

Distributed PRocessing in Mobile Environments (DPRiME) is a framework for processing large data sets across an ad-hoc network. Developed to address the shortcomings of Google's MapReduce outside of a fully-connected network, DPRiME separates nodes on the network into a master and workers; the master distributes sections of the data to available one-hop workers to process in parallel. Upon returning results to its master, a worker is assigned an unfinished task. Five data mining classifiers were implemented to process the data: decision trees, k-means, k-nearest neighbor, Naïve Bayes, and artificial neural networks. Ensembles were used so the classification tasks could be performed in parallel. This framework is well-suited for many tasks because it handles communications, node movement, node failure, packet loss, data partitioning, and result collection automatically. Therefore, DPRiME allows users with little knowledge of networking or distributed systems to harness the processing power of an entire network of single- and multi-hop nodes.

References

[1]
C. Pettey, "Gartner Says Worldwide Smartphone Sales Grew 29 Percent in First Quarter of 2008," Gartner, 6 June 2008, 30 July 2008 <http://www.gartner.com/it/page.jsp?id=688116>.
[2]
B. Thuraisingham, L. Khan, C. Clifton, J. Maurer, and M. Ceruti, "Dependable Real-Time Data Mining," Proceedings of the Eighth IEEE International Symposium on Object-Oriented Real-Time Distributed Computing (2005).
[3]
J. Dean and S. Ghemawat, "MapReduce: Simplified Data Processing on Large CLusters," Sixth Symposium on Operating System Design and Implementation (2004), 15 July 2008 <http://labs.google.com/papers/mapreduce.html>.
[4]
T. M. Mitchell, Machine Learning, Ed. E. M. Munson, Singapore: The McGraw-Hill Companies, Inc., 1997.
[5]
I. H. Witten and E. Frank, Data Mining: Practical Machine Learning Tools and Techniques, 2nd ed. San Francisco: Morgan Kaufmann, 2005.
[6]
K. W. Bowyer, L. O. Hall, T. Moore, and N. Chawla, "A Parallel Decision Tree Builder for Mining Very Large Visualization Data Sets," IEEE International Conference on Systems, Man, and Cybernetics 3 (2000): 1888--893.
[7]
R. Agrawal and J. C. Shafer, "Parallel Mining of Association Rules." Ieee Trans. On Knowledge And Data Engineering 8 (1996): 962--69.
[8]
G. J. Narlikar, "A Parallel, Multithreaded Decision Tree Builder," (1998).
[9]
T. G. Dietterich, "Ensemble Methods in Machine Learning." Lecture Notes in Computer Science (2000).
[10]
C. Chu, S. K. Kim, Y. Lin, Y. Yu, G. Bradski, A. Y. Ng, and K. Oluktun, "Map-Reduce for Machine Learning on Multicore."

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
SensorKDD '09: Proceedings of the Third International Workshop on Knowledge Discovery from Sensor Data
June 2009
150 pages
ISBN:9781605586687
DOI:10.1145/1601966
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 28 June 2009

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. MapReduce
  2. ad-hoc network
  3. classifier
  4. data mining
  5. ensemble

Qualifiers

  • Research-article

Funding Sources

Conference

KDD09
Sponsor:

Upcoming Conference

KDD '24

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • 0
    Total Citations
  • 264
    Total Downloads
  • Downloads (Last 12 months)1
  • Downloads (Last 6 weeks)0
Reflects downloads up to 18 Aug 2024

Other Metrics

Citations

View Options

Get Access

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media