Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
10.1145/2389656.2389659acmconferencesArticle/Chapter ViewAbstractPublication PagescikmConference Proceedingsconference-collections
research-article

OmpiJava: a tool for development of high-performance reasoning applications for the semantic web

Published: 29 October 2012 Publication History

Abstract

The World Wide Web has naturally been evolving towards processing extra-large data volumes, such as collected by Linked Life Data or Open PHACTS repositories, capable of hosting billions of information entities (e.g., RDF triples used in Semantic Web) and beyond. In view of the explosive data growth along with excessive QoS requirements on scalability and processing time constraints, the Web is expected to dominate the data-centric computing already in the next decade. On the other hand, most of the current HPC infrastructures, both academic and industrial, do not support parallel Web applications, e.g., developed in the Hadoop framework, due to their service-oriented implementation in the Java programming language, which is (and will surely remain) prevalent for the Web programming. As a reaction to novel challenges of promoting data-centric supercomputing to the Web, we present a solution that introduces the Message Passing Interface (MPI) bindings to Java, seamlessly integrated in one of the most popular current MPI implementations - Open MPI. Our implementation enables Java-based Semantic Web applications to be successfully ported to the most of modern HPC systems. We also discuss the design features of Open MPI that enable the proliferation of MPI into Java applications. Finally, we present a pilot Semantic Statistics scenario implemented with MPI, Random Indexing, and discuss future work in terms of promising Semantic Web applications, such as Reasoning.

References

[1]
Aster mapreduce analytics portfolio: Supercharge analytics with sql-mapreduce.
[2]
Mpi: A message-passing interface standard, 1995.
[3]
M. Assel, A. Cheptsov, B. Czink, D. Damljanovic, and J. Quesada. Mpi realization of high performance search for querying large rdf graphs using statistical semantics. In Proc. The 1st Workshop on High-Performance Computing for the Semantic Web (HPCSW2011), co-located with the 8th Extended Semantic Web Conference, ESWC2011, Heraklion, Greece, May 2011.
[4]
M. Baker, B. Carpenter, G. Fox, S. Ko, and S. Lim. mpiJava: An object-oriented java interface to mpi. In Proc. International Workshop on Java for Parallel and Distributed Computing IPPS/SPDP, San Juan, Puerto Rico, 1999.
[5]
M. Baker, B. Carpenter, and A. Shafi. MPJ Express: Towards thread safe java hpc. In Proc. IEEE International Conference on Cluster Computing (Cluster'2006), Barcelona, Spain, September 2006.
[6]
M. Bornemann, R. van Nieuwpoort, and T. Kielmann. Mpj/ibis: A flexible and efficient message passing platform for java. Concurrency and Computation: Practice and Experience, 17:217--224, 2005.
[7]
B. Carpenter, G. Fox, S.-H. Ko, and S. Lim. mpiJava 1.2: Api specification. Northeast Parallel Architecture Center. Paper 66, 1999.
[8]
B. Carpenter, V. Getov, G. Judd, A. Skjellum, and G. Fox. MPJ: Mpi-like message passing for java. Concurrency and Computation - Practice and Experience, 12(11):1019--1038, 2000.
[9]
A. Cheptsov and M. Assel. Towards high performance semantic web -- experience of the larkc project. inSiDE - Journal of Innovatives Supercomputing in Deutschland, 9(1):569--571, Spring 2011.
[10]
A. Cheptsov, M. Assel, B. Koller, R. Kübert, and G. Gallizo. Enabling high performance computing for java applications using the message-passing interface. In Proc. The Second International Conference on Parallel, Distributed, Grid and Cloud Computing for Engineering (PARENG'2011).
[11]
N. Davis. Cray's yarcdata division launches new big data graph appliance, February 2012.
[12]
J. Dean and S. Ghemawat. Mapreduce- simplified data processing on large clusters. In Proc. OSDI'04: 6th Symposium on Operating Systems Design and Implementation, 2004.
[13]
E. Gabriel, G. E. Fagg, G. Bosilca, T. Angskun, J. J. Dongarra, J. M. Squyres, V. Sahay, P. Kambadur, B. Barrett, A. Lumsdaine, R. H. Castain, D. J. Daniel, R. L. Graham, and T. S. Woodall. Open MPI: Goals, concept, and design of a next generation MPI implementation. In Proc., 11th European PVM/MPI Users' Group Meeting, pages 97--104, Budapest, Hungary, September 2004.
[14]
G. Judd, M. Clement, Q. Snell, and V. Getov. Design issues for efficient implementation of mpi in java. In Proc. the 1999 ACM Java Grande Conference, pages 58--65, 1999.
[15]
P. McCarthy. Introduction to jena. IBM developerWorks.
[16]
M. Sahlgren. An introduction to random indexing. In Proc. Methods and Applications of Semantic Indexing Workshop at the 7th International Conference on Terminology and Knowledge Engineering (TKE)'2005, pages 1--9, 2005.
[17]
E. Sirin, B. Parsia, B. C. Grau, A. Kalyanpur, and Y. Katz. Pellet: a practical owl-dl reasoner. Journal of Web Semantics.
[18]
J. Weaver and J. A. Hendler. Parallel materialization of the finite rdfs closure for hundreds of millions of triples. In A. B. et al., editor, Proc. International Semantic Web Conference (ISWC) 2009, 2009.

Cited By

View all
  • (2021)Knowledge graph technology application in Chinese SSCI: An example of short videos researchJournal of Librarianship and Information Science10.1177/0961000621106320155:1(84-98)Online publication date: 9-Dec-2021
  • (2012)The 2012 international workshop on web-scale knowledge representation, retrieval, and reasoningProceedings of the 21st ACM international conference on Information and knowledge management10.1145/2396761.2398755(2760-2761)Online publication date: 29-Oct-2012

Index Terms

  1. OmpiJava: a tool for development of high-performance reasoning applications for the semantic web

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Conferences
    Web-KR '12: Proceedings of the 2012 international workshop on Web-scale knowledge representation, retrieval and reasoning
    October 2012
    32 pages
    ISBN:9781450317115
    DOI:10.1145/2389656
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

    Sponsors

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 29 October 2012

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. data-centric applications
    2. high performance computing

    Qualifiers

    • Research-article

    Conference

    CIKM'12
    Sponsor:

    Acceptance Rates

    Overall Acceptance Rate 4 of 4 submissions, 100%

    Upcoming Conference

    CIKM '25

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)0
    • Downloads (Last 6 weeks)0
    Reflects downloads up to 17 Jan 2025

    Other Metrics

    Citations

    Cited By

    View all
    • (2021)Knowledge graph technology application in Chinese SSCI: An example of short videos researchJournal of Librarianship and Information Science10.1177/0961000621106320155:1(84-98)Online publication date: 9-Dec-2021
    • (2012)The 2012 international workshop on web-scale knowledge representation, retrieval, and reasoningProceedings of the 21st ACM international conference on Information and knowledge management10.1145/2396761.2398755(2760-2761)Online publication date: 29-Oct-2012

    View Options

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Media

    Figures

    Other

    Tables

    Share

    Share

    Share this Publication link

    Share on social media