Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
Skip to main content

Data Management Support for Notification Services

  • Chapter
Data Management in a Connected World

Part of the book series: Lecture Notes in Computer Science ((LNISA,volume 3551))

  • 629 Accesses

Abstract

Database management systems are highly specialized to efficiently organize and process huge amounts of data in a transactional manner. During the last years, however, database management systems have been evolving as a central hub for the integration of mostly heterogeneous and autonomous data sources to provide homogenized data access. The next step in pushing database technology forward to play the role of an information marketplace is to actively notify registered users about incoming messages or changes in the underlying data set. Therefore, notification services may be seen as a generic term for subscription systems or, more general, data stream systems which both enable processing of standing queries over transient data.

This article gives a comprehensive introduction into the context of notification services by outlining their differences to the classical query/response-based communication pattern, it illustrates potential application areas, and it discusses requirements addressing the underlying data management support. In more depth, this article describes the core concepts of the PubScribe project thereby choosing three different perspectives. From a first perspective, the subscription process and its mapping onto the primitive publish/subscribe communication pattern is explained. The second part focuses on a hybrid subscription data model by describing the basic constructs from a structural as well as an operational point of view. Finally, the PubScribe notification service project is characterized by a storage and processing model based on relational database technology.

To summarize, this contribution introduces the idea of notification services from an application point of view by inverting the database approach and dealing with persistent queries and transient data. Moreover, the article provides an insight into database technology, which must be exploited and adopted to provide a solid base for a scalable notification infrastructure, using the PubScribe project as an example.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

Similar content being viewed by others

References

  1. Adiba, M., Lindsay, B.: Database Snapshots. In: Proceedings of the VLDB Conference, pp. 86–91 (1980)

    Google Scholar 

  2. Arasu, A., Babcock, B., Babu, S., Datar, M., Ito, K., Nishizawa, I., Rosenstein, J., Widom, J.: STREAM: The Stanford Stream Data Manager. In: Proceedings of the SIGMOD Conference, p. 665 (2003)

    Google Scholar 

  3. Avnur, R., Hellerstein, J.M.: Eddies: Continuously Adaptive Query Processing. In: Proceedings of the SIGMOD Conference, pp. 261–272 (2000)

    Google Scholar 

  4. Madden, S., Shah, M.A., Hellerstein, J.M., Raman, V.: Continuously adaptive continuous queries over streams. In: Proceedings of the SIGMOD Conference, pp. 49–60 (2002)

    Google Scholar 

  5. Birman, K.P.: The Process Group Approach to Reliable Distributed Computing. Communications of the ACM 36(12), 36–53 (1993)

    Article  Google Scholar 

  6. Bonnet, P., Gehrke, J., Seshadri, P.: Towards Sensor Database Systems. In: Proceedings of the Mobile Data Management Conference, pp. 3–14 (2001)

    Google Scholar 

  7. Carney, D., Çetintemel, U., Cherniack, M., Convey, C., Lee, S., Seidman, G., Stonebraker, M., Tatbul, N., Zdonik, S.B.: Monitoring Streams - A New Class of Data Management Applications. In: Proceedings of VLDB Conference, pp. 215–226 (2002)

    Google Scholar 

  8. Codd, E.F.: A Relational Model of Data for Large Shared Data Banks. Communications of the ACM 13(6), 377–387 (1970)

    Article  MATH  Google Scholar 

  9. Cortes, C., Fisher, K., Pregibon, D., Rogers, A., Smith, F.: Hancock: A Language for Extracting Signatures from Data Streams. In: Proceedings of the Knowledge Discovery and Data Mining Conference, pp. 9–17 (2000)

    Google Scholar 

  10. Foltz, P.W., Dumais, S.T.: Personalized Information Delivery: An Analysis of Information Filtering Methods. Communications of the ACM 35(12), 51–60 (1992)

    Article  Google Scholar 

  11. Forgy, C.L.: Rete: A Fast Algorithm for the Many Pattern/Many Object Pattern Match Problem. Artifical Intelligence 19(1), 17–37 (1982)

    Article  Google Scholar 

  12. Gamma, E., Helm, R., Johnson, R., Vlissides, J.: Design Patterns: Elements of Reusable Object-Oriented Software. Addison-Wesley, Reading (1997)

    Google Scholar 

  13. Gupta, A., Mumick, I.: Materialized Views: Techniques, Implementations and Applications. MIT Press, Cambridge (1999)

    Google Scholar 

  14. Hellerstein, J.M., Franklin, M.J., Chandrasekaran, S., Deshpande, A., Hildrum, K., Madden, S., Raman, B., Shah, M.A.: Adaptive Query Processing: Technology in Evolution. IEEE Data Engineering Bulletin 23(2), 7–18 (2000)

    Google Scholar 

  15. Koudas, K., Srivastava, D.: Data Stream Query Processing: A Tutorial. In: Proceedings of VLDB Conference, p. 1149 (2003)

    Google Scholar 

  16. Lehner, W.: Datenbanktechnologie für Data-Warehouse-Systeme (in German). dpunkt.verlag (2003)

    Google Scholar 

  17. Lehner, W., Schöning, H.: XQuery: Grundlagen und fortgeschrittene Methoden (in German). dpunkt.verlag (2004)

    Google Scholar 

  18. Lehner, W.: Marktplatz omnipräsenter Informationen - Aufbau und Analyse von Subskriptionssystemen. B.G. Teubner Verlag, Stuttgart (2002) (in German)

    Google Scholar 

  19. Lehner, W. (Hrsg.): Advanced Techniques in Personalized Information Delivery. Technical Report, University of Erlangen-Nuremberg 34(5) (2001)

    Google Scholar 

  20. Lehner, W., Pirahesh, H., Cochrane, R., Zaharioudakis, M.: fAST Refresh using Mass Query Optimization. In: Proceedings of the ICDE Conference, pp. 391–398 (2001)

    Google Scholar 

  21. McCarthy, D.R., Dayal, U.: The Architecture Of An Active Data Base Management System. In: Proceedings of the SIGMOD Conference, pp. 215–224 (1989)

    Google Scholar 

  22. Oki, B.M., Pflügl, M., Siegel, A., Skeen, D.: The Information Bus - An Architecture for Extensible Distributed Systems. In: Proceedings of the SOSP Conference, pp. 58–68 (1993)

    Google Scholar 

  23. Powell, D.: Group Communication (Introduction to the Special Section). Communications of the ACM 39(4), 50–53 (1996)

    Article  Google Scholar 

  24. Pu, Y., Liu, L.: Update Monitoring: The CQ Project. In: Proceedings of the International Conference on Worldwide Computing and Its Applications, pp. 396–411 (1998)

    Google Scholar 

  25. Ramakrishnan, S., Dayal, V.: The PointCast Network. In: Proceedings of the SIGMOD Conference, p. 520 (1998)

    Google Scholar 

  26. Roth, M.T., Schwarz, P.M.: Don’t Scrap It, Wrap It! A Wrapper Architecture for Legacy Data Sources. In: Proceedings of the VLDB Conference, pp. 266–275 (1997)

    Google Scholar 

  27. Sellis, T.: Multiple Query Optimization. ACM Transactions on Database Systems 13(1), 23–52 (1988)

    Article  Google Scholar 

  28. Seshadri, P., Livny, M., Ramakrishnan, R.: Sequence Query Processing. In: Proceedings of the SIGMOD Conference, pp. 430–441 (1994)

    Google Scholar 

  29. Sullivan, M., Heybey, A.: Tribeca: A system for managing large databases of network traffic. In: Proceedings of the USENIX Annual Technical Conference (1998)

    Google Scholar 

  30. Terry, D.B., Goldberg, D., Nichols, D., Oki, B.M.: Continuous Queries over Append-Only Databases. In: Proceedings of the SIGMOD Conference, pp. 321–330 (1992)

    Google Scholar 

  31. Tian, F., Reinwald, B., Pirahesh, H., Mayr, T., Myllymaki, J.: Implementing a Scalable XML Publish/Subscribe System Using a Relational Database System. In: Proceedings of the SIGMOD Conference, pp. 479–490 (2004)

    Google Scholar 

  32. World Wide Web Consortium: Extensible Markup Language (XML), Version 1.0, 2nd Edn. W3C Recommendation, Electronically available at http://www.w3.org/TR/2000/REC-xml-20001006

  33. World Wide Web Consortium: XML Schema Part 1: Structures, Electronically available at http://www.w3.org/TR/xmlschema-1/

  34. World Wide Web Consortium: XML Schema Part 2: Datatypes, Electronically available at http://www.w3.org/TR/xmlschema-2/

  35. Yan, T.W., Garcia-Molina, H.: SIFT - a Tool for Wide-Area Information Dissemination. In: Proceedings of the USENIX Winter Conference, pp. 177–186 (1995)

    Google Scholar 

  36. Zaharioudakis, M., Cochrane, R., Pirahesh, H., Lapis, G., Urata, M.: Answering Complex SQL Queries Using Summary Tables. In: Proceedings of the SIGMOD Conference, pp. 105–116 (2000)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2005 Springer-Verlag Berlin Heidelberg

About this chapter

Cite this chapter

Lehner, W. (2005). Data Management Support for Notification Services. In: Härder, T., Lehner, W. (eds) Data Management in a Connected World. Lecture Notes in Computer Science, vol 3551. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11499923_7

Download citation

  • DOI: https://doi.org/10.1007/11499923_7

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-26295-4

  • Online ISBN: 978-3-540-31654-1

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics