Abstract
Increased network speeds coupled with new services delivered via the Internet have increased the demand for intelligence and flexibility in network systems. This paper argues that both can be provided by new hardware platforms comprised of heterogeneous multi-core systems with specialized communication support. We present and evaluate an experimental network service platform that uses an emergent class of devices—network processors—as its communication support, coupled via a dedicated interconnect to a host processor acting as a computational core. A software infrastructure spanning both enables the dynamic creation of application-specific services on the network processor, mediated by middleware and controlled by kernel-level communication support. Experimental evaluations use a Pentium IV-based computational core coupled with an IXP 2400 network processor. The sample application services run on both include an image manipulation application and application-level multicasting.
Similar content being viewed by others
References
Apostolopoulos G, Aubespin D, Peris V, Pradhan P, Debanjan Saha (2000) Design, implementation and performance of a content-based switch, In: Proc. of IEEE INFOCOM 2000, Tel Aviv, Israel (March 2000)
Braun F, Lockwood J, Waldvogel M (2002) Protocol wrappers for layered network packet processing in reconfigurable networks. IEEE MICRO 22(1), (Jan/Feb)
Bustamante F, Eisenhauer G, Schwan K (2000) Efficient wire formats for high performance computing. In: Supercomputing 2000 (November 2000)
Carzagina A, Rosenblum DS, Wolf AL (2001) Design and evaluation of a wide-area event notification service. In: ACM transactions on computer systems, vol 19, no 3 (August)
Cisco Press Release (2005) Cisco unveils application oriented networking, In: Networkers’05 (June 2005)
Clark C, Lee W, Schimmel D, ContisD, Kone M, Thomas A (2004) A hardware platform for network intrusion detection and prevention. In: Proceedings of the 3rd workshop on network processors and applications (NP3), Madrid, Spain (February 2004)
Consel C, Hamdi H, Reveillere L, Singaravelu L, Yu H, Pu C (2003) Spidle: a DSL approach to specifying streaming applications. In: Proceedings of the 2nd international conference on generative programming and component engineering, Erfurt, Germany (September 2003)
Diot L, Gautier A (1999) A distributed architecture for multiplayer interactive applications on the Internet. In: Network, vol 13, no 4. IEEE, New York (July–August)
Eisenhauer G, Bustamante F, Schwan K (2000) Event services for high performance computing. In: 9th symposium on high performance distributed computing (HPDC-9), Pittsburgh, PA (August)
Feng Wu-ching, Bulusu N, Feng Wu-chang (2005) Dissecting the video sensing landscape. In: ACM NOSSDAV 2005, Stevenson, WA (June)
Feng W-C, Hurwitz G, Newman H, Ravot S, Cottrell L, Martin O, Coccetti F, Jin C, Wei D, Low S (2003) Optimizing 10-Gigabit ethernet for networks of workstations, clusters and grids: a case study. In: SC2003: high-performance networking and computing conference, Phoenix, AZ (November)
Gavrilovska A, Oleson V, Schwan K (2002) Practical approach for zero downtime in an operational information system. In: 22nd IEEE international conference on distributed computing systems (ICDCS-2005), Vienna, Austria (July)
Gavrilovska A, Kumar S, Schwan K (2004) The execution of event–action rules on programmable network processors. In: OASIS 2004, held with ASPLOS-XI (October)
Gavrilovska A, Kumar S, Sundaragopalan S, Schwan K (2005) Platform overlays: enabling in-network stream processing in large scale distributed applications. In: 15th workshop on network and operating systems principles and design (NOSSDAV’05), Stevenson, WA (June)
Gavrilovska A, Schwan K, Nordstrom O, Seifu H (2003) Network processors as building blocks in overlay networks. In: Hot interconnects
Guo J, Yao J, Bhuyan L (2005) An efficient packet scheduling algorithm in network processors. In: IEEE infocom (March)
IBM MQSeries, http://www.mqseries.net.
Intel Corporation (2001) Intel IXA programming framework
IXP Intel Network Processor Family, http://developer.intel.com/design/npfamily
Kong J, Schwan K (2005) K-streams: kernel support for efficient data streaming in proxy servers. In: 15th workshop on network and operating systems principles and design (NOSSDAV’05) (June)
Krishnamurthy R, Yalamanchili S, Schwan K, West R (2002) Architecture and hardware for scheduling gigabit packet streams. In: Proceedings of hot interconnects, vol 10, Stanford, CA (August)
Kumar V, Cooper B, Cai Z, Eisenhauer G, Schwan K (2005) Resource-aware distributed stream management using dynamic overlays. In: 25th IEEE international conference on distributed computing systems (ICDCS-2005), Columbus, OH
Kumar S, Gavrilovska A, Sundaragopalan S, Schwan K (2005) C-core: using communication cores for high performance network services. In: 4th IEEE conference on network computing and applications (July)
Liao C, Martinosi M, Clark, D W (1998) Performance monitoring in a myrinet-connected shrimp cluster. In: ACM sigmetrics symposium on parallel and distributed tools (SPDT) (August)
Lin Y-D, Lin Y-N, Yang S-C, Lin Y-S (2002) DiffServ over network processors: implementation and evaluation. In: Proceedings of hot interconnects, vol 10 (August)
[LIN] Linksys Home Router, Linksys Broadband and Wireless Networking, http://www.linksys.com.
Liu L, Tang W, Buttler D, Pu C (2001) Information monitoring on the web: a scalable solution. In: World Wide Web Journal, vol 4, no 4. Kluwer, New York
Mehra P (2003) Apsara: The quest for the perfect server for network computing applications. In: Proceedings of network computing and applications (NCA), Cambridge, MA (April)
[NPF] Network Processing Forum, http://www.npforum.org
Otey M, Noronha R, Parthasarathy S, Panda DK (2002) NIC-based intrusion detection: a feasibility study. In: Proceedings of the workshop on data mining for cyber threat analysis
Oleson V, Eisenhauer G, Schwan K, Plale B, Pu C, Amin D (2000) Operational information systems—an example from the airline industry. In: 1st workshop on industrial experiences and systems software (WEISS 2000), San Diego, CA
Pai V, Cox A, Pai V, Zwaenepoel W (2003) A flexible and efficient application programming interface (API) for a customizable proxy cache. In: Proceedings of 4th USENIX symposium on internet technologies and systems, Seattle, WA (August)
Path 1 Network Technologies (2002) Professional digital video gateways for the broadcaster and multi-service operator: delivered by Path 1 Network Technologies* and Intel® Network Processors. White paper, http://www.intel.com/design/network/casestudies/path1.htm
Regnier G, Minturn D, McAlpine G, Saletore V, Foong A (2003) ETA: experience with an Intel Xeon processor as a packet processing engine, hot interconnects, vol XI, Stanford, CA (August)
Rosu M-C, Schwan K, Fujimoto R (1998) Supporting parallel applications on clusters of workstations: the virtual communication machine-based architecture. In: Cluster computing, Special issue on high performance distributed computing, vol. 1 (May)
Roy S, Ankcorn J, Wee S (2003) An Architecture for componentized, network-based media services. In: Proceedings of IEEE international conference on multimedia and expo (July)
Rowstron A, Kermarrec A-M, Castro M, Druschel P (2001) SCRIBE: the design of a large-scale event notification infrastructure. In: Proceedings of 3rd international workshop on networked group communication, London, UK (November)
Shah N, Plishker W, Keutzer K (2003) NP-click: a programming model for the Intel IXP1200. In: 2nd workshop on network processors (NP-2), Anaheim, CA. (February)
Shivam P, Wyckoff P, Panda DK (2002) Can user level protocols take advantage of multi-CPU NICs? In: International parallel and distributed processing symposium (IPDPS ‘02) (April)
Spalink T, Karlin S, Peterson L, Gottlieb Y (2001) Building a robust software-based router using network processors. In: SOSP 2001, Banff, Canada (December)
Sundaragopalan S, Gavrilovska A, Kumar S, Schwan K (2005) An approach towards enabling intelligent networking services for distributed multimedia applications. In: IMMCN’05 (April)
Teja NP Software Platform for Intel IXP2xxx Network Processor Family, White Paper, http://www.teja.com
Taylor DE, Lockwood JW, Sproull TS, Turner JS, Parlour DB (2002) Scalable IP lookup for programmable routers. In: Proceedings of IEEE INFOCOM 2002, New York, NY (June)
Tibco Software Inc., http://www.tibco.com
Thies W, Karczmarek M, Amarasinghe S (2002) StreamIt: A language for streaming applications, international conference on compiler construction (ICCC’02), Grenoble, France (April)
West R, Schwan K (1999) Dynamic window-constrained scheduling for multimedia applications. In: Proceedings of 6th international conference on multimedia computing and systems, Florence, Italy (June)
Wolf M, Cai Z, Huang W, Schwan K (2002) WCH02s: Personalized scientific data portals in your hand. In: Supercomputing 2002 (November)
Yocum K, Chase J (2001) Payload caching: high-speed data forwarding for network intermediaries. In: Proceedings of USENIX technical conference (USENIX’01), Boston, MA (June)
Zhao Y, Storm R (2001) Exploiting event stream interpretation in publish-subscribe systems. In: Proceedings of ACM symposium on principles of distributed computing, Newport, RI (August)
Zhuang X, Shi W, Paul I, Schwan K (2002) Efficient implementation of the DWCS algorithm on high-speed programmable network processors. In: Proceedings of multimedia networks and systems (MMNS) (October)
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Gavrilovska, A., Kumar, S., Sundaragopalan, S. et al. Advanced networking services for distributed multimedia streaming applications. Multimed Tools Appl 34, 179–200 (2007). https://doi.org/10.1007/s11042-006-0089-0
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11042-006-0089-0