research-article

Supporting media workflows on an advanced cloud object store platform

Authors:

Maurizio Montagnuolo,

Paula Ta-ShmaAuthors Info & Claims

SAC '16: Proceedings of the 31st Annual ACM Symposium on Applied Computing

Pages 384 - 389

https://doi.org/10.1145/2851613.2851620

Published: 04 April 2016 Publication History

Get Access

Abstract

The media industry faces daily challenges storing, managing and facilitating collaboration for vast amounts of video, photos, text, audio, and social media. This, together with increasing quality factors like high frame rates and Ultra-High resolution, drives the need for more dependable storage and scalable computation. As a solution to tackle these challenges, we describe the Active Media Store (AMS), which extends OpenStack Swift with storlets and content-centric access. Computation units called "Storlets" run typical media workflow functions, such as transcoding, metadata extraction and quality checks, close to the stored data, thereby reducing data transfer bandwidth and latency typically associated with cloud storage. Powerful search capabilities over rich user-defined metadata enable content-centric access, the ability to find stored media objects based on their content and relationships. Media workflows are easily implemented and managed through the Media Bridge, middleware running over the AMS and adapting its low level APIs. We describe an example workflow for file staging over this infrastructure in order to illustrate its power.

References

[1]

S. Dey. Mobile cloud applications: Opportunities, challenges and directions. In Proc. of the 1st Intl. Workshop on Mobile Cloud Computing & Networking, MobileCloud '13, pages 1--2, 2013.

Digital Library

Google Scholar

[2]

EBU. Loudness normalisation and permitted maximum level of audio levels. EBU Recommendation R128, European Broadcasting Union, 2010.

Google Scholar

[3]

M. Factor, D. Naor, S. Rabinovici-Cohen, L. Ramati, P. Reshef, J. Satran, and D. L. Giaretta. Preservation datastores: Architecture for preservation aware storage. In 24th IEEE Conf. on Mass Storage Systems and Technologies, MSST, 2007.

Digital Library

Google Scholar

[4]

ITU. Algorithms to measure audio programme loudness and true-peak audio level. Recommendation BS.1770, International Telecommunication Union, 2012.

Google Scholar

[5]

E. K. Kolodner, S. Tal, D. Kyriazis, D. Naor, M. Allalouf, L. Bonelli, P. Brand, A. Eckert, E. Elmroth, S. V. Gogouvitis, D. Harnik, F. Hernández, M. C. Jaeger, E. B. Lakew, J. M. Lopez, M. Lorenz, A. Messina, A. Shulman-Peleg, R. Talyansky, A. Voulodimos, and Y. Wolfsthal. A cloud environment for data-intensive storage services. In IEEE 3rd Intl. Conf. on Cloud Computing Technology and Science, CloudCom, 2011.

Digital Library

Google Scholar

[6]

A. Kurze and R. Knauf. A scalable open source framework for live media production and distribution. In 2011 14th ITG Conf. on Electronic Media Technology (CEMT), pages 1--4, 2011.

Google Scholar

[7]

B. Li, Y. He, and K. Xu. Distributed metadata management scheme in cloud computing. In 2011 6th Intl. Conf. on Pervasive Computing and Applications (ICPCA), pages 32--38, 2011.

Google Scholar

[8]

M. Montenovo. From the cloud to tv production: a real world case study of an architecture and performance model. In IBC2014 Conference, 2014.

Crossref

Google Scholar

[9]

M. Seger and E. O'Toole. Performance measurements on swift / do-it-yourself swift benchmarking made simple. In OpenStack Summit Atlanta 2014, 2014.

Google Scholar

[10]

H. Tan and L. Chen. An approach for fast and parallel video processing on apache hadoop clusters. In IEEE Intl. Conf. on Multimedia and Expo, ICME 2014, Chengdu, China, July 14-18, 2014, pages 1--6, 2014.

Crossref

Google Scholar

[11]

Q. Zheng, H. Chen, Y. Wang, J. Zhang, and J. Duan. Cosbench: Cloud object storage benchmark. In Proc. of the 4th ACM/SPEC Intl. Conf. on Performance Engineering, ICPE, 2013.

Digital Library

Google Scholar

Cited By

View all

Noor JRatul RBasher MSoumik JSadman SRozario NReaz RChellappan SIslam A(2024)Secure Processing-aware Media Storage and Archival (SPMSA)Future Generation Computer Systems10.1016/j.future.2024.05.010159(290-306)Online publication date: Oct-2024
https://doi.org/10.1016/j.future.2024.05.010
Noor JAkbar HSujon RAl Islam A(2017)Secure processing-aware media storage (SPMS)2017 IEEE 36th International Performance Computing and Communications Conference (IPCCC)10.1109/PCCC.2017.8280457(1-8)Online publication date: Dec-2017
https://doi.org/10.1109/PCCC.2017.8280457

Index Terms

Supporting media workflows on an advanced cloud object store platform
1. Information systems
  1. Information storage systems
    1. Storage architectures
      1. Cloud based storage
2. Networks
  1. Network services
    1. Cloud computing

Recommendations

Native Cloud Object Storage in Db2 Warehouse: Implementing a Fast and Cost-Efficient Cloud Storage Architecture
SIGMOD/PODS '24: Companion of the 2024 International Conference on Management of Data

Database systems built on traditional storage subsystems typically store their data in small blocks referred to as data pages (commonly sized in a multiple of 4KB for historical reasons). These traditional storage subsystems, for example network attached ...
Workload-aware storage policies for cloud object storage
Abstract
Different applications have different access characteristics and various performance requirements. Thus, the shared cloud object store entails providing tenant-specific policies. However, the limited configurability of existing storage ...
Highlights
- We actively detect the workload characteristics and track their changes.
- We ...
File-based media workflows using ltfs tapes
MM '10: Proceedings of the 18th ACM international conference on Multimedia

While digital video cameras have existed for over two decades digital video cassettes are still the primary storage medium in professional video archives. One of the major inhibitors in the transition to file-based workflows and media archives is the ...

Comments

Information & Contributors

Information

Published In

SAC '16: Proceedings of the 31st Annual ACM Symposium on Applied Computing

April 2016

2360 pages

ISBN:9781450337397

DOI:10.1145/2851613

Conference Chair:
Sascha Ossowski
University Rey Juan Carlos, Spain

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 04 April 2016

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

SAC 2016

Sponsor:

SIGAPP

SAC 2016: Symposium on Applied Computing

April 4 - 8, 2016

Pisa, Italy

Acceptance Rates

SAC '16 Paper Acceptance Rate 252 of 1,047 submissions, 24%;

Overall Acceptance Rate 1,650 of 6,669 submissions, 25%

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

2
Total Citations
View Citations
116
Total Downloads

Downloads (Last 12 months)5
Downloads (Last 6 weeks)0

Reflects downloads up to

Other Metrics

View Author Metrics

Citations

Cited By

View all

Noor JRatul RBasher MSoumik JSadman SRozario NReaz RChellappan SIslam A(2024)Secure Processing-aware Media Storage and Archival (SPMSA)Future Generation Computer Systems10.1016/j.future.2024.05.010159(290-306)Online publication date: Oct-2024
https://doi.org/10.1016/j.future.2024.05.010
Noor JAkbar HSujon RAl Islam A(2017)Secure processing-aware media storage (SPMS)2017 IEEE 36th International Performance Computing and Communications Conference (IPCCC)10.1109/PCCC.2017.8280457(1-8)Online publication date: Dec-2017
https://doi.org/10.1109/PCCC.2017.8280457

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Cited By

Index Terms

Recommendations

Native Cloud Object Storage in Db2 Warehouse: Implementing a Fast and Cost-Efficient Cloud Storage Architecture

Workload-aware storage policies for cloud object storage

File-based media workflows using ltfs tapes