Article

quFiles: the right file at the right time

Authors:

Kaushik Veeraraghavan,

Edmund B. Nightingale,

Brian NobleAuthors Info & Claims

FAST'10: Proceedings of the 8th USENIX conference on File and storage technologies

Page 1

Published: 23 February 2010 Publication History

Abstract

A quFile is a unifying abstraction that simplifies data management by encapsulating different physical representations of the same logical data. Similar to a quBit (quantum bit), the particular representation of the logical data displayed by a quFile is not determined until the moment it is needed. The representation returned by a quFile is specified by a data-specific policy that can take into account context such as the application requesting the data, the device on which data is accessed, screen size, and battery status. We demonstrate the generality of the quFile abstraction by using it to implement six case studies: resource management, copy-on-write versioning, data redaction, resource-aware directories, application-aware adaptation, and platform-specific encoding. Most quFile policies were expressed using less than one hundred lines of code. Our experimental results show that, with caching and other performance optimizations, quFiles add less than 1% overhead to application-level file system benchmarks.

References

[1]

ANAND, M., NIGHTINGALE, E. B., AND FLINN, J. Self-tuning wireless network power management. In Proceedings of the 9th Annual Conference on Mobile Computing and Networking (San Diego, CA, September 2003), pp. 176-189.

Digital Library

[2]

BELARAMANI, N., DAHLIN, M., GAO, L., NAYATE, A., VENKATARAMANI, A., YALAGANDULA, P., AND ZHENG, J. PRACTI Replication. In Proceedings of the 3rd Symposium on Networked System Design and Implementation (San Jose, CA, May 2006), pp. 59-72.

Digital Library

[3]

BERSHAD, B., SAVAGE, S., PARDYAK, P., SIRER, E., FIUCZYNSKI, M., BECKER, D., CHAMBERS, C., AND EGGERS, S. Extensibility, safety and performance in the SPIN operating system. In Proceedings of the 15th ACM Symposium on Operating Systems Principles (Copper Mountain, CO, Dec. 1995), pp. 267-284.

Digital Library

[4]

BERSHAD, B. B., AND PINKERTON, C. B. Watchdogs - extending the UNIX file system. Computer Systems 1, 2 (Spring 1988).

[5]

BILA, N., RONDA, T., MOHOMED, I., TRUONG, K. N., AND DE LARA, E. PageTailor: Reusable end-user customization for the mobile web. In Proceedings of the 5th International Conference on Mobile Systems, Applications and Services (San Juan, Puerto Rico, June 2007), pp. 16-29.

Digital Library

[6]

Bundle programming guide. http://developer.apple. com/documentation/CoreFoundation/Conceptual/ CFBundles/CFBundles.html.

[7]

DE LARA, E., KUMAR, R., WALLACH, D. S., AND ZWAENEPOEL, W. Collaboration and multimedia authoring on mobile devices. In Proceedings of the 1st International Conference on Mobile Systems, Applications and Services (San Francisco, CA, May 2003), pp. 287-301.

Digital Library

[8]

DE LARA, E., WALLACH, D. S., AND ZWAENEPOEL, W. Puppeteer: Component-based adaptation for mobile computing. In Proceedings of the 3rd USENIX Symposium on Internet Technologies and Systems (San Francisco, CA, March 2001), pp. 159-170.

Digital Library

[9]

DOURISH, P., EDWARDS, W. K., LAMARCA, A., LAMPING, J., PETERSEN, K., SALISBURY, M., TERRY, D. B., AND THORNTON, J. Extending document management systems with user-specific active properties. ACM Transactions on Information Systems 18, 2 (2000), 140-170.

Digital Library

[10]

ENGLER, D., KAASHOEK, M., AND J. O'TOOLE, J. Exokernel: An operating system architecture for application-level resource management. In Proceedings of the 15th ACM Symposium on Operating Systems Principles (Copper Mountain, CO, December 1995), pp. 251-266.

Digital Library

[11]

FLINN, J., AND SATYANARAYANAN, M. Energy-aware adaptation for mobile applications. In Proceedings of the 17th ACM Symposium on Operating Systems Principles (Kiawah Island, SC, December 1999), pp. 48-63.

Digital Library

[12]

FOX, A., GRIBBLE, S. D., BREWER, E. A., AND AMIR, E. Adapting to network and client variability via on-demand dynamic distillation. In Proceedings of the 7th International ACM Conference on Architectural Support for Programming Languages and Operating Systems (Cambridge, MA, October 1996), pp. 160-170.

Digital Library

[13]

Filesystem in Userspace. http://fuse.sourceforge.net/.

[14]

GEHANI, N. H., JAGADISH, H. V., AND ROOME, W. D. OdeFS: A file system interface to an object-oriented database. In Proceedings of the 20th International Conference on Very Large Databases (Santiago de Chile, Chile, September 1994), pp. 249- 260.

Digital Library

[15]

GIFFORD, D. K., JOUVELOT, P., SHELDON, M. A., AND O'TOOLE, J. W. Semantic file systems. In Proceedings of the 13th ACM Symposium on Operating Systems Principles (Pacific Grove, CA, October 1991), pp. 16-25.

Digital Library

[16]

GnuCash: Free Accounting Software. http://www.gnucash. org.

[17]

GUPTA, A., AND MUMICK, I. S. Maintenance of materialized views: Problems, techniques and applications. IEEE Quarterly Bulletin on Data Engineering; Special Issue on Materialized Views and Data Warehousing 18, 2 (1995), 3-18.

[18]

HOWARD, J. H., KAZAR, M. L., MENEES, S. G., NICHOLS, D. A., SATYANARAYANAN, M., SIDEBOTHAM, R. N., AND WEST, M. J. Scale and performance in a distributed file system. ACM Transactions on Computer Systems 6, 1 (February 1988).

Digital Library

[19]

IOANNIDIS, S., SIDIROGLOU, S., AND KEROMYTIS, A. D. Privacy as an operating system service. In Proceedings of the 1st conference on USENIX Workshop on Hot Topics in Security (Vancouver, B.C., Canada, 2006), pp. 45-50.

Digital Library

[20]

KISTLER, J. J., AND SATYANARAYANAN, M. Disconnected operation in the Coda file system. ACM Transactions on Computer Systems 10, 1 (February 1992).

Digital Library

[21]

KJÆR, K. A survey of context-aware middleware. In Proceedings of the IASTED International Conference on Software Engineering (Innsbruck, Austria, February 2007), pp. 148-155.

Digital Library

[22]

LOPRESTI, D. P., AND LAWRENCE, S. A. Information leakage through document redaction: attacks and countermeasures. In Proceedings of Document Recognition and Retrieval XII - International Symposium on Electronic Imaging (San Jose, CA, January 2005), pp. 183-190.

[23]

LOVE, R. Kernel Korner: Intro to inotify. Linux Journal, 139 (2005), 8.

Digital Library

[24]

NARAYANAN, D., FLINN, J., AND SATYANARAYANAN, M. Using history to improve mobile application adaptation. In Proceedings of the 2nd IEEE Workshop on Mobile Computing Systems and Applications (Monterey, CA, August 2000), pp. 30-41.

Digital Library

[25]

NICHOLSON, A. J., AND NOBLE, B. D. BreadCrumbs: Forecasting mobile connectivity. In Proceedings of the 14th International Conference on Mobile Computing and Networking (San Francisco, CA, September 2008), pp. 46-57.

Digital Library

[26]

NIGHTINGALE, E. B., AND FLINN, J. Energy-efficiency and storage flexibility in the Blue File System. In Proceedings of the 6th Symposium on Operating Systems Design and Implementation (San Francisco, CA, December 2004), pp. 363-378.

Digital Library

[27]

NOBLE, B. D., SATYANARAYANAN, M., NARAYANAN, D., TILTON, J. E., FLINN, J., AND WALKER, K. R. Agile application-aware adaptation for mobility. In Proceedings of the 16th ACM Symposium on Operating Systems Principles (Saint-Malo, France, October 1997), pp. 276-287.

Digital Library

[28]

NOKIA. Nokia Energy Profiler. http://www.forum. nokia.com/main/resources/development_process/ power_management/nokia_energy profiler/.

[29]

PEEK, D., AND FLINN, J. EnsemBlue: Integrating distributed storage and consumer electronics. In Proceedings of the 7th Symposium on Operating Systems Design and Implementation (Seattle, WA, November 2006), pp. 219-232.

Digital Library

[30]

PEEK, D., NIGHTINGALE, E. B., HIGGINS, B. D., KUMAR, P., AND FLINN, J. Sprockets: Safe extensions for distributed file systems. In Proceedings of the USENIX Annual Technical Conference (Santa Clara, CA, June 2007), pp. 115-128.

Digital Library

[31]

PETERSON, Z. N. J., AND BURNS, R. Ext3cow: A time-shifting file system for regulatory compliance. ACM Transacations on Storage 1, 2 (2005), 190-212.

Digital Library

[32]

PHAN, T., ZORPAS, G., AND BAGRODIA, R. Middleware support for reconciling client updates and data transcoding. In Proceedings of the 2nd International Conference on Mobile Systems, Applications and Services (Boston, MA, 2004), pp. 139-152.

Digital Library

[33]

PILLAI, P., KE, Y., AND CAMPBELL, J. Multi-fidelity storage. In Proceedings of the ACM 2nd International Workshop on Video Surveillance and Sensor Networks (New York, NY, 2004), pp. 72-79.

Digital Library

[34]

RAMASUBRAMANIAN, V., RODEHEFFER, T. L., TERRY, D. B., WALRAED-SULLIVAN, M., WOBBER, T., MARSHALL, C. C., AND VAHDAT, A. Cimbiosys: A platform for content-based partial replication. In Proceedings of the 6th Symposium on Networked System Design and Implementation (Boston, MA, April 2009), pp. 261-276.

Digital Library

[35]

RUSSINOVICH, M. E., AND SOLOMON, D. A. Advanced features of NTFS. Microsoft Windows Internals (2005), 719-721.

[36]

SALMON, B., SCHLOSSER, S. W., CRANOR, L. F., AND GANGER, G. R. Perspective: Semantic data management for the home. In Proceedings of the 7th USENIX Conference on File and Storage Technologies (San Francisco, CA, February 2009), pp. 167-182.

Digital Library

[37]

SANTRY, D. S., FEELEY, M. J., HUTCHINSON, N. C., VEITCH, A. C., CARTON, R. W., AND OFIR, J. Deciding when to forget in the Elephant file system. SIGOPS Operating Systems Review 33, 5 (1999), 110-123.

Digital Library

[38]

SCHILIT, B., ADAMS, N., AND WANT, R. Context-aware computing applications. In IEEE Workshop on Mobile Computing Systems and Applications (Santa Cruz, CA, 1994), pp. 85-90.

Digital Library

[39]

SELTZER, M. I., ENDO, Y., SMALL, C., AND SMITH, K. A. Dealing with disaster: Surviving misbehaved kernel extensions. In Proceedings of the 2nd Symposium on Operating Systems Design and Implementation (Seattle, Washington, October 1996), pp. 213-227.

Digital Library

[40]

SOHN, T., GRISWOLD, W. G., SCOTT, J., LAMARCA, A., CHAWATHE, Y., SMITH, I., AND CHEN, M. Experiences with Place Lab: an open source toolkit for location-aware computing. In Proceedings of the 28th International Conference on Software Engineering (Shanghai, China, May 2006), pp. 462-471.

Digital Library

[41]

Xerces-C++ XML Parser. http://xerces.apache.org/ xerces-c/.

[42]

YUMEREFENDI, A. R., MICKLE, B., AND COX, L. P. TightLip: Keeping applications from spilling the beans. In Proceedings of the 4th Symposium on Networked Systems Design and Implementation (Cambridge, MA, April 2007), pp. 159-172.

Digital Library

Cited By

Anand ABalachandran AAkella ASekar VSeshan S(2016)Enhancing video accessibility and availability using information-bound referencesIEEE/ACM Transactions on Networking10.1109/TNET.2015.241335224:2(1223-1236)Online publication date: 1-Apr-2016
https://dl.acm.org/doi/10.1109/TNET.2015.2413352
Devecsery DChow MDou XFlinn JChen PFlinn JLevy H(2014)Eidetic systemsProceedings of the 11th USENIX conference on Operating Systems Design and Implementation10.5555/2685048.2685090(525-540)Online publication date: 6-Oct-2014
https://dl.acm.org/doi/10.5555/2685048.2685090
Anand ABalachandran AAkella ASekar VSeshan SAlmeroth KMathy LPapagiannaki KMisra V(2013)Enhancing video accessibility and availability using information-bound referencesProceedings of the ninth ACM conference on Emerging networking experiments and technologies10.1145/2535372.2535393(345-356)Online publication date: 9-Dec-2013
https://dl.acm.org/doi/10.1145/2535372.2535393
Show More Cited By

quFiles: the right file at the right time
1. General and reference
  1. Cross-computing tools and techniques
2. Software and its engineering
  1. Software organization and properties
    1. Contextual software domains
      1. Operating systems

Recommendations

quFiles: The right file at the right time

A quFile is a unifying abstraction that simplifies data management by encapsulating different physical representations of the same logical data. Similar to a quBit (quantum bit), the particular representation of the logical data displayed by a quFile is ...
quFiles: a unifying abstraction for mobile data management
HotMobile '08: Proceedings of the 9th workshop on Mobile computing systems and applications

We introduce a unifying file system abstraction, called a quFile, that provides a new mechanism for implementing mobile data management policies. quFiles allow arbitrary data types to be bundled together without confusing the user. Similar to a quBit (...
HPDA: A hybrid parity-based disk array for enhanced performance and reliability

Flash-based Solid State Drive (SSD) has been productively shipped and deployed in large scale storage systems. However, a single flash-based SSD cannot satisfy the capacity, performance and reliability requirements of the modern storage systems that ...

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences

FAST'10: Proceedings of the 8th USENIX conference on File and storage technologies

February 2010

21 pages

Sponsors

USENIX Assoc: USENIX Assoc

In-Cooperation

SIGOPS: ACM Special Interest Group on Operating Systems

Publisher

USENIX Association

United States

Publication History

Published: 23 February 2010

Check for updates

Qualifiers

Article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

10
Total Citations
View Citations
0
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 11 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

Anand ABalachandran AAkella ASekar VSeshan S(2016)Enhancing video accessibility and availability using information-bound referencesIEEE/ACM Transactions on Networking10.1109/TNET.2015.241335224:2(1223-1236)Online publication date: 1-Apr-2016
https://dl.acm.org/doi/10.1109/TNET.2015.2413352
Devecsery DChow MDou XFlinn JChen PFlinn JLevy H(2014)Eidetic systemsProceedings of the 11th USENIX conference on Operating Systems Design and Implementation10.5555/2685048.2685090(525-540)Online publication date: 6-Oct-2014
https://dl.acm.org/doi/10.5555/2685048.2685090
Anand ABalachandran AAkella ASekar VSeshan SAlmeroth KMathy LPapagiannaki KMisra V(2013)Enhancing video accessibility and availability using information-bound referencesProceedings of the ninth ACM conference on Emerging networking experiments and technologies10.1145/2535372.2535393(345-356)Online publication date: 9-Dec-2013
https://dl.acm.org/doi/10.1145/2535372.2535393
Kim HAgrawal NUngureanu CBolosky WFlinn J(2012)Revisiting storage for smartphonesProceedings of the 10th USENIX conference on File and Storage Technologies10.5555/2208461.2208478(17-17)Online publication date: 14-Feb-2012
https://dl.acm.org/doi/10.5555/2208461.2208478
Kim HAgrawal NUngureanu C(2012)Revisiting storage for smartphonesACM Transactions on Storage10.1145/2385603.23856078:4(1-25)Online publication date: 6-Dec-2012
https://dl.acm.org/doi/10.1145/2385603.2385607
Veeraraghavan KLee DWester BOuyang JChen PFlinn JNarayanasamy S(2012)DoublePlayACM Transactions on Computer Systems10.1145/2110356.211035930:1(1-24)Online publication date: 1-Feb-2012
https://dl.acm.org/doi/10.1145/2110356.2110359
Veeraraghavan KLee DWester BOuyang JChen PFlinn JNarayanasamy S(2011)DoublePlayACM SIGPLAN Notices10.1145/1961296.195037046:3(15-26)Online publication date: 5-Mar-2011
https://dl.acm.org/doi/10.1145/1961296.1950370
Veeraraghavan KLee DWester BOuyang JChen PFlinn JNarayanasamy S(2011)DoublePlayACM SIGARCH Computer Architecture News10.1145/1961295.195037039:1(15-26)Online publication date: 5-Mar-2011
https://dl.acm.org/doi/10.1145/1961295.1950370
Veeraraghavan KLee DWester BOuyang JChen PFlinn JNarayanasamy SGupta RMowry T(2011)DoublePlayProceedings of the sixteenth international conference on Architectural support for programming languages and operating systems10.1145/1950365.1950370(15-26)Online publication date: 5-Mar-2011
https://dl.acm.org/doi/10.1145/1950365.1950370
Anand AGember AAkella ASekar VGkantsidis CPapagiannaki KSalonidis T(2010)Tracking semantic relationships for effective data management in home networksProceedings of the 2010 ACM SIGCOMM workshop on Home networks10.1145/1851307.1851320(49-54)Online publication date: 3-Sep-2010
https://dl.acm.org/doi/10.1145/1851307.1851320

View Options

View options

Figures

Tables

Media

View Table of Conten