article

Free access

Log files: an extended file service exploiting write-once storage

Authors:

D. CheritonAuthors Info & Claims

ACM SIGOPS Operating Systems Review, Volume 21, Issue 5

Pages 139 - 148

https://doi.org/10.1145/37499.37516

Published: 01 November 1987 Publication History

Abstract

A log service provides efficient storage and retrieval of data that is written sequentially (append-only) and not subsequently modified. Application programs and subsystems use log services for recovery, to record security audit trails, and for performance monitoring. Ideally, a log service should accommodate very large, long-lived logs, and provide efficient retrieval and low space overhead.

In this paper, we describe the design and implementation of the Clio log service. Clio provides the abstraction of log files: readable, append-only files that are accessed in the same way as conventional files. The underlying storage medium is required only to be append-only; more general types of write access are not necessary. We show how log files can be implemented efficiently and robustly on top of such storage media—in particular, write-once optical disk.

In addition, we describe a general application software storage architecture that makes use of log files.

This work was supported in part by the Defense Advanced Research Projects Agency under contracts N00039-84-C-0211 and N00039-86-K-0431, by National Science Foundation grant DCR-83-52048, and by Digital Equipment Corporation, Bell-Northern Research and AT&T Information Systems.

References

[1]

G. Ariav. A temporally oriented data model. ACM Transactions on Database Systems, 11(4):499-527, December 1986.

Digital Library

[2]

A. E. Bell. Optical data storage--a status report. Proceedings of the 6th IEEE Symposium on Mass Storage Systems, 93-98, 1984.

[3]

D. 1~. Cheriton. UIO: a uniform I/O system interface for distributed systems. A CM Transactions on Computer Systems, 5(1), February 1987.

Digital Library

[4]

D. R. Cheriton. The V kernel: a software base for distributed systems. IEEE Software, 1(2), April 1984.

[5]

G. Copeland. What if mass storage were free? Computer, 27-35, July 1982.

[6]

D. S. Daniels, A. Z. Spector, and D. S. Thompson. Distributed Logging for Transaction Processing. Technical Report CMU~CS-86-106, Carnegie-Mellon University, Department of Computer Science, June 1986.

[7]

J. Donahue and W-S. Orr. Walnut: Storing Electronic Mail in a Database. TechnicM Report CSL-85-9, Xerox Palo Alto Research Center, November 1985.

[8]

L. Fujitani. Laser optical disk: the coming revolution in online storage. Communications of the ACM, 27(6):546-554, June 1984.

Digital Library

[9]

S. L. Garfinkel. A file system for write-once media. October 1986. MIT Media Lab.

[10]

S. Mullender and A. Tanenbaum. A distributed file service based on optimistic concurrency control. Proceedings of the A CM Symposium on Operating System Principles, 51-62, December 1985.

Digital Library

[11]

J. K. Ousterhout et al. A trace-driven analysis of the Unix 4.2 BSD file system. Proceedings of the ACM Symposium on Operating System Principles, 15-24, December 1985.

Digital Library

[12]

P. Rathmann. Dynamic data structures on optical disks. Proceedings of the IEEE Data Engineering Conference, 175- 180, April 1984.

Digital Library

[13]

R. Snodgrass and I. Ahn. Temporal databases. Computer, 19(9):35-42, September 1986.

Digital Library

[14]

L. Svobodova. A reliable object-oriented data repository for a distributed computer system. Proceedings of the A CM Symposium on Operating System Principles, 47-58, December 1981.

Digital Library

[15]

J. F. Vitter. An efficient I/0 interface for optical disks. A CM Transactions on Database Systems, 10(2):129-162, June 1985.

Digital Library

Cited By

Le QAmer AHolliday J(2019)RAID 4SMR: RAID Array with Shingled Magnetic Recording Disk for Mass Storage SystemsJournal of Computer Science and Technology10.1007/s11390-019-1946-434:4(854-868)Online publication date: 19-Jul-2019
https://doi.org/10.1007/s11390-019-1946-4
Lin ZGopalan KYang P(2010)A Case for Secure Virtual Append-Only Storage for Virtual MachinesProceedings of the 2010 39th International Conference on Parallel Processing Workshops10.1109/ICPPW.2010.15(245-250)Online publication date: 13-Sep-2010
https://dl.acm.org/doi/10.1109/ICPPW.2010.15
(1994)LoggingIEEE Micro10.1109/MM.1994.36308614:5(62)Online publication date: 1-Oct-1994
https://dl.acm.org/doi/10.1109/MM.1994.363086
Show More Cited By

Index Terms

Log files: an extended file service exploiting write-once storage
1. Software and its engineering
  1. Software organization and properties
    1. Contextual software domains
      1. Operating systems
        File systems management
        Memory management
        Secondary storage

Recommendations

The design and implementation of a log-structured file system

This paper presents a new technique for disk storage management called a log-structured file system. A log-structured file system writes all modifications to disk sequentially in a log-like structure, thereby speeding up both file writing and crash ...
Log Files: An Extended File Service Exploiting Write-Once Storage
Log files: an extended file service exploiting write-once storage
SOSP '87: Proceedings of the eleventh ACM Symposium on Operating systems principles

A log service provides efficient storage and retrieval of data that is written sequentially (append-only) and not subsequently modified. Application programs and subsystems use log services for recovery, to record security audit trails, and for ...

Comments

Information & Contributors

Information

Published In

cover image ACM SIGOPS Operating Systems Review

ACM SIGOPS Operating Systems Review Volume 21, Issue 5

Nov. 1987

162 pages

ISSN:0163-5980

DOI:10.1145/37499

Editor:
William M. Waite

Issue’s Table of Contents

SOSP '87: Proceedings of the eleventh ACM Symposium on Operating systems principles
November 1987
162 pages
ISBN:089791242X
DOI:10.1145/41457
Chairman:
Les Belady

Copyright © 1987 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 01 November 1987

Published in SIGOPS Volume 21, Issue 5

Check for updates

Qualifiers

Article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

52
Total Citations
View Citations
861
Total Downloads

Downloads (Last 12 months)107
Downloads (Last 6 weeks)17

Reflects downloads up to 17 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

Le QAmer AHolliday J(2019)RAID 4SMR: RAID Array with Shingled Magnetic Recording Disk for Mass Storage SystemsJournal of Computer Science and Technology10.1007/s11390-019-1946-434:4(854-868)Online publication date: 19-Jul-2019
https://doi.org/10.1007/s11390-019-1946-4
Lin ZGopalan KYang P(2010)A Case for Secure Virtual Append-Only Storage for Virtual MachinesProceedings of the 2010 39th International Conference on Parallel Processing Workshops10.1109/ICPPW.2010.15(245-250)Online publication date: 13-Sep-2010
https://dl.acm.org/doi/10.1109/ICPPW.2010.15
(1994)LoggingIEEE Micro10.1109/MM.1994.36308614:5(62)Online publication date: 1-Oct-1994
https://dl.acm.org/doi/10.1109/MM.1994.363086
Weiler BNett E(1994)Speed LogIEEE Micro10.1109/MM.1994.36306614:5(60-71)Online publication date: 1-Oct-1994
https://dl.acm.org/doi/10.1109/MM.1994.363066
Talwadker RChen DDesnoyers Pde Lara E(2017)DexterProceedings of the 10th ACM International Systems and Storage Conference10.1145/3078468.3078484(1-12)Online publication date: 22-May-2017
https://dl.acm.org/doi/10.1145/3078468.3078484
McCune RWeninger TMadey G(2015)Thinking Like a VertexACM Computing Surveys10.1145/281818548:2(1-39)Online publication date: 12-Oct-2015
https://dl.acm.org/doi/10.1145/2818185
Illiano VLupu E(2015)Detecting Malicious Data Injections in Wireless Sensor NetworksACM Computing Surveys10.1145/281818448:2(1-33)Online publication date: 12-Oct-2015
https://dl.acm.org/doi/10.1145/2818184
Bernstein PDas SDing BPilman MSellis TDavidson SIves Z(2015)Optimizing Optimistic Concurrency Control for Tree-Structured, Log-Structured DatabasesProceedings of the 2015 ACM SIGMOD International Conference on Management of Data10.1145/2723372.2737788(1295-1309)Online publication date: 27-May-2015
https://dl.acm.org/doi/10.1145/2723372.2737788
Sahri SSchwarz TJ. S(2014)Design Issues of Shingled Write Disk for DatabaseJournal of Computers10.4304/jcp.9.10.2247-22579:10Online publication date: 30-Oct-2014
https://doi.org/10.4304/jcp.9.10.2247-2257
Balakrishnan MMalkhi DWobber TWu MPrabhakaran VWei MDavis JRao SZou TZuck AKaminsky MDahlin M(2013)TangoProceedings of the Twenty-Fourth ACM Symposium on Operating Systems Principles10.1145/2517349.2522732(325-340)Online publication date: 3-Nov-2013
https://dl.acm.org/doi/10.1145/2517349.2522732
Show More Cited By

View Options

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

Figures

Tables

Media

View Issue’s Table of Contents