Article

Differencing Data Streams

Author:

Sudarshan S. ChawatheAuthors Info & Claims

IDEAS '05: Proceedings of the 9th International Database Engineering & Application Symposium

Pages 273 - 284

https://doi.org/10.1109/IDEAS.2005.21

Published: 25 July 2005 Publication History

Publisher Site

Abstract

We present external-memory algorithms for differencing large hierarchical datasets. Our methods are especially suited to streaming data with bounded differences. For input sizes m and n and maximum output (difference) size e, the I/O, RAM, and CPU costs of our algorithm rdiff are, respectively, m + n, 4e + 8, and O(MN). That is, given 4e + 8 blocks of RAM, our algorithm performs no I/O operations other than those required to read both inputs. We also present a variant of the algorithm that uses only four blocks of RAM, with I/O cost 8me+18m+n+6e+5 and CPU cost O(MN).

Cited By

View all

Chawathe SDesai BCho W(2020)Organizing and compressing collections of files using differencesProceedings of the 24th Symposium on International Database Engineering & Applications10.1145/3410566.3410584(1-10)Online publication date: 12-Aug-2020
https://dl.acm.org/doi/10.1145/3410566.3410584
Agarwal DBarman DGunopulos DYoung NKorn FSrivastava DBerkhin PCaruana RWu X(2007)Efficient and effective explanation of change in hierarchical summariesProceedings of the 13th ACM SIGKDD international conference on Knowledge discovery and data mining10.1145/1281192.1281197(6-15)Online publication date: 12-Aug-2007
https://dl.acm.org/doi/10.1145/1281192.1281197

Index Terms

Differencing Data Streams

Recommendations

Statistical log differencing
ASE '19: Proceedings of the 34th IEEE/ACM International Conference on Automated Software Engineering

Recent works have considered the problem of log differencing: given two or more system's execution logs, output a model of their differences. Log differencing has potential applications in software evolution, testing, and security.

In this paper we ...
Using finite-state models for log differencing
ESEC/FSE 2018: Proceedings of the 2018 26th ACM Joint Meeting on European Software Engineering Conference and Symposium on the Foundations of Software Engineering

Much work has been published on extracting various kinds of models from logs that document the execution of running systems. In many cases, however, for example in the context of evolution, testing, or malware analysis, engineers are interested not only ...
Space-efficient Relative Error Order Sketch over Data Streams
ICDE '06: Proceedings of the 22nd International Conference on Data Engineering

We consider the problem of continuously maintaining order sketches over data streams with a relative rank error guarantee ∊. Novel space-efficient and one-scan randomised techniques are developed. Our first randomised algorithm can guarantee such a ...

Comments

Information & Contributors

Information

Published In

IDEAS '05: Proceedings of the 9th International Database Engineering & Application Symposium

July 2005

420 pages

ISBN:0769524044

Publisher

IEEE Computer Society

United States

Publication History

Published: 25 July 2005

Qualifiers

Article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

2
Total Citations
View Citations
0
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 27 Jul 2024

Other Metrics

View Author Metrics

Citations

Cited By

View all

Chawathe SDesai BCho W(2020)Organizing and compressing collections of files using differencesProceedings of the 24th Symposium on International Database Engineering & Applications10.1145/3410566.3410584(1-10)Online publication date: 12-Aug-2020
https://dl.acm.org/doi/10.1145/3410566.3410584
Agarwal DBarman DGunopulos DYoung NKorn FSrivastava DBerkhin PCaruana RWu X(2007)Efficient and effective explanation of change in hierarchical summariesProceedings of the 13th ACM SIGKDD international conference on Knowledge discovery and data mining10.1145/1281192.1281197(6-15)Online publication date: 12-Aug-2007
https://dl.acm.org/doi/10.1145/1281192.1281197

Abstract

Cited By

Index Terms

Recommendations

Statistical log differencing

Using finite-state models for log differencing

Space-efficient Relative Error Order Sketch over Data Streams

Comments

Information

Published In

Publisher

Publication History

Qualifiers

Contributors

Other Metrics

Bibliometrics

Article Metrics

Other Metrics

Citations

Cited By

View options

Figures

Other

Share

Share this Publication link

Share on social media

Affiliations