Abstract
Array DBMSs extend the set of supported data structures in databases with (potentially large) multi-dimensional arrays. This information category actually comprises a core data structure in many scientific applications.
When it comes to Petabyte archives, storage costs prohibit importing (i.e., copying) such data into a database. Therefore, in-situ processing of database queries is required, that is: evaluating queries on the original files, without previous insertion into the database. We have implemented such an in-situ feature for the rasdaman Array DBMS. In this demonstration, we show with rasdaman how query processing in array databases can simultaneously rely on arrays stored in the database — as usual — and in operating system files, like preexisting archives.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
EarthServer - Big Earth Data Analytics (seen on March 8, 2013)
GDAL - Geospatial Data Abstraction Library (seen on March 8, 2013)
ISO/IEC 9075-9:2008 Information technology - Database languages - SQL - Part 9: Management of External Data (SQL/MED)
Oracle bfile (seen on March 8, 2013)
Scidb (seen on March 8, 2013)
Baumann, P.: On the management of multi-dimensional discrete data. VLDB Journal 4(3), 401–444 (1994)
Baumann, P., Feyzabadi, S., Jucovschi, C.: Putting pixels in place: A storage layout language for scientific data. In: Proc. 10th ICDM, December 14, pp. 194–201 (2010)
Baumann, P., Jucovschi, C., Stancu-Mara, S.: Efficient map portrayal using a general-purpose query language. In: Bhowmick, S.S., Küng, J., Wagner, R. (eds.) DEXA 2009. LNCS, vol. 5690, pp. 153–163. Springer, Heidelberg (2009)
Alagiannis, I., et al.: NoDB: efficient query execution on raw data files. In: Proc. ACM SIGMOD, May 20, pp. 241–252. ACM (2012)
Ivanova, M., Kersten, M., Manegold, S.: Data vaults: A symbiosis between database technology and scientific file repositories. In: Ailamaki, A., Bowers, S. (eds.) SSDBM 2012. LNCS, vol. 7338, pp. 485–494. Springer, Heidelberg (2012)
Kersten, M., Zhang, Y., Ivanova, M., Nes, N.: SciQL, a query language for science applications. In: Proc. Workshop on Array Databases, March 25 (2011)
Machlin, R.: Index-based multidimensional array queries: safety and equivalence. In: Proc. ACM PoDS, pp. 175–184 (2007)
Widmann, N., Baumann, P.: Performance evaluation of multidimensional array storage techniques in databases. In: Proc. IDEAS, pp. 408–413 (1999)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2013 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Baumann, P., Dumitru, A.M., Merticariu, V. (2013). The Array Database That Is Not a Database: File Based Array Query Answering in Rasdaman. In: Nascimento, M.A., et al. Advances in Spatial and Temporal Databases. SSTD 2013. Lecture Notes in Computer Science, vol 8098. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-40235-7_32
Download citation
DOI: https://doi.org/10.1007/978-3-642-40235-7_32
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-40234-0
Online ISBN: 978-3-642-40235-7
eBook Packages: Computer ScienceComputer Science (R0)