Building Scalable and Consistent Distributed Databases Under Conflicts
Loading...
Files
Date
2018-04-12
Authors
Fan, Hua
Journal Title
Journal ISSN
Volume Title
Publisher
University of Waterloo
Abstract
Distributed databases, which rely on redundant and distributed storage across multiple
servers, are able to provide mission-critical data management services at large scale. Parallelism
is the key to the scalability of distributed databases, but concurrent queries having
conflicts may block or abort each other when strong consistency is enforced using rigorous
concurrency control protocols. This thesis studies the techniques of building scalable distributed
databases under strong consistency guarantees even in the face of high contention
workloads. The techniques proposed in this thesis share a common idea, conflict mitigation,
meaning mitigating conflicts by rescheduling operations in the concurrency control in the first
place instead of resolving contending conflicts. Using this idea, concurrent queries
under conflicts can be executed with high parallelism. This thesis explores this idea on
both databases that support serializable ACID (atomic, consistency, isolation, durability)
transactions, and eventually consistent NoSQL systems.
First, the epoch-based concurrency control (ECC) technique is proposed in ALOHA-KV,
a new distributed key-value store that supports high performance read-only and write-only
distributed transactions. ECC demonstrates that concurrent serializable distributed
transactions can be processed in parallel with low overhead even under high contention.
With ECC, a new atomic commitment protocol is developed that only requires amortized
one round trip for a distributed write-only transaction to commit in the absence of failures.
Second, a novel paradigm of serializable distributed transaction processing is developed
to extend ECC with read-write transaction processing support. This paradigm uses a
newly proposed database operator, functors, which is a placeholder for the value of a key,
which can be computed asynchronously in parallel with other functor computations of the
same or other transactions. Functor-enabled ECC achieves more fine-grained concurrency
control than transaction level concurrency control, and it never aborts transactions due
to read-write or write-write conflicts but allows transactions to fail due to logic errors or
constraint violations while guaranteeing serializability.
Lastly, this thesis explores consistency in the eventually consistent system, Apache
Cassandra, for an investigation of the consistency violation, referred to as "consistency
spikes". This investigation shows that the consistency spikes exhibited by Cassandra are
strongly correlated with garbage collection, particularly the "stop-the-world" phase in the
Java virtual machine. Thus, delaying read operations arti cially at servers immediately
after a garbage collection pause can virtually eliminate these spikes.
All together, these techniques allow distributed databases to provide scalable and
consistent storage service.
Description
Keywords
distributed database, distributed transaction, eventual consistency