DataSets helps make data wrangling code more reusable.
- We want to make it easy to relocate an algorithm between different data storage environments without code changes. For example from your laptop to the cloud, to another user's machine, or to an HPC system.
- We want to reduce coupling between data and code, by storing rich type information in metadata. Metadata bridges the gap between the ad hoc implicit type system of data outside your program and the Julia data structures within your program.
Watch DataSets.jl talk from JuliaCon 2021, or read the latest documentation more information.