A Scala API for Apache Beam and Google Cloud Dataflow.

A Scala feature transformation library for data science and machine learning

Code snippets for solving common big data problems in various platforms. Inspired by Rosetta Code

A Giter8 template for scio

A collection of Scio exercises inspired by Ruby Koans and many others.

Playground for Apache Beam and Scio experiments, driven by real-world use cases.

Community-supported add-ons for Scio

Learn how to develop and test stateful streaming and batch data pipelines

leverage cats type classes and data types in scio pipelines

Dataflow job to dump the content coming from a PubSub subscription into Cloud storage

Example of how to run Scio job with Dataflow Flex Template

A Scio extension that allows SPARQL to query a collection of triples

Collection of additional string interpolators to use in your scio pipeline

Functional Big Data Processing API

Main repository of IndexGADM

Learning challenge for Scala/Scio

Scio job to import discogs xml dumps into BigQuery

This repository contains a sample pipeline for starting with Scio, the Scala framework to develop Apache Beam pipelines. Fork this repository so you can commit your changes in your own repository.

WIP: Moving data from GCS to BigQuery.