scio - A Scala API for Apache Beam and Google Cloud Dataflow.

  •        41

Verb: I can, know, understand, have knowledge.Scio is a Scala API for Apache Beam and Google Cloud Dataflow inspired by Apache Spark and Scalding.

http://spotify.github.io/scio/com/spotify/scio/
https://github.com/spotify/scio

Tags
Implementation
License
Platform

   




Related Projects

DataflowJavaSDK - Google Cloud Dataflow provides a simple, powerful model for building both batch and streaming parallel data processing pipelines

  •    Java

Google Cloud Dataflow SDK for Java is a distribution of Apache Beam designed to simplify usage of Apache Beam on Google Cloud Dataflow service. This artifact includes the parent POM for other Dataflow SDK artifacts.

ipython-soccer-predictions - Sample iPython notebook with soccer predictions

  •    Python

We’ve had a great time giving you our predictions for the World Cup (check out our post before the quarter finals and the one before the semi-finals). So far, we’ve gotten 13 of 14 games correct. But this shouldn’t be about what we did - it’s about what you can do with Google Cloud Platform. Now, we are open-sourcing our prediction model and packaging it up so you can do your own analysis and predictions.We have ingested raw touch-by-touch gameplay day from Opta for thousands of soccer matches using Google Cloud Dataflow and polished the raw data into predictive statistics using Google BigQuery. You can see BigQuery engineer Jordan Tigani (+JordanTigani) and developer advocate Felipe Hoffa (@felipehoffa) talk about how we did it in this video from Google I/O.

Apache Beam - Unified model for defining both batch and streaming data-parallel processing pipelines

  •    Java

Apache Beam is an open source, unified model for defining both batch and streaming data-parallel processing pipelines. Using one of the open source Beam SDKs, you build a program that defines the pipeline. The pipeline is then executed by one of Beam’s supported distributed processing back-ends, which include Apache Apex, Apache Flink, Apache Spark, and Google Cloud Dataflow.

google-cloud-go - Google Cloud Client Libraries for Go

  •    Go

Go packages for Google Cloud Platform services.NOTE: Some of these packages are under development, and may occasionally make backwards-incompatible changes.

google-cloud-go - Google Cloud Client Libraries for Go.

  •    Go

Go packages for Google Cloud Platform services. NOTE: Some of these packages are under development, and may occasionally make backwards-incompatible changes.


google-cloud-node - Google Cloud Client Library for Node.js

  •    Javascript

Node.js idiomatic client for Google Cloud Platform services.If you need support for other Google APIs, check out the Google Node.js API Client library.

datalab - Interactive tools and developer experiences for Big Data on Google Cloud Platform.

  •    Jupyter

Google Cloud DataLab provides a productive, interactive, and integrated tool to explore, visualize, analyze and transform data, bringing together the power of Python, SQL, and the Google Cloud Platform with services such as BigQuery and Storage.

nodejs-speech - Node

  •    Javascript

The Cloud Speech API enables easy integration of Google speech recognition technologies into developer applications. Send audio and receive a text transcription from the Cloud Speech API service. Select or create a Cloud Platform project.

cloud-functions-emulator - A local emulator for Google Cloud Functions that allows you to deploy, run, and debug your Cloud Functions on your local machine before deploying them to the production Google Cloud Functions service

  •    Javascript

Disclaimer: This is not an official Google product.The Google Cloud Functions Emulator is a Node.js application that implements the Google Cloud Functions API, and includes a CLI with which you can manage the application.

berglas - A tool for managing secrets on Google Cloud

  •    Go

Berglas is a command line tool and library for storing and and retrieving secrets on Google Cloud. Secrets are encrypted with Cloud KMS and stored in Cloud Storage. As a CLI, berglas automates the process of encrypting, decrypting, and storing data on Google Cloud.

nodejs-storage - Node

  •    TypeScript

Node.js idiomatic client for Cloud Storage. Cloud Storage allows world-wide storage and retrieval of any amount of data at any time. You can use Google Cloud Storage for a range of scenarios including serving website content, storing data for archival and disaster recovery, or distributing large data objects to users via direct download.

Node.js client for Dialogflow - Design and integrate a conversational user interface into your applications and devices.

  •    Javascript

Dialogflow is an enterprise-grade NLU platform that makes it easy for developers to design and integrate conversational user interfaces into mobile apps, web applications, devices, and bots. Select or create a Cloud Platform project.

functions-samples - Collection of sample apps showcasing popular use cases using Cloud Functions for Firebase

  •    Javascript

This repository contains a collection of samples showcasing some typical uses of Cloud Functions for Firebase.Cloud Functions is a hosted, private, and scalable Node.js environment where you can run JavaScript code. Cloud Functions for Firebase integrates the Firebase platform by letting you write code that responds to events and invokes functionality exposed by other Firebase features.

google-cloud-php - Google Cloud Client Library for PHP

  •    PHP

Idiomatic PHP client for Google Cloud Platform services.If you need support for other Google APIs, please check out the Google APIs Client Library for PHP.

google-cloud-node - Google Cloud Client Library for Node.js

  •    

Node.js idiomatic client for Google Cloud Platform services. If you need support for other Google APIs, check out the Google Node.js API Client library.

google-cloud-php - Google Cloud Client Library for PHP

  •    PHP

Idiomatic PHP client for Google Cloud Platform services. If you need support for other Google APIs, please check out the Google APIs Client Library for PHP.

google-api-java-client - Google APIs Client Library for Java

  •    Java

These client libraries are officially supported by Google. However, these libraries are considered complete and are in maintenance mode. This means that we will address critical bugs and security issues, but will not add any new features. If you're working with Google Cloud Platform APIs such as Datastore, Pub/Sub and many others, consider using the Cloud Client Libraries for Java instead. These are the new and idiomatic Java libraries targeted specifically at Google Cloud Platform Services. The Google APIs Client Library for Java is a flexible, efficient, and powerful Java client library for accessing any HTTP-based API on the web, not just Google APIs.

google-cloud-ruby - Google Cloud Client Library for Ruby

  •    Ruby

Idiomatic Ruby client for Google Cloud Platform services.The support for each service is distributed as a separate gem. However, for your convenience, the google-cloud gem lets you install the entire collection.