Displaying 1 to 20 from 44 results

google-cloud-node - Google Cloud Client Library for Node.js

  •    Javascript

Node.js idiomatic client for Google Cloud Platform services.If you need support for other Google APIs, check out the Google Node.js API Client library.

scio - A Scala API for Apache Beam and Google Cloud Dataflow.

  •    Scala

Verb: I can, know, understand, have knowledge.Scio is a Scala API for Apache Beam and Google Cloud Dataflow inspired by Apache Spark and Scalding.

franchise - 🍟 a notebook sql client. what you get when have a lot of sequels.

  •    Javascript

Franchise is a lightweight but powerful SQL tool with a notebook interface. You can use it online at franchise.cloud. There's an online version of franchise right here. There are also instructions for building franchise to static files here.

redash - Make Your Company Data Driven

  •    Python

Redash is our take on freeing the data within our company in a way that will better fit our culture and usage patterns. Prior to Redash, we tried to use traditional BI suites and discovered a set of bloated, technically challenged and slow tools/flows. What we were looking for was a more hacker'ish way to look at data, so we built one.

Elasticsearch-Exporter - A small script to export data from one Elasticsearch cluster into another.

  •    Javascript

A command line script to import/export data from ElasticSearch to various other storage systems. This is a brand new implementation with lots of bugs and way too little time to test everything for one lonely developer, so please consider this beta at best and provide feedback, bug reports and maybe even patches.

generate-schema - Convert JSON Objects to MySQL Schema, JSON Schema, Mongoose Schema, Google BigQuery, or a Generic template for Swagger files, documentation, code generation, and more

  •    Javascript

Convert JSON Objects to MySQL Table Schema, JSON Schema, Mongoose Schema, ClickHouse Schema, Google BigQuery, or a Generic template for documentation, code generation, and more. Optionally, add -g to the above if you want the generate-schema command line executable.

bigrquery - An interface to Google's bigquery from R.

  •    R

The low-level API provides thin wrappers over the underlying REST API. All the low-level functions start with bq_, and mostly have the form bq_noun_verb(). This level of abstraction is most appropriate if you’re familiar with the REST API and you want do something not supported in the higher-level APIs. The DBI interface wraps the low-level API and makes working with BigQuery like working with any other database system. This is most convenient layer if you want to execute SQL queries in BigQuery or upload smaller amounts (i.e. <100 MB) of data.

feast - Feature Store for Machine Learning

  •    Java

Feast (Feature Store) is a tool to manage storage and access of machine learning features. Access to features in serving: Machine learning models typically require access to features created in both batch pipelines, and real time streams. Feast provides a means for accessing these features in a serving environment, at low latency and high load.

BigQuery-Python - Simple Python client for interacting with Google BigQuery.

  •    Python

Simple Python client for interacting with Google BigQuery.This client provides an API for retrieving and inserting BigQuery data by wrapping Google's low-level API client library. It also provides facilities that make it convenient to access data that is tied to an App Engine appspot, such as request logs.

pypinfo - Easily view PyPI download statistics via Google's BigQuery.

  •    Python

pypinfo is a simple CLI to access PyPI download statistics via Google's BigQuery.Hatch is distributed on PyPI as a universal wheel and is available on Linux/macOS and Windows and supports Python 3.5+ and PyPy.

LINQ-to-BigQuery - LINQ to BigQuery is C# LINQ Provider for Google BigQuery

  •    CSharp

LINQ to BigQuery is C# LINQ Provider for Google BigQuery. It also enables Desktop GUI Client with LINQPad and plug-in driver.LINQPad Driver can install from LINQ Pad driver gallery. "Add connection" -> "View more drivers..." -> clcik "LINQ to BigQuery" - "Download & Enabled driver" link. Note:Configuration's JSON is OAuth2 JSON Generate from GCP Management Page.

ratatool - A tool for random data sampling and generation

  •    Scala

Or download the release jar and run it.The command line tool can be used to sample from local file system or Google Cloud Storage directly if Google Cloud SDK is installed and authenticated.

pandas-gbq - Pandas Google Big Query

  •    Python

See the pandas-gbq documentation for more details.

node-google-bigquery - Google BigQuery API using service account credentials.

  •    Javascript

Copy your .pem file to the 'test' folder, and then run the tests using mocha or npm test. Notice: these tests are going to be hitting your bigquery account directly, so I recommend setting a tests project, and setting the mocha timeout to 10 seconds (mocha --timeout 10000 test/tests.js).

shapeless-datatype - Shapeless utilities for common data types

  •    Scala

This library includes the following modules. Due to library dependency shapeless-datatype-datastore is built for different versions of Datastore client, e.g. shapeless-datatype-datastore_1.3 for datastore-v1-proto-client 1.3.0.

lambda-kinesis-bigquery - AWS Lambda function for insert Kinesis event to Google BigQuery

  •    Javascript

AWS Lambda function for insert Kinesis event to Google BigQuery example. Wait role is created.

mongobq - Command Line Tool to import MongoDB collection into BigQuery

  •    Javascript

mongobq is a command line tool to import MongoDB collection into BigQuery. mongobq >= 0.2.0 only works with node >= 0.12.0. You want to use with node 0.10 or below, use 0.1.4.

mara-example-project - An example mini data warehouse for python project stats, template for new projects

  •    Python

A runnable app that demonstrates how to build a data warehouse with mara. Combines the data-integration and bigquery-downloader libraries with the mara-app framework into a project. The example ETL integrates PyPi download stats and GitHub repo activitiy metrics into more general Python project activity stats.

bigtsquery - Search Engine for TypeScript Code using AST Queries

  •    TypeScript

Run TypeScript AST Queries across all public TypeScript code on GitHub. Copyright (C) 2018, Uri Shaked. The code in this repo is published under the MIT license.