BigQuery-Python - Simple Python client for interacting with Google BigQuery.

  •        88

Simple Python client for interacting with Google BigQuery.This client provides an API for retrieving and inserting BigQuery data by wrapping Google's low-level API client library. It also provides facilities that make it convenient to access data that is tied to an App Engine appspot, such as request logs.

https://github.com/tylertreat/BigQuery-Python

Tags
Implementation
License
Platform

   




Related Projects

generate-schema - Convert JSON Objects to MySQL Schema, JSON Schema, Mongoose Schema, Google BigQuery, or a Generic template for Swagger files, documentation, code generation, and more

  •    Javascript

Convert JSON Objects to MySQL Table Schema, JSON Schema, Mongoose Schema, ClickHouse Schema, Google BigQuery, or a Generic template for documentation, code generation, and more. Optionally, add -g to the above if you want the generate-schema command line executable.

ipython-soccer-predictions - Sample iPython notebook with soccer predictions

  •    Python

We’ve had a great time giving you our predictions for the World Cup (check out our post before the quarter finals and the one before the semi-finals). So far, we’ve gotten 13 of 14 games correct. But this shouldn’t be about what we did - it’s about what you can do with Google Cloud Platform. Now, we are open-sourcing our prediction model and packaging it up so you can do your own analysis and predictions.We have ingested raw touch-by-touch gameplay day from Opta for thousands of soccer matches using Google Cloud Dataflow and polished the raw data into predictive statistics using Google BigQuery. You can see BigQuery engineer Jordan Tigani (+JordanTigani) and developer advocate Felipe Hoffa (@felipehoffa) talk about how we did it in this video from Google I/O.

bigrquery - An interface to Google's bigquery from R.

  •    R

The low-level API provides thin wrappers over the underlying REST API. All the low-level functions start with bq_, and mostly have the form bq_noun_verb(). This level of abstraction is most appropriate if you’re familiar with the REST API and you want do something not supported in the higher-level APIs. The DBI interface wraps the low-level API and makes working with BigQuery like working with any other database system. This is most convenient layer if you want to execute SQL queries in BigQuery or upload smaller amounts (i.e. <100 MB) of data.

python-bigquery

  •    Python

Querying massive datasets can be time consuming and expensive without the right hardware and infrastructure. Google BigQuery solves this problem by enabling super-fast, SQL queries against append-mostly tables, using the processing power of Google's infrastructure. Install this library in a virtualenv using pip. virtualenv is a tool to create isolated Python environments. The basic problem it addresses is one of dependencies and versions, and indirectly permissions.

Cube.js — Open-Source Analytical API Platform

  •    Javascript

Cube.js is an open-source analytical API platform. It is primarily used to build internal business intelligence tools or add customer-facing analytics to existing applications. Cube.js was designed to work with serverless data warehouses and query engines like Google BigQuery and AWS Athena. A multi-stage querying approach makes it suitable for handling trillions of data points. Most modern RDBMS work with Cube.js as well and can be further tuned for performance.


datalab - Interactive tools and developer experiences for Big Data on Google Cloud Platform.

  •    Jupyter

Google Cloud DataLab provides a productive, interactive, and integrated tool to explore, visualize, analyze and transform data, bringing together the power of Python, SQL, and the Google Cloud Platform with services such as BigQuery and Storage.

google-cloud-node - Google Cloud Client Library for Node.js

  •    Javascript

Node.js idiomatic client for Google Cloud Platform services.If you need support for other Google APIs, check out the Google Node.js API Client library.

google-cloud-go - Google Cloud Client Libraries for Go

  •    Go

Go packages for Google Cloud Platform services.NOTE: Some of these packages are under development, and may occasionally make backwards-incompatible changes.

scio - A Scala API for Apache Beam and Google Cloud Dataflow.

  •    Scala

Verb: I can, know, understand, have knowledge.Scio is a Scala API for Apache Beam and Google Cloud Dataflow inspired by Apache Spark and Scalding.

google-cloud-go - Google Cloud Client Libraries for Go.

  •    Go

Go packages for Google Cloud Platform services. NOTE: Some of these packages are under development, and may occasionally make backwards-incompatible changes.

GrowthBook - The Open Source A/B Testing Platform

  •    Typescript

Growth Book is an open source experimentation platform designed for companies that want to bring A/B testing in-house, but don't want to build it themselves. It supports experimentation with deep code integration or using a visual front-end editor.

github_globe - A visualization of GitHub users throughout the globe

  •    Javascript

All data is provided by GitHub Archive and fetched via Google BigQuery. Locations are provided by approximately 1 million of the 4 million GitHub users. They are written in an informal syntax with varying specificity. For example, Seattle, Seattle, WA and United States are all valid.

AutoWebPerf - AutoWebPerf provides a flexible and scalable framework for running web performance audits with arbitrary audit tools including PageSpeedInsights, WebPageTest and more

  •    Javascript

AutoWebPerf provides a flexible and scalable framework for running web performance audits with arbitrary audit tools like WebPageTest and PageSpeedInsights. This library enables developers to collect metrics consistently and store metrics to a preferred data store such as local JSON files, Google Sheets, BigQuery, or an in-house SQL database. Check out https://web.dev/autowebperf for introduction.

AndroidViewClient - Android ViewServer client

  •    Python

😡 NOTE: Pypi statistics are broken see here. The new statistics can be obtained from BigQuery. Thanks to all who made it possible.

redash - Make Your Company Data Driven

  •    Python

Redash is our take on freeing the data within our company in a way that will better fit our culture and usage patterns. Prior to Redash, we tried to use traditional BI suites and discovered a set of bloated, technically challenged and slow tools/flows. What we were looking for was a more hacker'ish way to look at data, so we built one.

Elementary - Data observability platform for modern data teams that is open and transparent

  •    Python

Elementary was built out of the need to effortlessly and immediately gain visibility into the data stack, starting with tracing the actual upstream & downstream dependencies in the data warehouse, without any implementation efforts, security risks or compromises on accuracy.

tmi - TMI (Too Many Images) - discover your image weight on the web

  •    Javascript

Find out the image weight in your pages, compare to the BigQuery quantiles and discover what images you can optimize further. Verbose mode will show you a detailed summary of which images needs improving.

franchise - 🍟 a notebook sql client. what you get when have a lot of sequels.

  •    Javascript

Franchise is a lightweight but powerful SQL tool with a notebook interface. You can use it online at franchise.cloud. There's an online version of franchise right here. There are also instructions for building franchise to static files here.






We have large collection of open source products. Follow the tags from Tag Cloud >>


Open source products are scattered around the web. Please provide information about the open source projects you own / you use. Add Projects.