We have collection of more than 1 Million open source products ranging from Enterprise product to small libraries in all platforms. We aggregate information from all open source repositories. Search and find the best for your needs. Check out projects section.
pipeline - PipelineAI: Real-Time Enterprise AI Platform
Each model is built into a separate Docker image with the appropriate Python, C++, and Java/Scala Runtime Libraries for training or prediction. Use the same Docker Image from Local Laptop to Production to avoid dependency surprises.
machine-learning artificial-intelligence tensorflow kubernetes elasticsearch cassandra ipython spark kafka netflixoss presto airflow pipeline jupyter-notebook zeppelin docker redis neural-network gpu microservicesAgile_Data_Code_2 - Code for Agile Data Science 2.0, O'Reilly 2017, Second Edition
Like my work? I am Principal Consultant at Data Syndrome, a consultancy offering assistance and training with building full-stack analytics products, applications and systems. Find us on the web at datasyndrome.com. There is now a video course using code from chapter 8, Realtime Predictive Analytics with Kafka, PySpark, Spark MLlib and Spark Streaming. Check it out now at datasyndrome.com/video.
data-syndrome data data-science analytics apache-spark apache-kafka kafka spark predictive-analytics machine-learning machine-learning-algorithms airflow python-3 python3 amazon-ec2 agile-data agile-data-science vagrant amazon-web-servicesawesome-apache-airflow - Curated list of resources about Apache Airflow
This is a curated list of resources about Apache Airflow (incubating). Please feel free to contribute any items that should be included. Items are generally added at the top of each section so that more fresh items are featured more prominently.
airflow apache-airflow workflow-managementairflow-docker - Apache Airflow Docker Image.
This repository contains Dockerfile of apache-airflow for Docker's automated build published to the public Docker Hub Registry. Pull the image from the Docker repository.
docker airflow scheduler workflowairflow-operator - Kubernetes custom controller and CRDs to managing Airflow
This is not an officially supported Google product. The Airflow Operator is still under active development and has not been extensively tested in production environment. Backward compatibility of the APIs is not guaranteed for alpha releases.
kubernetes kubernetes-operator apache-airflow airflow crd kubernetes-controller workflow-engineairflow-prometheus-exporter - Export Airflow metrics (from mysql) in prometheus format
Export airflow metrics in Prometheus format. Requires Go. Tested with Go 1.9+.
airflow mysql prometheus exporter metrics apache-airflow apachedag-factory - Dynamically generate Apache Airflow DAGs from YAML configuration files
dag-factory is a library for dynamically generating Apache Airflow DAGs from YAML configuration files. To install dag-factory run pip install dag-factory. It requires Python 3.6.0+ and Apache Airflow 1.9+.
airflow apache-airflow dagsdiscreETLy - ETLy is an add-on dashboard service on top of Apache Airflow.
DiscreETLy is an add-on dashboard service on top of Apache Airflow. It is a user friendly UI showing status of particular DAGs. Moreover, it allows the users to map Tasks within a particular DAG to tables available in any system (relational and non-relational) via friendly yaml definition. DiscreETLy provides fuctionality for monitoring DAGs status as well as optional communication with services such as Prometheus or InfluxDB. Minimal setup required to run the dashboard requires docker. You can find docker installation instructions on official docker website.
etl edt-dashboard airflow
We have large collection of open source products. Follow the tags from
Tag Cloud >>
Open source products are scattered around the web. Please provide information
about the open source projects you own / you use.
Add Projects.
