54 best open source workflow engine projects.

We have collection of more than 1 Million open source products ranging from Enterprise product to small libraries in all platforms. We aggregate information from all open source repositories. Search and find the best for your needs. Check out projects section.

Displaying 1 to 20 from 54 results

azkaban - Azkaban workflow manager.

Java

Azkaban builds use Gradle and requires Java 8 or higher. The following set of commands run on *nix platforms like Linux, OS X.

workflow-engine azkaban scheduling

viewflow - Reusable workflow library for Django

Python

Viewflow is a lightweight reusable workflow library that helps to organize people collaboration business logic in django applications. In conjunction with django-material, they could be used as the framework to build ready to use business applications in minutes.

django workflow-engine workflow bpmn process-engine

argo - Get stuff done with container-native workflows for Kubernetes.

If you actively use Argo in your organization and believe that your organization may be interested in actively participating in the Argo Community, please ask a representative to contact saradhi_sreegiriraju@intuit.com for additional information. Argo is an open source container-native workflow engine for getting work done on Kubernetes. Argo is implemented as a Kubernetes CRD (Custom Resource Definition).

workflow kubernetes docker workflow-engine argo

zeebe - Distributed Workflow Engine for Microservices Orchestration

Java

Zeebe provides visibility into and control over business processes that span multiple microservices. Starting with Zeebe 0.20.0, the "developer preview" label was removed from Zeebe and the first production-ready version was released .

microservices orchestration-framework workflow-engine

temporal - Temporal service and CLI

Temporal is a microservice orchestration platform which enables developers to build scalable applications without sacrificing productivity or reliability. Temporal server executes units of application logic, Workflows, in a resilient manner that automatically handles intermittent failures, and retries failed operations. Temporal is a mature technology, a fork of Uber's Cadence. Temporal is being developed by Temporal Technologies, a startup by the creators of Cadence.

distributed-systems workflow-engine service-bus microservices-architecture workflows workflow-management service-fabric microservice-framework workflow-management-system workflow-automation microservice-orchestration

prefect - The easiest way to automate your data

Python

We've rebuilt data engineering for the data science era. Prefect is a new workflow management system, designed for modern infrastructure and powered by the open-source Prefect Core workflow engine. Users organize Tasks into Flows, and Prefect takes care of the rest.

infrastructure workflow data-science automation workflow-engine data-engineering prefect data-ops ml-ops

Argo Project - Get stuff done with Kubernetes

Argo has set of open source tools for Kubernetes to run workflows, manage clusters, and do GitOps right.

continuous-deployment gitops machine-learning airflow workflow-engine argo dag knative argo-workflows ci-cd kubernetes-tools

argo-workflows - Workflow engine for Kubernetes

Argo Workflows is an open source container-native workflow engine for orchestrating parallel jobs on Kubernetes. Argo Workflows is implemented as a Kubernetes CRD (Custom Resource Definition). Argo is a Cloud Native Computing Foundation (CNCF) hosted project.

kubernetes workflow machine-learning airflow workflow-engine cncf argo k8s cloud-native hacktoberfest dag knative argo-workflows

nextflow - A DSL for data-driven computational pipelines

Groovy

With the rise of big data, techniques to analyse and run experiments on large datasets are increasingly necessary. Parallelization and distributed computing are the best ways to tackle this kind of problem, but the tools commonly available to the bioinformatics community traditionally lack good support for these techniques, or provide a model that fits badly with the specific requirements in the bioinformatics domain and, most of the time, require the knowledge of complex tools or low-level APIs.

bioinformatics workflow-engine pipeline pipeline-framework nextflow cloud data-flow sge slurm aws docker singularity hpc singularity-containers reproducible-science reproducible-research

galaxy - Data intensive science for everyone.

Python

You may wish to make changes from the default configuration. This can be done in the config/galaxy.ini file. Note that not all dependencies for the tools provided in the tool_conf.xml.sample are included. To install them please visit "Manage dependencies" in the admin interface.

bioinformatics workflow genomics science sequencing ngs dna usegalaxy docker pipeline workflow-engine

workflow-core - Lightweight workflow engine for .NET Standard

CSharp

Workflow Core is a light weight workflow engine targeting .NET Standard. Think: long running processes with multiple tasks that need to track state. It supports pluggable persistence and concurrency providers to allow for multi-node clusters. See Tutorial here.

workflow saga-transactions saga workflow-engine

Wexflow - An extensible workflow engine with a cross-platform manager and designer.

CSharp

Wexflow is an open source extensible workflow engine with a cross-platform manager and designer. The goal of Wexflow is to automate recurring tasks without user intervention. Wexflow aims to make automations, workflow processes, long-running processes and interactions between systems, applications and folks easy, straightforward and clean. Discover more about the features in details.

workflow workflow-engine wexflow

couler - Unified Interface for Constructing and Managing Workflows on different workflow engines, such as Argo Workflows, Tekton Pipelines, and Apache Airflow

Python

Couler aims to provide a unified interface for constructing and managing workflows on different workflow engines, such as Argo Workflows, Tekton Pipelines, and Apache Airflow. Couler is included in CNCF Cloud Native Landscape and LF AI Landscape.

kubernetes machine-learning workflow-engine scheduler distributed-computing cloud-native workflow-management unified-interface workflow-automation unified-api apache-airflow kubeflow argo-workflows tekton-pipelines

easy-flows - The simple, stupid workflow engine for Java

Java

The simple, stupid workflow engine for Java

workflow workflow-engine

Azkaban - Batch workflow job scheduler created at LinkedIn to run Hadoop jobs

Java

Azkaban is a batch workflow job scheduler created at LinkedIn to run Hadoop jobs. Azkaban resolves the ordering through job dependencies and provides an easy to use web user interface to maintain and track your workflows. Azkaban was designed primarily with usability in mind. It has been running at LinkedIn for several years, and drives many of their Hadoop and data warehouse processes.

workflow-engine scheduling hacktoberfest automation workflow hadoop hadoop-jobs batch-jobs

django-river - Django workflow library supports on the fly changes.

Python

River is a open source workflow system for Django which support on the fly changes on every item in workflow instead of hardcoding states and transitions. Main goal of developing this framework is to be able to edit any workflow item on the fly. This means, all elements in workflow like states, transitions, user authorizations(permission), group authorization are editable. To do this, all data about the workflow item is persisted into DB. Hence, they can be changed without touching the code and re-deploying your application.

django workflow workflow-engine python-2 python-3

Devtron - Software Delivery Workflow For Kubernetes

Devtron is designed as a self-serve platform for operationalizing and maintaining applications (AppOps) on kubernetes in a developer friendly way. It provides workflow which understands the domain of kubernetes, testing, CD, SecOps so that you dont have to write scripts. It supports reusable and composable components so that workflows are easy to contruct and reason through. Deploy to multiple kubernetes cluster.

kubernetes dashboard deployment workflow-engine continuous-deployment gke kubectl deployment-strategy release-automation kubernetes-dashboard appops kubernetes-deployment devtron deployment-pipeline deployment-automation gitops aks eks argocd

utask - µTask is an automation engine that models and executes business processes declared in yaml

µTask allows you to model business processes in a declarative yaml format. Describe a set of inputs and a graph of actions and their inter-dependencies: µTask will asynchronously handle the execution of each action, working its way around transient errors and keeping an encrypted, auditable trace of all intermediary states until completion. The payments API keeps a reference to the running workflow via its task ID. Operators of the payments API can follow the state of current tasks by requesting the µTask instance directly. Depending on the payments API implementation, it may allow its callers to follow a task's state.

workflow automation workflow-engine devops-tools golang-application workflow-automation angular8