We have collection of more than 1 Million open source products ranging from Enterprise product to small libraries in all platforms. We aggregate information from all open source repositories. Search and find the best for your needs. Check out projects section.
Helix - Cluster Management Framework
- 1565
Helix is a generic cluster management framework used for the automatic management of partitioned, replicated and distributed resources hosted on a cluster of nodes. It helps to perform scheduling of maintenance tasks, such as backups, garbage collection, file consolidation, index rebuilds, repartitioning of data or resources across the cluster, informing dependent systems of changes so they can react appropriately to cluster changes, throttling system tasks and changes and so on.
http://helix.incubator.apache.org| Tags | cluster-management cluster datacenter node automatic-deployment virtualization vm-management |
| Implementation | Java |
| License | Apache |
| Platform | OS-Independent |
Related Projects
OpenNebula - Data Center Management Solution
OpenNebula provides solution for building and managing virtualized enterprise data centers and cloud infrastructures to enable on-premise IaaS clouds. OpenNebula interoperability makes cloud an evolution by leveraging existing IT assets, protecting your investments, and avoiding vendor lock-in. penNebula was designed to address the requirements of business use cases from leading companies and across multiple industries, such as Hosting, Telecom, eGovernment, Utility Computing and lot more.
cloud cloud-computing datacenter iaas infrastructure-as-a-service cloud-managementSynnefo - Open source Cloud Software, Used to create massively scalable IaaS clouds
Synnefo is a complete open source cloud stack written in Python that provides Compute, Network, Image, Volume and Storage services, similar to the ones offered by AWS. Synnefo manages multiple Ganeti clusters at the backend for handling low-level VM operations and uses Archipelago to unify cloud storage. To boost 3rd-party compatibility, Synnefo exposes the OpenStack APIs to users.
cloud iaas cloud-management cluster-management cluster infrastructure-as-a-service datacenterkubernetes-app - Grafana App for Kubernetes
Kubernetes is an open-source system for automating deployment, scaling, and management of containerized applications.The Grafana Kubernetes App allows you to monitor your Kubernetes cluster's performance. It includes 4 dashboards, Cluster, Node, Pod/Container and Deployment. It also comes with Intel Snap collectors that are deployed to your cluster to collect health metrics. The metrics collected are high-level cluster and node stats as well as lower level pod and container stats. Use the high-level metrics to alert on and the low-level metrics to troubleshoot.
kubernetes metrics grafana monitoringopenQRM - Datacenter Management and Cloud Computing Platform
openQRM a web-based open source datacenter management and cloud computing platform that integrates flexibly with your existing datacenter components. openQRM supports the all major virtualization technologies. It automates provisioning, virtualization, storage and configuration management, and it takes care of high-availability. A self-service cloud portal with integrated billing system enables end-users to request new managed servers and application stacks on-demand.
cloud cloud-computing datacenter iaas infrastructure-as-a-service cloud-managementspark-cluster-deployment - Automates Spark standalone cluster tasks with Puppet and Fabric.
Apache Spark is a research project for distributed computing which interacts with HDFS and heavily utilizes in-memory caching. Spark 1.0.0 can be deployed to traditional cloud and job management services such as EC2, Mesos, or Yarn. Further, Spark's standalone cluster mode enables Spark to run on other servers without installing other job management services.However, configuring and submitting applications to a Spark 1.0.0 standalone cluster currently requires files to be synchronized across the entire cluster, including the Spark installation directory. This project utilizes Fabric and Puppet to further automate the Spark standalone cluster. The Puppet scripts are MIT-licensed from stefanvanwouw/puppet-spark and wikimedia/puppet-cdh4.
Kubernetes - Container Cluster Manager
Kubernetes is an open source orchestration system for Docker containers. It handles scheduling onto nodes in a compute cluster and actively manages workloads to ensure that their state matches the users declared intentions. Using the concepts of "labels" and "pods", it groups the containers which make up an application into logical units for easy management and discovery.
container cluster-management datacenter cloudganeti - Cluster-based virtualization management software
Cluster-based virtualization management software
Falcon-DL-VME-Cluster
DNF Security’s Integrated Falcon-DL VME Cluster (Diskless) video recording and management server cluster, boots directly from your Seahawk 6GS-Class IP SAN, simplifying deployment and virtually eliminating points of failure in your video recording server. DNF Security provides Video Management System. Further Visit http://www.dnfsecurity.com/products.asp/section/Product~Categories/category/Falcon-DL~Series/options//drivetype//formfactor//inface//product/Falcon-DL~VME~Cluster/ID/972010-5839/act/G
node-problem-detector - This is a place for various problem detectors running on the Kubernetes nodes
node-problem-detector aims to make various node problems visible to the upstream layers in cluster management stack. It is a daemon which runs on each node, detects node problems and reports them to apiserver. node-problem-detector can either run as a DaemonSet or run standalone. Now it is running as a Kubernetes Addon enabled by default in the GCE cluster.Currently these problems are invisible to the upstream layers in cluster management stack, so Kubernetes will continue scheduling pods to the bad nodes.
Virtual Cluster -- Corona
Construct and management virtual clusters which the nodes of the clusters running on the virtual machine rather than native machine. Fast install and switch virtual clusters. Efficiently storage vm images. support variant VMMs.
PiCluster - Manage Docker Containers
PiCluster is a simple way to manage Docker containers on multiple hosts. Docker Swarm not that good and Kubernetes was too difficult to install currently on ARM. PiCluster will only build and run images from Dockerfile's on the host specified in the config file. This software will work on regular x86 hardware also and is not tied to ARM.
container-orchestration container-management container-cluster cluster paas paas-framework docker faas-platform faasshync - Simple parallel server cluster management tool for Node using ssh and scp
Simple parallel server cluster management tool for Node using ssh and scp
Nomad - Easily Deploy Applications at Any Scale
Nomad is a cluster manager, designed for both long lived services and short lived batch processing workloads. Developers use a declarative job specification to submit work, and Nomad ensures constraints are satisfied and resource utilization is optimized by efficient task packing. Nomad supports all major operating systems and virtualized, containerized, or standalone applications.
cluster-manager job-scheduler manage-workloads cluster-management deployment scalabilityfuel-plugin-ha-fencing - Fuel plugin for HA fencing for Pacemaker cluster
The Fuel fencing plugin is a Puppet configuration module being executed as an additional post deployment step in order to provide HA fencing (STONITH based) of a failed cluster nodes. The plugin itself is used to describe a datacenter's HW power management configuration - such as PDU outlets, IPMI and other agents - and represent it as a fencing topology for Corosync & Pacemaker cluster.The Fuel fencing plugin is intended to provide STONITHing of the failed nodes in Corosync & Pacemaker cluster. Fencing plugin operates the YAML data structures and extends the Fuel YAML configuration file.
OpenStack - Software for building Private and Public Clouds
OpenStack is a cloud operating system that controls large pools of compute, storage, and networking resources throughout a datacenter, all managed through a dashboard that gives administrators control while empowering their users to provision resources through a web interface.
cloud cloud-computing datacenter iaas infrastructure-as-a-service cloud-managementquartermaster - A framework for managing containerized storage systems on top of Kubernetes
Quartermaster is a framework for managing containerized storage systems like Ceph, GlusterFS, NFS-Ganesha, Rook and others on top of Kubernetes. Quartermaster enables the deployment, installation, and integration of these type of storage systems onto a Kubernetes cluster. Quartermaster abstracts this complexity and presents the client with a simple storage deployment model which is fully integrated with Kubernetes. By simplifying the deployment of storage systems, Quartermaster makes it possible to easily and reliably deploy, upgrade, and get status of a desired storage system in a Kubernetes cluster. Once deployed, a Quartermaster managed storage system could be used to fulfill persistent volume claim requests. Quartermaster can also be used to help the setup and testing of PersistentVolumes provided by containerized storage systems deployed in Kubernetes. Today, Quartermaster supports GlusterFS, but it is designed to easily be extended to support a multitude of storage systems on top of Kubernetes.You can use minikube but only for mock or nfs storage deployments since minikube is only a single node. To create a Kubernetes cluster with storage, it is recommended you use Matchbox/Bootkube or Kubernetes-CentOS. Check driver documentation for any requirements on these systems.
ankush - A big data cluster management tool that creates and manages clusters of different technologies
A big data cluster management tool that creates and manages clusters of different technologies. It provides visual, graphical, and email notifications regarding the health of a Cluster that allow Cluster Administrators to take informed actions.The guide will help you to setup and start the server.
serf - Service orchestration and management tool
Serf is a decentralized solution for service discovery and orchestration that is lightweight, highly available, and fault tolerant.Serf runs on Linux, Mac OS X, and Windows. An efficient and lightweight gossip protocol is used to communicate with other nodes. Serf can detect node failures and notify the rest of the cluster. An event system is built on top of Serf, letting you use Serf's gossip protocol to propagate events such as deploys, configuration changes, etc. Serf is completely masterless with no single point of failure.
service-discovery service-orchestration high-availability gossip-protocol