PapaParse - Fast and powerful CSV (delimited text) parser that gracefully handles large files and malformed input

•    Javascript

---

Fast and powerful CSV parser for the browser that supports web workers and streaming large files. Converts CSV to JSON and JSON to CSV.

csv csv-parser parser parse parsing delimited text data auto-detect comma tab pipe file filereader stream worker workers thread threading multi-threaded jquery-plugin

flower - Real-time monitor and web admin for Celery distributed task queue

•    Python

---

Flower is a web based tool for monitoring and administrating Celery clusters. Flower API enables to manage the cluster via REST API, call tasks and receive task events in real-time via WebSockets.

celery task-queue monitoring administration workers rabbitmq redis asynchronous

workq - Job server in Go

•    Go

---

Workq is a job scheduling server strictly focused on simplifying job processing and streamlining coordination. It can run jobs in blocking foreground or non-blocking background mode. Workq runs as a standalone TCP server and implements a simple, text based protocol. Clients interact with Workq over a TCP socket in a request/response model with text commands. Please refer to the full protocol doc for details.

queue queueing jobs jobqueue job job-scheduler worker workers scheduler schedule

html - HTML Standard

•    HTML

---

This repository hosts the HTML Standard. We are committed to providing a friendly, safe and welcoming environment for all. Please read and respect the WHATWG Code of Conduct.

whatwg html standard canvas storage websocket eventsource workers

worker-plugin - 🐳 Adds native Web Worker bundling support to Webpack.

•    Javascript

---

Automatically bundle & compile Web Workers within Webpack. The best part? That worker constructor works just fine without bundling turned on too.

webpack workers webworker webpack-plugin plugin worker web-worker thread

roadrunner - High-performance PHP application server, load-balancer and process manager written in Golang

•    Go

---

RoadRunner is an open source (MIT licensed), high-performance PHP application server, load balancer and process manager. It supports running as a service with the ability to extend its functionality on a per-project basis. RoadRunner includes PSR-7/PSR-17 compatible HTTP and HTTP/2 server and can be used to replace classic Nginx+FPM setup with much greater performance.

php7 application-server workers load-balancer supervisor psr-7 http http2 http2-push

gush - Fast and distributed workflow runner using only Sidekiq and Redis

•    Ruby

---

Gush is a parallel workflow runner using only Redis as storage and ActiveJob for scheduling and executing jobs. Gush relies on directed acyclic graphs to store dependencies, see Parallelizing Operations With Dependencies by Stephen Toub to learn more about this method.

workflows sidekiq graph parallel parallelization activejob queues redis workflow workers

miniflare - 🔥 Fully-local simulator for Cloudflare Workers

•    TypeScript

---

Miniflare is a simulator for developing and testing Cloudflare Workers. It's an alternative to wrangler dev, written in TypeScript, that runs your workers in a sandbox implementing Workers' runtime APIs.

cloudflare cloudflare-workers workers worker local cloudworker

jose - "JSON Web Almost Everything" - JWA, JWS, JWE, JWT, JWK, JWKS with no dependencies using runtime's native crypto in Node

•    Javascript

---

"JSON Web Almost Everything" - JWA, JWS, JWE, JWT, JWK, JWKS with no dependencies using runtime's native crypto in Node.js, Browser, Cloudflare Workers, Electron, and Deno. The test suite utilizes examples defined in RFC7520 to confirm its JOSE implementation is correct.

verify jwt node browser jose validate jsonwebtoken sign jwk jwe jws jwa encrypt decrypt jwks deno cloudflare-workers cloudflare compact decode detached ec ecdsa eddsa electron embedded flattened general isomorphic json-web-token oct okp payload pem pkcs8 rsa secp256k1 signature spki universal webcrypto workers x509

catiline - JavaScript library to take the pain out of web workers.

•    Javascript

---

Multi proccessing with workers in the browser.

workers threads parallel

Bree - Best job scheduler for Node.js and JavaScript with cron, dates, ms, later, and human-friendly support

•    Javascript

---

Bree is the best job scheduler for Node.js and JavaScript with cron, dates, ms, later, and human-friendly support. It uses worker threads (Node.js) and web workers (browsers) to spawn sandboxed processes, and supports async/await, retries, throttling, concurrency, and cancelable jobs with graceful shutdown.

cron simple job crontab scheduler concurrency workers jobs human processes cronjob throttling sandboxed retries ms cancelable job-queue job-scheduler cron-job

verk - A job processing system that just verks!

•    Elixir

---

Verk is a job processing system backed by Redis. It uses the same job definition of Sidekiq/Resque. The goal is to be able to isolate the execution of a queue of jobs as much as possible.

redis workers elixir sidekiq resque

node-worker-nodes - A node

•    Javascript

---

A library to run cpu-intensive tasks without blocking the event loop.

nodejs workers processes cluster pool farm

grpool - Lightweight Goroutine pool

•    Go

---

Clients can submit jobs. Dispatcher takes job, and sends it to first available worker. When worker is done with processing job, will be returned back to worker pool.Number of workers and Job queue size is configurable.

goroutine pool workers

worker-threads-pool - Easily manage a pool of Node.js Worker Threads

•    Javascript

---

Easily manage a pool of Node.js Worker Threads. Number of active workers in the pool.

pool worker workers thread threads worker_threads parallel

dingo - An easy-to-use, distributed, extensible task/job queue framework for #golang

•    Go

---

One important concept I learned from Celery and inherited in Dingo is that Caller and Worker could share the same codebase. When you send a task message in Celery, that message will not contain any source code, but only the name of the task you want to execute. This works similarly to how host names work on the internet: every worker maintains a mapping of task names to their actual functions, called the task registry.

task-queue workers

jquery-aciWorker - Abstract web workers with jQuery

•    JQuery

---

Abstract web workers with jQuery

jquery-plugin web workers abstract settimeout thread

ost - Redis based queues and workers.

•    Ruby

---

Redis based queues and workers.Ost makes it easy to enqueue object ids and process them with workers.

workers queueing lesscode job-queue task-queue queue worker background-task

preact-worker-demo - Demo of preact rendering an entire app in a Web Worker.

•    Javascript

---

Demo of preact rendering an entire app in a Web Worker.

web-worker preact workers thread background-thread virtual-dom dom demo webpack worker

jobqueue - Jobqueue manages running and scheduling jobs (think Sidekiq or Resque for Go).

•    Go

---

Jobqueue manages running and scheduling jobs (think Sidekiq or Resque). You can choose between MySQL and MongoDB as a backend for persistent storage.

jobqueue resque sidekiq scheduled-jobs workers