Task dispatcher for Postgres

Last update: Dec 06, 2021

Overview

Features

a task being ran as an OS process
supports task queue with priority and process limit per node
fully database driven (a worker and task can be controlled through table row)
task can be cancelled by changing its state in the table row (OS process terminated)
task can be scheduled at a time or with interval
uses postgres NOTYFY events in opposite to pooling (instant changes discovery, less request)
supports clustering (several workers per group)
supports faiover (several nodes per worker)

Class diagramm

Task lifecycle

Continuous Archiving for Postgres

WAL-E Continuous archiving for Postgres WAL-E is a program designed to perform continuous archiving of PostgreSQL WAL files and base backups. To corre

3.4k Dec 30, 2022

The ormar package is an async mini ORM for Python, with support for Postgres, MySQL, and SQLite.

python async mini orm with fastapi in mind and pydantic validation

1.2k Jan 5, 2023

A basic CRUD application built in flask using postgres as database

flask-postgres-CRUD A basic CRUD application built in flask using postgres as database Taks list Dockerfile Initial docker-compose - It is working Dat

9 Sep 25, 2022

Dockerizing Django with Postgres, Gunicorn, Nginx and Certbot. A fully Django starter project.

Dockerizing Django with Postgres, Gunicorn, Nginx and Certbot 🚀 Features A Django stater project with fully basic requirements for a production-ready

8 Jun 27, 2022

A server shell for you to play with Powered by Django + Nginx + Postgres + Bootstrap + Celery.

1 Jan 10, 2022

CLI utility for updating the EVE Online static data export in a postgres database

EVE SDE Postgres updater CLI utility for updating the EVE Online static data export postgres database. This has been tested with the Fuzzwork postgres

1 Oct 29, 2021

a Scrapy spider that utilizes Postgres as a DB, Squid as a proxy server, Redis for de-duplication and Splash to render JavaScript. All in a microservices architecture utilizing Docker and Docker Compose

This is George's Scraping Project To get started cd into the theZoo file and run: chmod +x script.sh then: ./script.sh This will spin up a Postgres co

7 Nov 27, 2022

FastAPI + Postgres + Docker Compose + Heroku Deploy Template

FastAPI + Postgres + Docker Compose + Heroku Deploy ⚠️ For educational purpose only. Not ready for production use YET Features FastAPI with Postgres s

12 Dec 27, 2022

Sample FastAPI project that uses async SQLAlchemy, SQLModel, Postgres, Alembic, and Docker.

FastAPI + SQLModel + Alembic Sample FastAPI project that uses async SQLAlchemy, SQLModel, Postgres, Alembic, and Docker. Want to learn how to build th

228 Jan 2, 2023

MLFlow in a Dockercontainer based on Azurite and Postgres

mlflow-azurite-postgres docker This is a MLFLow image which works with a postgres DB and a local Azure Blob Storage Instance (Azurite). This image is

2 May 29, 2022

Simple CLI for managing Postgres databases in Flask.

Overview Simple CLI that provides the following commands: flask psql create flask psql init flask psql drop flask psql setup: create → init flask psql

21 Oct 3, 2022

A program made in PYTHON🐍 that automatically performs data insertions into a POSTGRES database 🐘 , using as base a .CSV file 📁 , useful in mass data insertions

A program made in PYTHON🐍 that automatically performs data insertions into a POSTGRES database 🐘 , using as base a .CSV file 📁 , useful in mass data insertions.

1 Oct 17, 2022

This is a Python binding to the tokenizer Ucto. Tokenisation is one of the first step in almost any Natural Language Processing task, yet it is not always as trivial a task as it appears to be. This binding makes the power of the ucto tokeniser available to Python. Ucto itself is regular-expression based, extensible, and advanced tokeniser written in C++ (http://ilk.uvt.nl/ucto).

Ucto for Python This is a Python binding to the tokeniser Ucto. Tokenisation is one of the first step in almost any Natural Language Processing task,

27 Dec 14, 2022

Django database backed celery periodic task scheduler with support for task dependency graph

Djag Scheduler (Dj)ango Task D(AG) (Scheduler) Overview Djag scheduler associates scheduling information with celery tasks The task schedule is persis

3 Nov 25, 2022

Using Bert as the backbone model for lime, designed for NLP task explanation (sentence pair text classification task)

Lime Comparing deep contextualized model for sentences highlighting task. In addition, take the classic explanation model "LIME" with bert-base model

2 Jan 18, 2022

A CLI based task manager tool which helps you track your daily task and activity.

CLI based task manager tool This is the simple CLI tool can be helpful in increasing your productivity. More like your todolist. It uses Postgresql as

1 Jan 19, 2022

Real-time monitor and web admin for Celery distributed task queue

Flower Flower is a web based tool for monitoring and administrating Celery clusters. Features Real-time monitoring using Celery Events Task progress a

5.5k Dec 28, 2022

Remote task execution tool

Gunnery Gunnery is a multipurpose task execution tool for distributed systems with web-based interface. If your application is divided into multiple s

747 Nov 9, 2022

A fast and reliable background task processing library for Python 3.

dramatiq A fast and reliable distributed task processing library for Python 3. Changelog: https://dramatiq.io/changelog.html Community: https://groups

3.4k Jan 1, 2023

Releases(v0.3-beta)

v0.3-beta(Nov 5, 2021)

Source code(tar.gz)
Source code(zip)
v0.2-beta(Oct 26, 2021)

Source code(tar.gz)
Source code(zip)
v0.1-beta(Oct 24, 2021)

Tested by me.
Source code(tar.gz)
Source code(zip)

Owner

GitHub Repository

A Python package that provides physical constants.

PhysConsts A Python package that provides physical constants. The code is being developed by Marc van der Sluys of the department of Astrophysics at t

1 Jan 05, 2022

In this project we will be using OpenCV to virtually drag a rectangle and drop it at a different location. It will be further used for Virtual Mouse.

Virtual Drag & Drog using OpenCV In this project we will be using OpenCV to virtually drag a rectangle and drop it at a different location. It will be

5 Sep 27, 2021

Yet another basic python package.

ironmelts A basic python package. Easy to use. Minimum requirements. Installing Linux python3 -m pip install -U ironmelts macOS python3 -m pip install

1 Oct 26, 2021

Python library for parsing Godot scene files

Godot Parser This is a python library for parsing Godot scene (.tscn) and resource (.tres) files. It's intended to make it easier to automate certain

30 Jan 04, 2023

Procedural 3D data generation pipeline for architecture

Synthetic Dataset Generator Authors: Stanislava Fedorova Alberto Tono Meher Shashwat Nigam Jiayao Zhang Amirhossein Ahmadnia Cecilia bolognesi Dominik

49 Nov 25, 2022

Visualization of COVID-19 Omicron wave data in Seoul, Osaka, Tokyo, Hong Kong and Shanghai. 首尔、大阪、东京、香港、上海由新冠病毒 Omicron 变异株引起的本轮疫情数据可视化分析。

COVID-19 in East Asian Megacities This repository holds original Python code for processing and visualization COVID-19 data in East Asian megacities a

10 May 18, 2022

Task dispatcher for Postgres

Related tags

Overview

Features

Class diagramm

Task lifecycle

You might also like...

Continuous Archiving for Postgres

The ormar package is an async mini ORM for Python, with support for Postgres, MySQL, and SQLite.

A basic CRUD application built in flask using postgres as database

Dockerizing Django with Postgres, Gunicorn, Nginx and Certbot. A fully Django starter project.

A server shell for you to play with Powered by Django + Nginx + Postgres + Bootstrap + Celery.

CLI utility for updating the EVE Online static data export in a postgres database

a Scrapy spider that utilizes Postgres as a DB, Squid as a proxy server, Redis for de-duplication and Splash to render JavaScript. All in a microservices architecture utilizing Docker and Docker Compose

FastAPI + Postgres + Docker Compose + Heroku Deploy Template

Sample FastAPI project that uses async SQLAlchemy, SQLModel, Postgres, Alembic, and Docker.

MLFlow in a Dockercontainer based on Azurite and Postgres

Simple CLI for managing Postgres databases in Flask.

A program made in PYTHON🐍 that automatically performs data insertions into a POSTGRES database 🐘 , using as base a .CSV file 📁 , useful in mass data insertions

Django database backed celery periodic task scheduler with support for task dependency graph

Using Bert as the backbone model for lime, designed for NLP task explanation (sentence pair text classification task)

A CLI based task manager tool which helps you track your daily task and activity.

Real-time monitor and web admin for Celery distributed task queue

Remote task execution tool

A fast and reliable background task processing library for Python 3.

Releases(v0.3-beta)

v0.3-beta(Nov 5, 2021)

v0.2-beta(Oct 26, 2021)

v0.1-beta(Oct 24, 2021)

Owner

A Python package that provides physical constants.

In this project we will be using OpenCV to virtually drag a rectangle and drop it at a different location. It will be further used for Virtual Mouse.

Yet another basic python package.

Python library for parsing Godot scene files

Procedural 3D data generation pipeline for architecture

Visualization of COVID-19 Omicron wave data in Seoul, Osaka, Tokyo, Hong Kong and Shanghai. 首尔、大阪、东京、香港、上海由新冠病毒 Omicron 变异株引起的本轮疫情数据可视化分析。

Neogex is a human readable parser standard, being implemented in Python

Python bindings for Basler's VisualApplets TCL script generation

My solutions for Advent of Code 2021 🌟🎄

Python library for datamining glitch information from Gen 1 Pokémon GameBoy ROMs

rebalance is a simple Python 3.9+ library for rebalancing investment portfolios

For Tok-k passages that have passed through the Bi-Encoder Retrival, ReRank is performed using CrossEncoder.

【幼盾】个性化图片徽章服务！

Taichi is a parallel programming language for high-performance numerical computations.

A tool to help you to do the monthly reading requirements

Python programming language Test

to learn how to do pull request and do contribution to other's repo

Bootcamp de Introducción a la Programación. Módulo 6: Matemáticas Discretas

Код файнтюнинга оригинального CLIP на русский язык

This repository contains each day of Advent of Code 2021 that I've done.