Rate-limit-semaphore - Semaphore implementation with rate limit restriction for async-style (any core)

Last update: Jun 21, 2022

Related tags

Overview

Rate Limit Semaphore

Rate limit semaphore for async-style (any core)

There are two implementations of rate limit semaphore. Live demo shows how FixedNewPreviousDelaySemaphore and FixedNewFirstDelaySemaphore work

Overview

import datetime
import ralisem

# Or another implementation
sem = ralisem.FixedNewPreviousDelaySemaphore(
    access_times=3, per=datetime.timedelta(seconds=1)
)
async with sem:
    ...

Difference:

FixedNewPreviousDelaySemaphore: Sures the last and a new access have a fixed required delay (per / access_times)
FixedNewFirstDelaySemaphore: Sures first and last in series (serias is access_times) have a fixed delay (per)

Methods

All of these implementations are inherited from one base TimeRateLimitSemaphoreBase. Check out full methods here

Installation

Via PyPI:

python -m pip install ralisem

Or via GitHub

python -m pip install https://github.com/deknowny/rate-limit-semaphore/archive/main.zip

Contributing

Check out Contributing section

You might also like...

A fast poisson image editing implementation that can utilize multi-core CPU or GPU to handle a high-resolution image input.

Poisson Image Editing - A Parallel Implementation Jiayi Weng (jiayiwen), Zixu Chen (zixuc) Poisson Image Editing is a technique that can fuse two imag

110 Dec 27, 2022

PyTorch implementation of Advantage async actor-critic Algorithms (A3C) in PyTorch

Advantage async actor-critic Algorithms (A3C) in PyTorch @inproceedings{mnih2016asynchronous, title={Asynchronous methods for deep reinforcement lea

111 Dec 8, 2022

Implementation of "Meta-rPPG: Remote Heart Rate Estimation Using a Transductive Meta-Learner"

Meta-rPPG: Remote Heart Rate Estimation Using a Transductive Meta-Learner This repository is the official implementation of Meta-rPPG: Remote Heart Ra

137 Dec 13, 2022

PyTorch implementation of the paper Deep Networks from the Principle of Rate Reduction

Deep Networks from the Principle of Rate Reduction This repository is the official PyTorch implementation of the paper Deep Networks from the Principl

459 Dec 27, 2022

PyTorch implementation of some learning rate schedulers for deep learning researcher.

pytorch-lr-scheduler PyTorch implementation of some learning rate schedulers for deep learning researcher. Usage WarmupReduceLROnPlateauScheduler Visu

59 Dec 8, 2022

Official NumPy Implementation of Deep Networks from the Principle of Rate Reduction (2021)

Deep Networks from the Principle of Rate Reduction This repository is the official NumPy implementation of the paper Deep Networks from the Principle

49 Dec 16, 2022

A Pytorch Implementation of a continuously rate adjustable learned image compression framework.

GainedVAE A Pytorch Implementation of a continuously rate adjustable learned image compression framework, Gained Variational Autoencoder(GainedVAE). N

39 Dec 24, 2022

Pytorch implementation of Learning Rate Dropout.

Learning-Rate-Dropout Pytorch implementation of Learning Rate Dropout. Paper Link: https://arxiv.org/pdf/1912.00144.pdf Train ResNet-34 for Cifar10: r

42 Nov 25, 2022

Bayesian-Torch is a library of neural network layers and utilities extending the core of PyTorch to enable the user to perform stochastic variational inference in Bayesian deep neural networks

Bayesian-Torch is a library of neural network layers and utilities extending the core of PyTorch to enable the user to perform stochastic variational inference in Bayesian deep neural networks. Bayesian-Torch is designed to be flexible and seamless in extending a deterministic deep neural network architecture to corresponding Bayesian form by simply replacing the deterministic layers with Bayesian layers.

210 Jan 4, 2023

Releases(v0.1.0)

v0.1.0(Feb 15, 2022)

A few words…

Если вы, как и я, уже устали писать что-то под API, имеющее rate limit на запросы, и постоянно делать костыли, чтобы этот rate limit не превысить, то эта библиотека именно для вас

ralisem предоставляет две имплементации семафора с ограничением по частоте исполнения вместо ограничения по количеству исполняемых одновременно задач, что предоставляет стандартный asyncio.Semaphore. Одна из них ожидает равное количество времени между каждыми исполняемыми задачами, другая проверяет, чтобы 1 и последняя задача в серии имели заданный промежуток ожидания (прикрепил две лайв демки). Сделано на anyio, поэтому будет работать как на asyncio, так и на trio

Да, будет заюзано в квике для ограничения частоты обращений к API (собственно, это и послужило поводом)

Если кто подскажет, как на такое писать юнит тесты — буду рад (думал как-то через моки текущего времени, но жутко лень). Сейчас работает на честном слове

Доки здесь не нужно, чисто пара слов в ридми. На PyPI залита
Source code(tar.gz)
Source code(zip)

Rate-limit-semaphore - Semaphore implementation with rate limit restriction for async-style (any core)

Related tags

Overview

Rate Limit Semaphore

Overview

Methods

Installation

Contributing

You might also like...

A fast poisson image editing implementation that can utilize multi-core CPU or GPU to handle a high-resolution image input.

PyTorch implementation of Advantage async actor-critic Algorithms (A3C) in PyTorch

Implementation of "Meta-rPPG: Remote Heart Rate Estimation Using a Transductive Meta-Learner"

PyTorch implementation of the paper Deep Networks from the Principle of Rate Reduction

PyTorch implementation of some learning rate schedulers for deep learning researcher.

Official NumPy Implementation of Deep Networks from the Principle of Rate Reduction (2021)

A Pytorch Implementation of a continuously rate adjustable learned image compression framework.

Pytorch implementation of Learning Rate Dropout.

Bayesian-Torch is a library of neural network layers and utilities extending the core of PyTorch to enable the user to perform stochastic variational inference in Bayesian deep neural networks

Releases(v0.1.0)

v0.1.0(Feb 15, 2022)

A few words…

Owner

Yan Kurbatov

Code for the TASLP paper "PSLA: Improving Audio Tagging With Pretraining, Sampling, Labeling, and Aggregation".

The repository for freeCodeCamp's YouTube course, Algorithmic Trading in Python

A numpy-based implementation of RANSAC for fundamental matrix and homography estimation. The degeneracy updating and local optimization components are included and optional.

Mememoji - A facial expression classification system that recognizes 6 basic emotions: happy, sad, surprise, fear, anger and neutral.

A clean and robust Pytorch implementation of PPO on continuous action space.

Official code for: A Probabilistic Hard Attention Model For Sequentially Observed Scenes

Ensemble Knowledge Guided Sub-network Search and Fine-tuning for Filter Pruning

Official implementation of Deep Reparametrization of Multi-Frame Super-Resolution and Denoising

Multi-Output Gaussian Process Toolkit

This is the repository for Learning to Generate Piano Music With Sustain Pedals

Repository for benchmarking graph neural networks

This repository is based on Ultralytics/yolov5, with adjustments to enable polygon prediction boxes.

System Design course at HSE (2021)

Personal implementation of paper "Approximate Nearest Neighbor Negative Contrastive Learning for Dense Text Retrieval"

Github project for Attention-guided Temporal Coherent Video Object Matting.

Specification language for generating Generalized Linear Models (with or without mixed effects) from conceptual models

Gesture-Volume-Control - This Python program can adjust the system's volume by using hand gestures

Identifying Stroke Indicators Using Rough Sets

Code for ACM MM2021 paper "Complementary Trilateral Decoder for Fast and Accurate Salient Object Detection"

This repo contains the code required to train the multivariate time-series Transformer.