A database-based CDN node supporting PostgreSQL and MongoDB backends.

Last update: Nov 19, 2022

Overview

imoog

A simple to use database-based deployable CDN node for hobbyist developers who wish to have their own CDN!

Setup

Clone this repo via this command: git clone https://github.com/justanotherbyte/imoog
Go into the imoog/settings.py file and adjust your settings. Examples for both database drivers have been provided in the file.
Install a production asgi server of your choice. The 2 I recommend are hypercorn and uvicorn. Installing their base packages will suffice.
To automatically install the respective dependencies, please run pip install -r requirements.txt in the directory where you wish to store your node.
It is recommended to house the imoog folder within another folder, as there are other files that come with this repo, that are not housed within the imoog folder.

Settings

imoog offers granular control over many key aspects of the node. Most of these can be extremely overwhelming. Go ahead and hop into the imoog/settings.py file, where you'll find detailed explanations of each and every setting.
Another thing that can be overwhelming are the 2 database drivers. How do you configure them? What are their optimal settings. Again, everything is explained inside the imoog/settings.py file.

Proxy

In order to use this node cleanly, I recommend placing yourself behind a proxy server. One of the most popular choices is NGINX.

Caching + Cloudflare

The Imoog Node handles a lot of the caching for you, however, a good next step would be to place your CDN on cloudflare.
Cloudflare has some awesome caching solutions. Also, overall, they make it easy to expose your CDN to the open-web.

Uploading Files

This Node receives files via multipart/form-data. So it's best if you were to adapt your upload system to this. The field name the node expects is just file, so please upload it with this name. Please remember to register the Authorization header. This key can be set in the imoog/settings.py file.

Upload example (aiohttp)

import aiohttp
import asyncio


async def main():
    session = aiohttp.ClientSession()
    form  = aiohttp.FormData()
    form.add_field("file", b'imagebyteshere', content_type="bytes")
    resp = await session.post("http://localhost:8000/upload", data=form, headers={"Authorization": "myawesomesecretkey"})
    returned_data = await resp.json()
    print(returned_data)
    await session.close()

asyncio.get_event_loop().run_until_complete(main())

>>> {'status': 200, 'file_id': 'FSTSH2RPI'}

Driver and dependency information

Internally, imoog uses 2 different libraries for the 2 different supported database drivers.

PostgreSQL - asyncpg
MongoDB - motor

Both of these libraries are currently the best in their field for asynchronous client side connections to their respective databases.

You might also like...

Network-Shredder is a python based NIDS.

9 Dec 13, 2022

Simple Port Scanner script written in Python, plans is to expand upon this script to turn it into a GUI based pen testing suite

PortScanner Simple Port Scanner script written in Python, plans is to expand upon this script to turn it into a GUI based pen testing suite. #IMPORTAN

1 Oct 23, 2021

Tool to get the top 100 of the fastest nodes in the Tor network. Based on Kirzahk tool.

Tor Network Top 100 IPs Tool to get the top 100 of the fastest nodes in the Tor network. Based on Kirzahk tool. Just execute top100ipstor.py to get th

0 Jan 23, 2022

This is a zeep based SOAP client wrapper for simple communication with the Bricknode SOAP API.

2 Dec 15, 2021

Connects to databases or sftp server based on configured environmental variables.

Myconnections Connects to Oracle databases or sftp servers depending on configured environmental variables. VERY IMPORTANT: VPN must exist. Installati

0 Jan 2, 2022

A simple electrical network analyzer, BASED ON computer-aided design.

Electrical Network Analyzer A simple electrical network analyzer. Given the oriented graph of the electrical network (circut), BASED ON computer-aided

4 Oct 15, 2022

A simple Encrypted IM chat software Server & client based on Python3.

SecretBox A simple Encrypted IM chat software Server & client based on Python3. Version 1.0 命令行版安装步骤 Server 运行pip3 install -r requirements 安装依赖。运行py

5 Oct 31, 2022

TsuserverMoS - A Python-based server for Attorney Online,

tsuserverMoS A Python-based server for Attorney Online, forked from RealKaiser/tsuserverCC Requires Python 3.7+ and PyYAML. Changes/additions from tsu

1 Dec 30, 2021

Serves some data over HTTP, once. Based on the built-in Python module http.server

serve-me-once Serves some data over HTTP, once. Based on the built-in Python module http.server.

2 Jan 6, 2022

Comments

Don't need async definition in conection. (Sourcery refactored)
Pull Request #3 refactored by Sourcery.

Since the original Pull Request was opened as a fork in a contributor's repository, we are unable to create a Pull Request branching from it.

To incorporate these changes, you can either:

Merge this Pull Request instead of the original, or

Ask your contributor to locally incorporate these commits and push them to the original Pull Request

Incorporate changes via command line

git fetch https://github.com/justanotherbyte/imoog pull/3/head git merge --ff-only FETCH_HEAD git push

NOTE: As code is pushed to the original Pull Request, Sourcery will re-run and update (force-push) this Pull Request with new refactorings as necessary. If Sourcery finds no refactorings at any point, this Pull Request will be closed automatically.

See our documentation here.

Run Sourcery locally

Reduce the feedback loop during development by using the Sourcery editor plugin:

VS Code

PyCharm

Help us improve this pull request!
opened by sourcery-ai[bot] 1
Fix some psql stuff
This fixes some psql fixes on database/postgres.py file.

Add table on connect in postgresql if it does not exist.

Fix invalid psql statements such as: Having name but passing image instead
DELETE FROM {table_name} - WHERE image = $1 + WHERE name = $1

Trying to get mime but only image is passed in SELECT statement

- SELECT image FROM {table_name} + SELECT image, mime FROM {table_name} WHERE image = $1
opened by proguy914629bot 1
some fixes (Sourcery refactored)
Pull Request #6 refactored by Sourcery.

Since the original Pull Request was opened as a fork in a contributor's repository, we are unable to create a Pull Request branching from it.

To incorporate these changes, you can either:

Merge this Pull Request instead of the original, or

Ask your contributor to locally incorporate these commits and push them to the original Pull Request

Incorporate changes via command line

git fetch https://github.com/justanotherbyte/imoog pull/6/head git merge --ff-only FETCH_HEAD git push

NOTE: As code is pushed to the original Pull Request, Sourcery will re-run and update (force-push) this Pull Request with new refactorings as necessary. If Sourcery finds no refactorings at any point, this Pull Request will be closed automatically.

See our documentation here.

Run Sourcery locally

Reduce the feedback loop during development by using the Sourcery editor plugin:

VS Code

PyCharm

Help us improve this pull request!
opened by sourcery-ai[bot] 1
Docker Image

Hi, I'm writing an issue in hopes to hear if there are any plans for a Docker image.

Why? Docker is only getting more and more popular, especially among self-hosters. It allows them to setup a service within a matter of seconds.

If need be I'd be okay trying to make something for this.

Preferably there'd be multiple images, each one for Redis, PostgreSQL, and MongoDB.

Thank you.

opened by kaylynnnn 1

Releases(v1.1.1)

v1.1.1(Sep 17, 2022)

Source code(tar.gz)
Source code(zip)
imoog-android(18.74 MB)
imoog-linux(19.15 MB)
imoog-linux-aarch64(18.23 MB)
imoog-linux-i686(19.24 MB)
imoog-macos(12.84 MB)
imoog-windows.exe(28.62 MB)
v1.1.0(Feb 7, 2022)

Really just a semi-major release patch after some random changes. Nothing much as changed, its really just to make sure people know everything is up to date after the latest changes.
Source code(tar.gz)
Source code(zip)
v1.0.0(Nov 29, 2021)
Release 1.0.0

imoog, a simple to use, database-based, deployable CDN node for hobbyist developers to have their own media delivering services.

What comes in this release?

Caching

PostgreSQL and MongoDB support

What's planned for the future

Redis caching

MySQL support (highly unlikely due to MySQL instability)

KeyDB caching (KeyDB is an upcoming redis competitor)

Source code(tar.gz)
Source code(zip)

Owner

Vish M

Hey! I'm Vish, an avid Discord Bot Developer. I primarily work in Python, but I sometimes use HTML and CSS. Pronouns: he/him

GitHub Repository

Azure-function-proxy - Basic proxy as an azure function serverless app

azure function proxy (for phishing) here are config files for using *[.]azureweb

17 Nov 09, 2022

An automatic reaction network generator for reactive molecular dynamics simulation.

ReacNetGenerator An automatic reaction network generator for reactive molecular dynamics simulation. ReacNetGenerator: an automatic reaction network g

35 Dec 14, 2022

Modern Denial-of-service ToolKit for python

💣 Impulse Modern Denial-of-service ToolKit 💻 Main window 📡 Methods: Method Target Description SMS PHONE Sends a massive amount of SMS messages and

1 Nov 29, 2021

Edge static generator. Also Edge means: the outside limit of an object, area, or surface.

Edge Edge is a new static generator. Edge is onworking. Do not clone or do any changes. No P.R will be merged Also Edge means: the outside limit of an

12 Jan 16, 2022

Readable, simple and fast asynchronous non-blocking network apps

Fast and readable async non-blocking network apps Netius is a Python network library that can be used for the rapid creation of asynchronous non-block

120 Nov 20, 2022

pfSense integration with Home Assistant

hass-pfsense Join pfSense with home-assistant! hass-pfsense uses the built-in xmlrpc service of pfSense for all interactions. No special plugins or so

105 Dec 24, 2022

Automatically block traffic on Cloudflare's side based on Nginx Log parsing.

AutoRL This is a PoC of automatically block traffic on Cloudflare's side based on Nginx Log parsing. It will evaluate Nginx access.log and find potent

62 Dec 28, 2022

Simple DNS resolver for asyncio

Simple DNS resolver for asyncio aiodns provides a simple way for doing asynchronous DNS resolutions using pycares. Example import asyncio import aiodn

471 Dec 27, 2022

Way find out if DNS is down or your instance

DNS-PING Way to find out if DNS is down or your instance Problem: At times it happens that DNS provider services of a website URL is down and so to re

4 Nov 18, 2022

Ultimate transformation library that supports validation, contexts and aiohttp.

Trafaret Ultimate transformation library that supports validation, contexts and aiohttp. Trafaret is rigid and powerful lib to work with foreign data,

174 Nov 27, 2022

Socket Based Backdoor and Listener

The Project is mainly based on Sockets , File Handling and subprocess library for Creating backdoors For Hacking into one's Computer (Any OS-Platform Service) and listening on your computer and waiti

3 May 31, 2021

Python script to stop qBittorrent from torrenting without VPN for users with static IP.

1 Oct 25, 2021

openPortScanner is a port scanner made with Python!

Port Scanner made with python • Installation • Usage • Commands Installation Run this to install: $ git clone https://github.com/Miguel-Galdin0/openPo

7 Jan 09, 2022

基于多线程快速端口扫描脚本，支持目标批量导入、结果导出。

JWS_portscan 基于多线程快速端口扫描脚本，支持目标批量导入、结果导出。如果扫描公网资产，为了提升扫描的精准性，建议放到服务器运行。用法依赖安装：pip3 install -r requriement.txt 支持参数：python3 JWS_portscan.py --help 脚本

5 Apr 12, 2022

Publish GPU miner info to MQTT

Miner2MQTT Доступ к вашему GPU майнеру через MQTT. Изменения 1.0 EXE файл для Windows 1.1 Управление вентиляторами видеокарт (Linux) Упраление power l

5 Aug 21, 2022

ProxyBroker is an open source tool that asynchronously finds public proxies from multiple sources and concurrently checks them

ProxyBroker is an open source tool that asynchronously finds public proxies from multiple sources and concurrently checks them. Features F

3.2k Jan 04, 2023