Logparser

Command line parser for common log format (Nginx default).

Usage

It counts most important data: referrers, operating systems, browsers and daily unique visitors (IPs).

# Console output
python parse.py sitename.log.gz

# HTML output
python parse.py sitename.log.gz --html ~/sitename/logs.html

Install and update PIP packages.

pip install -U -r requirements.txt

Speed

logparser 24,249/s
GoAccess 6,234/s

Outputs

HTML output is based on Jinja2 templates. It can be improved as you see fit.
Console output for Subreply for a fews days in Sep, 2021:

----- Days
 1402 2021-09-14 Tuesday
  893 2021-09-15 Wednesday
  797 2021-09-16 Thursday
  857 2021-09-17 Friday
  951 2021-09-18 Saturday
  945 2021-09-19 Sunday
  869 2021-09-20 Monday

----- Browsers
    2 Chrome Mobile iOS
    2 Bytespider
    2 HeadlessChrome
    3 Links
    4 Firefox iOS
    4 UC Browser
    6 IE
    7 Go-http-client
    7 Opera
    8 Other
   20 Chrome Mobile WebView
   20 Edge
   28 Firefox Mobile
   30 Safari
   42 Chrome Mobile
   56 Mobile Safari
  111 Firefox
 3468 Chrome

----- Operating Systems
   15 Other
   22 Ubuntu
   39 Linux
   63 iOS
   91 Android
  101 Mac OS X
 3474 Windows

----- Referrers
    2 twtxt.net
    2 l.instagram.com
    2 lobste.rs/s/bffayk/what_are_you_doing_this_weekend
    3 ro.linkedin.com
    3 199.247.2.88:80
    3 t.co/sv4adihlka
    3 lobste.rs/s/fe2eph/what_are_you_doing_this_weekend
    4 news.ycombinator.com
    4 1mb.club
    4 old.reddit.com/r/internetisbeautiful
    4 baidu.com
    4 t.co
    5 out.reddit.com/t3_pl9hiu
    5 sjmulder.nl/en/textonly.html
    8 nt
   10 199.247.2.88
   11 lobste.rs
   13 sjmulder.nl
   15 google.com
   16 lucianmarin.com
   49 reddit.com
   85 lobste.rs/s/8fzzmz/what_are_you_doing_this_week

Command line parser for common log format (Nginx default).

Related tags

Overview

Logparser

Usage

Speed

Outputs

Owner

Lucian Marin

ctree - command line christmas tree

Shazam is a Command Line Application that checks the integrity of the file by comparing it with a given hash.

A Python script for finding a food-truck based on latitude and longitude coordinates that you can run in your shell

Quo is a Python based toolkit for writing Command-Line Interface(CLI) applications.

A Tempmail Tool for Terminal and Termux.

Easily handle day to day CLI operation via Python instead of regular Bash programs.

Loading animation; a progress bar

pypyr task-runner cli & api for automation pipelines.

A dashboard for your Terminal written in the Python 3 language,

A Python package for Misty II development

A CLI minesweeper application written in 60 LoC python

A communist shell written in Python

The most comprehensive, exhaustive, parameterized command-line wordle solver.

adds flavor of interactive filtering to the traditional pipe concept of UNIX shell

🎮 An easy to use tool to change the mapping of your input device buttons.

A super simple wallet application for the NANO cryptocurrency that runs in the terminal

A simple Python CLI tool that draws routes/paths on a given map.

A command line connect 4 game against a minimax agent.

alternative cli util for update-alternatives

This is a CLI utility that allows you to view RedFlagDeals.com on the command line.