CRISP: Critical Path Analysis of Microservice Traces

This repo contains code to compute and present critical path summary from Jaeger microservice traces. To use first collect the microservice traces of a specific endpoint in a directory (say traces). Let the traces be for OP operation and SVC service (these are Jaeger termonologies). python3 process.py --operationName OP --serviceName SVC -t <path to trace> -o . --parallelism 8 will produce the critical path summary using 8 concurrent processes. The summary will be output in the current directory as an HTML file with a heatmap, flamegraph, and summary text in criticalPaths.html. It will also produce three flamegraphs flame-graph-*.svg for three different percentile values.

The script accepts the following options:

python3 process.py --help
usage: process.py [-h] -a OPERATIONNAME -s SERVICENAME [-t TRACEDIR] [--file FILE] -o OUTPUTDIR
                  [--parallelism PARALLELISM] [--topN TOPN] [--numTrace NUMTRACE] [--numOperation NUMOPERATION]

optional arguments:
  -h, --help            show this help message and exit
  -a OPERATIONNAME, --operationName OPERATIONNAME
                        operation name
  -s SERVICENAME, --serviceName SERVICENAME
                        name of the service
  -t TRACEDIR, --traceDir TRACEDIR
                        path of the trace directory (mutually exclusive with --file)
  --file FILE           input path of the trace file (mutually exclusivbe with --traceDir)
  -o OUTPUTDIR, --outputDir OUTPUTDIR
                        directory where output will be produced
  --parallelism PARALLELISM
                        number of concurrent python processes.
  --topN TOPN           number of services to show in the summary
  --numTrace NUMTRACE   number of traces to show in the heatmap
  --numOperation NUMOPERATION
                        number of operations to show in the heatmap

CRISP: Critical Path Analysis of Microservice Traces

Related tags

Overview

CRISP: Critical Path Analysis of Microservice Traces

Owner

Uber Research

A CLI tool to reduce the friction between data scientists by reducing git conflicts removing notebook metadata and gracefully resolving git conflicts.

simple way to build the declarative and destributed data pipelines with python

This is an example of how to automate Ridit Analysis for a dataset with large amount of questions and many item attributes

fds is a tool for Data Scientists made by DAGsHub to version control data and code at once.

VevestaX is an open source Python package for ML Engineers and Data Scientists.

MEAD: A Large-scale Audio-visual Dataset for Emotional Talking-face Generation [ECCV2020]

PyStan, a Python interface to Stan, a platform for statistical modeling. Documentation: https://pystan.readthedocs.io

Python utility to extract differences between two pandas dataframes.

signac-flow - manage workflows with signac

Implementation in Python of the reliability measures such as Omega.

This tool parses log data and allows to define analysis pipelines for anomaly detection.

Statistical & Probabilistic Analysis of Store Sales, University Survey, & Manufacturing data

PyChemia, Python Framework for Materials Discovery and Design

Analysis scripts for QG equations

A set of procedures that can realize covid19 virus detection based on blood.

PySpark bindings for H3, a hierarchical hexagonal geospatial indexing system

Convert monolithic Jupyter notebooks into Ploomber pipelines.

Show you how to integrate Zeppelin with Airflow

This cosmetics generator allows you to generate the new Fortnite cosmetics, Search pak and search cosmetics!

A pipeline that creates consensus sequences from a Nanopore reads. I