This library provides an abstraction to perform Model Versioning using Weight & Biases.

Last update: Jan 28, 2022

Overview

Description

This library provides an abstraction to perform Model Versioning using Weight & Biases.

Features

Version a new trained model
Promote a model to another stage (e.g production)

Example of usage

The following code snippet shows how to promote a newly trained model to the best_model on the validation set. First, it creates the model providing the checkpoint path, the artifact name and type, a description, and the metadata, where the metrics or any desired information is stored.

The comparision_type indicates how to compare the metrics between the two models. E.g if smaller, the smaller the metric from the new model the better

run = wandb.init(...)

# Create the desired artifact
artifact = versioner.create_artifact(
                            checkpoint='model.ckpt',
                            artifact_name='prueba',
                            artifact_type='model',
                            description='Prueba Wandb-MV',
                            metadata={
                                'val_metric': 78.0,
                                'test_metric': 0.0
                            })

# Promote the desired artifact to the 'best_model' tag
versioner.promote_model(new_model=artifact,
                        artifact_name='prueba',
                        artifact_type='model',
                        comparision_metric='val_metric',
                        promotion_alias='best_model',
                        comparision_type='smaller'
                       )

This code snippet shows how to promote a trained model to production after being validated on the test set. The already_deployed parameter indicates that the model is already logged, so it only needs to be updated.

versioner = Versioner(run)
versioner.promote_model(new_model=artifact,
                        artifact_name='prueba',
                        artifact_type='model',
                        comparision_metric='test_metric',
                        promotion_alias='production',
                        comparision_type='smaller',
                        already_deployed=True
                        )

Next features

Allow providing a custom comparision function to promote a model
...

This library provides an abstraction to perform Model Versioning using Weight & Biases.

Related tags

Overview

Description

Features

Example of usage

Next features

Owner

Hector Lopez Almazan

Code for the paper 'A High Performance CRF Model for Clothes Parsing'.

Official repository for "PAIR: Planning and Iterative Refinement in Pre-trained Transformers for Long Text Generation"

PyContinual (An Easy and Extendible Framework for Continual Learning)

Receptive Field Block Net for Accurate and Fast Object Detection, ECCV 2018

A program to recognize fruits on pictures or videos using yolov5

Circuit Training: An open-source framework for generating chip floor plans with distributed deep reinforcement learning

Cluster-GCN: An Efficient Algorithm for Training Deep and Large Graph Convolutional Networks

Image De-raining Using a Conditional Generative Adversarial Network

Gradient Step Denoiser for convergent Plug-and-Play

This is the official implementation for "Do Transformers Really Perform Bad for Graph Representation?".

MonoScene: Monocular 3D Semantic Scene Completion

cisip-FIRe - Fast Image Retrieval

Project for music generation system based on object tracking and CGAN

A public available dataset for road boundary detection in aerial images

Self-supervised spatio-spectro-temporal represenation learning for EEG analysis

CTRL-C: Camera calibration TRansformer with Line-Classification

This repository compare a selfie with images from identity documents and response if the selfie match.

Hierarchical Clustering: O(1)-Approximation for Well-Clustered Graphs

This is a collection of our NAS and Vision Transformer work.

A small demonstration of using WebDataset with ImageNet and PyTorch Lightning