This library provides an abstraction to perform Model Versioning using Weight & Biases.

Last update: Jan 28, 2022

Overview

Description

This library provides an abstraction to perform Model Versioning using Weight & Biases.

Features

Version a new trained model
Promote a model to another stage (e.g production)

Example of usage

The following code snippet shows how to promote a newly trained model to the best_model on the validation set. First, it creates the model providing the checkpoint path, the artifact name and type, a description, and the metadata, where the metrics or any desired information is stored.

The comparision_type indicates how to compare the metrics between the two models. E.g if smaller, the smaller the metric from the new model the better

run = wandb.init(...)

# Create the desired artifact
artifact = versioner.create_artifact(
                            checkpoint='model.ckpt',
                            artifact_name='prueba',
                            artifact_type='model',
                            description='Prueba Wandb-MV',
                            metadata={
                                'val_metric': 78.0,
                                'test_metric': 0.0
                            })

# Promote the desired artifact to the 'best_model' tag
versioner.promote_model(new_model=artifact,
                        artifact_name='prueba',
                        artifact_type='model',
                        comparision_metric='val_metric',
                        promotion_alias='best_model',
                        comparision_type='smaller'
                       )

This code snippet shows how to promote a trained model to production after being validated on the test set. The already_deployed parameter indicates that the model is already logged, so it only needs to be updated.

versioner = Versioner(run)
versioner.promote_model(new_model=artifact,
                        artifact_name='prueba',
                        artifact_type='model',
                        comparision_metric='test_metric',
                        promotion_alias='production',
                        comparision_type='smaller',
                        already_deployed=True
                        )

Next features

Allow providing a custom comparision function to promote a model
...

This library provides an abstraction to perform Model Versioning using Weight & Biases.

Related tags

Overview

Description

Features

Example of usage

Next features

Owner

Hector Lopez Almazan

Models, datasets and tools for Facial keypoints detection

Official repository for "Intriguing Properties of Vision Transformers" (2021)

U-Net Brain Tumor Segmentation

Tensors and neural networks in Haskell

Pytorch implementation of YOLOX、PPYOLO、PPYOLOv2、FCOS an so on.

a delightful machine learning tool that allows you to train, test and use models without writing code

Zsseg.baseline - Zero-Shot Semantic Segmentation

EMNLP 2021 Adapting Language Models for Zero-shot Learning by Meta-tuning on Dataset and Prompt Collections

PyTorch implementation of InstaGAN: Instance-aware Image-to-Image Translation

Guided Internet-delivered Cognitive Behavioral Therapy Adherence Forecasting

This repository is for our paper Exploiting Scene Graphs for Human-Object Interaction Detection accepted by ICCV 2021.

Unofficial implementation of MUSIQ (Multi-Scale Image Quality Transformer)

Lipschitz-constrained Unsupervised Skill Discovery

This repository contains part of the code used to make the images visible in the article "How does an AI Imagine the Universe?" published on Towards Data Science.

noisy labels; missing labels; semi-supervised learning; entropy; uncertainty; robustness and generalisation.

Unofficial PyTorch implementation of Neural Additive Models (NAM) by Agarwal, et al.

A tensorflow implementation of an HMM layer

The code repository for EMNLP 2021 paper "Vision Guided Generative Pre-trained Language Models for Multimodal Abstractive Summarization".

Stochastic Scene-Aware Motion Prediction

Code for the Paper: Conditional Variational Capsule Network for Open Set Recognition