This library provides an abstraction to perform Model Versioning using Weight & Biases.

Last update: Jan 28, 2022

Overview

Description

This library provides an abstraction to perform Model Versioning using Weight & Biases.

Features

Version a new trained model
Promote a model to another stage (e.g production)

Example of usage

The following code snippet shows how to promote a newly trained model to the best_model on the validation set. First, it creates the model providing the checkpoint path, the artifact name and type, a description, and the metadata, where the metrics or any desired information is stored.

The comparision_type indicates how to compare the metrics between the two models. E.g if smaller, the smaller the metric from the new model the better

run = wandb.init(...)

# Create the desired artifact
artifact = versioner.create_artifact(
                            checkpoint='model.ckpt',
                            artifact_name='prueba',
                            artifact_type='model',
                            description='Prueba Wandb-MV',
                            metadata={
                                'val_metric': 78.0,
                                'test_metric': 0.0
                            })

# Promote the desired artifact to the 'best_model' tag
versioner.promote_model(new_model=artifact,
                        artifact_name='prueba',
                        artifact_type='model',
                        comparision_metric='val_metric',
                        promotion_alias='best_model',
                        comparision_type='smaller'
                       )

This code snippet shows how to promote a trained model to production after being validated on the test set. The already_deployed parameter indicates that the model is already logged, so it only needs to be updated.

versioner = Versioner(run)
versioner.promote_model(new_model=artifact,
                        artifact_name='prueba',
                        artifact_type='model',
                        comparision_metric='test_metric',
                        promotion_alias='production',
                        comparision_type='smaller',
                        already_deployed=True
                        )

Next features

Allow providing a custom comparision function to promote a model
...

This library provides an abstraction to perform Model Versioning using Weight & Biases.

Related tags

Overview

Description

Features

Example of usage

Next features

Owner

Hector Lopez Almazan

CondLaneNet: a Top-to-down Lane Detection Framework Based on Conditional Convolution

Generalized Proximal Policy Optimization with Sample Reuse (GePPO)

🏎️ Accelerate training and inference of 🤗 Transformers with easy to use hardware optimization tools

Code and data of the EMNLP 2021 paper "Mind the Style of Text! Adversarial and Backdoor Attacks Based on Text Style Transfer"

利用Tensorflow实现基于CNN的中文短文本分类

Pytorch implementation of the paper: "A Unified Framework for Separating Superimposed Images", in CVPR 2020.

Towers of Babel: Combining Images, Language, and 3D Geometry for Learning Multimodal Vision. ICCV 2021.

automated systems to assist guarding corona Virus precautions for Closed Rooms (e.g. Halls, offices, etc..)

NATS-Bench: Benchmarking NAS Algorithms for Architecture Topology and Size

A bunch of random PyTorch models using PyTorch's C++ frontend

A script depending on VASP output for calculating Fermi-Softness.

An Open-Source Tool for Automatic Disease Diagnosis..

A Keras implementation of YOLOv4 (Tensorflow backend)

A rough implementation of the paper "A Steering Algorithm for Redirected Walking Using Reinforcement Learning"

Code for GNMR in ICDE 2021

Open-source codebase for EfficientZero, from "Mastering Atari Games with Limited Data" at NeurIPS 2021.

[CVPR 2021] MiVOS - Mask Propagation module. Reproduced STM (and better) with training code :star2:. Semi-supervised video object segmentation evaluation.

This Jupyter notebook shows one way to implement a simple first-order low-pass filter on sampled data in discrete time.

The best solution of the Weather Prediction track in the Yandex Shifts challenge

Cycle Consistent Adversarial Domain Adaptation (CyCADA)