Beta Shapley: a Unified and Noise-reduced Data Valuation Framework for Machine Learning

Last update: Nov 10, 2022

Related tags

Overview

Beta Shapley: a Unified and Noise-reduced Data Valuation Framework for Machine Learning

This repository provides an implementation of the paper Beta Shapley: a Unified and Noise-reduced Data Valuation Framework for Machine Learning accepted at AISTATS 2022 as oral presentation. We propose a noise-reduced data valuation method, Beta Shapley, which is powerful at capturing the importance of data points.

Quick start

We provide a notebook using the Covertype dataset. It shows how to compute the Beta Shapley value and its application on several downstream ML tasks.

--> Beta Shapley can identify noisy samples by focusing marginal contributions on small cardinalities.

--> Beta Shapley on the CIFAR100 test dataset. Mislabeled data points have negative Beta Shapley values, meaning they actually harm the model performance. Beta Shapley can detect mislabeled points.

Files

betashap/ShapEngine.py: main class for computing Beta-Shapley.

betashap/data.py: handles loading and preprocessing datasets.

Beta Shapley: a Unified and Noise-reduced Data Valuation Framework for Machine Learning

Related tags

Overview

Beta Shapley: a Unified and Noise-reduced Data Valuation Framework for Machine Learning

Quick start

Files

Owner

Yongchan Kwon

A bare-bones TensorFlow framework for Bayesian deep learning and Gaussian process approximation

Run Keras models in the browser, with GPU support using WebGL

Unofficial PyTorch implementation of "RTM3D: Real-time Monocular 3D Detection from Object Keypoints for Autonomous Driving" (ECCV 2020)

Implementation of a memory efficient multi-head attention as proposed in the paper, "Self-attention Does Not Need O(n²) Memory"

PyTorch Implementation of Daft-Exprt: Robust Prosody Transfer Across Speakers for Expressive Speech Synthesis

DecoupledNet is semantic segmentation system which using heterogeneous annotations

Codebase for Amodal Segmentation through Out-of-Task andOut-of-Distribution Generalization with a Bayesian Model

Efficient 3D Backbone Network for Temporal Modeling

quantize aware training package for NCNN on pytorch

Bottleneck Transformers for Visual Recognition

MG-GCN: Scalable Multi-GPU GCN Training Framework

OCRA (Object-Centric Recurrent Attention) source code

structured-generative-modeling

Improved Fitness Optimization Landscapes for Sequence Design

Jax/Flax implementation of Variational-DiffWave.

A Python package to process & model ChEMBL data.

PyTorch implementation of probabilistic deep forecast applied to air quality.

Cycle Consistent Adversarial Domain Adaptation (CyCADA)

One-Shot Neural Ensemble Architecture Search by Diversity-Guided Search Space Shrinking

PyToch implementation of A Novel Self-supervised Learning Task Designed for Anomaly Segmentation