Beta Shapley: a Unified and Noise-reduced Data Valuation Framework for Machine Learning

Last update: Nov 10, 2022

Related tags

Overview

Beta Shapley: a Unified and Noise-reduced Data Valuation Framework for Machine Learning

This repository provides an implementation of the paper Beta Shapley: a Unified and Noise-reduced Data Valuation Framework for Machine Learning accepted at AISTATS 2022 as oral presentation. We propose a noise-reduced data valuation method, Beta Shapley, which is powerful at capturing the importance of data points.

Quick start

We provide a notebook using the Covertype dataset. It shows how to compute the Beta Shapley value and its application on several downstream ML tasks.

--> Beta Shapley can identify noisy samples by focusing marginal contributions on small cardinalities.

--> Beta Shapley on the CIFAR100 test dataset. Mislabeled data points have negative Beta Shapley values, meaning they actually harm the model performance. Beta Shapley can detect mislabeled points.

Files

betashap/ShapEngine.py: main class for computing Beta-Shapley.

betashap/data.py: handles loading and preprocessing datasets.

Beta Shapley: a Unified and Noise-reduced Data Valuation Framework for Machine Learning

Related tags

Overview

Beta Shapley: a Unified and Noise-reduced Data Valuation Framework for Machine Learning

Quick start

Files

Owner

Yongchan Kwon

🔥 Cogitare - A Modern, Fast, and Modular Deep Learning and Machine Learning framework for Python

Doing fast searching of nearest neighbors in high dimensional spaces is an increasingly important problem

Supporting code for the Neograd algorithm

Turning SymPy expressions into JAX functions

Emotion Recognition from Facial Images

Faster RCNN pytorch windows

(CVPR 2022 - oral) Multi-View Depth Estimation by Fusing Single-View Depth Probability with Multi-View Geometry

BBB streaming without Xorg and Pulseaudio and Chromium and other nonsense (heavily WIP)

Line-level Handwritten Text Recognition (HTR) system implemented with TensorFlow.

FLVIS: Feedback Loop Based Visual Initial SLAM

Embeddinghub is a database built for machine learning embeddings.

Implementation EfficientDet: Scalable and Efficient Object Detection in PyTorch

Repository for MDPGT

Neural-Pull: Learning Signed Distance Functions from Point Clouds by Learning to Pull Space onto Surfaces(ICML 2021)

Predicting Event Memorability from Contextual Visual Semantics

Implementation of Geometric Vector Perceptron, a simple circuit for 3d rotation equivariance for learning over large biomolecules, in Pytorch. Idea proposed and accepted at ICLR 2021

License Plate Detection Application

Provided is code that demonstrates the training and evaluation of the work presented in the paper: "On the Detection of Digital Face Manipulation" published in CVPR 2020.

Deep Learning Interviews book: Hundreds of fully solved job interview questions from a wide range of key topics in AI.

Self-supervised learning optimally robust representations for domain generalization.