Official Code for "Constrained Mean Shift Using Distant Yet Related Neighbors for Representation Learning"

Last update: Nov 25, 2022

Related tags

Deep Learning CMSF

Overview

CMSF

Official Code for "Constrained Mean Shift Using Distant Yet Related Neighbors for Representation Learning"

Requirements

Python >= 3.7.6
PyTorch >= 1.4
torchvision >= 0.5.0
faiss-gpu >= 1.6.1

Install PyTorch and ImageNet dataset following the official PyTorch ImageNet training code. We used Python 3.7 for our experiments.

Install PyTorch (pytorch.org)

To run NN and CMSF-KM, you require to install FAISS.

FAISS:

Install FAISS (https://github.com/facebookresearch/faiss/blob/master/INSTALL.md)

Training Self-Supservised CMSF-KM

python self_supervised/train_msf_km.py \
  --cos \
  --weak_strong \
  --learning_rate 0.05 \
  --epochs 200 \
  --arch resnet50 \
  --topk 5 \
  --momentum 0.99 \
  --mem_bank_size 128000 \
  --num_clusters 50000 \
  --checkpoint_path <CHECKPOINT PATH> \
  <DATASET PATH>

Training Self-Supservised CMSF-2Q

python self_supervised/train_msf_2q.py \
  --cos \
  --weak_strong \
  --learning_rate 0.05 \
  --epochs 200 \
  --arch resnet50 \
  --topk 5 \
  --momentum 0.99 \
  --mem_bank_size 128000 \
  --topkp 5 \
  --checkpoint_path <CHECKPOINT PATH> \
  <DATASET PATH>

Training Supservised

Following command can be used to train the CMSF(Supervised Learning)

python supervised/train_sup_msf.py \
  --cos \
  --weak_strong \
  --learning_rate 0.05 \
  --epochs 200 \
  --arch resnet50 \
  --topk 10 \
  --momentum 0.99 \
  --mem_bank_size 128000 \
  --checkpoint_path <CHECKPOINT PATH> \
  <DATASET PATH>

License

This project is under the MIT license.

Official Code for "Constrained Mean Shift Using Distant Yet Related Neighbors for Representation Learning"

Related tags

Overview

CMSF

Requirements

Training Self-Supservised CMSF-KM

Training Self-Supservised CMSF-2Q

Training Supservised

License

Owner

This repository contains a re-implementation of the code for the CVPR 2021 paper "Omnimatte: Associating Objects and Their Effects in Video."

Implementation of CrossViT: Cross-Attention Multi-Scale Vision Transformer for Image Classification

(JMLR'19) A Python Toolbox for Scalable Outlier Detection (Anomaly Detection)

A plug-and-play library for neural networks written in Python

A comprehensive and up-to-date developer education platform for Urbit.

The FIRST GANs-based omics-to-omics translation framework

A scikit-learn compatible neural network library that wraps PyTorch

Inteligência artificial criada para realizar interação social com idosos.

Anchor-free Oriented Proposal Generator for Object Detection

3D ResNets for Action Recognition (CVPR 2018)

Code for the paper "Next Generation Reservoir Computing"

A collection of pre-trained StyleGAN2 models trained on different datasets at different resolution.

Reference implementation of code generation projects from Facebook AI Research. General toolkit to apply machine learning to code, from dataset creation to model training and evaluation. Comes with pretrained models.

🏎️ Accelerate training and inference of 🤗 Transformers with easy to use hardware optimization tools

a reimplementation of Holistically-Nested Edge Detection in PyTorch

Easy to use Audio Tagging in PyTorch

Repository containing the PhD Thesis "Formal Verification of Deep Reinforcement Learning Agents"

Learning Facial Representations from the Cycle-consistency of Face (ICCV 2021)

Official repository for the paper "Going Beyond Linear Transformers with Recurrent Fast Weight Programmers"

Implementation of a Transformer, but completely in Triton