PyTorch implementation of the Crafting Better Contrastive Views for Siamese Representation Learning

Last update: Dec 28, 2022

Related tags

Overview

Crafting Better Contrastive Views for Siamese Representation Learning

This is the official PyTorch implementation of the ContrastiveCrop paper:

@article{peng2022crafting,
  title={Crafting Better Contrastive Views for Siamese Representation Learning},
  author={Peng, Xiangyu and Wang, Kai and Zhu, Zheng and You, Yang},
  journal={arXiv preprint arXiv:2202.03278},
  year={2022}
}

This repo includes PyTorch implementation of SimCLR, MoCo, BYOL and SimSiam, as well as their DDP training code.

Preparation

Create a python enviroment with pytorch >= 1.8.1.
pip install -r requirements.txt
Modify dataset root in the config file.

Pre-train

# MoCo, CIFAR-10
python DDP_moco_ccrop.py configs/small/cifar10/moco_alpha0.1_th0.1.py

# SimSiam, CIFAR-100
python DDP_simsiam_ccrop.py configs/small/cifar100/simsiam_alpha0.1_th0.1.py

Linear Evaluation

# CIFAR-10
python DDP_linear.py configs/linear/cifar10_res18.py --load ./checkpoints/small/cifar10/moco_alpha0.1_th0.1/last.pth

# CIFAR-100
python DDP_linear.py configs/linear/cifar100_res18.py --load ./checkpoints/small/cifar100/simsiam_alpha0.1_th0.1/last.pth

More models and datasets coming soon.

PyTorch implementation of the Crafting Better Contrastive Views for Siamese Representation Learning

Related tags

Overview

Crafting Better Contrastive Views for Siamese Representation Learning

Preparation

Pre-train

Linear Evaluation

Owner

Neural Scene Flow Fields using pytorch-lightning, with potential improvements

This project provides the code and datasets for 'CapSal: Leveraging Captioning to Boost Semantics for Salient Object Detection', CVPR 2019.

This is code of book "Learn Deep Learning with PyTorch"

salabim - discrete event simulation in Python

Time should be taken seer-iously

CLIP (Contrastive Language–Image Pre-training) trained on Indonesian data

MINOS: Multimodal Indoor Simulator

Frequency Domain Image Translation: More Photo-realistic, Better Identity-preserving

A Pytorch implementation of "LegoNet: Efficient Convolutional Neural Networks with Lego Filters" (ICML 2019).

This Jupyter notebook shows one way to implement a simple first-order low-pass filter on sampled data in discrete time.

Implementation for Learning to Track with Object Permanence

Monify: an Expense tracker Program implemented in a Graphical User Interface that allows users to keep track of their expenses

Tracing Versus Freehand for Evaluating Computer-Generated Drawings (SIGGRAPH 2021)

Official Pytorch implementation of the paper: "Locally Shifted Attention With Early Global Integration"

FID calculation with proper image resizing and quantization steps

FlingBot: The Unreasonable Effectiveness of Dynamic Manipulations for Cloth Unfolding

Code for PhySG: Inverse Rendering with Spherical Gaussians for Physics-based Relighting and Material Editing

Self-Supervised depth kalilia

FuseDream: Training-Free Text-to-Image Generationwith Improved CLIP+GAN Space OptimizationFuseDream: Training-Free Text-to-Image Generationwith Improved CLIP+GAN Space Optimization

Deep Learning and Reinforcement Learning Library for Scientists and Engineers 🔥