SMIS - Semantically Multi-modal Image Synthesis(CVPR 2020)

Last update: Dec 01, 2022

Related tags

Deep Learning SMIS

Overview

Semantically Multi-modal Image Synthesis

Project page / Paper / Demo

Semantically Multi-modal Image Synthesis(CVPR2020).
Zhen Zhu, Zhiliang Xu, Ansheng You, Xiang Bai

Requirements

torch>=1.0.0
torchvision
dominate
dill
scikit-image
tqdm
opencv-python

Getting Started

Data Preperation

DeepFashion
Note: We provide an example of the DeepFashion dataset. That is slightly different from the DeepFashion used in our paper due to the impact of the COVID-19.

Cityscapes
The Cityscapes dataset can be downloaded at here

ADE20K
The ADE20K dataset can be downloaded at here

Test/Train the models

Download the tar of the pretrained models from the Google Drive Folder. Save it in checkpoints/ and unzip it. There are deepfashion.sh, cityscapes.sh and ade20k.sh in the scripts folder. Change the parameters like --dataroot and so on, then comment or uncomment some code to test/train model. And you can specify the --test_mask for SMIS test.

Acknowledgments

Our code is based on the popular SPADE

SMIS - Semantically Multi-modal Image Synthesis(CVPR 2020)

Related tags

Overview

Semantically Multi-modal Image Synthesis

Project page / Paper / Demo

Requirements

Getting Started

Data Preperation

Test/Train the models

Acknowledgments

Owner

Parris, the automated infrastructure setup tool for machine learning algorithms.

DeceFL: A Principled Decentralized Federated Learning Framework

This repo provides the base code for pytorch-lightning and weight and biases simultaneous integration.

Prefix-Tuning: Optimizing Continuous Prompts for Generation

Code for database and frontend of webpage for Neural Fields in Visual Computing and Beyond.

Code for "Intra-hour Photovoltaic Generation Forecasting based on Multi-source Data and Deep Learning Methods."

METER: Multimodal End-to-end TransformER

Implementation of Transformer in Transformer, pixel level attention paired with patch level attention for image classification, in Pytorch

Torch-ngp - A pytorch implementation of the hash encoder proposed in instant-ngp

[CVPR2021] The source code for our paper 《Removing the Background by Adding the Background: Towards Background Robust Self-supervised Video Representation Learning》.

a general-purpose Transformer based vision backbone

Negative Sample Matters: A Renaissance of Metric Learning for Temporal Grounding

FB-tCNN for SSVEP Recognition

NuPIC Studio is an all-in-one tool that allows users create a HTM neural network from scratch

Automatic differentiation with weighted finite-state transducers.

✔️ Visual, reactive testing library for Julia. Time machine included.

Semi-supervised Adversarial Learning to Generate Photorealistic Face Images of New Identities from 3D Morphable Model

Predicting Auction Sale Price using the kaggle bulldozer auction sales data: Modeling with Ensembles vs Neural Network

Official PyTorch implementation of StyleGAN3

A very lightweight monitoring system for Raspberry Pi clusters running Kubernetes.

SMIS - Semantically Multi-modal Image Synthesis(CVPR 2020)

Related tags

Overview

Semantically Multi-modal Image Synthesis

Project page / Paper / Demo

Requirements

Getting Started

Data Preperation

Test/Train the models

Acknowledgments

Owner

Parris, the automated infrastructure setup tool for machine learning algorithms.

DeceFL: A Principled Decentralized Federated Learning Framework

This repo provides the base code for pytorch-lightning and weight and biases simultaneous integration.

Prefix-Tuning: Optimizing Continuous Prompts for Generation

Code for database and frontend of webpage for Neural Fields in Visual Computing and Beyond.

Code for "Intra-hour Photovoltaic Generation Forecasting based on Multi-source Data and Deep Learning Methods."

METER: Multimodal End-to-end TransformER

Implementation of Transformer in Transformer, pixel level attention paired with patch level attention for image classification, in Pytorch

Torch-ngp - A pytorch implementation of the hash encoder proposed in instant-ngp

[CVPR2021] The source code for our paper 《Removing the Background by Adding the Background: Towards Background Robust Self-supervised Video Representation Learning》.

a general-purpose Transformer based vision backbone

Negative Sample Matters: A Renaissance of Metric Learning for Temporal Grounding

FB-tCNN for SSVEP Recognition

NuPIC Studio is an all­-in-­one tool that allows users create a HTM neural network from scratch

Automatic differentiation with weighted finite-state transducers.

✔️ Visual, reactive testing library for Julia. Time machine included.

Semi-supervised Adversarial Learning to Generate Photorealistic Face Images of New Identities from 3D Morphable Model

Predicting Auction Sale Price using the kaggle bulldozer auction sales data: Modeling with Ensembles vs Neural Network

Official PyTorch implementation of StyleGAN3

A very lightweight monitoring system for Raspberry Pi clusters running Kubernetes.

NuPIC Studio is an all-in-one tool that allows users create a HTM neural network from scratch