ITTR - Pytorch
Implementation of the Hybrid Perception Block (HPB) and Dual-Pruned Self-Attention (DPSA) block from the ITTR paper for Image to Image Translation using Transformers.
Install
$ pip install ITTR-pytorch
Usage
They had 9 blocks of Hybrid Perception Block (HPB) in the paper
import torch
from ITTR_pytorch import HPB
block = HPB(
dim = 512, # dimension
dim_head = 32, # dimension per attention head
heads = 8, # number of attention heads
attn_height_top_k = 16, # number of top indices to select along height, for the attention pruning
attn_width_top_k = 16, # number of top indices to select along width, for the attention pruning
attn_dropout = 0., # attn dropout
ff_mult = 4, # expansion factor of feedforward
ff_dropout = 0. # feedforward dropout
)
fmap = torch.randn(1, 512, 32, 32)
out = block(fmap) # (1, 512, 32, 32)
You can also use the dual-pruned self-attention as so
import torch
from ITTR_pytorch import DPSA
attn = DPSA(
dim = 512, # dimension
dim_head = 32, # dimension per attention head
heads = 8, # number of attention heads
height_top_k = 48, # number of top indices to select along height, for the attention pruning
width_top_k = 48, # number of top indices to select along width, for the attention pruning
dropout = 0. # attn dropout
)
fmap = torch.randn(1, 512, 32, 32)
out = attn(fmap) # (1, 512, 32, 32)
Citations
@inproceedings{Zheng2022ITTRUI,
title = {ITTR: Unpaired Image-to-Image Translation with Transformers},
author = {Wanfeng Zheng and Qiang Li and Guoxin Zhang and Pengfei Wan and Zhongyuan Wang},
year = {2022}
}
5 Sep 15, 2022
43 Dec 28, 2022
18 Nov 17, 2022
23 Nov 30, 2022
20 Dec 12, 2022
138 Dec 24, 2022
22 Dec 14, 2022
211 Dec 28, 2022
285 Jan 02, 2023
100 Dec 19, 2022
2.3k Dec 27, 2022
110 Dec 03, 2022
5 Dec 08, 2021
17 Oct 15, 2022
243 Dec 29, 2022
13 Dec 13, 2022
201 Dec 12, 2022
33 Dec 27, 2022
135 Dec 22, 2022
66 Dec 14, 2022
2 Jan 18, 2022
28 Nov 21, 2022
29.8k Jan 02, 2023
44 Oct 19, 2022
286 Dec 06, 2022
159 Apr 04, 2022
11 Feb 22, 2022