AdaPool: Exponential Adaptive Pooling for Information-Retaining Downsampling
Abstract
Pooling layers are essential building blocks of Convolutional Neural Networks (CNNs) that reduce computational overhead and increase the receptive fields of proceeding convolutional operations. They aim to produce downsampled volumes that closely resemble the input volume while, ideally, also being computationally and memory efficient. It is a challenge to meet both requirements jointly. To this end, we propose an adaptive and exponentially weighted pooling method named adaPool. Our proposed method uses a parameterized fusion of two sets of pooling kernels that are based on the exponent of the Dice-Sørensen coefficient and the exponential maximum, respectively. A key property of adaPool is its bidirectional nature. In contrast to common pooling methods, weights can be used to upsample a downsampled activation map. We term this method adaUnPool. We demonstrate how adaPool improves the preservation of detail through a range of tasks including image and video classification and object detection. We then evaluate adaUnPool on image and video frame super-resolution and frame interpolation tasks. For benchmarking, we introduce Inter4K, a novel high-quality, high frame-rate video dataset. Our combined experiments demonstrate that adaPool systematically achieves better results across tasks and backbone architectures, while introducing a minor additional computational and memory overhead.
[arXiv preprint -- coming soon]
| Original |  |
 |
 |
 |
 |
 |
|---|---|---|---|---|---|---|
| adaPool |  |
 |
 |
 |
 |
 |
Dependencies
All parts of the code assume that torch is of version 1.4 or higher. There might be instability issues on previous versions.
This work relies on the previous repo for exponential maximum pooling (alexandrosstergiou/SoftPool). Before opening an issue please do have a look at that repository as common problems in running or installation have been addressed.
! Disclaimer: This repository is heavily structurally influenced on Ziteng Gao's LIP repo https://github.com/sebgao/LIP
Installation
You can build the repo through the following commands:
$ git clone https://github.com/alexandrosstergiou/adaPool.git
$ cd adaPool-master/pytorch
$ make install
--- (optional) ---
$ make test
Usage
You can load any of the 1D, 2D or 3D variants after the installation with:
# Ensure that you import `torch` first!
import torch
import adapool_cuda
# For function calls
from adaPool import adapool1d, adapool2d, adapool3d, adaunpool
from adaPool import edscwpool1d, edscwpool2d, edscwpool3d
from adaPool import empool1d, empool2d, empool3d
from adaPool import idwpool1d, idwpool2d, idwpool3d
# For class calls
from adaPool import AdaPool1d, AdaPool2d, AdaPool3d
from adaPool import EDSCWPool1d, EDSCWPool2d, EDSCWPool3d
from adaPool import EMPool1d, EMPool2d, EMPool3d
from adaPool import IDWPool1d, IDWPool2d, IDWPool3d
(ada/edscw/em/idw)pool<x>d: Are functional interfaces for each of the respective pooling methods.(Ada/Edscw/Em/Idw)Pool<x>d: Are the class version to create objects that can be referenced in the code.
Citation
@article{stergiou2021adapool,
title={AdaPool: Exponential Adaptive Pooling for Information-Retaining Downsampling},
author={Stergiou, Alexandros and Poppe, Ronald},
journal={arXiv preprint},
year={2021}}
Licence
MIT
48 Nov 30, 2022
176 Dec 7, 2022
87 Oct 19, 2022
![[CVPR 2021] Official PyTorch Implementation for](https://github.com/codeslake/IFAN/raw/main/assets/IFAN_network.jpg)
173 Dec 30, 2022
59 Dec 22, 2022
873 Jan 6, 2023
15 Nov 21, 2022
15 Nov 18, 2022
326 Dec 30, 2022
242 Jan 07, 2023
1.5k Jan 01, 2023
2 Sep 15, 2022
1.7k Dec 29, 2022
10 Oct 10, 2022
427 Dec 13, 2022
60 Jan 03, 2023
22 Dec 30, 2022
196 Jan 05, 2023
46 Sep 05, 2022
40 Nov 03, 2022
31 Nov 04, 2022
6.9k Jan 01, 2023
65 Dec 26, 2022
38 Dec 08, 2022
284 Dec 27, 2022
55 Nov 24, 2022
584 Dec 31, 2022
15 Dec 26, 2022