This repo is built for paper: Attention Mechanisms in Computer Vision: A Survey paper
- TODO : Code about different attention mechanisms will come soon.
- TODO : Code link will come soon.
- TODO : collect more related papers. Contributions are welcome.
Channel attention
- Squeeze-and-Excitation Networks(CVPR2018) pdf, (PAMI2019 version) pdf
π₯ - Image superresolution using very deep residual channel attention networks(ECCV2018) pdf
π₯ - Context encoding for semantic segmentation(CVPR2018) pdf
π₯ - Spatio-temporal channel correlation networks for action classification(ECCV2018) pdf
- Global second-order pooling convolutional networks(CVPR2019) pdf
- Srm : A style-based recalibration module for convolutional neural networks(ICCV2019) pdf
- You look twice: Gaternet for dynamic filter selection in cnns(CVPR2019) pdf
- Second-order attention network for single image super-resolution(CVPR2019) pdf
π₯ - Spsequencenet: Semantic segmentation network on 4d point clouds(CVPR2020) pdf
- Ecanet: Efficient channel attention for deep convolutional neural networks (CVPR2020) pdf
π₯ - Gated channel transformation for visual recognition(CVPR2020) pdf
- Fcanet: Frequency channel attention networks(ICCV2021) pdf
Spatial attention
- Recurrent models of visual attention(NeurIPS2014), pdf
π₯ - Show, attend and tell: Neural image caption generation with visual attention(PMLR2015) pdf
π₯ - Draw: A recurrent neural network for image generation(ICML2015) pdf
π₯ - Spatial transformer networks(NeurIPS2015) pdf
π₯ - Multiple object recognition with visual attention(ICLR2015) pdf
π₯ - Action recognition using visual attention(arXiv2015) pdf
π₯ - Videolstm convolves, attends and flows for action recognition(arXiv2016) pdf
π₯ - Look closer to see better: Recurrent attention convolutional neural network for fine-grained image recognition(CVPR2017) pdf
π₯ - Learning multi-attention convolutional neural network for fine-grained image recognition(ICCV2017) pdf
π₯ - Diversified visual attention networks for fine-grained object classification(TMM2017) pdf
π₯ - Attentional pooling for action recognition(NeurIPS2017) pdf
π₯ - Non-local neural networks(CVPR2018) pdf
π₯ - Attentional shapecontextnet for point cloud recognition(CVPR2018) pdf
- Relation networks for object detection(CVPR2018) pdf
π₯ - a2-nets: Double attention networks(NeurIPS2018) pdf
π₯ - Attention-aware compositional network for person re-identification(CVPR2018) pdf
π₯ - Tell me where to look: Guided attention inference network(CVPR2018) pdf
π₯ - Pedestrian alignment network for large-scale person re-identification(TCSVT2018) pdf
π₯ - Learn to pay attention(ICLR2018) pdf
π₯ - Attention U-Net: Learning Where to Look for the Pancreas(MIDL2018) pdf
π₯ - Psanet: Point-wise spatial attention network for scene parsing(ECCV2018) pdf
π₯ - Self attention generative adversarial networks(ICML2019) pdf
π₯ - Attentional pointnet for 3d-object detection in point clouds(CVPRW2019) pdf
- Co-occurrent features in semantic segmentation(CVPR2019) pdf
- Attention augmented convolutional networks(ICCV2019) pdf
π₯ - Local relation networks for image recognition(ICCV2019) pdf
- Latentgnn: Learning efficient nonlocal relations for visual recognition(ICML2019) pdf
- Graph-based global reasoning networks(CVPR2019) pdf
π₯ - Gcnet: Non-local networks meet squeeze-excitation networks and beyond(ICCVW2019) pdf
π₯ - Asymmetric non-local neural networks for semantic segmentation(ICCV2019) pdf
π₯ - Looking for the devil in the details: Learning trilinear attention sampling network for fine-grained image recognition(CVPR2019) pdf
- Second-order non-local attention networks for person re-identification(ICCV2019) pdf
π₯ - End-to-end comparative attention networks for person re-identification(ICCV2019) pdf
π₯ - Modeling point clouds with self-attention and gumbel subset sampling(CVPR2019) pdf
- Diagnose like a radiologist: Attention guided convolutional neural network for thorax disease classification(arXiv 2019) pdf
- L2g autoencoder: Understanding point clouds by local-to-global reconstruction with hierarchical self-attention(arXiv 2019) pdf
- Generative pretraining from pixels(PMLR2020) pdf
- Exploring self-attention for image recognition(CVPR2020) pdf
- Cf-sis: Semantic-instance segmentation of 3d point clouds by context fusion with self attention(MM20) pdf
- Disentangled non-local neural networks(ECCV2020) pdf
- Relation-aware global attention for person re-identification(CVPR2020) pdf
- Segmentation transformer: Object-contextual representations for semantic segmentation(ECCV2020) pdf
π₯ - Spatial pyramid based graph reasoning for semantic segmentation(CVPR2020) pdf
- Self-supervised Equivariant Attention Mechanism for Weakly Supervised Semantic Segmentation(CVPR2020) pdf
- End-to-end object detection with transformers(ECCV2020) pdf
π₯ - Pointasnl: Robust point clouds processing using nonlocal neural networks with adaptive sampling(CVPR2020) pdf
- Rethinking semantic segmentation from a sequence-to-sequence perspective with transformers(CVPR2021) pdf
- An image is worth 16x16 words: Transformers for image recognition at scale(ICLR2021) pdf
π₯ - An empirical study of training selfsupervised vision transformers(CVPR2021) pdf
- Ocnet: Object context network for scene parsing(IJCV 2021) pdf
π₯ - Point transformer(ICCV 2021) pdf
- PCT: Point Cloud Transformer (CVMJ 2021) pdf
- Pre-trained image processing transformer(CVPR 2021) pdf
- An empirical study of training self-supervised vision transformers(ICCV 2021) pdf
- Segformer: Simple and efficient design for semantic segmentation with transformers(arxiv 2021) pdf
- Beit: Bert pre-training of image transformers(arxiv 2021) pdf
- Beyond selfattention: External attention using two linear layers for visual tasks(arxiv 2021) pdf
- Query2label: A simple transformer way to multi-label classification(arxiv 2021) pdf
- Transformer in transformer(arxiv 2021) pdf
Temporal attention
- Jointly attentive spatial-temporal pooling networks for video-based person re-identification (ICCV 2017) pdf
π₯ - Video person reidentification with competitive snippet-similarity aggregation and co-attentive snippet embedding(CVPR 2018) pdf
- Scan: Self-and-collaborative attention network for video person re-identification (TIP 2019) pdf
Branch attention
- Training very deep networks, (NeurIPS 2015) pdf
π₯ - Selective kernel networks,(CVPR 2019) pdf
π₯ - CondConv: Conditionally Parameterized Convolutions for Efficient Inference (NeurIPS 2019) pdf
- Dynamic convolution: Attention over convolution kernels (CVPR 2020) pdf
- ResNest: Split-attention networks (arXiv 2020) pdf
π₯
ChannelSpatial attention
- Residual attention network for image classification (CVPR 2017) pdf
π₯ - SCA-CNN: spatial and channel-wise attention in convolutional networks for image captioning,(CVPR 2017) pdf
π₯ - CBAM: convolutional block attention module, (ECCV 2018) pdf
π₯ - Harmonious attention network for person re-identification (CVPR 2018) pdf
π₯ - Recalibrating fully convolutional networks with spatial and channel βsqueeze and excitationβ blocks (TMI 2018) pdf
- Mancs: A multi-task attentional network with curriculum sampling for person re-identification (ECCV 2018) pdf
π₯ - Bam: Bottleneck attention module(BMVC 2018) pdf
π₯ - Pvnet: A joint convolutional network of point cloud and multi-view for 3d shape recognition (ACM MM 2018) pdf
- Learning what and where to attend,(ICLR 2019) pdf
- Dual attention network for scene segmentation (CVPR 2019) pdf
π₯ - Abd-net: Attentive but diverse person re-identification (ICCV 2019) pdf
- Mixed high-order attention network for person re-identification (ICCV 2019) pdf
- Mlcvnet: Multi-level context votenet for 3d object detection (CVPR 2020) pdf
- Improving convolutional networks with self-calibrated convolutions (CVPR 2020) pdf
- Relation-aware global attention for person re-identification (CVPR 2020) pdf
- Strip Pooling: Rethinking spatial pooling for scene parsing (CVPR 2020) pdf
- Rotate to attend: Convolutional triplet attention module, (WACV 2021) pdf
- Coordinate attention for efficient mobile network design (CVPR 2021) pdf
- Simam: A simple, parameter-free attention module for convolutional neural networks (ICML 2021) pdf
SpatialTemporal attention
- An end-to-end spatio-temporal attention model for human action recognition from skeleton data(AAAI 2017) pdf
π₯ - Diversity regularized spatiotemporal attention for video-based person re-identification (ArXiv 2018)
π₯ - Interpretable spatio-temporal attention for video action recognition (ICCVW 2019) pdf
- Hierarchical lstms with adaptive attention for visual captioning, (TPAMI 2020) pdf
- Stat: Spatial-temporal attention mechanism for video captioning, (TMM 2020) pdf_link
- Gta: Global temporal attention for video action understanding (ArXiv 2020) pdf
- Multi-granularity reference-aided attentive feature aggregation for video-based person re-identification (CVPR 2020) pdf
- Read: Reciprocal attention discriminator for image-to-video re-identification, (ECCV 2020) pdf
- Decoupled spatial-temporal transformer for video inpainting (ArXiv 2021) pdf
314 Dec 19, 2022
32 Dec 21, 2022
255 Sep 07, 2022
135 Dec 23, 2022
12 Oct 25, 2022
11 Nov 27, 2022
48 Aug 30, 2022
25 Dec 15, 2022
34 Dec 31, 2022
11.4k Jan 09, 2023
28 Dec 07, 2022
4.2k Jan 09, 2023
131 Dec 30, 2022
91 Dec 30, 2022
21 May 09, 2022
2.9k Jan 08, 2023
95 Dec 18, 2022
42 Jan 02, 2023
50 Nov 30, 2022
57 Dec 26, 2022