Improving the robustness and performance of biomedical NLP models through adversarial training

Last update: Sep 20, 2022

Related tags

Overview

RobustBioNLP

Improving the robustness and performance of biomedical NLP models through adversarial training

In this repository you can find supplimentary materials and source codes for the paper titled "Improving the robustness and accuracy of biomedical language models through adversarial training". The paper can be found on arxive at (link to the arxive paper).

Biomedical/clinical NLP tasks

We used various biomedical/clinical text processing datasets covering five different NLP tasks.

Links to the datasets:

BioText: https://biotext.berkeley.edu/
MedNLI: https://physionet.org/content/mednli/1.0.0/
MedSTS: https://n2c2.dbmi.hms.harvard.edu/track1
PubMed-RCT: https://github.com/Franck-Dernoncourt/pubmed-rct
PubMed-QA: https://pubmedqa.github.io/

Robust-BioMed-RoBERTa models

Here you can find links to the Robust-BioMede-RoBERTa models separately fine-tuned on adversarial samples for each of the biomedical/clinical NLP tasks:

Robust-BioMed-RoBERTa-RelationClassification: https://huggingface.co/mmoradi/Robust-Biomed-RoBERTa-RelationClassification
Robust-BioMed-RoBERTa-TextualInference: https://huggingface.co/mmoradi/Robust-Biomed-RxoBERTa-TextualInference
Robust-BioMed-RoBERTa-SemanticSimilarity: https://huggingface.co/mmoradi/Robust-Biomed-RoBERTa-SemanticSimilarity
Robust-BioMed-RoBERTa-TextClassification: https://huggingface.co/mmoradi/Robust-Biomed-RoBERTa-TextClassification
Robust-BioMed-RoBERTa-QuestionAnswering: https://huggingface.co/mmoradi/Robust-Biomed-RoBERTa-QuestionAnswering

Improving the robustness and performance of biomedical NLP models through adversarial training

Related tags

Overview

RobustBioNLP

Biomedical/clinical NLP tasks

Robust-BioMed-RoBERTa models

Owner

Milad Moradi

pixelNeRF: Neural Radiance Fields from One or Few Images

Automatic Differentiation Multipole Moment Molecular Forcefield

codebase for "A Theory of the Inductive Bias and Generalization of Kernel Regression and Wide Neural Networks"

Self-Supervised Learning for Domain Adaptation on Point-Clouds

StyleGAN2 with adaptive discriminator augmentation (ADA) - Official TensorFlow implementation

PyTorch implementation of PSPNet

A PyTorch implementation of SIN: Superpixel Interpolation Network

coldcuts is an R package to automatically generate and plot segmentation drawings in R

This is the pytorch implementation for the paper: Learning Accurate Performance Predictors for Ultrafast Automated Model Compression, which is in submission to TPAMI

This is a template for the Non-autoregressive Deep Learning-Based TTS model (in PyTorch).

GUI for TOAD-GAN, a PCG-ML algorithm for Token-based Super Mario Bros. Levels.

Unofficial implementation of Point-Unet: A Context-Aware Point-Based Neural Network for Volumetric Segmentation

Pose Transformers: Human Motion Prediction with Non-Autoregressive Transformers

This is 2nd term discrete maths project done by UCU students that uses backtracking to solve various problems.

EFENet: Reference-based Video Super-Resolution with Enhanced Flow Estimation

Public repo for the ICCV2021-CVAMD paper "Is it Time to Replace CNNs with Transformers for Medical Images?"

SymmetryNet: Learning to Predict Reflectional and Rotational Symmetries of 3D Shapes from Single-View RGB-D Images

Implementation of CrossViT: Cross-Attention Multi-Scale Vision Transformer for Image Classification

Pytorch implementation of the paper DocEnTr: An End-to-End Document Image Enhancement Transformer.

Benchmark datasets, data loaders, and evaluators for graph machine learning

Improving the robustness and performance of biomedical NLP models through adversarial training

Related tags

Overview

RobustBioNLP

Biomedical/clinical NLP tasks

Robust-BioMed-RoBERTa models

Owner

Milad Moradi

pixelNeRF: Neural Radiance Fields from One or Few Images

Automatic Differentiation Multipole Moment Molecular Forcefield

codebase for "A Theory of the Inductive Bias and Generalization of Kernel Regression and Wide Neural Networks"

Self-Supervised Learning for Domain Adaptation on Point-Clouds

StyleGAN2 with adaptive discriminator augmentation (ADA) - Official TensorFlow implementation

PyTorch implementation of PSPNet

A PyTorch implementation of SIN: Superpixel Interpolation Network

coldcuts is an R package to automatically generate and plot segmentation drawings in R

This is the pytorch implementation for the paper: *Learning Accurate Performance Predictors for Ultrafast Automated Model Compression*, which is in submission to TPAMI

This is a template for the Non-autoregressive Deep Learning-Based TTS model (in PyTorch).

GUI for TOAD-GAN, a PCG-ML algorithm for Token-based Super Mario Bros. Levels.

Unofficial implementation of Point-Unet: A Context-Aware Point-Based Neural Network for Volumetric Segmentation

Pose Transformers: Human Motion Prediction with Non-Autoregressive Transformers

This is 2nd term discrete maths project done by UCU students that uses backtracking to solve various problems.

EFENet: Reference-based Video Super-Resolution with Enhanced Flow Estimation

Public repo for the ICCV2021-CVAMD paper "Is it Time to Replace CNNs with Transformers for Medical Images?"

SymmetryNet: Learning to Predict Reflectional and Rotational Symmetries of 3D Shapes from Single-View RGB-D Images

Implementation of CrossViT: Cross-Attention Multi-Scale Vision Transformer for Image Classification

Pytorch implementation of the paper DocEnTr: An End-to-End Document Image Enhancement Transformer.

Benchmark datasets, data loaders, and evaluators for graph machine learning

This is the pytorch implementation for the paper: Learning Accurate Performance Predictors for Ultrafast Automated Model Compression, which is in submission to TPAMI