This is a project of data parallel that running on NLP tasks.

Last update: Dec 12, 2021

Related tags

Text Data & NLP torch-ddp

Overview

torch-ddp

This is a project of data parallel that running on NLP tasks.

You can e-mail Jiamao at [email protected] , if you have any questions.

Requirements

Our code works with the following environment.

python>=3.7
pytorch>=1.3
transformers
spacy

Tips

you should contain zh_core_web_sm belonged spacy when you running the project.

Run

0:python pre_myfile.py 1:python generate.py 2:python data__process.py 3:python python -m torch.distributed.launch --nproc_per_node=1 --use_env train.py.py

Owner

GitHub Repository

Toward a Visual Concept Vocabulary for GAN Latent Space, ICCV 2021

Toward a Visual Concept Vocabulary for GAN Latent Space Code and data from the ICCV 2021 paper Sarah Schwettmann, Evan Hernandez, David Bau, Samuel Kl

13 Dec 23, 2022

Simplified diarization pipeline using some pretrained models - audio file to diarized segments in a few lines of code

simple_diarizer Simplified diarization pipeline using some pretrained models. Made to be a simple as possible to go from an input audio file to diariz

65 Dec 30, 2022

State-of-the-art NLP through transformer models in a modular design and consistent APIs.

Trapper (Transformers wRAPPER) Trapper is an NLP library that aims to make it easier to train transformer based models on downstream tasks. It wraps h

42 Sep 21, 2022

Text preprocessing, representation and visualization from zero to hero.

Text preprocessing, representation and visualization from zero to hero. From zero to hero • Installation • Getting Started • Examples • API • FAQ • Co

2.7k Jan 08, 2023

Universal End2End Training Platform, including pre-training, classification tasks, machine translation, and etc.

背景安装教程快速上手（一）预训练模型（二）机器翻译（三）文本分类 TenTrans 进阶 1. 多语言机器翻译 2. 跨语言预训练背景 TrenTrans是一个统一的端到端的多语言多任务预训练平台，支持多种预训练方式，以及序列生成和自然语言理解任务。安装教程 git clone git

42 Dec 20, 2022

VD-BERT: A Unified Vision and Dialog Transformer with BERT

VD-BERT: A Unified Vision and Dialog Transformer with BERT PyTorch Code for the following paper at EMNLP2020: Title: VD-BERT: A Unified Vision and Dia

44 Nov 01, 2022

This github repo is for Neurips 2021 paper, NORESQA A Framework for Speech Quality Assessment using Non-Matching References.

NORESQA: Speech Quality Assessment using Non-Matching References This is a Pytorch implementation for using NORESQA. It contains minimal code to predi

36 Dec 08, 2022

AI Assistant for Building Reliable, High-performing and Fair Multilingual NLP Systems

37 Nov 29, 2022

Wake: Context-Sensitive Automatic Keyword Extraction Using Word2vec

Wake Wake: Context-Sensitive Automatic Keyword Extraction Using Word2vec Abstract استخراج خودکار کلمات کلیدی متون کوتاه فارسی با استفاده از word2vec ب

1 Dec 17, 2021

A collection of GNN-based fake news detection models.

This repo includes the Pytorch-Geometric implementation of a series of Graph Neural Network (GNN) based fake news detection models. All GNN models are implemented and evaluated under the User Prefere

251 Jan 01, 2023

The PyTorch based implementation of continuous integrate-and-fire (CIF) module.

CIF-PyTorch This is a PyTorch based implementation of continuous integrate-and-fire (CIF) module for end-to-end (E2E) automatic speech recognition (AS

24 Dec 29, 2022

Machine learning classifiers to predict American Sign Language .

ASL-Classifiers American Sign Language (ASL) is a natural language that serves as the predominant sign language of Deaf communities in the United Stat

0 Feb 08, 2022

Summarization, translation, sentiment-analysis, text-generation and more at blazing speed using a T5 version implemented in ONNX.

Summarization, translation, Q&A, text generation and more at blazing speed using a T5 version implemented in ONNX. This package is still in alpha stag

211 Dec 28, 2022

This is a project of data parallel that running on NLP tasks.

Related tags

Overview

torch-ddp

Requirements

Tips

Run

Owner

Toward a Visual Concept Vocabulary for GAN Latent Space, ICCV 2021

Simplified diarization pipeline using some pretrained models - audio file to diarized segments in a few lines of code

State-of-the-art NLP through transformer models in a modular design and consistent APIs.

Text preprocessing, representation and visualization from zero to hero.

Universal End2End Training Platform, including pre-training, classification tasks, machine translation, and etc.

VD-BERT: A Unified Vision and Dialog Transformer with BERT

This github repo is for Neurips 2021 paper, NORESQA A Framework for Speech Quality Assessment using Non-Matching References.

AI Assistant for Building Reliable, High-performing and Fair Multilingual NLP Systems

Wake: Context-Sensitive Automatic Keyword Extraction Using Word2vec

A collection of GNN-based fake news detection models.

The PyTorch based implementation of continuous integrate-and-fire (CIF) module.

Machine learning classifiers to predict American Sign Language .

Summarization, translation, sentiment-analysis, text-generation and more at blazing speed using a T5 version implemented in ONNX.

The FinQA dataset from paper: FinQA: A Dataset of Numerical Reasoning over Financial Data

Unlimited Call - Text Bombing Tool

SummerTime - Text Summarization Toolkit for Non-experts

GPT-3 command line interaction

基于Transformer的单模型、多尺度的VAE模型

SGMC: Spectral Graph Matrix Completion

FactSumm: Factual Consistency Scorer for Abstractive Summarization