EmoTag helps you train emotion detection model for Chinese audios

Last update: Sep 07, 2022

Overview

emoTag

emoTag helps you train emotion detection model for Chinese audios.

Environment

pip install -r requirement.txt

Data

We used Emotional Speech Dataset (ESD) for Speech Synthesis and Voice Conversion from HLT Singapore.

Train Emotion Classifier

Use this command to train a classifier. Adjust training setups in conf/logfbank_train-emo.json.

python train.py --config conf/logfbank_train-emo.json --name task_trial_1

Models and logs will be find in exp/.

usage: train.py [-h] [-c CONFIG] [-r RESUME] [-n NAME] [--lr LR] [--bs BS]
                [--train_utt2wav TRAIN_UTT2WAV] [--val_utt2wav VAL_UTT2WAV]
                [--blocks BLOCKS] [--optimizer OPTIMIZER]
                [--train_pad0 TRAIN_PAD0] [--devel_pad0 DEVEL_PAD0]
                [--pretrain PRETRAIN]

PyTorch Template

optional arguments:
  -h, --help            show this help message and exit
  -c CONFIG, --config CONFIG
                        config file path (default: None)
  -r RESUME, --resume RESUME
                        path to latest checkpoint (default: None)
  -n NAME, --name NAME
  --lr LR, --learning_rate LR
  --bs BS, --batch_size BS
  --train_utt2wav TRAIN_UTT2WAV
  --val_utt2wav VAL_UTT2WAV
  --blocks BLOCKS
  --optimizer OPTIMIZER
  --train_pad0 TRAIN_PAD0
  --devel_pad0 DEVEL_PAD0
  --pretrain PRETRAIN

Infer labels

python infer_label.py

Adjust the vad_file param and code if necessary to adapt to new tasks. infer_label.py adopted multiprocessing, increased cpu utilities rate and inference efficiency. See usage details below.

usage: infer_label.py [-h] [--vad_file VAD_FILE] [--model_dir MODEL_DIR]
                      [--output_dir OUTPUT_DIR]

parse model info

optional arguments:
  -h, --help            show this help message and exit
  --vad_file VAD_FILE
  --model_dir MODEL_DIR
  --output_dir OUTPUT_DIR

EmoTag helps you train emotion detection model for Chinese audios

Related tags

Overview

emoTag

Environment

Data

Train Emotion Classifier

Infer labels

Owner

_zza

Pairwise Learning for Neural Link Prediction for OGB (PLNLP-OGB)

Lab Materials for MIT 6.S191: Introduction to Deep Learning

Yolov5-lite - Minimal PyTorch implementation of YOLOv5

YOLOX-RMPOLY

Multi-Task Learning as a Bargaining Game

Official implementation of Long-Short Transformer in PyTorch.

This code is a toolbox that uses Torch library for training and evaluating the ERFNet architecture for semantic segmentation.

Open Source Differentiable Computer Vision Library for PyTorch

Full Stack Deep Learning Labs

Match SafeGraph POIs with Data collected through a cultural resource survey in Washington DC.

Romanian Automatic Speech Recognition from the ROBIN project

Official PyTorch implementation of "Synthesis of Screentone Patterns of Manga Characters"

Cl datasets - PyTorch image dataloaders and utility functions to load datasets for supervised continual learning

Resco: A simple python package that report the effect of deep residual learning

For auto aligning, cropping, and scaling HR and LR images for training image based neural networks

Evolutionary Scale Modeling (esm): Pretrained language models for proteins

Betafold - AlphaFold with tunings

Automatically align face images 🙃→🙂. Can also do windowing and warping.

Cognate Detection Repository

Ensembling Off-the-shelf Models for GAN Training