Neural machine translation between the writings of Shakespeare and modern English using TensorFlow

Last update: Dec 28, 2022

Overview

Shakespeare translations using TensorFlow

This is an example of using the new Google's TensorFlow library on monolingual translation going from modern English to Shakespeare based on research from Wei Xu.

Prepare

First download the TensorFlow library depending on your platform:

pip install https://storage.googleapis.com/tensorflow/mac/tensorflow-0.5.0-py2-none-any.whl # for mac
pip install https://storage.googleapis.com/tensorflow/linux/cpu/tensorflow-0.5.0-cp27-none-linux_x86_64.whl # for ubuntu

Grabs parallel data.
Gets train, dev split.
Builds vocabulary
Converts parallel data into ids

From the root directory:

python -m tensorshake.get_data
python -m tensorshake.prepare_corpus

Delete /cache to start anew.

Train

Use the example BASH script to train the model. This saves the check points in the --train_dir directory. If you run it again, the training process continues from the check point. To restart with fresh parameters, simply delete/rename the check points.

./run.sh

Results

Benchmarks from original paper. (Shakespeare -> Modern English)

Input	Output
i will bite thee by the ear for that jest .	i ’ ll bite you by the ear for that joke .
what further woe conspires against mine age ?	what ’ s true despair conspires against my old age ?
how doth my lady ?	how is my lady ?
hast thou slain tybalt ?	have you killed tybalt ?
an i might live to see thee married once , i have my wish .	if i could live to see you married, i ’ ve my wish .
benvolio , who began this bloody fray ?	benvolio , who started this bloody fight itself ?
what is your will ?	what do you want ?
call her forth to me .	bring her out to me .

Cherrypicked examples from this repo (Modern English -> Shakespeare)

Input	Output
but you’re not listening to me.	but you do not hear me .
Gregory, on my word, we will not be humiliated, like carrying coal.	regory , we 'll not carry coals .
but he got the promotion.	he is the friend .
i can hit quickly, if i'm motivated.	i strike , i am moved .
Did you just give us the finger, sir?	have you leave the thumb , sir ?
You don’t know what you’re doing!	you do not what you know you .
have you killed Tybalt?	hast thou slain tybalt ?
Why, Romeo, are you crazy?	why , art thou mad , mad ?

Pre-Trained Models

Here is a link for an example model: https://s3-us-west-2.amazonaws.com/foxtype-nlp/tensorshake/model_cache.zip

Possible improvements

word embeddings
beam search
language model reranking

Neural machine translation between the writings of Shakespeare and modern English using TensorFlow

Related tags

Overview

Shakespeare translations using TensorFlow

Prepare

Train

Results

Pre-Trained Models

Possible improvements

Owner

Motoki Wu

Semi-supervised Transfer Learning for Image Rain Removal. In CVPR 2019.

A New Approach to Overgenerating and Scoring Abstractive Summaries

Repo for "TableParser: Automatic Table Parsing with Weak Supervision from Spreadsheets" at [email protected]

Parallel Latent Tree-Induction for Faster Sequence Encoding

[CVPR2021] DoDNet: Learning to segment multi-organ and tumors from multiple partially labeled datasets

Examples of using f2py to get high-speed Fortran integrated with Python easily

Labelbox is the fastest way to annotate data to build and ship artificial intelligence applications

Retinal vessel segmentation based on GT-UNet

PySOT - SenseTime Research platform for single object tracking, implementing algorithms like SiamRPN and SiamMask.

Learning an Adaptive Meta Model-Generator for Incrementally Updating Recommender Systems

Data and analysis code for an MS on SK VOC genomes phenotyping/neutralisation assays

Improving adversarial robustness by a coupling rejection strategy

Code release for paper: The Boombox: Visual Reconstruction from Acoustic Vibrations

This repo is official PyTorch implementation of MobileHumanPose: Toward real-time 3D human pose estimation in mobile devices(CVPRW 2021).

Randstad Artificial Intelligence Challenge (powered by VGEN). Soluzione proposta da Stefano Fiorucci (anakin87) - primo classificato

NBEATSx: Neural basis expansion analysis with exogenous variables

Official implementation for paper: A Latent Transformer for Disentangled Face Editing in Images and Videos.

Colab notebook and additional materials for Python-driven analysis of redlining data in Philadelphia

A wrapper around SageMaker ML Lineage Tracking extending ML Lineage to end-to-end ML lifecycles, including additional capabilities around Feature Store groups, queries, and other relevant artifacts.

codebase for "A Theory of the Inductive Bias and Generalization of Kernel Regression and Wide Neural Networks"