LPAQA: Language model Prompt And Query Archive

This repository contains data and code for the paper How Can We Know What Language Models Know?

Install

Our repository is based on LAMA. Please download our fork from here and follow the instructions to set up the environment and download pre-trained language models.

# clone LPAQA
git clone https://github.com/jzbjyb/LPAQA.git LPAQA
# clone LAMA
git clone https://github.com/jzbjyb/LAMA.git LAMA
pushd LAMA && git reset --hard b6b1885c64de5981f249a8b65de25cb0802b4bd5 && rm -rf .git && popd
mv LAMA/* LPAQA/ && rm -rf LAMA
# follow the instructions to install
cd LPAQA
./setup.sh

Retrieve factual knowledge from LMs

For example, to query the owner of MSN (Microsoft is the answer), you can either use manually created prompts (x is owned by y):

python lama/eval_generation.py --lm bert --t "MSN is owned by [MASK]."

or use LPAQA that ensembles a diversity of prompts:

# mined prompts
python lama/eval_ensemble.py --lm bert --subject MSN --relation P127 --prompts prompt/mine
# paraphrased prompts
python lama/eval_ensemble.py --lm bert --subject MSN --relation P127 --prompts prompt/paraphrase

Language model Prompt And Query Archive

Related tags

Overview

LPAQA: Language model Prompt And Query Archive

Install

Retrieve factual knowledge from LMs

Owner

ICCV2021 Oral SA-ConvONet: Sign-Agnostic Optimization of Convolutional Occupancy Networks

A Human-in-the-Loop workflow for creating HD images from text

FaceQgen: Semi-Supervised Deep Learning for Face Image Quality Assessment

Adjust Decision Boundary for Class Imbalanced Learning

A Shading-Guided Generative Implicit Model for Shape-Accurate 3D-Aware Image Synthesis

[CVPR2021] DoDNet: Learning to segment multi-organ and tumors from multiple partially labeled datasets

Wide Residual Networks (WideResNets) in PyTorch

Coded illumination for improved lensless imaging

The repository contains source code and models to use PixelNet architecture used for various pixel-level tasks. More details can be accessed at .

Understanding Convolution for Semantic Segmentation

Code for HLA-Face: Joint High-Low Adaptation for Low Light Face Detection (CVPR21)

Image morphing without reference points by applying warp maps and optimizing over them.

[SIGGRAPH'22] StyleGAN-XL: Scaling StyleGAN to Large Diverse Datasets

A library for differentiable nonlinear optimization.

Data pipelines for both TensorFlow and PyTorch!

Attempt at implementation of a simple GAN using Keras

Bayesian algorithm execution (BAX)

SSD: A Unified Framework for Self-Supervised Outlier Detection [ICLR 2021]

Trash Sorter Extraordinaire is a software which efficiently detects the different types of waste in a pile of random trash through feeding it pictures or videos.

Using contrastive learning and OpenAI's CLIP to find good embeddings for images with lossy transformations