Complete system for facial identity system

Last update: May 02, 2022

Overview

Facial Identity system

⭐️ ⭐️ ⭐ This repo is still updating ⭐ ⭐ ⭐

Introduction

This project is to utilize facial recognition to create a facial identity system. Our backend is constructed by one-shot models which is more flexible for adding a new face. The system is built on personal computer and Jetson Nano. Jetson Nano is used to recognized the faces and upload the detected information to Firebase. Users who used our application with account and password can log in to control the database and also see the information.

Folder structure

| - backend - For Personal computer
|
| - csv_file - Contribution for the CelebA dataset
|
| - jetson - Files for Jetson Nano
|
| - model - Model we used for training and detecting

Features

Our facial identity system includes below features:

One-shot face recognition, add your faces without extra training
Complete database operation (upload, delete, update)
Fine-tuned your model at any time
Use as a monitor
Visualize the features

Installation

Personal computer

$ pip install -r requirements.txt

Jetson Nano

$ pip install -r requirements.txt

Increase swap space on Jetson Nano (Optional)

Our nano would crush when using cuda until we increase its swap memory 🥳

> /etc/fstab'">

# 4.0G is the swap space
$ sudo fallocate -l 4.0G /swapfile
$ sudo chmod 600 /swapfile
$ sudo mkswap /swapfile
$ sudo swapon /swapfile

# Create swap memory on every reboot
$ sudo bash -c 'echo "/var/swapfile swap swap defaults 0 0" >> /etc/fstab'

Experiments

Result for real-time training

Type		Original	New
Cosine Similarity	Positive	0.9889	0.9863
Cosine Similarity	Negative	0.7673	0.6695
L2 Distance	Positive	0.1491	0.1655
L2 Distance	Negative	0.6822	0.8130

Run time using different methods

second per image (s / img)

CPU (Pytorch)	Cuda (Pytorch)	ONNX	TensorRT
4.11s	75.329s	0.1260s	1.975s

It is surprising that cuda consumes lots of time. We guess it is because cuda rely on huge amount of swap memory that slow down its runtime 😢 .

Contribution to CelebA

In order to train one-shot model, we obtain the face's coordinates beforehand. All files are placed in csv_file.

The coordinates were obtained from facenet-pytorch

File name	Description
`id_multiple.csv`	To ensure each celebrity have at least two images (For positive usage).
`cropped.csv`	Include the face's coordinates and ensure each celebrity has at least two images.

Citation

@inproceedings{liu2015faceattributes,
  title = {Deep Learning Face Attributes in the Wild},
  author = {Liu, Ziwei and Luo, Ping and Wang, Xiaogang and Tang, Xiaoou},
  booktitle = {Proceedings of International Conference on Computer Vision (ICCV)},
  month = {December},
  year = {2015} 
}

@inproceedings{koch2015siamese,
  title={Siamese neural networks for one-shot image recognition},
  author={Koch, Gregory and Zemel, Richard and Salakhutdinov, Ruslan and others},
  booktitle={ICML deep learning workshop},
  volume={2},
  year={2015},
  organization={Lille}
}

@inproceedings{chen2020simple,
  title={A simple framework for contrastive learning of visual representations},
  author={Chen, Ting and Kornblith, Simon and Norouzi, Mohammad and Hinton, Geoffrey},
  booktitle={International conference on machine learning},
  pages={1597--1607},
  year={2020},
  organization={PMLR}
}

@inproceedings{schroff2015facenet,
  title={Facenet: A unified embedding for face recognition and clustering},
  author={Schroff, Florian and Kalenichenko, Dmitry and Philbin, James},
  booktitle={Proceedings of the IEEE conference on computer vision and pattern recognition},
  pages={815--823},
  year={2015}
}

GazeScroller - Using Facial Movements to perform Hands-free Gesture on the system

GazeScroller Using Facial Movements to perform Hands-free Gesture on the system

2 Jan 5, 2022

An automated facial recognition based attendance system (desktop application)

Facial_Recognition_based_Attendance_System An automated facial recognition based attendance system (desktop application) Made using Python, Tkinter an

1 Jun 21, 2022

The world's simplest facial recognition api for Python and the command line

Face Recognition You can also read a translated version of this file in Chinese 简体中文版 or in Korean 한국어 or in Japanese 日本語. Recognize and manipulate fa

46.9k Jan 3, 2023

Spontaneous Facial Micro Expression Recognition using 3D Spatio-Temporal Convolutional Neural Networks

Spontaneous Facial Micro Expression Recognition using 3D Spatio-Temporal Convolutional Neural Networks Abstract Facial expression recognition in video

103 Dec 29, 2022

Facial Action Unit Intensity Estimation via Semantic Correspondence Learning with Dynamic Graph Convolution

FAU Implementation of the paper: Facial Action Unit Intensity Estimation via Semantic Correspondence Learning with Dynamic Graph Convolution. Yingruo

78 Nov 29, 2022

Py-FEAT: Python Facial Expression Analysis Toolbox

Py-FEAT is a suite for facial expressions (FEX) research written in Python. This package includes tools to detect faces, extract emotional facial expressions (e.g., happiness, sadness, anger), facial muscle movements (e.g., action units), and facial landmarks, from videos and images of faces, as well as methods to preprocess, analyze, and visualize FEX data.

Computational Social Affective Neuroscience Laboratory

147 Jan 6, 2023

Instant Real-Time Example-Based Style Transfer to Facial Videos

Complete system for facial identity system

Related tags

Overview

Facial Identity system

⭐️ ⭐️ ⭐ This repo is still updating ⭐ ⭐ ⭐

Introduction

Folder structure

Features

Installation

Personal computer

Jetson Nano

Increase swap space on Jetson Nano (Optional)

Experiments

Result for real-time training

Run time using different methods

Contribution to CelebA

Citation

You might also like...

GazeScroller - Using Facial Movements to perform Hands-free Gesture on the system

An automated facial recognition based attendance system (desktop application)

The world's simplest facial recognition api for Python and the command line

Spontaneous Facial Micro Expression Recognition using 3D Spatio-Temporal Convolutional Neural Networks

Facial Action Unit Intensity Estimation via Semantic Correspondence Learning with Dynamic Graph Convolution

Py-FEAT: Python Facial Expression Analysis Toolbox

Instant Real-Time Example-Based Style Transfer to Facial Videos

Keeping it safe - AI Based COVID-19 Tracker using Deep Learning and facial recognition

Official PyTorch implementation of Retrieve in Style: Unsupervised Facial Feature Transfer and Retrieval.

Releases(weight)

weight(Jan 8, 2022)

Owner

Pytorch implementation of the paper Time-series Generative Adversarial Networks

Minimal deep learning library written from scratch in Python, using NumPy/CuPy.

This repository contains various models targetting multimodal representation learning, multimodal fusion for downstream tasks such as multimodal sentiment analysis.

CVPR 2021 Challenge on Super-Resolution Space

Exposure Time Calculator (ETC) and radial velocity precision estimator for the Near InfraRed Planet Searcher (NIRPS) spectrograph

A transformer model to predict pathogenic mutations

This is the code repository implementing the paper "TreePartNet: Neural Decomposition of Point Clouds for 3D Tree Reconstruction".

Universal Adversarial Triggers for Attacking and Analyzing NLP (EMNLP 2019)

This is the official code of L2G, Unrolling and Recurrent Unrolling in Learning to Learn Graph Topologies.

Semi-supervised Representation Learning for Remote Sensing Image Classification Based on Generative Adversarial Networks

Details about the wide minima density hypothesis and metrics to compute width of a minima

Automatically measure the facial Width-To-Height ratio and get facial analysis results provided by Microsoft Azure

Variational Attention: Propagating Domain-Specific Knowledge for Multi-Domain Learning in Crowd Counting (ICCV, 2021)

A disassembler for the RP2040 Programmable I/O State-machine!

PyTorch implementation for Score-Based Generative Modeling through Stochastic Differential Equations (ICLR 2021, Oral)

YOLTv4 builds upon YOLT and SIMRDWN, and updates these frameworks to use the most performant version of YOLO, YOLOv4

A PyTorch implementation of "CoAtNet: Marrying Convolution and Attention for All Data Sizes".

Course content and resources for the AIAIART course.

🤗 Push your spaCy pipelines to the Hugging Face Hub

Code for our ACL 2021 paper - ConSERT: A Contrastive Framework for Self-Supervised Sentence Representation Transfer