about me

Hi, my name is João and I am a Biometrics and AI Engineer. I have completed my Ph.D. degree in Electrical and Computers Engineering in 2022 and my M.Sc. degree in Bioengineering (field of Biomedical Engineering) in 2017 at Faculdade de Engenharia da Universidade do Porto (FEUP).

Since 2024, I have been a Research Engineer at Vision-Box, working on biometrics and computer vision technologies for seamless and effortless authentication solutions in airports and border control. From 2022 to 2023, I worked on the THEIA and ATLAS projects at Bosch, pushing the boundaries of self-driving cars. I contributed to the development of intelligent perception algorithms to interpret sensor data (especially LIDAR), to give vehicles information on their environment and surroundings and to support autonomous driving decisions.

From 2017 to 2022, my doctoral research with the Visual Computing and Machine Intelligence (VCMI) research group at INESC TEC (Porto, Portugal) has focused on developing novel and robust pattern recognition methodologies for biometric recognition and wellbeing monitoring (emotion, drowsiness, activity, among other parameters). These focused on the use of seamless/unobtrusive data sources, especially in the scenario of driver/passenger monitoring on intelligent vehicles, and included major contributions to the topic of ECG biometrics.

Welcome to my website, where I present a little bit more about myself and my work. Feel free to contact me with any question or proposal, I am always looking for new opportunities to develop my skills and expand my knowledge.

experience
see more
research
Biometrics

Biometric recognition is the art of recognising individuals based on intrinsic characteristics, like fingerprints, face video, or iris images. These characteristics are always carried by the person, and are harder to forget, misplace, steal, or copy than ID cards or passwords.

My research is focused on developing more effective, robust, and secure biometric systems. I have focused mainly on the electrocardiogram as a biometric trait, given its hidden nature that makes it more difficult to steal or counterfeit. However, I have also worked on other traits, especially face image and video.

While biometric recognition is the main focus of my research, I have also delved into the topics of template security, presentation attack detection and, more recently, the use of interpretability tools to explain decisions given by deep biometric models.

Pattern Recognition

When looking at a picture, humans immediately recognise there are people in it, maybe some trees, a house, and the sky in the background. For a computer, however, a picture is no more than a matrix of organised numeric values. The same applies to signals, video, or any other data.

In Pattern Recognition, a subarea of Artificial Intelligence, researchers focus on making computers able to detect, discriminate, and identify patterns in data. For that, we use signal processing, image analysis, and/or machine learning methods for computers to learn to understand data.

My research focuses mainly in pattern recognition for biometrics. However, I have also worked on image analysis for automatic medical diagnosis, and on more fundamental machine learning topics including weakly-supervised learning and ordinal classification.

Electrocardiogram

The electrocardiogram (ECG) is the signal that measures the flow of electrical currents across the heart. It is not only a key tool for clinical diagnosis of heart conditions, but a carrier of valuable personal information on identity, health, and emotional states.

Through my research, I create algorithms that use the ECG for automatic recognition of identity, emotions, and fatigue in human-computer interfaces. Specifically, I focus on challenging off-the-person signals acquired unobtrusively, through electrodes seamlessly integrated in common objects such as wearables, smartphones, or steering wheels.

One of my main goals is to make the ECG biometric algorithms as effective and robust as face or fingerprint biometrics, while reataining the higher security it offers as a hidden biometric trait.

Wellbeing Monitoring

The variability of a person's traits is often a nuisance for biometric recognition. However, it often reveals valuable information that could be used to understand other aspects and characteristics of the subjects, including their health and emotional states.

Face image and video has long been used to understand facial expressions and link them to emotional states, despite claims of unreliability. Physiological traits like the ECG include more intrinsic information on health and emotions, that is much harder to fake than facial expressions.

My research in wellbeing monitoring is mainly focused on combining ECG and face video information for more robust emotion, stress, and fatigue recognition. This work is especially focused on human-machine interface contexts, e.g., for real-time monitoring of vehicle drivers.

publications
selected publications
Multimodal PointPillars for Efficient Object Detection in Autonomous Vehicles IEEE Transactions on Intelligent Vehicles M. Oliveira, R. Cerqueira, J. R. Pinto, J. Fonseca, and L. F. Teixeira 2024
Secure Triplet Loss: Achieving Cancelability and Non-Linkability in End-to-End Deep Biometrics IEEE Transactions on Biometrics, Behavior, and Identity Science J. R. Pinto, M. V. Correia, and J. S. Cardoso 2021
Explaining ECG Biometrics: Is It All In The QRS? 19th International Conference of the Biometrics Special Interest Group (BIOSIG 2020) J. R. Pinto and J. S. Cardoso 2020
An End-to-End Convolutional Neural Network for ECG-Based Biometric Authentication 10th IEEE International Conference in Biometrics: Theory, Applications and Systems (BTAS '19) J. R. Pinto and J. S. Cardoso 2019
Evolution, Current Challenges, and Future Possibilities in ECG Biometrics IEEE Access J. R. Pinto, J. S. Cardoso, and A. Lourenço 2018
see full list
activity
5awards
7research projects
15scientific events
16master theses supervised
23interns supervised
131verified peer reviews
my cv download
Biometrics and AI Engineer