New paper accepted in TiiS

We are pleased to announce that the following paper was accepted for publication in the ACM Transactions on Interactive Intelligent Systems (TiiS) 2025 journal. Congratulations to the authors!

1. HAIFAI: Human-AI Interaction for Mental Face Reconstruction

   Florian Strohm, Mihai Bâce, Andreas Bulling

   ACM Transactions on Interactive Intelligent Systems (TiiS), , 2025.

   Abstract Links BibTeX Project

   We present HAIFAI - a novel two-stage system where humans and AI interact to tackle the challenging task of reconstructing a visual representation of a face that exists only in a person’s mind. In the first stage, users iteratively rank images our reconstruction system presents based on their resemblance to a mental image. These rankings, in turn, allow the system to extract relevant image features, fuse them into a unified feature vector, and use a generative model to produce an initial reconstruction of the mental image. The second stage leverages an existing face editing method, allowing users to manually refine and further improve this reconstruction using an easy-to-use slider interface for face shape manipulation. To avoid the need for tedious human data collection for training the reconstruction system, we introduce a computational user model of human ranking behaviour. For this, we collected a small face ranking dataset through an online crowd-sourcing study containing data from 275 participants. We evaluate HAIFAI and an ablated version in a 12-participant user study and demonstrate that our approach outperforms the previous state of the art regarding reconstruction quality, usability, perceived workload, and reconstruction speed. We further validate the reconstructions in a subsequent face ranking study with 18 participants and show that HAIFAI achieves a new state-of-the-art identification rate of 60.6%. These findings represent a significant advancement towards developing new interactive intelligent systems capable of reliably and effortlessly reconstructing a user’s mental image.

   doi: 10.48550/arXiv.2412.06323

   Paper Access: http://arxiv.org/abs/2412.06323

   @article{strohm25_tiis, title = {{HAIFAI}: {Human}-{AI} {Interaction} for {Mental} {Face} {Reconstruction}}, shorttitle = {{HAIFAI}}, url = {http://arxiv.org/abs/2412.06323}, doi = {10.48550/arXiv.2412.06323}, journal = {ACM Transactions on Interactive Intelligent Systems (TiiS)}, author = {Strohm, Florian and Bâce, Mihai and Bulling, Andreas}, year = {2025}, keywords = {Computer Science - Computer Vision and Pattern Recognition} }

Here are some related news you might like to read next:

• Best Journal Paper Award at ISMAR
• Paper accepted in Neural Computing and Applications
• Paper accepted in Frontiers in Cognition
• Paper accepted at ISMAR 2024
• Paper accepted in TVCG