Aligning LLMs with human preferences with eye-tracking rewards

To better understand the potential of cognitive data in improving machine learning models, specifically Large Language Models (LLMs), we propose GazeReward, an innovative framework for aligning LLMs with human preferences by incorporating eye-tracking (ET) data into reward modeling. LLMs like GPT-4 [1], Llama 3 [2], and others have revolutionized Natural Language Processing (NLP), excelling in …

User-controlled Form Adaptation by Unsupervised Learning

To support context-aware adaptive user interfaces, UCLouvain and Univ. of Luxembourg joined their efforts to present Scaler, a novel web environment for designing and deploying forms in which adaptation is initiated by the system and/or the user according to a vector profile, but always under the user’s control, using two unsupervised learning methods: The paper …

Participation in ETRA 2024

The 2024 ACM Symposium on Eye Tracking Research and Applications (ETRA) was held in Glasgow, Scotland, from June 4th to June 7th. Attendees had the opportunity to engage in discussions and attend presentations on cutting-edge research shaping the future of eye-tracking technology and its applications. Parvin Emami from University of Luxembourg presented the research paper …

At the IHIET-AI Conference

The 11th International Conference on Human Interaction and Emerging Technologies (IHIET) is the leading global forum for the convergence of interdisciplinary expertise in areas such as healthcare, sports medicine, engineering and artificial intelligence (AI). The conference aimed to facilitate discussions, presentations and collaborations that push the boundaries of innovation and address pressing societal challenges. Andreas …

Adaptive Visualization Framework for Human-Centric Data Interaction in Time-Critical Environments

We are thrilled to share that our abstract, titled “Adaptive Visualization Framework for Human-Centric Data Interaction in Time-Critical Environments,” has been accepted for presentation at the 11th International Conference on Human Interaction & Emerging Technologies (IHIET-AI 2024). This work is a significant downstate of the importance of the SYMBIOTIK project goals towards making data visualization …

Evaluating a Large Language Model on Searching for GUI Layouts

Recent research has investigated the use of Large Language Models (LLMs) to engineer Graphical User Interfaces (GUIs) using Generative Artificial Intelligence (GenAI). We have developed an LLM-based tool, called Instigator, for the purpose of facilitating the search for GUI layouts in this study. The purpose of our study was to determine whether such a tool …

Context-aware Adaptive Visualizations for Critical Decision Making

We are pleased to announce our very first joint publication! It is an academic paper where we introduce the SYMBIOTIK framework together with an extensive discussion of the current challenges and opportunities for adaptive user interfaces. Here is the abstract: User interface adaptations for Information Visualisation (InfoVis) have yet to unlock their potential in critical …