Evaluating LLMs for visualization generation and understanding

Abstract Information Visualization has been utilized to gain insights from complex data. In recent times, Large Language models (LLMs) have performed very well in many tasks. In this paper, we showcase the capabilities of different popular LLMs to generate code for visualization based on simple prom...

Full description

Saved in:
Bibliographic Details
Main Authors: Saadiq Rauf Khan, Vinit Chandak, Sougata Mukherjea
Format: Article
Language:English
Published: Springer 2025-05-01
Series:Discover Data
Subjects:
Online Access:https://doi.org/10.1007/s44248-025-00036-4
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:Abstract Information Visualization has been utilized to gain insights from complex data. In recent times, Large Language models (LLMs) have performed very well in many tasks. In this paper, we showcase the capabilities of different popular LLMs to generate code for visualization based on simple prompts. We also analyze the power of LLMs to understand some common visualizations by answering questions. Our study shows that LLMs could generate code for some simpler visualizations such as bar and pie charts. Moreover, they could answer simple questions about visualizations. However, LLMs also have several limitations. For example, some of them had difficulty generating complex visualizations, such as violin plot. LLMs also made errors in answering some questions about visualizations, for example, identifying relationships between close boundaries and determining lengths of shapes. We believe that our insights can be used to improve both LLMs and Information Visualization systems.
ISSN:2731-6955