Unified Visual-Aware Representations for Data Analytics

One of the characteristics of big data is its internal complexity and variety manifested in many types of datasets that are to be managed, searched, or analyzed. In their natural forms, some data entities are unstructured, such as texts or multimedia objects, while some are structured but too comple...

Full description

Saved in:
Bibliographic Details
Main Authors: Ladislav Peska, Ivana Sixtova, David Hoksza, David Bernhauer, Jakub Lokoc, Tomas Skopal
Format: Article
Language:English
Published: IEEE 2025-01-01
Series:IEEE Access
Subjects:
Online Access:https://ieeexplore.ieee.org/document/10854212/
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1832575626962272256
author Ladislav Peska
Ivana Sixtova
David Hoksza
David Bernhauer
Jakub Lokoc
Tomas Skopal
author_facet Ladislav Peska
Ivana Sixtova
David Hoksza
David Bernhauer
Jakub Lokoc
Tomas Skopal
author_sort Ladislav Peska
collection DOAJ
description One of the characteristics of big data is its internal complexity and variety manifested in many types of datasets that are to be managed, searched, or analyzed. In their natural forms, some data entities are unstructured, such as texts or multimedia objects, while some are structured but too complex (e.g., high-dimensional tabular data). Due to the many different forms of data managed in many domain-specific problems, there are many different data representations used – tailored to a specific data form, domain and task. In this paper, we propose a framework for universal visual representations of complex data. The desired property of the visualizations is the ability to visually encode the semantic features of the original data. Hence, processing of visualizations (images) by generic deep learning models results in deep feature vectors that could be uniformly used in standard data retrieval/analytics tasks. Specifically, we develop a semi-automated transfer learning pipeline for transformation of input arbitrary tabular data into visual representations. The visual representations serve for data analytics tasks performed by human users as well as serve for universal data representations used in machine learning models for automated tasks. We show in large study that visual representations of complex data are effective in a number of domains while we also propose a recommender to help with the parameterization of the entire pipeline for certain domains and use cases. In summary, the proposed framework enables rapid prototyping of data representations (in an arbitrary domain) using a shared concept – visual representations applicable in data analytics using generic deep learning models.
format Article
id doaj-art-f170c1384b164a2280a798a6d4121a5a
institution Kabale University
issn 2169-3536
language English
publishDate 2025-01-01
publisher IEEE
record_format Article
series IEEE Access
spelling doaj-art-f170c1384b164a2280a798a6d4121a5a2025-01-31T23:04:57ZengIEEEIEEE Access2169-35362025-01-0113196941971510.1109/ACCESS.2025.353433010854212Unified Visual-Aware Representations for Data AnalyticsLadislav Peska0https://orcid.org/0000-0001-8082-4509Ivana Sixtova1https://orcid.org/0000-0003-2874-1217David Hoksza2https://orcid.org/0000-0003-4679-0557David Bernhauer3https://orcid.org/0000-0003-2368-7506Jakub Lokoc4https://orcid.org/0000-0002-3558-4144Tomas Skopal5https://orcid.org/0000-0002-6591-0879SIRET Research Group, Faculty of Mathematics and Physics, Charles University, Prague, CzechiaSIRET Research Group, Faculty of Mathematics and Physics, Charles University, Prague, CzechiaSIRET Research Group, Faculty of Mathematics and Physics, Charles University, Prague, CzechiaSIRET Research Group, Faculty of Mathematics and Physics, Charles University, Prague, CzechiaSIRET Research Group, Faculty of Mathematics and Physics, Charles University, Prague, CzechiaSIRET Research Group, Faculty of Mathematics and Physics, Charles University, Prague, CzechiaOne of the characteristics of big data is its internal complexity and variety manifested in many types of datasets that are to be managed, searched, or analyzed. In their natural forms, some data entities are unstructured, such as texts or multimedia objects, while some are structured but too complex (e.g., high-dimensional tabular data). Due to the many different forms of data managed in many domain-specific problems, there are many different data representations used – tailored to a specific data form, domain and task. In this paper, we propose a framework for universal visual representations of complex data. The desired property of the visualizations is the ability to visually encode the semantic features of the original data. Hence, processing of visualizations (images) by generic deep learning models results in deep feature vectors that could be uniformly used in standard data retrieval/analytics tasks. Specifically, we develop a semi-automated transfer learning pipeline for transformation of input arbitrary tabular data into visual representations. The visual representations serve for data analytics tasks performed by human users as well as serve for universal data representations used in machine learning models for automated tasks. We show in large study that visual representations of complex data are effective in a number of domains while we also propose a recommender to help with the parameterization of the entire pipeline for certain domains and use cases. In summary, the proposed framework enables rapid prototyping of data representations (in an arbitrary domain) using a shared concept – visual representations applicable in data analytics using generic deep learning models.https://ieeexplore.ieee.org/document/10854212/Data visualizationuniversal data representationsdeep learningdata analyticsuser study
spellingShingle Ladislav Peska
Ivana Sixtova
David Hoksza
David Bernhauer
Jakub Lokoc
Tomas Skopal
Unified Visual-Aware Representations for Data Analytics
IEEE Access
Data visualization
universal data representations
deep learning
data analytics
user study
title Unified Visual-Aware Representations for Data Analytics
title_full Unified Visual-Aware Representations for Data Analytics
title_fullStr Unified Visual-Aware Representations for Data Analytics
title_full_unstemmed Unified Visual-Aware Representations for Data Analytics
title_short Unified Visual-Aware Representations for Data Analytics
title_sort unified visual aware representations for data analytics
topic Data visualization
universal data representations
deep learning
data analytics
user study
url https://ieeexplore.ieee.org/document/10854212/
work_keys_str_mv AT ladislavpeska unifiedvisualawarerepresentationsfordataanalytics
AT ivanasixtova unifiedvisualawarerepresentationsfordataanalytics
AT davidhoksza unifiedvisualawarerepresentationsfordataanalytics
AT davidbernhauer unifiedvisualawarerepresentationsfordataanalytics
AT jakublokoc unifiedvisualawarerepresentationsfordataanalytics
AT tomasskopal unifiedvisualawarerepresentationsfordataanalytics