Self-trainable and adaptive sensor intelligence for selective data generation

With the increasing integration of machine learning into IoT devices, managing energy consumption and data transmission has become a critical challenge. Many IoT applications depend on complex computations performed on server-side infrastructure, necessitating efficient methods to reduce unnecessary...

Full description

Saved in:
Bibliographic Details
Main Authors: Arghavan Rezvani, Wenjun Huang, Hanning Chen, Yang Ni, Mohsen Imani
Format: Article
Language:English
Published: Frontiers Media S.A. 2025-01-01
Series:Frontiers in Artificial Intelligence
Subjects:
Online Access:https://www.frontiersin.org/articles/10.3389/frai.2024.1403187/full
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1832591659860230144
author Arghavan Rezvani
Wenjun Huang
Hanning Chen
Yang Ni
Mohsen Imani
author_facet Arghavan Rezvani
Wenjun Huang
Hanning Chen
Yang Ni
Mohsen Imani
author_sort Arghavan Rezvani
collection DOAJ
description With the increasing integration of machine learning into IoT devices, managing energy consumption and data transmission has become a critical challenge. Many IoT applications depend on complex computations performed on server-side infrastructure, necessitating efficient methods to reduce unnecessary data transmission. One promising solution involves deploying compact machine learning models near sensors, enabling intelligent identification and transmission of only relevant data frames. However, existing near-sensor models lack adaptability, as they require extensive pre-training and are often rigidly configured prior to deployment. This paper proposes a novel framework that fuses online learning, active learning, and knowledge distillation to enable adaptive, resource-efficient near-sensor intelligence. Our approach allows near-sensor models to dynamically fine-tune their parameters post-deployment using online learning, eliminating the need for extensive pre-labeling and training. Through a sequential training and execution process, the framework achieves continuous adaptability without prior knowledge of the deployment environment. To enhance performance while preserving model efficiency, we integrate knowledge distillation, enabling the transfer of critical insights from a larger teacher model to a compact student model. Additionally, active learning reduces the required training data while maintaining competitive performance. We validated our framework on both benchmark data from the MS COCO dataset and in a simulated IoT environment. The results demonstrate significant improvements in energy efficiency and data transmission optimization, highlighting the practical applicability of our method in real-world IoT scenarios.
format Article
id doaj-art-baa902ed5d2c4220b4e498aaa22ac159
institution Kabale University
issn 2624-8212
language English
publishDate 2025-01-01
publisher Frontiers Media S.A.
record_format Article
series Frontiers in Artificial Intelligence
spelling doaj-art-baa902ed5d2c4220b4e498aaa22ac1592025-01-22T07:14:37ZengFrontiers Media S.A.Frontiers in Artificial Intelligence2624-82122025-01-01710.3389/frai.2024.14031871403187Self-trainable and adaptive sensor intelligence for selective data generationArghavan RezvaniWenjun HuangHanning ChenYang NiMohsen ImaniWith the increasing integration of machine learning into IoT devices, managing energy consumption and data transmission has become a critical challenge. Many IoT applications depend on complex computations performed on server-side infrastructure, necessitating efficient methods to reduce unnecessary data transmission. One promising solution involves deploying compact machine learning models near sensors, enabling intelligent identification and transmission of only relevant data frames. However, existing near-sensor models lack adaptability, as they require extensive pre-training and are often rigidly configured prior to deployment. This paper proposes a novel framework that fuses online learning, active learning, and knowledge distillation to enable adaptive, resource-efficient near-sensor intelligence. Our approach allows near-sensor models to dynamically fine-tune their parameters post-deployment using online learning, eliminating the need for extensive pre-labeling and training. Through a sequential training and execution process, the framework achieves continuous adaptability without prior knowledge of the deployment environment. To enhance performance while preserving model efficiency, we integrate knowledge distillation, enabling the transfer of critical insights from a larger teacher model to a compact student model. Additionally, active learning reduces the required training data while maintaining competitive performance. We validated our framework on both benchmark data from the MS COCO dataset and in a simulated IoT environment. The results demonstrate significant improvements in energy efficiency and data transmission optimization, highlighting the practical applicability of our method in real-world IoT scenarios.https://www.frontiersin.org/articles/10.3389/frai.2024.1403187/fullactive learningintelligent sensingInternet of Thingsknowledge distillationmachine learningnear-sensor computing
spellingShingle Arghavan Rezvani
Wenjun Huang
Hanning Chen
Yang Ni
Mohsen Imani
Self-trainable and adaptive sensor intelligence for selective data generation
Frontiers in Artificial Intelligence
active learning
intelligent sensing
Internet of Things
knowledge distillation
machine learning
near-sensor computing
title Self-trainable and adaptive sensor intelligence for selective data generation
title_full Self-trainable and adaptive sensor intelligence for selective data generation
title_fullStr Self-trainable and adaptive sensor intelligence for selective data generation
title_full_unstemmed Self-trainable and adaptive sensor intelligence for selective data generation
title_short Self-trainable and adaptive sensor intelligence for selective data generation
title_sort self trainable and adaptive sensor intelligence for selective data generation
topic active learning
intelligent sensing
Internet of Things
knowledge distillation
machine learning
near-sensor computing
url https://www.frontiersin.org/articles/10.3389/frai.2024.1403187/full
work_keys_str_mv AT arghavanrezvani selftrainableandadaptivesensorintelligenceforselectivedatageneration
AT wenjunhuang selftrainableandadaptivesensorintelligenceforselectivedatageneration
AT hanningchen selftrainableandadaptivesensorintelligenceforselectivedatageneration
AT yangni selftrainableandadaptivesensorintelligenceforselectivedatageneration
AT mohsenimani selftrainableandadaptivesensorintelligenceforselectivedatageneration