Edge Computing-Aided Dynamic Wireless Charging and Trip Planning of UAVs by Palwasha W. Shaikh, Hussein T. Mouftah

“…Additionally, a dynamic arrival management algorithm is introduced to minimize UAV wait times to enhance operational efficiency. …”
Get full text

Using Graph Neural Networks in Reinforcement Learning With Application to Monte Carlo Simulations in Power System Reliability Analysis by Oystein Rognes Solheim, Boye Annfelt Hoverstad, Magnus Korpas

“…Recent efforts from the authors indicate that optimal power flow solvers could potentially be replaced with the policies of deep reinforcement learning agents, to obtain significant speedups of Monte Carlo simulations while retaining close to optimal accuracies. …”
Get full text

Control strategy of robotic manipulator based on multi-task reinforcement learning by Tao Wang, Ziming Ruan, Yuyan Wang, Chong Chen

“…To tackle this issue, instead of uniform parameter sharing, we propose an adjudicate reconfiguration network model, which we integrate into the Soft Actor-Critic (SAC) algorithm to address the optimization problems brought about by parameter sharing in multi-task reinforcement learning algorithms. …”
Get full text

A Hybrid Deep Learning Model for UAV Path Planning in Dynamic Environments by Junchi Zhang, Yanning Xian, Xun Zhu, Hongtao Deng

“…While its variants can converge to the optimal solution, they suffer from more memory and computation consumption. …”
Get full text

Interference-Aware AAV-TBS Coordinated NOMA: Joint User Scheduling, Power Allocation and Trajectory Design by Haiyong Zeng, Rui Zhang, Xu Zhu, Yufei Jiang, Zhongxiang Wei, Fu-Chun Zheng

“…With the proposed scheme, the interference links between TBS and AAV-served users are enabled to carry useful information, therefore, an enhanced degree of freedom is achieved, leading to a much higher sum-rate over the non-coordinated AAV-assisted NOMA systems where the interference of AAV-served users from TBS is extensively suppressed. Moreover, joint optimization of user scheduling, power allocation and AAV three-dimensional (3D) trajectory design is conducted to maximize the sum-rate of edge users while maintaining a high quality of service at cell-center users, with the consideration of imperfect channel estimation: a) A user scheduling principle dedicated for AAV-TBS coordinated NOMA systems is presented, based on which a two-step user scheduling and power allocation (USPA) algorithm is proposed, with the derivation of optimal power allocation solution; b) A joint USPA algorithm is proposed with closed-form results; c) Considering the line of sight (LoS) and non-LoS factors in the air to ground channel, the 3D trajectory of AAV is designed based on successive convex approximation. …”
Get full text

Implementation of Machine Vision Methods for Cattle Detection and Activity Monitoring by Roman Bumbálek, Tomáš Zoubek, Jean de Dieu Marcel Ufitikirezi, Sandra Nicole Umurungi, Radim Stehlík, Zbyněk Havelka, Radim Kuneš, Petr Bartoš

“…The goal of this research was to implement machine vision algorithms in a cattle stable to detect cattle in stalls and determine their activities. …”
Get full text

Symmetry-driven embedding of networks in hyperbolic space by Simon Lizotte, Jean-Gabriel Young, Antoine Allard

“…We show that the samples are consistent with current algorithms while providing added credible intervals for the coordinates and all network properties. …”
Get full text

A Metaheuristic Method for the Task Assignment Problem in Continuous-Casting Production by Hongtao Hu, Yiwei Wu, Tingsong Wang

“…An improved solution algorithm based on particle swam optimization is developed to efficiently solve the proposed model. …”
Get full text

AI-enhanced fire detection and suppression system for autonomous ships by Hyuk Lee, Jung Hoon Chung, Hyun Chung, Jong-Hwan Kim, Yongho Yoo, Gil Hyuk Lim, Won-Sun Ruy

“…In this paper, we introduce an innovative AFDSS that integrates RGB, infrared (IR), and ultraviolet (UV) sensors to reduce false alarms and employ a reinforcement learning algorithm to optimize water spray under sea conditions. …”
Get full text

State-Aware Energy Management Strategy for Marine Multi-Stack Hybrid Energy Storage Systems Considering Fuel Cell Health by Pan Geng, Jingxuan Xu

“…A hybrid Genetic Algorithm–Particle Swarm Optimization (GA-PSO) approach achieves global optimization. …”
Get full text

RL based transmission power control for energy harvesting sensor by LIU Nanjun, JIA Riheng, XU Wentao, LI Minglu

“…Experimental results demonstrate that the proposed algorithm outperformes baseline strategies and approaches the theoretical optimal in certain scenarios.…”
Get full text

Modeling Analysis of the Relationship between Adolescent Aerobic Exercise and Obesity Reduction Based on Deep Learning by Peng Mu

“…It also explains the constraint conditions that aerobic exercise has to meet in the reduction of adolescent obesity and introduces particle algorithm to establish a model of optimal aerobic exercise to reduce adolescent obesity. …”
Get full text

Improving Secrecy Capacity in the Face of Eavesdropping in SWIPT CIoT Networks With Actor-Critic DRL by Nada Abdel Khalek, Walaa Hamouda

“…We formulate the challenging non-convex optimization problem to maximize secrecy capacity while ensuring spectrum sharing and energy constraints and model the CIoT agent’s decision-making as a model-free Markov decision process (MDP). …”
Get full text

Enhanced Vector Quantization for Embedded Machine Learning: A Post-Training Approach With Incremental Clustering by Thommas K. S. Flores, Morsinaldo Medeiros, Marianne Silva, Daniel G. Costa, Ivanovitch Silva

“…While VQ is a technique that reduces model size by grouping similar parameters, incremental clustering, implemented via the AutoCloud K-Fixed algorithm, preserves accuracy during compression. …”
Get full text

Leveraging Interactive Evolutionary Computation to Induce Serendipity in Informal Learning by Satoko Inoue, Emmanuel Ayedoun, Hiroshi Takenouchi, Masataka Tokumaru

“…We conducted both numerical simulations and experimental evaluations to assess the effectiveness of our content optimization algorithm and the impact of our approach on inducing serendipity in informal learning environments. …”
Get full text

UAV Mission Path Planning Based on Reinforcement Learning in Dynamic Environment by Gui Fu, Yang Gao, Liwen Liu, Mingye Yang, Xinyu Zhu

“…The path planning and optimization of UAV in dynamic environment is studied, and the path planning algorithm and Hungarian algorithm are added. …”
Get full text

DQN-Based Shaped Reward Function Mold for UAV Emergency Communication by Chenhao Ye, Wei Zhu, Shiluo Guo, Jinyin Bai

“…The experimental outcomes underscore the prowess of our methodology in effectively curtailing training time while augmenting convergence rates. In summary, our work underscores the potential of leveraging sophisticated virtual environments and refined reinforcement learning techniques to optimize UAVs deployment in emergency communication contexts.…”
Get full text

Fast and Efficient Drone Path Planning Using Riemannian Manifold in Indoor Environment by Rohit Dujari, Brijesh Patel, Bhumeshwar K. Patle

“…This paper introduces an innovative dual-path planning algorithm rooted in a topological three-dimensional Riemannian manifold (T3DRM) to optimize drone navigation in complex environments. …”
Get full text

Image-Based Classification of Freshwater Fish Species to Support Feed Recommendation Using Random Forest by Hindayati Mustafidah, Suwarsito Suwarsito, Rahmat Setiawan, Abdul Karim

“…Accurate identification of freshwater fish species plays a vital role in aquaculture, particularly in determining appropriate feed strategies to optimize fish growth. Visual similarities among species—such as color, shape, and surface texture—often hinder novice farmers from correctly recognizing fish types. …”
Get full text

User Cost Minimization and Load Balancing for Multiple Electric Vehicle Charging Stations Based on Deep Reinforcement Learning by Yongxiang Xia, Zhongyi Cheng, Jiaqi Zhang, Xi Chen

“…In the second stage, we use the DRL algorithm. In the DRL algorithm, we design a novel reward function that enables charging stations to meet user charging demands while minimizing user charging costs and reducing the load gap among distribution networks. …”
Get full text