Robust reinforcement learning algorithm based on pigeon-inspired optimization by Mingying ZHANG, Bing HUA, Yuguang ZHANG, Haidong LI, Mohong ZHENG

“…Reinforcement learning(RL) is an artificial intelligence algorithm with the advantages of clear calculation logic and easy expansion of the model.Through interacting with the environment and maximizing value functions on the premise of obtaining little or no prior information, RL can optimize the performance of strategies and effectively reduce the complexity caused by physical models .The RL algorithm based on strategy gradient has been successfully applied in many fields such as intelligent image recognition, robot control and path planning for automatic driving.However, the highly sampling-dependent characteristics of RL determine that the training process needs a large number of samples to converge, and the accuracy of decision making is easily affected by slight interference that does not match with the simulation environment.Especially when RL is applied to the control field, it is difficult to prove the stability of the algorithm because the convergence of the algorithm cannot be guaranteed.Considering that swarm intelligence algorithm can solve complex problems through group cooperation and has the characteristics of self-organization and strong stability, it is an effective way to be used for improving the stability of RL model.The pigeon-inspired optimization algorithm in swarm intelligence was combined to improve RL based on strategy gradient.A RL algorithm based on pigeon-inspired optimization was proposed to solve the strategy gradient in order to maximize long-term future rewards.Adaptive function of pigeon-inspired optimization algorithm and RL were combined to estimate the advantages and disadvantages of strategies, avoid solving into an infinite loop, and improve the stability of the algorithm.A nonlinear two-wheel inverted pendulum robot control system was selected for simulation verification.The simulation results show that the RL algorithm based on pigeon-inspired optimization can improve the robustness of the system, reduce the computational cost, and reduce the algorithm’s dependence on the sample database.…”
Get full text

Prevención de la hipertensión arterial by Mikhail Benet Rodríguez, Juan José Apolinaire Pennini, Yoel Torres Ros

“…In this sense, it has been observed that individuals with exaggerated cardiovascular responses to stress both, physical and mental, known as cardiovascular hyperreactives (CVHR), have a higher risk of hypertension than individuals who do not react the same way and are known as normal cardiovascular reactives. …”
Get full text

Hokuriku-plus familial hypercholesterolaemia registry study: rationale and study design by Hiroshi Matsumoto, Akihiro Nomura, Hayato Tada, Hirofumi Okada, Atsushi Nohara, Masa-aki Kawashiri, Koji Maeno, Manabu Fujimoto, Shohei Yoshida, Masaya Shimojima, Toyonobu Tsuda, Mika Mori, Shin-ichiro Takashima, Takeshi Kato, Soichiro Usui, Kenji Sakata, Kenshi Hayashi, Noboru Fujino, Akihiro Inazu, Shizuko Takahara, Yasuhito Imai, Takao Matsubara, Kenji Miwa, Masanobu Namura, Hidenobu Terai, Taiji Yoshida, Tsutomu Araki, Masahiro Minamoto, Toru Aburao, Yuji Ito, Chiaki Nakanishi, Suguru Kawasaki, Yasuhiro Todo, Junji Koizumi, Yoshihito Kita, Hiroaki Shintaku, Akihiko Hodatsu, Hidekazu Ino, Toshinori Higashikata, Mutsuko Takata, Katsushi Misawa, Masato Yamaguchi, Yoshihiro Noji, Kazuo Osato, Tomohito Mabuchi, Taro Ichise, Bunji Kaku, Shoji Katsuda, Katsuharu Uchiyama, Kensuke Fujioka, Takuya Nakahashi, Tsuyoshi Nozue, Ichiro Michishita, Kazuo Usuda, Kanichi Otowa, Kazuyasu Okeie, Satoshi Hirota, Isao Aburadani, Keisuke Kurokawa, Osamu Takatori, Shunichiro Hondo, Hiroyuki Oda, Shigeo Takata, Hisayoshi Murai, Masaki Kinoshita, Hideo Nagai, Yoshiteru Sekiguchi, Satoru Sakagami, Wataru Omi, Chikara Fujita, Tatsuo Katsuki, Hiroshi Ootsuji, Atsushi Igarashi, Manabu Nakano, Seiichiro Okura, Yasuhito Mitamura, Naoki Sugimoto, Masakazu Yamamoto, Hironobu Akao, Kouji Kajinami, Masayuki Takamura

“…We will collect clinical parameters, including lipids, physical findings, genetic backgrounds and clinical events covering atherosclerotic and other important events, such as malignancies. …”
Get full text

The Relevance of the Virchow Node and Virchow Triad in Renal Cancer Diagnosis by Luiza-Roxana Dorobantu-Lungu, Viviana Dinca, Andrei Gegiu, Dan Spataru, Andreea Toma, Luminita Welt, Mihaela Florentina Badea, Constantin Caruntu, Cristian Scheau, Ilinca Savulescu-Fiedler

“…<b>Methods:</b> We present a case of a 66-year-old man with Virchow–Troisier adenopathy during physical examination, which raises the suspicion of infra-diaphragmatic tumor. …”
Get full text

Ecological significance of protected areas in the tropical mountains of Eastern Africa by Marco Andrew Njana

“…The study also highlights that carbon pools are either affected positively or negatively by ecological and physical factors. The newly developed height-diameter allometries out-performed the existing allometries hence improving the prediction of tree height and biomass in the EAMs. …”
Get full text

Unaccountable counting: the folly of incorporating open ocean carbon sinks in Nationally Determined Contributions by Berger, Manon, Comte, Adrien, Kwiatkowski, Lester, Bopp, Laurent

“…However, it should be noted that this anthropogenic carbon uptake results from the physical and biogeochemical properties of water masses, rather than from human management practices. …”
Get full text

Changing Characteristics of Sandstone Pore Size under Cyclic Loading by Jiaguang Kan, Guichen Li, Nong Zhang, Peng Wang, Changliang Han, Shun Wang

“…The size and distribution of pores in rocks are closely related to their physical and mechanical properties. It is important to study the structure and distribution of pore size inside the rock to assess the risk of damage to a given rock volume. …”
Get full text

Service users’ perception and attitude toward telemedicine-based treatment for substance use disorders: A qualitative study from India by Abhishek Ghosh, Tathagata Mahintamani, P. V. Aswathy, Debasish Basu, Surendra K. Mattoo, B. N. Subodh, Renjith R. Pillai, Manpreet Kaur

“…They reported missing the elaborate inquiry, physical examination, and ritual of visiting their doctors in person. …”
Get full text

Effect of age on the treatment duration and proposed “impacted incisor severity score” of impacted maxillary incisor: A retrospective study by Umer Mukhtar, Manoj kumar Jaiswal, Rigzen Tamchos, Ashima Goyal, Satinder Pal Singh, Aditi Kapur

“…Among the various etiological factors, physical obstruction or inadequate space was found to be most common. …”
Get full text

A cognitive-stylistic study of deixis and deictic shifting in Iris Murdoch’s The Bell by Mohammad Ghaffary, Seyed Mohammad Hosseini, Mohadesse Khosravi

“…In cognitive stylistics, “deixis” is deemed one of the core linguistic elements through which both the physical and ideological stances of the participants in fictional narratives, namely the narrator and the character(-focalizer)s, are demonstrated. …”
Get full text

A Study on the Relationship between Sense of Disease Uncertainty and Family Strength and Mental Resilience in Guardians of Children with Inflammatory Bowel Disease by Jun Yan, Lin Luo

“…Inflammatory bowel disease is difficult to cure, which seriously affects the physical and mental health of children and brings negative psychological stress to guardians. …”
Get full text

Clinical efficacy of a virtual reality tool for the treatment of obesity: study protocol of a randomised controlled trial by Dimitra Anastasiadou, Jose Antonio Ramos-Quiroga, Mel Slater, Bernhard Spanlang, Desiderio Cano Porras, Marta Comas, Andreea Ciudin, Gemma Parramon Puig, Julia Vázquez-De Sebastián, Pilar Lusilla-Palacios

“…Readiness to change, BMI, eating habits and physical activity, psychological well-being, body image satisfaction, quality of life in relation to body image, and weight bias internalisation will be assessed at baseline, post intervention, 1-week and 4-week follow-up. …”
Get full text

Renal Function in Patients with Hypertension Associated Congestive Cardiac Failure Seen in a Tertiary Hospital by C. U. Osuji, C. U. Nwaneli, B. J. Onwubere, E. I. Onwubuya, G. I. Ahaneku

“…Patients’ biodata and medical history were obtained, detailed physical examination done and each patient had a chest X-ray, 12 lead ECG, urinalysis, serum urea and creatinine assay done. …”
Get full text

Metallographic Investigation on Postweld Heat-Treated0.21%C-1020 Steel Plates Joined by SMAW Method by Saurabh Dewangan, Senthil Kumaran Selvaraj, Karthikeyan B, Tezeta Moges Adane, Somnath Chattopadhyaya, Grzegorz Królczyk, Ramesh Raju

“…Hence, there were four different samples according to their physical conditions: sand-cooled, water-quenched, oil-quenched, and air-cooled. …”
Get full text

Evaluation of Eating Habits and Quality of Life in Postbariatric Surgery Patients and Their Family Members: A Case-Control Study by Carla Ibrahim, Joane Matta, Kàtia Lurbe i Puerto, Yonna Sacre

“…Moreover, 35.8% of the caregivers of bariatric patients had a low physical activity level compared to those of the control group who had a lower level (70%). …”
Get full text

Nomenclatural issues concerning cultured yeasts and other fungi: why it is important to avoid unneeded name changes by Andrey Yurkov, Artur Alves, Feng-Yan Bai, Kyria Boundy-Mills, Pietro Buzzini, Neža Čadež, Gianluigi Cardinali, Serge Casaregola, Vishnu Chaturvedi, Valérie Collin, Jack W. Fell, Victoria Girard, Marizeth Groenewald, Ferry Hagen, Chris Todd Hittinger, Aleksey V. Kachalkin, Markus Kostrzewa, Vassili Kouvelis, Diego Libkind, Xinzhan Liu, Thomas Maier, Wieland Meyer, Gábor Péter, Marcin Piątek, Vincent Robert, Carlos A. Rosa, Jose Paulo Sampaio, Matthias Sipiczki, Marc Stadler, Takashi Sugita, Junta Sugiyama, Hiroshi Takagi, Masako Takashima, Benedetta Turchetti, Qi-Ming Wang, Teun Boekhout

“…The unambiguous application of names is assured by the preservation of nomenclatural history and the physical organisms representing a name. Fungi are extremely diverse in terms of ecology, lifestyle, and methods of study. …”
Get full text

Reclamation of poultry litter for the production of biochar by Rose Kukwa, Donald Kukwa, Samson Barnabas

“…The biochar was examined chemically and physically using a variety of techniques. These included microwave plasma atomic emission spectroscopy (MP-AES), the scanning electron microscope (SEM), the Fourier transform infrared (FTIR) spectroscopy, and thermo gravimetric analysis (TGA and DTG).Results: The pyrolysis output was 56.38%, 32.20% ash, 2.00% moisture, 0.60 kg/m3 bulk density, pH 9.65, and 0.00314 dS/m EC. …”
Get full text

Screen on = development off? A systematic scoping review and a developmental psychology perspective on the effects of screen time on early childhood development by Fabio Sticca, Fabio Sticca, Valérie Brauchli, Patricia Lannen

“…These outcomes were sleep-related parameters, physical health, cognition, learning efficiency, language, motor skills, socio-emotional skills, social interaction, and overall development. …”
Get full text

Mulberry Juice-Derived Carbon Quantum Dots as a Cu2+ Ion Sensor: Investigating the Influence of Fruit Ripeness on the Optical Properties by Chiayee Salih Ajaj, Diyar Sadiq

“…The influence of fruit ripeness on the physical and chemical properties, focusing on the fluorescence spectra, has been explored. …”
Get full text

Sustainable Innovations in Steam Generation for Food Sterilization Processes: A Review by Atheer Abdul Amir Al-Mtury, Sabah Malik Al-Shatty, Asaad R. Al-Hilphy, Muhammad Faisal Manzoor

“…Nano-electric boiler boasts a high-power density, minimal carbon emissions, great physical stability, and high-power factor and electric conversion efficiency. …”
Get full text