Machine vision approach for monitoring and quantifying fish school migration

The precise monitoring and quantification of fish migration are crucial for enhancing agricultural productivity and promoting environmental conservation. However, conducting these tasks in natural environments presents challenges due to the subtle characteristics of fish and the inherent complexitie...

Full description

Saved in:
Bibliographic Details
Main Authors: Feng Lin, Jicheng Zhu, Aiju You, Lei Hua
Format: Article
Language:English
Published: Elsevier 2024-12-01
Series:Ecological Indicators
Subjects:
Online Access:http://www.sciencedirect.com/science/article/pii/S1470160X24012263
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1850119025828298752
author Feng Lin
Jicheng Zhu
Aiju You
Lei Hua
author_facet Feng Lin
Jicheng Zhu
Aiju You
Lei Hua
author_sort Feng Lin
collection DOAJ
description The precise monitoring and quantification of fish migration are crucial for enhancing agricultural productivity and promoting environmental conservation. However, conducting these tasks in natural environments presents challenges due to the subtle characteristics of fish and the inherent complexities in detection. This study addresses these challenges by introducing DVE-YOLO (Dynamic Vision Enhanced YOLO), a novel framework based on the YOLOv8 architecture, complemented by a tailored sample allocation strategy and a dedicated loss function. Operating on dual-frame input, DVE-YOLO integrates deep features from consecutive images to create composite anchor boxes from adjacent frames. This design enables DVE-YOLO to capture dynamic object features, reveal correlations of detected objects across frames, and facilitate efficient tracking and detection. Furthermore, this research proposes an innovative method for identifying fish migration through fish counting, documenting both the migration area and the duration of fish presence for subsequent analysis. Evaluation on an extensive fish migration dataset demonstrates that DVE-YOLO outperforms YOLOv8 and other mainstream detection algorithms, showcasing superior detection accuracy with higher AP50 and AP50−95 metrics. In terms of counting accuracy, DVE-YOLO achieves a lower Mean Squared Error (MSE) compared to YOLOv8+BoTSORT and YOLOv8+ByteTrack, indicating improved counting performance. Additionally, DVE-YOLO exhibits enhanced precision in identifying fish migration in contrast to YOLOv8+BoTSORT and YOLOv8+ByteTrack. Ultimately, these machine learning methods holds promising prospects for ecological applications.
format Article
id doaj-art-9bf92b4e206b46fe8a873ae2d9d3541e
institution OA Journals
issn 1470-160X
language English
publishDate 2024-12-01
publisher Elsevier
record_format Article
series Ecological Indicators
spelling doaj-art-9bf92b4e206b46fe8a873ae2d9d3541e2025-08-20T02:35:44ZengElsevierEcological Indicators1470-160X2024-12-0116911276910.1016/j.ecolind.2024.112769Machine vision approach for monitoring and quantifying fish school migrationFeng Lin0Jicheng Zhu1Aiju You2Lei Hua3College of Electrical Engineering, Zhejiang University, Hangzhou, 310027, China; Corresponding author.College of Electrical Engineering, Zhejiang University, Hangzhou, 310027, ChinaZhejiang Institute of Hydraulics and Estuary, Hangzhou, 310020, ChinaZhejiang Institute of Hydraulics and Estuary, Hangzhou, 310020, ChinaThe precise monitoring and quantification of fish migration are crucial for enhancing agricultural productivity and promoting environmental conservation. However, conducting these tasks in natural environments presents challenges due to the subtle characteristics of fish and the inherent complexities in detection. This study addresses these challenges by introducing DVE-YOLO (Dynamic Vision Enhanced YOLO), a novel framework based on the YOLOv8 architecture, complemented by a tailored sample allocation strategy and a dedicated loss function. Operating on dual-frame input, DVE-YOLO integrates deep features from consecutive images to create composite anchor boxes from adjacent frames. This design enables DVE-YOLO to capture dynamic object features, reveal correlations of detected objects across frames, and facilitate efficient tracking and detection. Furthermore, this research proposes an innovative method for identifying fish migration through fish counting, documenting both the migration area and the duration of fish presence for subsequent analysis. Evaluation on an extensive fish migration dataset demonstrates that DVE-YOLO outperforms YOLOv8 and other mainstream detection algorithms, showcasing superior detection accuracy with higher AP50 and AP50−95 metrics. In terms of counting accuracy, DVE-YOLO achieves a lower Mean Squared Error (MSE) compared to YOLOv8+BoTSORT and YOLOv8+ByteTrack, indicating improved counting performance. Additionally, DVE-YOLO exhibits enhanced precision in identifying fish migration in contrast to YOLOv8+BoTSORT and YOLOv8+ByteTrack. Ultimately, these machine learning methods holds promising prospects for ecological applications.http://www.sciencedirect.com/science/article/pii/S1470160X24012263Machine learningFish schools quantifyingDVE-YOLOSiamese network
spellingShingle Feng Lin
Jicheng Zhu
Aiju You
Lei Hua
Machine vision approach for monitoring and quantifying fish school migration
Ecological Indicators
Machine learning
Fish schools quantifying
DVE-YOLO
Siamese network
title Machine vision approach for monitoring and quantifying fish school migration
title_full Machine vision approach for monitoring and quantifying fish school migration
title_fullStr Machine vision approach for monitoring and quantifying fish school migration
title_full_unstemmed Machine vision approach for monitoring and quantifying fish school migration
title_short Machine vision approach for monitoring and quantifying fish school migration
title_sort machine vision approach for monitoring and quantifying fish school migration
topic Machine learning
Fish schools quantifying
DVE-YOLO
Siamese network
url http://www.sciencedirect.com/science/article/pii/S1470160X24012263
work_keys_str_mv AT fenglin machinevisionapproachformonitoringandquantifyingfishschoolmigration
AT jichengzhu machinevisionapproachformonitoringandquantifyingfishschoolmigration
AT aijuyou machinevisionapproachformonitoringandquantifyingfishschoolmigration
AT leihua machinevisionapproachformonitoringandquantifyingfishschoolmigration