NARA Discovery
Article Details
← Back to Search Results
Journal Article

An Integrated Framework with ADD-LSTM and DeepLabCut for Dolphin Behavior Classification

Shih-Pang Tseng; Shao-En Hsu; Jhing-Fa Wang; I-Fan Jen
Journal of Marine Science and Engineering · Vol. 12, Issue 4 · pp. 540 · 2024

Abstract

Caring for dolphins is a delicate process that requires experienced caretakers to pay close attention to their behavioral characteristics. However, caretakers may sometimes lack experience or not be able to give their full attention, which can lead to misjudgment or oversight. To address these issues, a dolphin behavior analysis system has been designed to assist caretakers in making accurate assessments. This study utilized image preprocessing techniques to reduce sunlight reflection in the pool and enhance the outline of dolphins, making it easier to analyze their movements. The dolphins were divided into 11 key points using an open-source tool called DeepLabCut, which accurately helped mark various body parts for skeletal detection. The AquaAI Dolphin Decoder (ADD) was then used to analyze six dolphin behaviors. To improve behavior recognition accuracy, the long short-term memory (LSTM) neural network was introduced. The ADD and LSTM models were integrated to form the ADD-LSTM system. Several classification models, including unidirectional and bidirectional LSTM, GRU, and SVM, were compared. The results showed that the ADD module combined with a double-layer bidirectional LSTM method achieved high accuracy in dolphin behavior analysis. The accuracy rates for each behavior exceeded 90%.

Bibliographic Information

JournalJournal of Marine Science and Engineering
PublisherMDPI
Publication Date2024-03-24
Publication Year2024
Volume12
Issue4
Pages540
Document TypeJournal Article
eISSN2077-1312
DOI10.3390/jmse12040540
SubjectMarine science; oceanography; marine engineering; coastal science; marine environment

Access Information

NARA Access CoverageOA / free full text
Journal Homepagehttps://www.mdpi.com/journal/jmse
Publisher PageOpen Publisher Page
This article is openly available from the publisher.