Predicting sow postures from video images: Comparison of convolutional neural networks and segmentation combined with support vector machines under various training and testing setups. (December 2021)

• Record Type: Journal Article
• Authors: Bonneau, Mathieu; Benet, Bernard; Labrune, Yann; Bailly, Jean; Ricard, Edmond; Canario, Laurianne
• Is Part Of: Biosystems engineering. Volume 212(2021)
• Page Start: 19
• Page End: 29
• Publication Date: 2021-12
• Subjects: Automatic detection -- Posture -- Activity -- Sow -- Computer vision; Bioengineering -- Periodicals; Agricultural engineering -- Periodicals; Biological systems -- Periodicals; Génie rural -- Périodiques; Systèmes biologiques -- Périodiques; 631
• DOI: 10.1016/j.biosystemseng.2021.09.014
• Languages: English
• ISSNs: 1537-5110

Abstract

Abstract : The use of CNN and segmentation to extract image features for the prediction of four postures for sows kept in crates was examined. The extracted features were used as input variables in an SVM classification method to estimate posture. The possibility of using a posture prediction model with images not necessarily obtained under the same conditions as those used for the training set was explored. As a reference case, the efficacy of the posture prediction model was explored when training and testing datasets were built using the same pool of images. In this case, all the models produced satisfactory results, with a maximum f1-score of 97.7% with CNNs and 93.3% with segmentation. To evaluate the impact of environmental variations, the models were trained and tested on different monitoring days. In this case, the best f1-score dropped to 86.7%. The impact of using the posture prediction model on animals that were not present in the training dataset was then explored. The best f1-score reduced to 63.4% when the posture prediction models were trained on one animal and tested on 11 other different animals. Conversely, when the models were tested on one animal and trained on the 11 others, the f1-score only decreased to 86% with the best model. On average, a decrease of around 17% caused by environmental and individual variations between training and testing was observed. Highlights: Large collection of behavioural data are needed for animal genetic researches. Image analysis is a non-invasive method to record several behavioural traits. We compared two methods to extract image features and predict sows postures. CNNs, compared to segmentation, provide the better prediction and are more robust.