Convolutional neural networks for segmentation of FIB‐SEM nanotomography data from porous polymer films for controlled drug release. (4th May 2021)

• Record Type: Journal Article
• Authors: Skärberg, Fredrik; Fager, Cecilia; Mendoza‐Lara, Francisco; Josefson, Mats; Olsson, Eva; Lorén, Niklas; Röding, Magnus
• Is Part Of: Journal of microscopy. Volume 283:Part 1(2021)
• Page Start: 51
• Page End: 63
• Publication Date: 2021-05-04
• Subjects: controlled drug release -- convolutional neural networks -- deep learning -- focused ion beam scanning electron microscopy -- image analysis -- machine learning -- microstructure -- polymer films -- porous materials -- semantic segmentation; Microscopy -- Periodicals; 502.82
• DOI: 10.1111/jmi.13007
• Languages: English
• ISSNs: 0022-2720

Abstract

Abstract: Phase‐separated polymer films are commonly used as coatings around pharmaceutical oral dosage forms (tablets or pellets) to facilitate controlled drug release. A typical choice is to use ethyl cellulose and hydroxypropyl cellulose (EC/HPC) polymer blends. When an EC/HPC film is in contact with water, the leaching out of the water‐soluble HPC phase produces an EC film with a porous network through which the drug is transported. The drug release can be tailored by controlling the structure of this porous network. Imaging and characterization of such EC porous films facilitates understanding of how to control and tailor film formation and ultimately drug release. Combined focused ion beam and scanning electron microscope (FIB‐SEM) tomography is a well‐established technique for high‐resolution imaging, and suitable for this application. However, for segmenting image data, in this case to correctly identify the porous network, FIB‐SEM is a challenging technique to work with. In this work, we implement convolutional neural networks for segmentation of FIB‐SEM image data. The data are acquired from three EC porous films where the HPC phases have been leached out. The three data sets have varying porosities in a range of interest for controlled drug release applications. We demonstrate very good agreement with manual segmentations. In particular, we demonstrate an improvement in comparison to previous work on the same data sets that utilized a random forest classifier trained on Gaussian scale‐space features. Finally, we facilitate further development of FIB‐SEM segmentation methods by making the data and software used open access. Lay description: Drug release from pharmaceutical tablets or pellets is often controlled by applying a phase‐separated polymer film coating. Ethyl cellulose and hydroxypropyl cellulose (EC/HPC) polymer blends are commonly used. The HPC phase leaches out when in contact with water and the result is a porous EC matrix coating, with mass transport properties that can be controlled by tailoring the structure of the porous network. High‐resolution 3D imaging is necessary to characterize such materials, and the resolution of e.g. X‐ray computed tomography is simply insufficient. Combined focused ion beam and scanning electron microscope (FIB‐SEM) tomography on the other hand is a suitable technique, but segmentation of FIB‐SEM data, in this case to separate the solid matrix and the porous network, is challenging. In this work, we develop a method for segmentation of FIB‐SEM image data acquired from three different EC porous films where the HPC phases have been leached out. The segmentation is based on convolutional neural networks (CNNs). CNNs is a well‐established machine learning paradigm and has demonstrated state‐of‐the‐art performance in many image analysis and segmentation tasks. CNNs are inspired from biological processes in the visual cortex and act similarly, at least conceptually. In contrast to most conventional machine learning algorithms, CNNs learn by themselves which features to extract from the images. The features are extracted at different spatial scales and may constitute e.g. edge and contrast detectors. These features are subsequently used for classification. In this work, CNNs are used for image segmentation. The goal is to identify which regions in the images that contain either pore (empty space) or solid (material), hence a binary classification task. For the CNN to learn how to perform such a task, a ground truth is needed. This is achieved by letting an expert manually segment parts of the data. This is a very time‐consuming endeavor, hence only a small random subset of the full dataset is manually segmented. The CNN is trained for the task using the manually segmented data, after which automatic segmentation of the full dataset is performed. We obtain very good agreement with manual segmentations in terms of accuracy and porosity, and a clear improvement in comparison to an earlier developed random forest classifier trained on Gaussian scale‐space features on the same data. The development of accurate segmentation methods is a crucial step toward better understanding and tailoring of coatings for controlled drug release.