Ensemble methods can be used for many tasks, some of the most popular being: classification, regression, and image segmentation. Image segmentation is a challenging task, where the use of ensemble machine learning methods provides an opportunity to improve the accuracy of neural network predictions.
In this study, three new methods for combining neural network predictions were proposed, which were compared with the ensemble averaging method and the conventional use of neural networks. These methods are based on the idea of mask centering and different methods of combining predictions. The main goal of the research is to create more reliable and high-quality ensemble methods that can perform their tasks regardless of image quality. These methods are based on different approaches, which makes it possible to choose a more suitable method for solving a specific problem. Thanks to the use of the proposed methods, a good efficiency of segmentation of medical images on different data was obtained. The obtained results indicate that the proposed methods of combining predictions make it possible to minimize the overall error, better generalize the data and increase the reliability of using predictions.
- Breiman, L. (1996). Bagging predictors. Mach Learn 24, 123–140. https://doi.org/10.1007/BF00058655.
- Dietterich, T.G. (2000). Ensemble Methods in Machine Learning. In: Multiple Classifier Systems. MCS 2000. Lecture Notes in Computer Science, vol 1857. Springer, Berlin, Heidelberg. https://doi.org/10.1007/3-540-45014-9_1.
- Zhou, Z., Wu, J., Jiang, Y., & Chen, S. (2001). Genetic Algorithm based Selective Neural Network Ensemble. International Joint Conference on Artificial Intelligence.
- Lakshminarayanan, B., Pritzel, A., & Blundell, C. (2016). Simple and Scalable Predictive Uncertainty Estimation using Deep Ensembles. Neural Information Processing Systems. https://doi.org/10.48550/arXiv.1612.01474.
- Mohammed, A., & Kora, R. (2023). A comprehensive review on ensemble deep learning: Opportunities and challenges. Journal of King Saud University - Computer and Information Sciences, 35(2), 757–774. https://doi.org/10.1016/j.jksuci.2023.01.014.
- Han, Y., et al. (2023). An ensemble method with edge awareness for abnormally shaped nuclei segmentation. In 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) (pp. 4315-4325). Vancouver, BC, Canada. https://doi.org/10.1109/CVPRW59228.2023.00454.
- Dang, T., Nguyen, T. T., McCall, J., et al. (2024). Two-layer ensemble of deep learning models for medical image segmentation. Cognitive Computation, 16(1), 1141–1160. https://doi.org/10.1007/s12559-024-10257-5.
- Ullah, F., Ullah, I., Khan, R. U., Khan, S., Khan, K., & Pau, G. (2024). Conventional to deep ensemble methods for hyperspectral image classification: A comprehensive survey. IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, 17, 3878–3916. https://doi.org/10.1109/JSTARS.2024.3353551.
- Faska, Z., Khrissi, L., Haddouch, K., et al. (2023). A robust and consistent stack generalized ensemble-learning framework for image segmentation. Journal of Engineering and Applied Science, 70, 74. https://doi.org/10.1186/s44147-023-00226-4.
- Ho, E., Wang, E., Youn, S., Sivajohan, A., Lane, K., Chun, J., & Hutnik, C. M. L. (2022). Deep Ensemble Learning for Retinal Image Classification. Translational vision science & technology, 11(10), 39. https://doi.org/10.1167/tvst.11.10.39.
- Chen, Y., Mo, Y., Readie, A., et al. (2024). VertXNet: An ensemble method for vertebral body segmentation and identification from cervical and lumbar spinal X-rays. Scientific Reports, 14, 3341. https://doi.org/10.1038/s41598-023-49923-3.
- Rahil, M., Anoop, B. N., Girish, G. N., Kothari, A. R., Koolagudi, S. G., & Rajan, J. (2023). A deep ensemble learning-based CNN architecture for multiclass retinal fluid segmentation in OCT images. IEEE Access, 11, 17241–17251. https://doi.org/10.1109/ACCESS.2023.3244922.
- Park, J., Kweon, J., Kim, Y. I., Back, I., Chae, J., Roh, J. H., Kang, D. Y., Lee, P. H., Ahn, J. M., Kang, S. J., Park, D. W., Lee, S. W., Lee, C. W., Park, S. W., Park, S. J., & Kim, Y. H. (2023). Selective ensemble methods for deep learning segmentation of major vessels in invasive coronary angiography. Medical physics, 50(12), 7822–7839.https://doi.org/10.1002/mp.16554.
- Vindr.ai. (n.d.). Vindr.ai datasets: SpineXR. Vindr.ai. Retrieved from https://vindr.ai/datasets/spinexr
- Jaeger, S., Karargyris, A., Candemir, S., Folio, L., Siegelman, J., Callaghan, F., Xue, Z., Palaniappan, K., Singh, R. K., Antani, S., Thoma, G., Wang, Y. X., Lu, P. X., & McDonald, C. J. (2014). Automatic tuberculosis screening using chest radiographs. IEEE Transactions on Medical Imaging, 33(2), 233–245. https://doi.org/10.1109/TMI.2013.2284099.
- Candemir, S., Jaeger, S., Palaniappan, K., Musco, J. P., Singh, R. K., Xue, Z., Karargyris, A., Antani, S., Thoma, G., & McDonald, C. J. (2014). Lung segmentation in chest radiographs using anatomical atlases with nonrigid registration. IEEE Transactions on Medical Imaging, 33(2), 577–590. https://doi.org/10.1109/TMI.2013.2290491.