2. Home
  3. ARCHIVE
  4. 2023
  5. VOL 45, NO 6 (2023)
  6. pp. 65-76

An Ensemble Method for the Analysis of Small Biomedical Data based on a Neural Network Without Training

I.V. Izonin, cand. of techn. sciences,
R.O. Tkachenko, doctor of techn. sciences, O.L. Semchyshyn
Lviv Polytechnic National University
S. Bandera str., 12, 79013, Lviv, Ukraine,
E-mail: This email address is being protected from spambots. You need JavaScript enabled to view it.

Èlektron. model. 2023, 45(6):65-76

https://doi.org/10.15407/emodel.45.06.065

ABSTRACT

To enhance the accuracy of analyzing short datasets, this paper proposes a novel ensemble learning method that utilizes a single the General Regression Neural Network (GRNN). The core idea behind this method is the synthesis of additional pairs of vectors with different signs around each current vector from the test sample. This is achieved by employing the method of random symmetric perturbations and averaging the prediction outputs for the current vector and all synthesized vectors in its vicinity. Implementing this approach leads to a significant increase in prediction accuracy for short datasets. It achieves error compensation for each pair of additional vectors with different signs and also for the overall prediction result of the current vector and all additional pairs of synthetic vectors created for it. The effectiveness of the proposed method is validated through modeling on a small real-world biomedical dataset, and the optimal parameters have been selected. Comparative analysis with existing GRNN-based me­thods demonstrates a substantial improvement in accuracy.

KEYWORDS

small data approach, approximation, GRNN, ensemble learning, random symmetric disturbances.

REFERENCES

  1. Bodyanskiy, Y., Chala, O., Kasatkina, N., & Pliss, I. (2022). Modified generalized neo-fuzzy system with combined online fast learning in medical diagnostic task for situations of information deficit. Mathematical Biosciences and Engineering, 19(8), 8003-8018. https://doi.org/10.3934/mbe.2022374
  2. Zoya Duriagina, I.L. (2021). Optimized Filling of a Given Cuboid with Spherical Powders for Additive Manufacturing. Journal of the Operations Research Society of China, 9(4), 853-868. https://doi.org/10.1007/s40305-020-00314-9
  3. Hekler, E.B., Klasnja, P., Chevance, G., Golaszewski, N.M., Lewis, D., & Sim, I. (2019). Why we need a small data paradigm. BMC Medicine, 17. https://doi.org/10.1186/s12916-019-1366-x
  4. Shaikhina, T., & Khovanova, N.A. (2017). Handling limited datasets with neural networks in medical applications: A small-data approach. Artificial Intelligence in Medicine, 75, 51-63. https://doi.org/10.1016/j.artmed.2016.12.003
  5. Fong, S.J., Li, G., Dey, N., Gonzalez-Crespo, R., & Herrera-Viedma, E. (2020). Finding an Accurate Early Forecasting Model from Small Dataset: A Case of 2019-nCoV Novel Coronavirus Outbreak. International Journal of Interactive Multimedia and Artificial Intelligence, 6(1), 132. https://doi.org/10.9781/ijimai.2020.02.002
  6. Duda, P., Jaworski, M., & Rutkowski, L. (2018). Online GRNN-Based Ensembles for Regression on Evolving Data Streams. In T. Huang, J.Lv., C. Sun, & A.V. Tuzikov (Eds.), Advances in Neural Networks – ISNN 2018 (pp. 221-228). Springer International Publi­shing. https://doi.org/10.1007/978-3-319-92537-0_26
  7. Vakal, L.P., & Vakal, E.S. (2019). Best Uniform Spline Approximation Using Differential Evolution. Mathematical and computer modelling. Series: Technical sciences, 19, 17-24. https://doi.org/10.32626/2308-5916.2019-19.17-24
  8. Izonin, I., Tkachenko, R., Gregus ml., M., Zub, K., & Tkachenko, P. (2021). A GRNN-based Approach towards Prediction from Small Datasets in Medical Application. Procedia Computer Science, 184, 242-249. https://doi.org/10.1016/j.procs.2021.03.033
  9. Bodyanskiy, Y.V., & Tyshchenko, O.K. (2020). A Hybrid Cascade Neural Network with Ensembles of Extended Neo-Fuzzy Neurons and Its Deep Learning. In P. Kulczycki, J. Kacprzyk, L.T. Kóczy, R. Mesiar, & R. Wisniewski (Eds.), Information Technology, Systems Research, and Computational Physics (pp. 164-174). Springer International Publishing. https://doi.org/10.1007/978-3-030-18058-4_13
  10. Vitynskyi, P.B., Tkachenko, R.O., & Izonin, I.V. (2019). GRNN ensemble based on displacement of the surfaces of the response for E-commerce tasks. Scientific bulletin of UNFU, 29(9), Article 9. https://doi.org/10.36930/40290925
  11. Krak, I., Kuznetsov, V., Kondratiuk, S., Azarova, L., Barmak, O., & Padiuk, P. (2023). Analysis of Deep Learning Methods in Adaptation to the Small Data Problem Solving. In S. Babichev & V. Lytvynenko (Eds.), Lecture Notes in Data Engineering, Computational Intelligence, and Decision Making (Vol. 149, pp. 333-352). Springer International Publishing. https://doi.org/10.1007/978-3-031-16203-9_20
  12. Haykin, S. (2008). Neural Networks and Learning Machines (3rd edition). Pearson.

Full text: PDF