Abstract
A method for determining the weights of a binary neural network based on its decomposition into elementary modules is presented. The approach allows tuning the weight coefficients of all the network connections at the stage of its designing, which eliminates the implementation of time-consuming iterative algorithms for training the network during its operation. An algorithm and an example of calculating the weights are given.
Article PDF
Similar content being viewed by others
Explore related subjects
Discover the latest articles, news and stories from top researchers in related subjects.Avoid common mistakes on your manuscript.
References
G. F. Luger, Artificial Intelligence. Structures and Strategies for Complex Problem Solving, AddisonWesley (2004).
S. Russell and P. Norvig, Artificial Intelligence: A Modern Approach, Prentice Hall, Upper Saddle River, NJ (2003).
S. Khaykin, Neural Networks: A Comprehensive Foundation, Prentice Hall, Upper Saddle River, NJ (1999).
R. Callan, The Essence of Neural Networks, Prentice Hall Europe (1999).
O. Sigeru, Kh. Marzuki, and Y. Rybiyah, Neuro-Control and its Application, Springer (1996).
I. Goodfellow, Y. Bengio, and A. Courville, Deep Learning, The MIT Press, Cambridge, Massachusetts–London, England (2016).
T. Hastie, R. Tibshirani, and J. Friedman, The Elements of Statistical Learning: Data Mining, Inference and Prediction, Springer-Verlag (2009).
V. N. Opanasenko and S. L. Kryvyi, “Synthesis of neural-like networks on the basis of conversion of cyclic Hamming codes,” Cybern. Syst. Analysis, Vol. 53, No. 4, 627–635 (2017). https://doi.org/10.1007/s10559-017-9965-z.
A. V. Palagin, V. N. Opanasenko, and S. L. Kryvyi, “FPGA based hardware implementation of cyclic Hamming code transformations,” in: Proc. of the 15th All-Russian Sci. Techn. Conf. “Neuroinformatics-2013,” Part 3, NIYAU MIFI, Moscow (2013), pp. 203–212.
A. V. Kazantsev, “Visual data processing and action control using binary neural network,” Eight Intern. Workshop on Image Analysis for Multimedia Interactive Services (WIAMIS’07) (Santorini, Greece, June 6–8, 2007), IEEE (2007), pp. 23. https://doi.org/10.1109/WIAMIS.2007.90.
S. Liang, R. Sun, Y. Li, and R. Srikant, “Understanding the loss surface of neural networks for binary classification,” in: Proc. of the 35th Intern. Conf. on Machine Learning, PMLR, Vol. 80 (2018), pp. 2835–2843. URL: https://proceedings.mlr.press/v80/liang18a/liang18a.pdf.
M. Krinitskiy, P. Verezemskaya, K. Grashchenkov, N. Tilinina, S. Gulev, and M. Lazzara, “Deep convolutional neural networks capabilities for binary classification of polar mesocyclones in satellite mosaics,” Atmosphere, Vol. 9, Iss. 11, 426 (2018). https://doi.org/10.3390/atmos9110426.
J. A. Dunnmon, D. Yi, C. P. Langlotz, C. Ré, D. L. Rubin, and M. P. Lungren, “Assessment of convolutional neural networks for automated classification of chest radiographs,” Radiology, Vol. 290, No. 2, 537–544 (2018). https://doi.org/10.1148/radiol.2018181422.
S. Korolev, A. Safiullin, M. Belyaev, and Y. Dodonova, “Residual and plain convolutional neural networks for 3D brain MRI classification,” arXiv:1701.06643v1 [cs.CV] 23 Jan 2017. URL: https://arxiv.org/pdf/1701.06643.pdf.
A. K. Menon and R. C. Williamson, “The cost of fairness in binary classification,” in: Proc. of the 1st Conf. on Fairness, Accountability and Transparency, PMLR, Vol. 81 (2018), pp. 107–118.
A. Ferreyra-Ramírez, E. Rodríguez-Martínez, C. Avilés-Cruz, and F. Lypez-Saca, “Image retrieval system based on a binary auto-encoder and a convolutional neural network,” IEEE Latin America Transactions, Vol. 18, No. 11, 1925–1932 (2020). https://doi.org/10.1109/TLA.2020.9398634.
A. Litvinenko, “Algorithms for solution inference based on unified logical control models,” Cybern. Syst. Analysis, Vol. 56, No. 2, 187–194 (2020). https://doi.org/10.1007/s10559-020-00234-9.
Author information
Authors and Affiliations
Corresponding author
Additional information
Translated from Kibernetyka ta Systemnyi Analiz, No. 6, November–December, 2022, pp. 45–53.
Rights and permissions
Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Litvinenko, A., Kucherov, D. & Glybovets, M. Decomposition Method for Calculating the Weights of a Binary Neural Network. Cybern Syst Anal 58, 889–897 (2022). https://doi.org/10.1007/s10559-023-00522-0
Received:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10559-023-00522-0