TRAINING A NEURAL NETWORK FOR IMAGE STYLING

SA.
2024;
: 16-23
1
Lviv Polytechnic National University
2
National University "Lviv Polytechnic"
3
Department of Media Technologies, Publishing and Graphic Systems Ukrainian Academy of Printing

Improving the visualization of projects and portfolios of designers and architects can be achieved by enhancing the illustrativeness and stylization of images using artificial intelligence. The use of neural networks for content generation significantly speeds up the work of designers.

Among all the neural networks for image generation, MidJourney shows the best results. After analyzing the licenses and subscription costs of services as well as the models they employ, the Stable Diffusion deep learning neural network was chosen. The Stable Diffusion neural network is open-source, unlike DALL-E and Midjourney, allowing for unlimited content generation. The stylized images were generated in Stable Diffusion using Dreambooth based on the Google Collab platform. The creation of a custom model was conducted in two stages. The first stage involved preparing images for training the Stable Diffusion neural network. The second stage was the direct training of the neural network based on the Google Collab platform. Kobzar's graphic drawings served as the training dataset. Initially, 77 drawings with the same theme were selected for model training. 30 of these were used to train the model after corrections in Adobe Photoshop and Topaz Photo AI. Adjustments included cropping, background removal, printing raster, noise reduction, sharpening, and scaling images. The originality of the work lies in the fact that the trained model was used to create stylized creative images, utilizing excerpts from the poet's poems describing nature and events in a very realistic way. The generated images have successfully passed the Turing test, indicating a realistic reproduction of the style of Taras Shevchenko's drawings and the utilization of the author's poetic text as a prompt. The use of neural networks for generating and styling images as virtual assistants for designers and architects speeds up the creative process and enables the creation of works of any complexity.

Colab notebook for TheLastBen / fast-stable-diffusion. Retrieved from https://colab.research.google.com/drive/1-qeon9tJW1RjXOJldpXYQECv2TJV9QTP.

Google Colab або Google Colaboratory: shcho tse take. Retrieved from https://www.hwlibre.com/uk/google-colaboratory.

Hachman Mark. (2022). The new killer app: Creating AI art will absolutely crush your PC. Retrieved from https://www.pcworld.com/article/916785/creating-ai-art-local-pc-stable-d....

Stable Diffusion Repository on GitHub. (2022). CompVis – Machine Vision and Learning Research Group, LMU Munich. Retrieved from https://github.com/CompVis.

Turing Alan М. (1950). Computing Machinery and Intelligence. Mind, LIX (236): 433–460. doi:10.1093/mind/LIX.236.433. https://doi.org/10.1093/mind/LIX.236.433

Bozhko T., Arefiev V. (2023). Neironni merezhi yak instrument hrafichnoho dyzainu. Visnyk KNUKiM. Seriia «Mystetstvoznavstvo», (48), 125–135. https://doi.org/10.31866/2410-1176.48.2023.282475

Zaitseva V. I. (2021). Khudozhnia stylizatsiia yak osnovnyi vyrazhalnyi zasib u riznykh zhanrakh obrazotvorchoho mystetstva. Visnyk Natsionalnoi akademii kerivnykh kadriv kultury i mystetstv : nauk. zhurnal. № 2, 165-169. https://doi.org/10.32461/2226-3209.2.2021.240002

IPro Action. (2015). Kartyny Tarasa Shevchenka. Retrieved from https://taras-shevchenko.com.ua/ua/roboty_list/spisok-hudozhnih-robit.htm.

Mykhailenko V. Ye. (2012). Stylizatsiia pryrodnykh form u hrafichnomu dyzaini ta reklami : formotvorchi aspekty / V. Ye. Mykhailenko, S. V. Pryshchenko // Tekhnichna estetyka i dyzain. –Vyp. 11, 121–129.

Surovyi Yu. M. (2023). Zastosuvannia mashynnoho navchannia neiromerezhi dlia heneruvannia zobrazhen u dodrukarskykh protsesakh : mahisterska dysertatsiia na zdobuttia osvitnoho stupenia «mahistr» : spets. 186 «Vydavnytstvo ta polihrafiia» / Yu. M. Surovyi. Ukrainska akademiia drukarstva. ‒ Lviv, 78.

Tsokota V. R. (2022). Pidkhody do testuvannia rivnia ta riznovydu shtuchnoho intelektu. Humanitarian Aspects of Digital Society. Kharkiv, 28–30. Retrieved from https://library.pp-ss.pro/index.php/ndippsn_20221208/article/view/tsokot....

Shevchenko T. H.(2014). Kobzar / Taras Shevchenko. – Kh. : VD «Shkola», 576.