GraphicsAssist: Visual Artist’s Assistant for Narration-to-Illustrative Graphic Composition
Suma Dawn
Dept. of CSE & IT, Jaypee Institute of Information Technology, A-10, Sec-62, Noida-201309, India. Email: suma.dawn@gmail.com
Chitrolekha Journal 8:1 2024. https://doi.org/10.21659/cjad.81.v8n109
[Article History: Received: 12 June 2024. Revised: 28 June 2024. Accepted: 29 June 2024. Published: 30 June 2024.]
Abstract
Storytelling is an art that very few can carry with ease, putting in proper context the feelings and emotions of the characters, their setting, interactions, etc. This work attempts to recreate storytelling to form a graphic illustration for users so that the essence of the story is not lost in transference from one person to another, from storyteller to graphic illustration reader/user. ‘GraphicsAssist’ is an artist assistance system for graphic artists to help them generate certain options for usage as graphic frames. Text analysis has been exploited to understand contextual requirements or storytelling. Natural language-based learning has been applied to this requirement. The transfer-learning-based model is used to find suitable matches for the characters and visual environment settings. Illustrative drawings and their tags are considered a part of the frame database. Once the narration entities of the story are extracted, they are matched with the drawing tags and presented to the designer for framing and then panelling of graphic illustration. The chosen frames are displayed in panels in grid format. In its current form, manipulation of the selected drawings for the task of forming frames is, as yet, restricted. The aesthetic transition from frame to frame is yet lacking and may be integrated into later works. The work of this artist’s assistance system is validated by the test group, which gave feedback on some pre-defined parameters. Though the system has its drawbacks, it is the first step towards such a system that provides a computational translation model for translating a textual narration to a set of visual composition frames. This work aims to capture the nuances, characters, emotions, story setting, etc., from textual narration as an input of the story and convert it to the graphic illustration in 2D form by incorporating illustrative drawings as its visual translation.
Keywords: Textual Narration; NLP, NER; Image Tagging; Narratology; Feature extraction; Graphic frames; Transfer Learning; Visual Narration.
Sustainable Development Goals: Better Education
Citation: Dawn, S. (2024). GraphicsAssist: Visual Artist’s Assistant for Narration-to-Illustrative Graphic Composition. Chitrolekha Journal 8:1 https://doi.org/10.21659/cjad.81.v8n109