OBI Designer: Zero-Shot Oracle Bone Inscription Artistic Characters Generation with Multimodal Style Transfer

Oracle Bone Inscriptions(OBI) artistic character generation refers to combining the historical beauty of ancient characters and artificial intelligence technology to create artworks that have both cultural heritage and visual impact. At present, the creation of oracle art characters mainly relies on specialized skills of professionals, which are inefficient and time-consuming. In this article, we propose a zero-shot method OBI-Designer to automatically create oracle art characters. OBI-Designer relies on the significant ability of large-scale pre-trained Vision-Language Models to visually extract text concepts to generate oracle art characters. Specifically, OBI-Designer can be divided into two stages, namely glyph synthesis and texture synthesis. Glyph synthesis introduces a semantic-driven image vectorization method based on Interval Score Matching(ISM), which vividly expresses text concepts by optimizing character outlines, while using additional loss functions to ensure the readability and consistency of characters. In the texture synthesis stage, the glyph synthesis results are stylized with the help of ControlNet and LoRA fine-tuning to obtain the final oracle art characters. Extensive experiments have demonstrated the effectiveness of the proposed method. OBI-Designer further promotes the combination of oracle art synthesis and artificial intelligence.