We use a few cookies

Essential cookies keep the library working. With your permission, we'd also like to use analytics to see what's useful and improve the experience. Read our Privacy Policy or Cookie Policy.

Skip to main content
Home/e-Resources/Nursing/Divide & Bind Your Attention for Improved Generative Semantic Nursing
PeriodicalsNursing

Divide & Bind Your Attention for Improved Generative Semantic Nursing

arXiv2023

Checking your access to this record.

Abstract & Overview

Emerging large-scale text-to-image generative models, e.g., Stable Diffusion (SD), have exhibited overwhelming results with high fidelity. Despite the magnificent progress, current state-of-the-art models still struggle to generate images fully adhering to the input prompt. Prior work, Attend & Excite, has introduced the concept of Generative Semantic Nursing (GSN), aiming to optimize cross-attention during inference time to better incorporate the semantics. It demonstrates promising results in generating simple prompts, e.g., "a cat and a dog". However, its efficacy declines when dealing with more complex prompts, and it does not explicitly address the problem of improper attribute binding. To address the challenges posed by complex prompts or scenarios involving multiple entities and to achieve improved attribute binding, we propose Divide & Bind. We introduce two novel loss objectives for GSN: a novel attendance loss and a binding loss. Our approach stands out in its ability to faithfully synthesize desired objects with improved attribute alignment from complex prompts and exhibits superior performance across multiple evaluation benchmarks.

Cite this record

Yumeng Li, Margret Keuper, Dan Zhang, Anna Khoreva (2023). Divide & Bind Your Attention for Improved Generative Semantic Nursing. arXiv. https://library.shubhaarti.com/content/94cd0781-bed0-430c-8463-fc65fb772cc9

Copy in another style

Li, Y., Keuper, M., Zhang, D., & Khoreva, A. (2023). Divide & Bind Your Attention for Improved Generative Semantic Nursing. arXiv. https://library.shubhaarti.com/content/94cd0781-bed0-430c-8463-fc65fb772cc9
Author names are used as deposited, so check their order before you submit.

Metadata is harvested from open-access indexes and can be incomplete. Check a citation against the published version before relying on it — see our open access & attribution policy.