IP Composer ๐ โ๐๏ธ
compose new images with visual concepts extracted from refrence images using CLIP & IP Adapter
๐ ๏ธ How to Use:
- Upload a base image
- Upload 1โ3 concept images
- Select a concept type to extract from each concept image:
- Choose a predefined concept type from the dropdown (e.g. pattern, emotion, pose), or
- Upload a file with text variations of your concept (e.g. prompts from an LLM).
- ๐ If you're uploading a new concept, don't forget to adjust the "rank" value under Advanced Options for better results.
Following the algorithm proposed in IP-Composer: Semantic Composition of Visual Concepts by Dorfman et al. [Project page] [arxiv]
Pick concept type
- Upload a file with text variations of your concept (e.g. ask an LLM)
- Prefereably with > 100 variations.
Emotion Description
a photo of a person feeling joyful
a photo of a person feeling sorrowful
a photo of a person feeling enraged
a photo of a person feeling astonished
a photo of a person feeling disgusted
a photo of a person feeling terrified
...
Pick concept type
- Upload a file with text variations of your concept (e.g. ask an LLM)
- Prefereably with > 100 variations.
Emotion Description
a photo of a person feeling joyful
a photo of a person feeling sorrowful
a photo of a person feeling enraged
a photo of a person feeling astonished
a photo of a person feeling disgusted
a photo of a person feeling terrified
...
Pick concept type
- Upload a file with text variations of your concept (e.g. ask an LLM)
- Prefereably with > 100 variations.
Emotion Description
a photo of a person feeling joyful
a photo of a person feeling sorrowful
a photo of a person feeling enraged
a photo of a person feeling astonished
a photo of a person feeling disgusted
a photo of a person feeling terrified
...
If a concept is not showing enough, try to increase the rank
Base Image (Required) | Concept Image 1 | Concept 1 | Concept Image 2 | Concept 2 | Rank concept 1 | Rank concept 2 | Rank concept 3 | Scale | Seed | Num steps |
---|