Przemysław Mejna commited on
Commit
efa4c08
·
1 Parent(s): b851f88

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +53 -19
README.md CHANGED
@@ -2,36 +2,70 @@
2
  license: openrail
3
  ---
4
 
5
- # 2d pixel art embedding for SD 2.0 768px
6
 
7
  Hi - I am a big fan of retro/nostalgia things.
8
- This is the reason wy I made this embedding. The version of this embedding is beta.
9
- I have trained it on 29 images, the version I will be targeting in upcoming weeks will be based on 128 or 256 well-selected and filtered images, and processed
10
  through pixelate tool to keep the same pixel size on each of the input data. This should improve the embedding dramatically.
11
 
12
- ### Usage
 
 
 
13
 
14
  Before we start: cool tool to enhance your results even further: [link](https://giventofly.github.io/pixelit/#tryit)
15
 
16
- Few here to comment: first of all - I found the negative keywords which improving the pixelart in SD 2.0 dramatically:
17
- `grid, Tetris, tetris blocks, mosaic, mosaic, dog, trees, trees, cabin, house, house, blocky, ((blurred)) ((blur)), low poly, low-poly, 3d, disfigured, kitsch, ugly, oversaturated, grain, low-res, Deformed, blurry, bad anatomy, disfigured, poorly drawn face, mutation, mutated, extra limb, ugly, poorly drawn hands, missing limb, blurry, floating limbs, disconnected limbs, malformed hands, blur, out of focus, long neck, long body, ugly, disgusting, poorly drawn, childish, mutilated, , mangled, old, surreal, pixel-art, pixelated`
18
- If you like pixel art and if you want to use it - this should be very useful ^^.
19
- I will drop you an example of a full prompt and will explain the most useful usecases:
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
20
 
21
- Prompt:`(designing the ultimate retro monster:1.4), in pixel-art-xl and style of pixelart 3244 43242432Negative prompt: grid, Tetris, tetris blocks, mosaic, mosaic, trees, trees, cabin, house, house, blocky, ((blurred)) ((blur)), low poly, low-poly, 3d, disfigured, kitsch, ugly, oversaturated, grain, low-res, Deformed, blurry, bad anatomy, disfigured, poorly drawn face, mutation, mutated, extra limb, ugly, poorly drawn hands, missing limb, blurry, floating limbs, disconnected limbs, malformed hands, blur, out of focus, long neck, long body, ugly, disgusting, poorly drawn, childish, mutilated, , mangled, old, surreal, pixel-art, pixelatedSteps: 28, Sampler: DDIM, CFG scale: 8, Seed: 4017319045, Size: 768x768, Model hash: 2c02b20a`
22
- This dogs might haunt you from time to time - to remove their influence - change the prompt to something like: " (designing the ultimate retro monster:1.7), in pixel-art-xl and style of pixelart 3244 43242432 " - weight matters here a lot.
 
23
 
24
- So how to make pixel art? - usually the best is go with 768px x 768px. Of course DDIM. There are two models here.
25
 
26
- You usually combine two of the embeddings. Usually pixel-art-stylizer + pixelart. Or pixel-art-XYZ + pixelart.
27
 
28
- First embedding is better trained pixel-art (with extensions: pixel-art-sm, pixel-art-md, pixel-art-lg and pixel-art-xl, pixel-art-stylizer).
29
- This model influence the best "pixels". The "sm-xl" are the strength of the effect. stylizer one affecting the second embedding, improve coherence and eliminate often overloading of these two more trained ones (they still have some flaws)
30
 
31
- Second embedding is a retro time machine. Lot of stylized game screens and retro vibe of 80-s.Here is a cool combination you need to try:
32
- Prompt:
33
- Designing the ultimate retro geeky hero or villain, in pixel-art-stylizer and in style of pixelart
34
- Negative prompt:Tetris, tetris blocks, mosaic, mosaic, trees, trees, cabin, house, house, blocky, ((blurred)) ((blur)), low poly, low-poly, 3d, disfigured, kitsch, ugly, oversaturated, grain, low-res, Deformed, blurry, bad anatomy, disfigured, poorly drawn face, mutation, mutated, extra limb, ugly, poorly drawn hands, missing limb, blurry, floating limbs, disconnected limbs, malformed hands, blur, out of focus, long neck, long body, ugly, disgusting, poorly drawn, childish, mutilated, , mangled, old, surreal, pixel-art, pixelated, low poly, low-poly, 3d, disfigured, kitsch, ugly, oversaturated, grain, low-res, Deformed, blurry, bad anatomy, disfigured, poorly drawn face, mutation, mutated, extra limb, ugly, poorly drawn hands, missing limb, blurry, floating limbs, disconnected limbs, malformed hands, blur, out of focus, long neck, long body, ugly, disgusting, poorly drawn, childish, mutilated, , mangled, old, surreal, pixel-art, pixelatedSteps: 28, Sampler: DDIM, CFG scale: 8, Seed: 4010337303, Size: 768x768
35
 
36
- Enjoy! I will update documentation tommorow alongside the info how to scale stuff (a bit tricky but possible)
 
 
 
 
 
 
 
37
 
 
 
 
2
  license: openrail
3
  ---
4
 
5
+ # 2d pixel art (beta) embedding for SD 2.0 768px
6
 
7
  Hi - I am a big fan of retro/nostalgia things.
8
+ This is the reason why I made this embedding.
9
+ I have trained it on 70 images, the version I will be targeting in upcoming weeks will be based on 128 or 256 well-selected and filtered images, and processed
10
  through pixelate tool to keep the same pixel size on each of the input data. This should improve the embedding dramatically.
11
 
12
+ ### Installation:
13
+
14
+ Just drop the embedding files (.pt extension) to your SD embeddings folder (`your-folder/embeddings`).
15
+ Restart the app if running. Use the keyword as a filename ("pixelart" for example). You can rename them as you wish.
16
 
17
  Before we start: cool tool to enhance your results even further: [link](https://giventofly.github.io/pixelit/#tryit)
18
 
19
+ **Version of Stable Diffusion:** `2.0 - 768`
20
+ **Supported diffusers:**
21
+ - Euler a (Preffered)
22
+ - DDIM
23
+ - other (partially)
24
+
25
+
26
+
27
+ ### Embeddings
28
+
29
+ pixelart:
30
+ The most generic one. Usually gives decent pixels, reads quite well prompts, is not to "old-school".
31
+ Used for "pixelating process" in img2img.
32
+
33
+ pixelart-soft:
34
+ The softer version of an embedding. One of the most generic ones.Usually good for characters.
35
+
36
+ pixelart-hard:
37
+ More pixelated version of embedding. Vintage/old-school. Depends on the topic - can be colorful or very vintage/dull.
38
+
39
+ pixelart-1 & pixelart-2:
40
+ less generic ones. These sometimes give even better results than original (depends on topic, tags and diffuser)
41
+
42
+ pixelizer:
43
+ Fun but chaotic one. Good for some experiments but usually gives colorful 8-bit like pixelated platformers/game screens stuff.
44
+ I have left that one for experiments or as a factor for combination with other ones.
45
+
46
+ ### Usage
47
 
48
+ I highly recommend use these embeddings with `Euler a` diffuser. It will give usually best results. In some cases it would be
49
+ good to use negative prompts. Sometimes for testing if you caught good composition/colors - you might add or remove them
50
+ to impact the image.
51
 
 
52
 
53
+ ### Img2img
54
 
55
+ The embeddings give you a great opportunity to change some of your works into pixel ones.
56
+ The best way to do it is to follow this process:
57
 
58
+ First get your subject. If this is a simple image as:
59
+ ![image](https://i.imgur.com/ks4bpSV.png) - you might even need just one step.
 
 
60
 
61
+ What I did here was to use:
62
+ **Positive prompt:** "game icon, raven, by pixelart, pixelated" (very important to add pixelated)
63
+ **Negative prompt:** none (recommended, but you can of course experiment, especially if subject needs that)
64
+ **Sampler:** Euler a (needed for any pixelation)
65
+ **steps:** 20,
66
+ **CFG:** 7,
67
+ **Denoising:** 0.58.
68
+ **Resolution:** 768x768.
69
 
70
+ The result:
71
+ ![image](https://i.imgur.com/wErverC.png)