File size: 2,660 Bytes
4433093
d16309b
4433093
e23d549
d16309b
 
 
4433093
d16309b
08f52b2
 
a38ffa5
 
08f52b2
 
 
 
 
 
d16309b
09fc07b
d16309b
 
 
 
08f52b2
a38ffa5
08f52b2
a38ffa5
 
 
d16309b
a38ffa5
 
 
d16309b
a38ffa5
 
 
 
d16309b
 
a38ffa5
 
 
 
 
 
 
 
 
 
 
 
08f52b2
 
 
d16309b
 
 
a38ffa5
 
 
 
 
 
 
 
d16309b
 
08f52b2
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
d16309b
 
08f52b2
 
 
 
 
 
 
 
 
 
a38ffa5
08f52b2
 
d16309b
 
 
 
a38ffa5
d16309b
a38ffa5
08f52b2
 
 
 
 
d16309b
a38ffa5
 
08f52b2
09fc07b
 
 
 
 
 
 
 
 
 
 
0ca5279
 
 
09fc07b
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
---
language: en
license: mit
thumbnail: https://i.ibb.co/6NLyc1P/stellar-diffusion.png
tags:
- stable-diffusion
- text-to-image
---

# Stellar Diffusion

Stellar Diffusion v0.2 vs Base Stable Diffusion v1.5
![Galaxy - Stellar Diffusion](images/o7_11.png) ![Galaxy - Stable Diffusion](images/galaxy_sd.png)
```
prompt = A hubble photograph of a galaxy
seed = 42
size = 512x512
```


Version: 0.2 (Nebula) (Dreambooth / .ckpt formats)

Stable Diffusion 1.5 finetuned on high quality processed space imagery.

---

# Python Usage

```py
from diffusers import StableDiffusionPipeline
import torch

model_id = "rexwang8/stellar-diffusion"
pipe = StableDiffusionPipeline.from_pretrained(model_id, torch_dtype=torch.float16)
pipe = pipe.to("cuda")

prompt = "A hubble photograph of a galaxy"
image = pipe(prompt).images[0]  
    
image.save("hubble_galaxy.png")
```

---
# Example Results

![Stellar Diffusion](images/stellar-diffusion-comp-simple.png)

![Stellar Diffusion](images/stellar-diffusion-comp-hard.png)

![Stellar Diffusion](images/stellar-diffusion-comp-nebulas.png)

![Stellar Diffusion](images/stellar-diffusion-comp-styles.png)


---

# Suggested parameters

512x512

Place subjects and styles at the very front, roll a few times if you don't get the results you want.

Great - Nebulas, Galaxies

Good - Black holes, Pulsars, Comets, Jupiter

Decent - All other solar system planets

---

# Reconized Tags

All reconized tags can be found in the tags.txt file. They are generated from the annotated descriptions of the photograph.

### Partial support for scientific celestial body tags as follows:

NGC - New General Catalogue of Nebulae and Clusters of Stars

M / Messier - A set of 110 astronomical objects catalogued by the French astronomer Charles Messier

UGC – (catalog) Uppsala General Catalogue, a catalog of galaxies

### Partial support for the following classification methods as follows:

By recording instrument/spacecraft (ex. Voyager, Hubble)

By Color

By Celestial Body type



# Dataset and Credits

### Model

Rex Wang (me!)

RunwayML for their SD 1.5

### Compute

Coreweave - 2x A40s (~3 A40 hours)

### Dataset

91 of the 100 images from https://esahubble.org/ Top 100 Hubble Images
ESA/Hubble

~100 additional images from ESA/Hubble and ~10 images from ESA/Webb

~50 additional images from images.nasa.gov


---

# Version History

V0.2 (Codename: Galaxy) - 264 image dataset

V0.1 - 91 image dataset

---

# Contact me

All feedback, criticisms, complaints, etc to discord preferably.

[email protected]

Discord: bob#1236

### Donate

[![ko-fi](https://ko-fi.com/img/githubbutton_sm.svg)](https://ko-fi.com/J3J1E24MB)