ํฐ์ƒ‰ ์šฐ์ฃผ๋ณต์„ ์ž…์€ ์™ธ๋กœ์šด ์šฐ์ฃผ๋น„ํ–‰์‚ฌ๊ฐ€ ๋‹ค์ฑ„๋กœ์šด ๋„์‹œ ๋ถˆ๋น›๊ณผ ๊ณ ์ธต ๋นŒ๋”ฉ๋“ค๋กœ ๋น›๋‚˜๋Š” ๋‰ด์š•์‹œ์˜ ํ™œ๊ธฐ์ฐฌ ์•ผ๊ฒฝ์„ ๋‚ด๋ ค๋‹ค๋ณด๋ฉฐ ๊ณ ์ธต ๋นŒ๋”ฉ ๊ผญ๋Œ€๊ธฐ์— ์„œ ์žˆ์Šต๋‹ˆ๋‹ค.
๋น›๋‚˜๋Š” ๋ฌธ์ž๊ฐ€ ์ƒˆ๊ฒจ์ง„ ๋‚˜์„ ํ˜• ํƒ‘์ด ๋ˆˆ ๋ฎ์ธ ์‚ฐ์•… ํ™ฉ๋ฌด์ง€์—์„œ ๋น›๋‚˜๋Š” ๋‹ฌ๊ณผ ๋ถ๊ทน๊ด‘ ์•„๋ž˜ ์†Ÿ์•„์˜ค๋ฅด๊ณ , ๋กœ๋ธŒ๋ฅผ ์ž…์€ ์ˆœ๋ก€์ž๋“ค์ด ๋Œ๊ณ„๋‹จ์„ ์˜ค๋ฅด๊ณ  ์žˆ๋‹ค.
์–ด๋‘์šด ์ฝ”ํŠธ๋ฅผ ์ž…์€ ์ธ๋ฌผ์ด ํฐ ์‚ฌ์ด๋ฒ„ํŽ‘ํฌ ์Šคํƒ€์ผ์˜ ๋ฌผ๊ตฌ๋ฆ„ ์†Œ์šฉ๋Œ์ด ์•„๋ž˜ ๋„ค์˜จ ์กฐ๋ช… ์ƒ๋ฌผ๋ฐœ๊ด‘ ๊ฝƒ๋ฐญ์— ์„œ ์žˆ๊ณ , ์ค‘์‹ฌ์—๋Š” ๋น›๋‚˜๋Š” ๋ฌด์ง€๊ฐฏ๋น› ๋ˆˆ์ด ์žˆ์Šต๋‹ˆ๋‹ค.
์ดˆํ˜„์‹ค์ ์ธ ํ™ฉํ˜ผ ์žฅ๋ฉด์œผ๋กœ, ๋”ฐ๋œปํ•œ ํ™ฉํ˜ผ ๋น› ์•„๋ž˜ ๋ฐ˜์‚ฌ๋˜๋Š” ๋ฌผ๊ณผ ๋น›๋‚˜๋Š” ๊ฝƒ ์‹๋ฌผ์ด ์–ด์šฐ๋Ÿฌ์ง„ ๊ฐ€์šด๋ฐ, ํ•œ ๋ช…์˜ ๊ด€์ฐฐ์ž๊ฐ€ ์„œ ์žˆ๋Š” ๊ธฐ๋…๋น„์  ๋‹ค๋ฆฌ๊ฐ€ ๊ฐ€์‹œ ๋ฉ๊ตด๊ณผ ์‹์ถฉ ์‹๋ฌผ๋กœ ๋’ค๋ฎ์—ฌ ์žˆ๋‹ค.
์ƒ์ƒํ•œ ์ˆ˜์ฑ„ํ™”์™€ ์• ๋‹ˆ๋ฉ”์ด์…˜์—์„œ ์˜๊ฐ์„ ๋ฐ›์€ ์Šคํƒ€์ผ๋กœ ๊ทธ๋ ค์ง„, ๋ฐฐ๊ฒฝ์— ์šฐ๋š ์†Ÿ์€ ๋ˆˆ ๋ฎ์ธ ์„ฑ์ธต ํ™”์‚ฐ์ด ์žˆ๋Š” ์ˆ˜์ง ์ผ์ถœ ๋„์‹œ ํ’๊ฒฝ.
๋…ธ์„ ์ง„ ๊ตฌ๋ถˆ๊ตฌ๋ถˆํ•œ ์‚ฐ๊ธธ ์–ด๊นจ์— ์ฃผ์ฐจ๋œ ์„ ๋ช…ํ•œ ๋นจ๊ฐ„ ํด๋ž˜์‹ ์Šคํฌ์ธ ์นด, ๋น›๋‚˜๋Š” ํ›„๋ฏธ๋“ฑ, ์งˆ๊ฐ ์žˆ๋Š” ์•„์ŠคํŒ”ํŠธ, ์ „์‹ ์ฃผ, ์ผ๋ณธ ๋„๋กœ ํ‘œ์ง€ํŒ, ๊ทธ๋ฆฌ๊ณ  ๋‹ค์ฑ„๋กœ์šด ํ•˜๋Š˜ ์•„๋ž˜ ๋ฐ˜์ง์ด๋Š” ๋ถˆ๋น›์ด ๋น„์น˜๋Š” ๋จผ ๋„์‹œ ๊ณ„๊ณก.
ํฐ ๋ณด๋ผ์ƒ‰์—์„œ ํ˜ธ๋ฐ•์ƒ‰์œผ๋กœ ๋ณ€ํ•˜๋Š” ๋ฌด์ง€๊ฐฏ๋น› ๊ณ ๋ฆฌ๊ฐ€ ์žˆ๋Š” ๊ฒ€์€ ๋– ๋‹ค๋‹ˆ๋Š” ๊ตฌ์ฒด๊ฐ€ ์žˆ๋Š” ๋ฏธ๋‹ˆ๋ฉ€ํ•œ ํฐ์ƒ‰ ์ŠคํŠœ๋””์˜ค์— ๋นˆํ‹ฐ์ง€ ์˜์ž๊ฐ€ ์ž๋ฆฌํ•˜๋ฉฐ, ์ž”ํ•ด์™€ ๊ทธ๋ฆผ์ž์— ๋‘˜๋Ÿฌ์‹ธ์—ฌ ์žˆ์Œ.
์ผ์ถœ์— ๋ฐ”์œ„ ์ ˆ๋ฒฝ ์‚ฌ์ด๋ฅผ ๊ตฌ๋ถˆ๊ตฌ๋ถˆํ•˜๊ฒŒ ๋‹ฌ๋ฆฌ๋Š” ๋นˆํ‹ฐ์ง€ ๋…ธ๋ž€์ƒ‰ ์•„์ด์Šคํฌ๋ฆผ ๋ฐด, ๋ฐ”๋‹ค ํŒŒ๋„๊ฐ€ ๋ถ€์„œ์ง€๊ณ  ๊ฐˆ๋งค๊ธฐ๋“ค์ด ๋จธ๋ฆฌ ์œ„๋ฅผ ๋‚ ๊ณ  ์žˆ์Šต๋‹ˆ๋‹ค.
์•ˆ๊ฐœ๋กœ ๋ฎ์ธ ๋ธŒ๋ฃจํƒˆ๋ฆฌ์ŠคํŠธ ๋„์‹œ ์œ„๋กœ ๋น›๋‚˜๋Š” ํšŒ๋กœํŒ์„ ๊ฐ€์ง„ ๋ฏธ๋ž˜์ ์ธ ๊ฑฐ๋Œ€ํ•œ ๊ตฌ์กฐ๋ฌผ์ด ์†Ÿ์•„ ์žˆ์œผ๋ฉฐ, ํ”Œ๋žซํผ์— ์™ธ๋กœ์šด ์ธ๋ฌผ์ด ์„œ ์žˆ๋‹ค.
์˜ค๋ Œ์ง€ ๋‚˜๋น„์— ๋‘˜๋Ÿฌ์‹ธ์ธ ์‹ ๋น„๋กœ์šด ์ˆฒ ์†์— ์„œ ์žˆ๋Š” ์—ฌ์„ฑ ์‚ฌ์ด๋ณด๊ทธ. ๊ทธ๋…€๋Š” ๋„ค์˜จ ๋ธ”๋ฃจ ํŠธ๋ฆผ์ด ์žˆ๋Š” ํฐ์ƒ‰ ๊ฐ‘์˜ท์„ ์ž…๊ณ  ์–ผ๊ตด์ด ๋ณด์ด์ง€ ์•Š๋Š” ๋ถ‰์€ ๋น›์˜ ํˆฌ๋ช… ๋ฐ”์ด์ €๊ฐ€ ๋‹ฌ๋ฆฐ ๋ฏธ๋ž˜ํ˜• ํ—ฌ๋ฉง์„ ์ฐฉ์šฉํ•˜๊ณ  ์žˆ๋‹ค.

์ถ”์ฒœ ํ”„๋กฌํ”„ํŠธ

A cat holding a sign that says hello world

์ถ”์ฒœ ๋งค๊ฐœ๋ณ€์ˆ˜

steps

4 - 6

resolution

1024x1024

ํŒ

ํšจ์œจ์„ฑ์„ ์œ„ํ•ด bfloat16 ํ…์„œ ํƒ€์ž…์„ ์‚ฌ์šฉํ•˜์„ธ์š”.

ํ•„์š” ์‹œ VRAM ์ ˆ์•ฝ์„ ์œ„ํ•ด ๋ชจ๋ธ CPU ์˜คํ”„๋กœ๋“œ๋ฅผ ํ™œ์„ฑํ™”ํ•˜์„ธ์š”.

ํ˜ธํ™˜ ๊ฐ€๋Šฅํ•œ GPU์—์„œ ์„ฑ๋Šฅ ํ–ฅ์ƒ์„ ์œ„ํ•ด torch.compile์„ ํ™œ์„ฑํ™”ํ•˜์„ธ์š” (๋กœ๋”ฉ ์‹œ๊ฐ„์ด ๋Š˜์–ด๋‚  ์ˆ˜ ์žˆ์Œ).

์žฌํ˜„ ๊ฐ€๋Šฅํ•œ ๊ฒฐ๊ณผ๋ฅผ ์œ„ํ•ด ์ˆ˜๋™ ์‹œ๋“œ๋ฅผ ์‚ฌ์šฉํ•˜์„ธ์š”.

ํฌ๋ฆฌ์—์ดํ„ฐ ์Šคํฐ์„œ

์ตœ์‹  ์—…๋ฐ์ดํŠธ, ๋‰ด์Šค ๋“ฑ์„ ๋ฐ›์œผ๋ ค๋ฉด ์ €ํฌ Discord์— ์ฐธ์—ฌํ•˜์„ธ์š”.

์›น์‚ฌ์ดํŠธ https://designer.shuttleai.com/์—์„œ ๋ชจ๋ธ์„ ์‚ฌ์šฉํ•ด๋ณด์„ธ์š”.

ShuttleAI๋ฅผ ํ†ตํ•ด API๋กœ Shuttle 3.1 Aesthetic๋ฅผ ์‚ฌ์šฉํ•˜๊ณ  ShuttleAI ๋ฌธ์„œ๋„ ํ™•์ธํ•˜์„ธ์š”.

# Shuttle 3.1 Aesthetic

์ตœ์‹  ์—…๋ฐ์ดํŠธ, ๋‰ด์Šค ๋“ฑ์„ ๋ฐ›์œผ๋ ค๋ฉด ์ €ํฌ Discord์— ์ฐธ์—ฌํ•˜์„ธ์š”.

## ๋ชจ๋ธ ๋ณ€ํ˜•

๋‹ค์–‘ํ•œ ํ•˜๋“œ์›จ์–ด ์„ฑ๋Šฅ๊ณผ ์‚ฌ์šฉ ์‚ฌ๋ก€์— ์ตœ์ ํ™”๋œ ์„œ๋กœ ๋‹ค๋ฅธ ์ •๋ฐ€๋„ ๋ฐ ํ˜•์‹์„ ์ œ๊ณตํ•˜๋Š” ๋ชจ๋ธ ๋ณ€ํ˜•๋“ค์ž…๋‹ˆ๋‹ค.

- bfloat16

- fp8

- GGUF (๊ณง ์ œ๊ณต ์˜ˆ์ •)

Shuttle 3.1 Aesthetic๋Š” ํ…์ŠคํŠธ ํ”„๋กฌํ”„ํŠธ๋กœ๋ถ€ํ„ฐ 4~6๋‹จ๊ณ„ ๋งŒ์— ์„ธ๋ฐ€ํ•˜๊ณ  ์‹ฌ๋ฏธ์ ์ธ ์ด๋ฏธ์ง€๋ฅผ ์ƒ์„ฑํ•˜๋„๋ก ์„ค๊ณ„๋œ ํ…์ŠคํŠธ-์ด๋ฏธ์ง€ AI ๋ชจ๋ธ์ž…๋‹ˆ๋‹ค. ์ด๋ฏธ์ง€ ํ’ˆ์งˆ, ํƒ€์ดํฌ๊ทธ๋ž˜ํ”ผ, ๋ณต์žกํ•œ ํ”„๋กฌํ”„ํŠธ ์ดํ•ด ๋ฐ ์ž์› ํšจ์œจ์„ฑ์—์„œ ํ–ฅ์ƒ๋œ ์„ฑ๋Šฅ์„ ์ œ๊ณตํ•ฉ๋‹ˆ๋‹ค.

![image/png](https://huggingface.co/shuttleai/shuttle-3.1-aesthetic/resolve/main/demo.png)

์›น์‚ฌ์ดํŠธ https://designer.shuttleai.com/์—์„œ ๋ชจ๋ธ์„ ์‚ฌ์šฉํ•ด๋ณผ ์ˆ˜ ์žˆ์Šต๋‹ˆ๋‹ค.

## API๋ฅผ ํ†ตํ•œ ๋ชจ๋ธ ์‚ฌ์šฉ๋ฒ•

ShuttleAI๋ฅผ ํ†ตํ•ด Shuttle 3.1 Aesthetic๋ฅผ API๋กœ ์‚ฌ์šฉํ•  ์ˆ˜ ์žˆ์Šต๋‹ˆ๋‹ค.

- ShuttleAI

- ShuttleAI ๋ฌธ์„œ

## ๐Ÿงจ Diffusers๋ฅผ ์ด์šฉํ•œ ๋ชจ๋ธ ์‚ฌ์šฉ๋ฒ•

diffusers๋ฅผ ์„ค์น˜ํ•˜๊ฑฐ๋‚˜ ์—…๊ทธ๋ ˆ์ด๋“œํ•˜์„ธ์š”.

```shell

pip install -U diffusers

```

๊ทธ ๋‹ค์Œ DiffusionPipeline์„ ์‚ฌ์šฉํ•˜์—ฌ ๋ชจ๋ธ์„ ์‹คํ–‰ํ•  ์ˆ˜ ์žˆ์Šต๋‹ˆ๋‹ค.

```python

import torch

from diffusers import DiffusionPipeline

# ์‚ฌ์ „ ํ•™์Šต๋œ ๋ชจ๋ธ์—์„œ bfloat16 ํ…์„œ ํƒ€์ž…์„ ์‚ฌ์šฉํ•ด diffusion ํŒŒ์ดํ”„๋ผ์ธ ๋กœ๋“œ

pipe = DiffusionPipeline.from_pretrained(

"shuttleai/shuttle-3.1-aesthetic", torch_dtype=torch.bfloat16

).to("cuda")

# ํ•„์š” ์‹œ ๋ชจ๋ธ์„ CPU๋กœ ์˜คํ”„๋กœ๋“œํ•˜์—ฌ VRAM ์ ˆ์•ฝ ๊ฐ€๋Šฅ

# pipe.enable_model_cpu_offload()

# ํ˜ธํ™˜ ๊ฐ€๋Šฅํ•œ GPU์—์„œ torch.compile์„ ์‚ฌ์šฉํ•ด ์„ฑ๋Šฅ ํ–ฅ์ƒ ๊ฐ€๋Šฅ (๋กœ๋”ฉ ์‹œ๊ฐ„ ์ฆ๊ฐ€ํ•  ์ˆ˜ ์žˆ์Œ)

# pipe.transformer.to(memory_format=torch.channels_last)

# pipe.transformer = torch.compile(pipe.transformer, mode="max-autotune", fullgraph=True)

# ์ด๋ฏธ์ง€ ์ƒ์„ฑ์„ ์œ„ํ•œ ํ”„๋กฌํ”„ํŠธ ์„ค์ •

prompt = "A cat holding a sign that says hello world"

# diffusion ํŒŒ์ดํ”„๋ผ์ธ์„ ์ด์šฉํ•ด ์ด๋ฏธ์ง€ ์ƒ์„ฑ

image = pipe(

prompt,

height=1024,

width=1024,

guidance_scale=3.5,

num_inference_steps=4,

max_sequence_length=256,

# ์žฌํ˜„ ๊ฐ€๋Šฅํ•œ ๊ฒฐ๊ณผ๋ฅผ ์œ„ํ•ด ์ˆ˜๋™ ์‹œ๋“œ ์‚ฌ์šฉ ๊ฐ€๋Šฅ

# generator=torch.Generator("cpu").manual_seed(0)

).images[0]

# ์ƒ์„ฑ๋œ ์ด๋ฏธ์ง€ ์ €์žฅ

image.save("shuttle.png")

```

์ž์„ธํ•œ ๋‚ด์šฉ์€ diffusers ๋ฌธ์„œ๋ฅผ ์ฐธ๊ณ ํ•˜์„ธ์š”.

## ComfyUI๋กœ ๋ชจ๋ธ ์‚ฌ์šฉํ•˜๊ธฐ

Shuttle 3.1 Aesthetic๋ฅผ ๋กœ์ปฌ ์ถ”๋ก ํ™˜๊ฒฝ์—์„œ [ComfyUI](https://github.com/comfyanonymous/ComfyUI)์™€ ํ•จ๊ป˜ ์‚ฌ์šฉํ•˜๋ ค๋ฉด ์ด safetensors ํŒŒ์ผ์„ ์‚ฌ์šฉํ•˜์„ธ์š”.

## ํ›ˆ๋ จ ์„ธ๋ถ€ ์ •๋ณด

Shuttle 3.1 Aesthetic๋Š” Shuttle 3 Diffusion์„ ๊ธฐ๋ฐ˜์œผ๋กœ ํ•ฉ๋‹ˆ๋‹ค. ๋‹จ 4๋‹จ๊ณ„ ๋งŒ์— Flux Dev์™€ ์œ ์‚ฌํ•œ ์ด๋ฏธ์ง€๋ฅผ ์ƒ์„ฑํ•  ์ˆ˜ ์žˆ์œผ๋ฉฐ Apache 2 ๋ผ์ด์„ ์Šค๋ฅผ ๋”ฐ๋ฆ…๋‹ˆ๋‹ค. ํ›ˆ๋ จ ๊ณผ์ •์—์„œ ๋ชจ๋ธ ์ผ๋ถ€๋ฅผ ๋ถ€๋ถ„์ ์œผ๋กœ ๋””๋””์Šคํ‹ธ๋ง(de-distilled) ํ•˜์˜€์Šต๋‹ˆ๋‹ค. Schnell ์‹œ๋ฆฌ์ฆˆ ๋ชจ๋ธ์˜ ํ•œ๊ณ„๋ฅผ ๊ทน๋ณตํ•˜๊ธฐ ์œ„ํ•ด ํŠน๋ณ„ํ•œ ํ›ˆ๋ จ ๋ฐฉ์‹์„ ์ ์šฉํ•˜์—ฌ ๋””ํ…Œ์ผ๊ณผ ์ƒ‰์ƒ ํ‘œํ˜„์ด ๊ฐœ์„ ๋˜์—ˆ์Šต๋‹ˆ๋‹ค.

์ด์ „
Jigglygirls - Illustrious-XL
๋‹ค์Œ
Flux์šฉ Midjourney Image Enhancer Ultra - Devildonia ์ œ์ž‘ - v1.0

๋ชจ๋ธ ์„ธ๋ถ€์‚ฌํ•ญ

๋ชจ๋ธ ์œ ํ˜•

Checkpoint

๊ธฐ๋ณธ ๋ชจ๋ธ

Flux.1 S

๋ชจ๋ธ ๋ฒ„์ „

v1.0

๋ชจ๋ธ ํ•ด์‹œ

07bc112b20

์ œ์ž‘์ž

ํ† ๋ก 

๋Œ“๊ธ€์„ ๋‚จ๊ธฐ๋ ค๋ฉด log inํ•˜์„ธ์š”.

Shuttle 3.1 Aesthetic - v1.0 ์ œ์ž‘ ์ด๋ฏธ์ง€

stable diffusion ์ด๋ฏธ์ง€

์Šคํƒ€์ผ ์ด๋ฏธ์ง€