README.md · AlekseyCalvin/Somov_Carnivalesques_V2_FluxLoRA

metadata

license: apache-2.0
language:
  - en
base_model:
  - black-forest-labs/FLUX.1-dev
tags:
  - lora
  - flux
  - diffusers
  - image-generation
pipeline_tag: text-to-image
library_name: diffusers
instance_prompt: >-
  Somov style art, artwork by Konstantin Somov, detailed vibrantly carnivalesque
  illustration
widget:
  - text: >-
      (step 3600) Somov style art, artwork by Konstantin SomovSomov style art
      featuring artwork by Konstantin Somov with a carnival scene taking place
      in the 18th century, a man and a woman in Italian masks, in a garden,
      detailed illustration!
    output:
      url: images/example_tnkmv0i1l.png
  - text: >-
      (step 3600) Somov style art, artwork by Konstantin Somov, detailed
      carnivalesque illustration of a tiny drugged God inside of a wooden
      pillbox getting impaled by a giant red-robed woman wielding a huge sharp
      needle pin, indoors, in a hotel room in Vienna
    output:
      url: images/example_by5i130ad.png
  - text: >-
      (step 3600) Somov style art, artwork by Konstantin Somov, detailed
      carnivalesque illustration of of Arthur Rimbaud, the revolutionary blonde
      messy haired teenage trans man poet delivering a lecture to parlor book
      club group of revolutionary poet cat-person hermaphrodite angels circa the
      1870s
    output:
      url: images/example_3meubaokt.png
  - text: >-
      Somov style art, artwork by Konstantin Somov, detailed carnivalesque
      illustration of of Arthur Rimbaud, the revolutionary blonde messy haired
      teenage trans man poet delivering a lecture to parlor book club group of
      revolutionary poet cat-person hermaphrodite angels circa the 1870s
    output:
      url: images/example_zztk04zfe.png
  - text: >-
      (step 1800 sft) Somov style art, artwork by Konstantin Somov, detailed
      carnivalesque illustration of a tiny drugged God inside of a wooden
      pillbox getting impaled by a giant red-robed woman wielding a huge sharp
      needle pin, indoors, in a hotel room in Vienna
    output:
      url: images/example_9fgxf9yov.png
  - text: >-
      (step1800 sft) Somov style art, artwork by Konstantin SomovSomov style art
      featuring artwork by Konstantin Somov with a carnival scene taking place
      in the 18th century, a man and a woman in Italian masks, in a garden,
      detailed illustration!
    output:
      url: images/example_zt2satafa.png
  - text: >-
      (step1800 sft) Somov style art, artwork by Konstantin Somov, detailed
      carnivalesque illustration of of Arthur Rimbaud, the revolutionary blonde
      messy haired teenage trans man poet delivering a lecture to parlor book
      club group of revolutionary poet cat-person hermaphrodite angels circa the
      1870s
    output:
      url: images/example_9clbaos6r.png
  - text: >-
      (step2700sft) Somov style art, artwork by Konstantin SomovSomov style art
      featuring artwork by Konstantin Somov with a carnival scene taking place
      in the 18th century, a man and a woman in Italian masks, in a garden,
      detailed illustration!
    output:
      url: images/example_27g33y479.png
  - text: >-
      (step2700sft) Somov style art, artwork by Konstantin SomovSomov style art
      featuring artwork by Konstantin Somov with a carnival scene taking place
      in the 18th century, a man and a woman in Italian masks, in a garden,
      detailed illustration!
    output:
      url: images/example_zindsvqp8.png
  - text: >-
      (step2700sft) Somov style art, artwork by Konstantin Somov, detailed
      carnivalesque illustration of a tiny drugged God inside of a wooden
      pillbox getting impaled by a giant red-robed woman wielding a huge sharp
      needle pin, indoors, in a hotel room in Vienna
    output:
      url: images/example_px1dpfm1r.png
  - text: >-
      (step2700sft) Somov style art, artwork by Konstantin Somov, detailed
      carnivalesque illustration of of Arthur Rimbaud, the revolutionary blonde
      messy haired teenage trans man poet delivering a lecture to parlor book
      club group of revolutionary poet cat-person hermaphrodite angels circa the
      1870s
    output:
      url: images/example_7wcsu845t.png
  - text: >-
      (step2400sft) Somov style art, artwork by Konstantin Somov, detailed
      carnivalesque illustration of of Arthur Rimbaud, the revolutionary blonde
      messy haired teenage trans man poet delivering a lecture to parlor book
      club group of revolutionary poet cat-person hermaphrodite angels circa the
      1870s
    output:
      url: images/example_n515irc0r.png
  - text: >-
      (step2400sft) Somov style art, artwork by Konstantin SomovSomov style art
      featuring artwork by Konstantin Somov with a carnival scene taking place
      in the 18th century, a man and a woman in Italian masks, in a garden,
      detailed illustration!
    output:
      url: images/example_4cy3yjjcy.png
  - text: >-
      (step2400sft) Somov style art, artwork by Konstantin Somov, detailed
      carnivalesque illustration of a tiny drugged God inside of a wooden
      pillbox getting impaled by a giant red-robed woman wielding a huge sharp
      needle pin, indoors, in a hotel room in Vienna
    output:
      url: images/example_jiw9f5plp.png

Somov's C𝕒𝓇𝓃ⅈ𝓋𝔞𝓁esque 𝓛𝒾𝒶𝒾𝓼𝓸𝖓𝓼 Var.II

HISTORIC 𝒜𝓡𝒯𝚒𝕤𝕥 STYLE ℒ𝓸ℜ𝐴𝘴

||| By SilverAgePoets.com |||

Note: Variant II checkpoints of this model were fine-tuned at 64dim64alpha over AfroMan4Peace's Colossus2.1_Dedistilled + LongCLIP-GmP-ViT-L-14 by zer0int.
Key hyperparameters listed below.
Variant I checkpoints are found HERE: fine-tuned at 64dim128alpha and over DNA_1_618's Genova Apex De-distilled + LongCLIP-GmP-ViT-L-14 by zer0int.

A Low-Rank Adapter (LoRA) for FLUX-family models...
Fine-tuned on around 150 artworks inspired by Pierrot's lace tears, Columbina's satin gasps, Harlequin's velvet prances, by the toy moonlight of dreamed-up 18th centuries, and every achingly real rendezvous with fleeting masks of closeness...
And these artworks, of course, were crafted once upon a world by:
KONSTANTIN SOMOV (1869-1939), though representing but one facet, a brightest of dreams and among the deepest, of his manifold eclectic masteries.

Prompt
(step 3600) Somov style art, artwork by Konstantin SomovSomov style art featuring artwork by Konstantin Somov with a carnival scene taking place in the 18th century, a man and a woman in Italian masks, in a garden, detailed illustration!

Prompt
(step 3600) Somov style art, artwork by Konstantin Somov, detailed carnivalesque illustration of a tiny drugged God inside of a wooden pillbox getting impaled by a giant red-robed woman wielding a huge sharp needle pin, indoors, in a hotel room in Vienna

Prompt
(step 3600) Somov style art, artwork by Konstantin Somov, detailed carnivalesque illustration of of Arthur Rimbaud, the revolutionary blonde messy haired teenage trans man poet delivering a lecture to parlor book club group of revolutionary poet cat-person hermaphrodite angels circa the 1870s

Prompt
Somov style art, artwork by Konstantin Somov, detailed carnivalesque illustration of of Arthur Rimbaud, the revolutionary blonde messy haired teenage trans man poet delivering a lecture to parlor book club group of revolutionary poet cat-person hermaphrodite angels circa the 1870s

Prompt
(step 1800 sft) Somov style art, artwork by Konstantin Somov, detailed carnivalesque illustration of a tiny drugged God inside of a wooden pillbox getting impaled by a giant red-robed woman wielding a huge sharp needle pin, indoors, in a hotel room in Vienna

Prompt
(step1800 sft) Somov style art, artwork by Konstantin SomovSomov style art featuring artwork by Konstantin Somov with a carnival scene taking place in the 18th century, a man and a woman in Italian masks, in a garden, detailed illustration!

Prompt
(step1800 sft) Somov style art, artwork by Konstantin Somov, detailed carnivalesque illustration of of Arthur Rimbaud, the revolutionary blonde messy haired teenage trans man poet delivering a lecture to parlor book club group of revolutionary poet cat-person hermaphrodite angels circa the 1870s

Prompt
(step2700sft) Somov style art, artwork by Konstantin SomovSomov style art featuring artwork by Konstantin Somov with a carnival scene taking place in the 18th century, a man and a woman in Italian masks, in a garden, detailed illustration!

Prompt
(step2700sft) Somov style art, artwork by Konstantin Somov, detailed carnivalesque illustration of a tiny drugged God inside of a wooden pillbox getting impaled by a giant red-robed woman wielding a huge sharp needle pin, indoors, in a hotel room in Vienna

Prompt
(step2700sft) Somov style art, artwork by Konstantin Somov, detailed carnivalesque illustration of of Arthur Rimbaud, the revolutionary blonde messy haired teenage trans man poet delivering a lecture to parlor book club group of revolutionary poet cat-person hermaphrodite angels circa the 1870s

Prompt
(step2400sft) Somov style art, artwork by Konstantin Somov, detailed carnivalesque illustration of of Arthur Rimbaud, the revolutionary blonde messy haired teenage trans man poet delivering a lecture to parlor book club group of revolutionary poet cat-person hermaphrodite angels circa the 1870s

Prompt
(step2400sft) Somov style art, artwork by Konstantin SomovSomov style art featuring artwork by Konstantin Somov with a carnival scene taking place in the 18th century, a man and a woman in Italian masks, in a garden, detailed illustration!

Prompt
(step2400sft) Somov style art, artwork by Konstantin Somov, detailed carnivalesque illustration of a tiny drugged God inside of a wooden pillbox getting impaled by a giant red-robed woman wielding a huge sharp needle pin, indoors, in a hotel room in Vienna

Prompt with:

Scribble Somov style art, artwork by Konstantin Somov, detailed carnivalesque illustration & implore past-masked futures to guide you astray into endless carnival gardens; hedgerows tinseled with rainbows and moonglow, dresses & frock coats scuttle on echoes, rushing to catch for the billionth time early dawn fireworks of yearning igniting... Perhaps in these gardens you'd find at long last some mysteries yet to be dreamed...

Hyperparameters:

Fine-tuned on around 150 images, picked from a broader collection of 300+ Somov art files consolidated by us, and manually pre-processed/restored by us.
Upscaling was used sparingly, applied to only a small portion of the pieces; namely, only to those images which could not be found anywhere online in high quality or/and resolution.
Of the upscaled images, we added to the set only those that, after the upscale, did not appear to suffer extreme degradation texture/detail-wise, but seem unambiguously vivified in their roles as conflatable artistic translations apropos respective sources.
Somov the key Hyperparameters: 64dim/64alpha, Adamw8bit, lr.0003, ema:.99decay, linear timesteps, FluxCFG, resol.768, 1xbatch, on a single L4 via Google Colab Pro. Alas, due to the size of the dataset, we had to limit the resolution to 768. Even 1024 would cause out-of-memory errors, sometimes well into the training, at the tail end of the first epoch.

Use it with the 🧨 diffusers library

from diffusers import AutoPipelineForText2Image
import torch

pipeline = AutoPipelineForText2Image.from_pretrained('black-forest-labs/FLUX.1-dev', torch_dtype=torch.float16).to('cuda')
pipeline.load_lora_weights('AlekseyCalvin/Somov_Carnivalesques_V2_FluxLoRA_bySilverAgePoets')
image = pipeline('your prompt').images[0]