Spaces:

jbilcke-hf

/

ai-comic-factory

like 9.2k

Running on CPU Upgrade

Redrawing is entirely too much fun...

While I did delete some of the original prompt for this panel most of what is still there is originally generated by ACF.
I did change the lighting prompt from blue to red which is no doubt why our TRex is red.

The prompt that panel uses: flat 2D cel shaded style, a narrow river with a strong current takes the dinosaurs down stream. Use a red filter for the scene to make it feel intense.

I'd say it is using key words like 'strong' and 'red' and 'intense' to lean toward the creation of the TRex as opposed to other dino-critters.

This is a fun one and interesting to try to figure out what in the prompt generated what...

The prompt: 2D cel shaded style, waterfall in the distance, with a bright and balanced mix of yellow, orange, and green hues. Add Rex and Lily balancing on a narrow log above the rushing water, screaming in joy and fear. Use a bright and balanced mix of yellow, orange, and green hues for the scene to make it feel adventurous and thrilling.

ACF named the two dinosaurs Rex and Lilly when it generated the story but it seemed that was one of the things that led to the inclusion of kids in the panels so I removed those references.
Here those names are still there but apparently they were mostly ignored.

Over all I'd say the prompt was interpreted right.
It probably had to figure out what a 'Rex and Lily' was.

Here's the panel edit/story I came up with:

The only post work done was to fix a couple typos in the captions (ex: change the word 'next' to 'nest'.) and to reduce the image in size so it can post here.

Thanks to @jbilcke-hf for the additional logging and the tip on where to find our comic creation history!
I'm attaching a copy of the history in creating these pages... warts and all. ;)

We can't upload text files here so I do apologize for the length of this:

  "instructions": "Start by drawing the lush green jungle environment with tall palm trees, vines, and foliage. Add a small pond with a babbling brook in the distance. Place the two main characters, a boy dinosaur named Rex (red color scheme) and a girl dinosaur named Lily (purple color scheme) walking in the foreground, both around 10 years old. Rex is wearing a brown dinosaur hat and backpack, while Lily has a brown dinosaur bandana. Both have green dinosaur t-shirts and brown sandals. Use a warm, bright yellow light filter to make the jungle appear welcoming and inviting.",
  "caption": "Explore the jungle with us, Rex and Lily! Our dinosaur adventure begins!"
}, {
  "panel": 2,
  "instructions": "Show the dinosaurs crossing a moss-covered log bridge over the pond, with the babbling brook in the background. Make the log bridge tall enough to establish depth and perspective. Rex and Lily can walk side-by-side or hold hands. As
 LLM generated some new panels: Array(2)
 Converting the 2 new panels into image prompts..
 Image prompt for panel 0 => "Disney 2D cel shaded style, Start by drawing the lush green jungle environment with tall palm trees, vines, and foliage. Add a small pond with a babbling brook in the distance. Place the two main characters, a boy dinosaur named Rex (red color scheme) and a girl dinosaur named Lily (purple color scheme) walking in the foreground, both around 10 years old. Rex is wearing a brown dinosaur hat and backpack, while Lily has a brown dinosaur bandana. Both have green dinosaur t-shirts and brown sandals. Use a warm, bright yellow light filter to make the jungle appear welcoming and inviting."
 Image prompt for panel 1 => "Disney 2D cel shaded style, cute 3D dinosaurs adventure through the jungle"
 LLM result (1st trial): "panel": 3,
  "instructions": "As Rex and Lily continue through the jungle, they come across a group of baby dinosaurs huddled together. Rex, being the friendly one, approaches them gently and introduces himself. Lily, a little more cautious, waits nearby. Draw the baby dinosaurs in various shades of green and brown, and have Rex's eyes sparkle as he speaks to them. Add a soft orange light source from above to create a warm, cozy atmosphere.",
  "caption": "Our new friends need our help! Let's see how we can assist these precious little babies."
},
{
  "panel": 4,
  "instructions": "As Rex and Lily investigate, they discover a pack of sinister-looking carnivorous dinosaurs lurking in the shadows. Draw these dinosaurs in bold red and orange hues to emphasize their menacing nature. Use a more yellow-orange light filter to create a tense and ominous atmosphere.",
  "caption": "Oh no! We have to be careful, those dinosaurs are up to no good!"
}]
 LLM generated some new panels: Array(2)0: {panel: 3, instructions: 'As Rex and Lily continue through the jungle, they …rce from above to create a warm, cozy atmosphere.', caption: "Our new friends need our help! Let's see how we can assist these precious little babies."}1: {panel: 4, instructions: 'As Rex and Lily investigate, they discover a pack … filter to create a tense and ominous atmosphere.', caption: 'Oh no! We have to be careful, those dinosaurs are up to no good!'}length: 2[[Prototype]]: Array(0)
 Converting the 2 new panels into image prompts..
 Image prompt for panel 2 => "Disney 2D cel shaded style, As Rex and Lily continue through the jungle, they come across a group of baby dinosaurs huddled together. Rex, being the friendly one, approaches them gently and introduces himself. Lily, a little more cautious, waits nearby.  baby dinosaurs in various shades of green and brown, and have Rex's eyes sparkle as he speaks to them. Add a soft orange light source from above to create a warm, cozy atmosphere."
 Image prompt for panel 3 => "Disney 2D cel shaded style, As Rex and Lily investigate, they discover a pack of sinister-looking carnivorous dinosaurs lurking in the shadows. se dinosaurs in bold red and orange hues to emphasize their menacing nature. Use a more yellow-orange light filter to create a tense and ominous atmosphere."
 LLM result (1st trial): "panel": 5,
    "instructions": "Rex and Lily devise a plan to safely escort the baby dinosaurs to a nearby nesting area while avoiding the predator dinosaurs. Draw the baby dinosaurs following the older dinosaurs as they move through the jungle, looking up to them with trust and admiration. Use a light green filter for the scene to make it feel calmer and safer.",
    "caption": "We'll steer clear of danger and keep our young companions safe until they reach their new home!"
  },
  {
    "panel": 6,
    "instructions": "As they journey deeper into the jungle, Rex and Lily encounter a narrow river with a strong current. Draw them solving the problem by rafting together, steering the baby dinosaurs through the water with care. Use a blue filter for the scene to make it feel cool and serene.",
    "caption": "We'll have to make this crossing by raft! Let's work together and keep our heads above water!"
  }]
 LLM generated some new panels: Array(2)
 Converting the 2 new panels into image prompts..
 Image prompt for panel 4 => "Disney 2D cel shaded style, Rex and Lily devise a plan to safely escort the baby dinosaurs to a nearby nesting area while avoiding the predator dinosaurs.  baby dinosaurs following the older dinosaurs as they move through the jungle, looking up to them with trust and admiration. Use a light green filter for the scene to make it feel calmer and safer."
 Image prompt for panel 5 => "Disney 2D cel shaded style, As they journey deeper into the jungle, Rex and Lily encounter a narrow river with a strong current. m solving the problem by rafting together, steering the baby dinosaurs through the water with care. Use a blue filter for the scene to make it feel cool and serene."
2 panel finished!
 LLM result (1st trial): "panel": 7,
    "instructions": "Draw a waterfall in the distance, with a bright and balanced mix of yellow, orange, and green hues. Add Rex and Lily balancing on a narrow log above the rushing water, screaming in joy and fear. Use a bright and balanced mix of yellow, orange, and green hues for the scene to make it feel adventurous and thrilling.",
    "caption": "Hold on tight, we're about to cross the most dangerous part of our journey yet!"
  },
  {
    "panel": 8,
    "instructions": "Show Rex and Lily ultimately reaching the nesting area with the baby dinosaurs safe and sound, where they reunite with their families. Use a warm and yellow filter for the scene to make it feel peaceful and harmonious.",
    "caption": "We made it! Our babies are reunited with their families, all thanks to us. Let's celebrate this journey with a feast!"
  }]

Note: These instructions and captions should ultimately showcase the dangers and exhilaration of adventuring through a lush jungle full of cute and colorful 3
 LLM generated some new panels: Array(2)
 Converting the 2 new panels into image prompts..
 Image prompt for panel 6 => "Disney 2D cel shaded style, waterfall in the distance, with a bright and balanced mix of yellow, orange, and green hues. Add Rex and Lily balancing on a narrow log above the rushing water, screaming in joy and fear. Use a bright and balanced mix of yellow, orange, and green hues for the scene to make it feel adventurous and thrilling."
 Image prompt for panel 7 => "Disney 2D cel shaded style, Show Rex and Lily ultimately reaching the nesting area with the baby dinosaurs safe and sound, where they reunite with their families. Use a warm and yellow filter for the scene to make it feel peaceful and harmonious."
 good, we are half way there, hold tight!
6 panel finished!
 upscaling panel 0 (9ce2a3db-1462-433e-918c-289992bff6c5)
 upscale successful, removing 0 (9ce2a3db-1462-433e-918c-289992bff6c5) from upscale queue
 upscaling panel 1 (adba48e3-e236-436e-a41b-ebd9aa7366f9)
 upscale successful, removing 1 (adba48e3-e236-436e-a41b-ebd9aa7366f9) from upscale queue
 upscaling panel 2 (4d97981e-32ab-42e5-867c-a321b44f8f8b)
 upscale successful, removing 2 (4d97981e-32ab-42e5-867c-a321b44f8f8b) from upscale queue
 upscaling panel 3 (256ac628-6f72-48e2-985f-b6bf9d9b1779)
 upscale successful, removing 3 (256ac628-6f72-48e2-985f-b6bf9d9b1779) from upscale queue
 upscaling panel 4 (989c6876-5a16-47f1-aa41-19ffdf28a603)
 upscale successful, removing 4 (989c6876-5a16-47f1-aa41-19ffdf28a603) from upscale queue
 upscaling panel 5 (7d23b437-6b5c-4d85-b647-50b17611cca4)
 upscale successful, removing 5 (7d23b437-6b5c-4d85-b647-50b17611cca4) from upscale queue
 upscaling panel 6 (593b25c5-b57f-45ce-b956-ed7b97ade7c7)
 upscale successful, removing 6 (593b25c5-b57f-45ce-b956-ed7b97ade7c7) from upscale queue
 upscaling panel 7 (3ad48530-c4d5-41a7-b9b8-85c5d78d6c35)
 upscale successful, removing 7 (3ad48530-c4d5-41a7-b9b8-85c5d78d6c35) from upscale queue
 Asked to save a new prompt: 2D cel shaded style, waterfall in the distance, with a bright and balanced mix of yellow, orange, and green hues. Add Rex and Lily balancing on a narrow log above the rushing water, screaming in joy and fear. Use a bright and balanced mix of yellow, orange, and green hues for the scene to make it feel adventurous and thrilling.
 panel finished!
 Asked to save a new prompt: 2D cel shaded style, cute 3D dinosaurs adventure through the jungle
 panel finished!
 Asked to save a new prompt: flat 2D cel shaded style, cute 3D dinosaurs adventure through the jungle
 panel finished!
 Asked to save a new prompt: 2D cel shaded style, Start by drawing the lush green jungle environment with tall palm trees, vines, and foliage. Add a small pond with a babbling brook in the distance. Place the two main characters, a boy dinosaur named Rex (red color scheme) and a girl dinosaur named Lily (purple color scheme) walking in the foreground, both around 10 years old. Rex is wearing a brown dinosaur hat and backpack, while Lily has a brown dinosaur bandana. Both have green dinosaur t-shirts and brown sandals. Use a warm, bright yellow light filter to make the jungle appear welcoming and inviting.
 panel finished!
 Asked to save a new prompt: 2D cel shaded style, Start by drawing the lush green jungle environment with tall palm trees, vines, and foliage. Add a small pond with a babbling brook in the distance. a boy dinosaur named Rex (red color scheme) and a girl dinosaur named Lily (purple color scheme) walking in the foreground, both around 10 years old. Use a warm, bright yellow light filter to make the jungle appear welcoming and inviting.
 panel finished!
 Asked to reload panel 1
 panel finished!
 Asked to save a new prompt: flat 2D cel shaded style, cute 3D dinosaurs adventure through the jungle, bright yellow light filter to make the jungle appear welcoming and inviting.
 panel finished!
 Asked to save a new prompt: 2D cel shaded style, As they journey deeper into the jungle, Rex and Lily encounter a narrow river with a strong current. m solving the problem by rafting together, steering the baby dinosaurs through the water with care. Use a blue filter for the scene to make it feel cool and serene.
 panel finished!
 Asked to save a new prompt: 2D cel shaded style, As they journey deeper into the jungle, we encounter a narrow river with a strong current. steer the baby dinosaurs through the water with care. Use a blue filter for the scene to make it feel cool and serene.
 panel finished!
 Asked to save a new prompt: fkat 2D cel shaded style, a narrow river with a strong current takes the dinosaurs down stream. Use a blue filter for the scene to make it feel cool and serene.
 panel finished!
 Asked to save a new prompt: 2D cel shaded style, Show Rex and Lily ultimately reaching the nesting area with the baby dinosaurs safe and sound, where they reunite with their families. Use a warm and yellow filter for the scene to make it feel peaceful and harmonious.
 panel finished!
 Asked to save a new prompt: flat 2D cel shaded style, a narrow river with a strong current takes the dinosaurs down stream. Use a blue filter for the scene to make it feel cool and serene.
 panel finished!
 Asked to save a new prompt: flat 2D cel shaded style, a narrow river with a strong current takes the dinosaurs down stream. Use a red  filter for the scene to make it feel intense.
 panel finished!
 Asked to save a new prompt: 2D cel shaded style, Start by drawing the lush green jungle environment with tall palm trees, vines, and foliage. Add a small pond with a babbling brook in the distance. a boy dinosaur named Rex (red color scheme) and a girl dinosaur named Lily (purple color scheme) walking in the foreground, both around 10 years old. Use a warm, bright off white light filter to make the jungle appear welcoming and inviting.
 panel finished!
 Asked to save a new prompt: 2D cel shaded style, Start by drawing the lush green jungle environment with tall palm trees, vines, and foliage. Add a small pond with a babbling brook in the distance. a boy dinosaur (red color scheme) and a girl dinosaur (purple color scheme) walk in the foreground. Use a warm, bright off white light filter to make the jungle appear welcoming and inviting.
 panel finished!
 Asked to reload panel 5
 panel finished!
 Asked to save a new prompt: 2D cel shaded style, a lush green jungle environment with tall palm trees, vines, and foliage. a small pond with a babbling brook in the distance. a boy dinosaur (red color scheme) and a girl dinosaur (purple color scheme) walk in the foreground. Use a warm, bright off white light filter to make the jungle appear welcoming and inviting.
 panel finished!
 Asked to save a new prompt: flat 2D cel shaded style, cute 3D dinosaurs adventure through the jungle, bright yellow light filter to make the jungle appear welcoming and inviting.
 Asked to save a new prompt: flat 2D cel shaded style, cute 3D dinosaurs adventure through the jungle, an asteroid is plummeting to earth in the far background, bright yellow light filter to make the jungle appear strangely welcoming and inviting.
 panel finished!
 Asked to save a new prompt: flat 2D cel shaded style, cute 3D dinosaurs adventure through the jungle, fiery asteroids are  crossing the sky in the far background, bright yellow light filter to make the jungle appear strangely welcoming and inviting.
 panel finished!
 Asked to save a new prompt: flat 2D cel shaded style, cute 3D dinosaurs adventure through the jungle, fiery asteroids are  crossing the sky in the far background, bright yellow filter makes the jungle appear overly bright
 panel finished!
 Asked to save a new prompt: 2D cel shaded style, a nearby nesting area avoids  the predator dinosaurs. baby dinosaurs follow the older dinosaurs, looking up to them with trust and admiration. a light green filter makes the scene feel calm and safe.
 panel finished!
api.hf.space/v1/jbilcke-hf/ai-comic-factory/sse:1 
        
        
       Failed to load resource: net::ERR_HTTP2_PROTOCOL_ERROR
SpaceHeader-1eb4020f.js:5 Failed to fetch Space status via SSE: network error
onStateChange @ SpaceHeader-1eb4020f.js:5
SSEUtils-86ad33eb.js:2 SSE Stream ended with error: TypeError: network error
(anonymous) @ SSEUtils-86ad33eb.js:2
 Asked to save a new prompt: 2D cel shaded style, a nearby nesting area, tiny baby pterodatcyls fly in sky, a bright blue filter makes the scene feel calm and safe.
 panel finished!
 Asked to save a new prompt: 2D cel shaded style, a nearby nesting area, tiny Pterodactyls fly in sky, a bright blue filter makes the scene feel calm and safe.
 panel finished!
 Asked to save a new prompt: 2D cel shaded style, blue sky background, tiny winged dinosaurs fly in sky, a bright blue filter makes the scene feel calm and safe.
 panel finished!
 Asked to save a new prompt: 2D cel shaded style, blue sky background, winged dinosaurs fly in sky, a bright blue filter makes the scene feel calm and safe.
 panel finished!
 Asked to save a new prompt: 2D cel shaded style, a group of baby dinosaurs huddled together. Add a soft orange light source from above to create a warm, cozy atmosphere.
 panel finished!
 Asked to reload panel 2
 panel finished!
 Asked to save a new prompt: 2D cel shaded style, full view, a group of baby dinosaurs huddled together. Add a soft orange light source from above to create a warm, cozy atmosphere.
 panel finished!
 Asked to save a new prompt: 2D flat cel shaded style, full view, a group of baby dinosaurs huddle together, a soft orange light source from above to create a warm, cozy atmosphere.
 panel finished!
 Asked to save a new prompt: 2D cel shaded style, blue sky background, winged dinosaurs fly in dark red sky, a bright blue filter makes the scene feel calm and safe.
 panel finished!
 Asked to save a new prompt: 2D flat cel shaded style, blue sky background, winged dinosaurs fly in dark red sky, a bright blue filter makes the scene feel calm and safe.
 panel finished!
 Asked to save a new prompt: 2D cel shaded style, waterfall in the distance, with a bright and balanced mix of yellow, orange, and green hues. Add Rex and Lily balancing on a narrow log above the rushing water, screaming in joy and fear. Dark red fog, bright and balanced mix of yellow, orange, and green hues for the scene to make it feel adventurous and thrilling.
 panel finished!
 Asked to save a new prompt: 2D cel shaded style, a lush green jungle environment with tall palm trees, vines, and foliage. a small pond with a babbling brook in the distance. a boy dinosaur (green color scheme) and a girl dinosaur (yellow-green color scheme) walk in the foreground. Use a warm, bright off white light filter to make the jungle appear welcoming and inviting.
 panel finished!
 upscaling panel 0 (6266fb2b-910f-40fb-8b8d-8313efcddb2a)
 upscale successful, removing 0 (6266fb2b-910f-40fb-8b8d-8313efcddb2a) from upscale queue
 upscaling panel 1 (6b631366-1045-4a30-9859-d44504dfd837)
 upscale successful, removing 1 (6b631366-1045-4a30-9859-d44504dfd837) from upscale queue
 upscaling panel 2 (1e8f633e-894c-4805-9a1e-f94ff3f0c0ca)
 upscale successful, removing 2 (1e8f633e-894c-4805-9a1e-f94ff3f0c0ca) from upscale queue
 upscaling panel 4 (954c7775-ef96-4bac-9088-e0b66990c96a)
 Asked to save a new caption:  There has been peace in the jungle for as long as there have been tales to tell 
 Asked to save a new caption:  Why should today be any different?..
 upscale successful, removing 4 (954c7775-ef96-4bac-9088-e0b66990c96a) from upscale queue
 upscaling panel 5 (68879e7b-2a2e-45da-a5f8-24853a15e5d3)
 Asked to save a new caption:  But trouble is stirring  
 Asked to save a new caption:  and the elders are restless 
 upscale successful, removing 5 (68879e7b-2a2e-45da-a5f8-24853a15e5d3) from upscale queue
 upscaling panel 6 (166903b1-48f3-406c-943e-c6b1d0371fec)
 upscale successful, removing 6 (166903b1-48f3-406c-943e-c6b1d0371fec) from upscale queue
 upscaling panel 7 (b28e9896-5682-40d0-9e64-8606af2fd5eb)
 Asked to save a new caption:  The skies are filled with red at night and not their warm blue Hue 
 upscale successful, removing 7 (b28e9896-5682-40d0-9e64-8606af2fd5eb) from upscale queue
 Asked to save a new caption:  Even those downstream are restless 
 Asked to save a new caption:  But the morning sun refreshes our home 
 Asked to save a new caption:   and we are ready to leave the next again and play ```

I wish open-source models were really able to interpret all those detailed instructions!
But I think this is coming soon (2024?)