Audioreactive Graffiti – TouchDesigner x StreamDiffusion Tutorial 1
In this tutorial, we're looking at how to create graffiti based on abstract generative shapes and colors in TouchDesigner, using @dotsimulate's latest .tox for StreamDiffusion. It's all still very new and unexplored, so this is just one of my first approaches and I'm happy to hear any feedback :) Really looking forward to many more examples! This also works without StreamDiffusion, you can simply watch the part before! StreamDiffusion .tox by dotsimulate: https://www.patreon.com/posts/streamdiffusion-97939064 Setup Tutorial: https://youtu.be/X4rlC6y1ahw?si=LGqtrDdh-YK2H43z Snare Detection: https://www.patreon.com/posts/98175337 Video File: https://www.patreon.com/posts/98175466 Previous video: https://youtu.be/4wpn_3JNaIc?si=104ESdGwJ5WC4I_t Music video made with StreamDiffusion: https://youtu.be/-nQoPNNN6_E?si=1hmM7JG4jRihME0X Resolutions: https://www.reddit.com/r/StableDiffusion/comments/15c3rf6/sdxl_resolution_cheat_sheet/ The prompt used for this example: graffiti, text, graffiti art, wall, grunge You can use any prompt you like. Not entirely sure but order seems to matter, first "weigh" more. I usually don't use sentences, but simply add words that fit with commas. Pro Tips: TD now includes Nvidia Upscaler, I can highly recommend using that at the ned of the network! Specs: TouchDesigner 2023.11340, Windows 11, RTX 3070 Laptop, Intel i7 11 Gen, 32GB Ram ----- 00:00 Intro & Overview 02:11 Timeline Setup 05:22 StreamDiffusion Setup 07:17 Audio Setup 09:54 Instancing & Render Setup 13:39 Audioreactivity & Post Processing 15:55 Prompt & Step 17:34 Outlines & Breaks 21:27 Adding Noise 24:26 Frame by Frame 26:21 Seed 27:14 Exporting* 28:28 Misc 30:24 Pep Talk 31:26 Outro ----- *To see the file, check the project folder or define one on your moviefileout. Files, exclusive content and more: https://www.patreon.com/elekktronaut The special thanks is integrated at the end of the video ❤ If you have any questions, feel free to ask. IG: @elekktronaut https://www.instagram.com/elekktronaut/
In this tutorial, we're looking at how to create graffiti based on abstract generative shapes and colors in TouchDesigner, using @dotsimulate's latest .tox for StreamDiffusion. It's all still very new and unexplored, so this is just one of my first approaches and I'm happy to hear any feedback :) Really looking forward to many more examples! This also works without StreamDiffusion, you can simply watch the part before! StreamDiffusion .tox by dotsimulate: https://www.patreon.com/posts/streamdiffusion-97939064 Setup Tutorial: https://youtu.be/X4rlC6y1ahw?si=LGqtrDdh-YK2H43z Snare Detection: https://www.patreon.com/posts/98175337 Video File: https://www.patreon.com/posts/98175466 Previous video: https://youtu.be/4wpn_3JNaIc?si=104ESdGwJ5WC4I_t Music video made with StreamDiffusion: https://youtu.be/-nQoPNNN6_E?si=1hmM7JG4jRihME0X Resolutions: https://www.reddit.com/r/StableDiffusion/comments/15c3rf6/sdxl_resolution_cheat_sheet/ The prompt used for this example: graffiti, text, graffiti art, wall, grunge You can use any prompt you like. Not entirely sure but order seems to matter, first "weigh" more. I usually don't use sentences, but simply add words that fit with commas. Pro Tips: TD now includes Nvidia Upscaler, I can highly recommend using that at the ned of the network! Specs: TouchDesigner 2023.11340, Windows 11, RTX 3070 Laptop, Intel i7 11 Gen, 32GB Ram ----- 00:00 Intro & Overview 02:11 Timeline Setup 05:22 StreamDiffusion Setup 07:17 Audio Setup 09:54 Instancing & Render Setup 13:39 Audioreactivity & Post Processing 15:55 Prompt & Step 17:34 Outlines & Breaks 21:27 Adding Noise 24:26 Frame by Frame 26:21 Seed 27:14 Exporting* 28:28 Misc 30:24 Pep Talk 31:26 Outro ----- *To see the file, check the project folder or define one on your moviefileout. Files, exclusive content and more: https://www.patreon.com/elekktronaut The special thanks is integrated at the end of the video ❤ If you have any questions, feel free to ask. IG: @elekktronaut https://www.instagram.com/elekktronaut/