AI art

📽️🎞️ HOW-TO for "Second Law"

A short breakdown of how the movie was created using a variety of AI tools integrated into a hybrid workflow.

The core is done in Runaway (text-to-video), but there are others that were essential to create a concise work.

Let's dive in 1/10 🧵

2/10

First thing's first, the context. I wrote about my motivation for making the movie in this X post (no way to post the whole video to Farcaster unfortunately), so I suggest you read it 👇

Computational architect. Some structure, mostly chaos. Co-founder {protocell:labs}

https://protocell.xyz/

3/10

I had this idea of creating boulders suspended mid-air in realistic landscapes. My go-to text-to-image generator is Midjourney, which I've been using since they launched in 2022. I've invited the Midjourney bot to our own discord server so I can keep all generations in one place.

4/10

Example prompt:

basalt rock cliff floating mid-air, weird vibrant pigmentation, ultra-detailed texture, 35mm color photography --style raw --chaos 20 --aspect 2:3 --v 6.0

Raw parameter removes default Midjourney styling. I also used chaos and weird parameters to get more variation.

No post-processing needed!

5/10

Next, we can turn still images into animated scenes using Runway. Set camera motion / rotation using the interface and add additional movement in the scene using motion brush. You will have to tinker with the parameters somewhat to figure it out, although the interface is very intuitive.

6/10

I've used the free version of Runway which has a watermark below, but it's fully functional even in this free tier!

Great, now we have 4 seconds long animated clips. But what about the story? A compilation of moving clips will just be boring to watch.

7/10

I am a big fan of sci-fi and modern physics, so I thought to incorporate these elements into the story. I used ChatGPT to reformat a quote from Ludwig Boltzmann's "The second law of thermodynamics" and added some parts myself. This made it more concise and suitable for narration.

8/10

Next was turning this text into a voice, for which we used ElevenLabs text-to-speech generator. We synthesized an old-fashioned English sci-fi narrator using clips found online.

Tinkering with the parameters and regenerating helps finding the best sounding clip, as well as some post-editing to adjust the pace.

9/10

To get the background sounds and effects, we used Freesound, although you can also generate sound effects in Runway (and soon in ElevenLabs as well). Who needs stock sites when you can generate everything yourself?

The font used in the movie is an amazing retro-digital CC0 font MonoMEK by MEK.txt

10/10

Finally, video clips, background sounds, narration and the titles were edited in Adobe Premiere, but you can use any video editing software you are comfortable with. Only "special" effects added are the VR glitch effect at the start and the end of the video, and the title oscillations.

Done! 🎞️✂️

✨ 

I figured I should compile a list of links to all the tools (in order of appearance):

www.midjourney.com
runwayml.com
chat.openai.com
elevenlabs.io
freesound.org
objkt.com/collections/KT1WfQkAv9HZCin7bgUD1xQnUreXR6HKEhYK
www.adobe.com/products/premiere

Hope you found this thread useful 🎓

2/10

First thing's first, the context. I wrote about my motivation for making the movie in this X post (no way to post the whole video to Farcaster unfortunately), so I suggest you read it 👇

https://twitter.com/LukaPiskorec/status/1763878055993389526

generative artist. digital design. — https://www.dennis-chilas.work —hosting /gradients

thank you for sharing your process, luca! 1500 $DEGEN

Digital and generative art enthusiast and maker | https://linktr.ee/todemashi

Thank you for sharing the concept and process! Very useful and enjoyable 🙌 228 $DEGEN

Computational biologist, data scientist, digital artist | 
https://clauswilke.art/links | Hosting /ai-art & /clauswilke

Thank you Claus! I thought it would be useful. Will try to do more in the future. Knowledge is power ✊

And thank you for the mega tip!!!

1000 $degen 💁🏻‍♂️🎩

Great to see detailed how-to's!
10000 $DEGEN

agente causal 💜 🇲🇽
3D, AR, AI, Design, Code, Illustration, Glitch ✨🫧
💙 motittacorp.netlify.app
🌵 nopalrunner.netlify.app

Always super excited to try new things, especially web3 innovation :)

Stay Curious // iixii // Lazer Technologies // Prev: CoinDesk, Roc Nation // based

Glad you like it! And thank you ser for the generous tip 💁🏻‍♂️🎩

Web3 maximalist / degenerate • Former lawyer turned fashion designer • LDN

Former Pooler, Based Painter, Pixel Aficionado, smoky drink imbiber, and green thumbed gardener. 
🌐🦇🔊🪶🏆🌳🎨🥃

Glad you found it useful. Just tried to share what I learned. And thank you for the tip 💁🏻‍♂️🎩

This is just phenomenal, thank you for this.
2000 $degen

Whatever your decentralized, borderless, neutral, censorship-resistant open blockchain question is, the answer is YES… to Crypto!

👨🏻‍🍳 Better cook than I look 👨🏻‍🍳 
🧪 Dada scientist 🧪 
📐 Student of design 📐 
👾 👾 👾 👾 👾 

 /ai-art

Glad it resonated with you. I will try to share more in the future.

Btw. I got much better reactions here than on X (made the same thread there). FC community is so much more welcoming and engaged.

And thank you ser for this generous tip 💁🏻‍♂️🎩

Love this! Big fan of any how-to and walkthrough, especially with so many tools out there these days! 

31128 $degen

Human, father and artist. Exploring existence one step at a time. Love working with algorithms | Creating generative art daily | https://linktr.ee/vicdoval

Thank you Victor 💁🏻‍♂️🎩

You are one of the very few people who replied to the same thread on X, otherwise the engagement there was pretty dismal 😅

I will make an engagement comparison thread on X vs FC soon 🫡

Building /nounspace | Founding Member /atxdao | Creating community and good vibes wherever I go.

husband, father of two sexy girls, crypto community manager, bizniz owner and opinionated conservative. jesus guns girls america 🇺🇸

@wake.bsky.social

Artist - Father - /anemale
Dive into our dreams with the Anihimale Dreams collection
https://highlight.xyz/mint/base:0x59811D5cBAC7e0e1d9a5A9509E425C5962d87D67

Thank you Anemale, much appreciated 🙏 I’m glad the post resonated with you. And thanks for sharing and caring 💁🏻‍♂️🎩

1000 $DEGEN 

It may not be @wake  100K, but I'll feature your work tonight in my daily art because explaining your artistic process can help others evolve
🫂✨🖼

Designing /brand3 strategies at /floc | /degen logo creator | nf.td/esdotge

Farcaster OG | FID: 10174 | @fireflyapp Ambassador | /bnfarcaster 🎙 in Spanish  | https://www.youtube.com/@DiscoveryCaster

Thank you ser for the very generous tip 💁🏻‍♂️🎩

Also, I really like your glitched animated profile 👾