OVERTIME · 107 MIN SIX PEOPLE BEAT THE BIG AI LABS

Gen AI for Creators | Pulse Check: Midjourney, Runway, Minimax, Krea, Flux & More

October 18, 2024107 min Rory Flynn & Drew Brucker with Chris Branch

The short version

In this crossover livestream with Chris Branch's Gen AI for Creators pulse check, Rory and Drew join Chris to react to AI video and image work from across the community. They compare MiniMax, Runway, Kling, and Luma for motion quality, break down key-frame and prompting tricks like baking motion into base images, and cover Adobe Max's new Firefly video tool and Generative Extend. They close by debating AI advertising models emerging inside Perplexity and custom GPTs.

Key takeaways

  1. 01

    Bake motion into your base image before generating video: spinning wheels or a mid-stride walking pose give the video model a head start.

  2. 02

    Put motion descriptors first in a video prompt, Rory says, since earlier tokens get weighted more heavily than later ones.

  3. 03

    MiniMax, built by a six-person team, impressed the hosts most in 2024 for dynamic camera moves and character motion Runway and Luma couldn't match.

  4. 04

    Runway's key-frame edits break down if the two reference images differ too much; smaller, consistent changes blend far better than dramatic ones.

  5. 05

    Adobe Max's biggest reveals were a Firefly video tool in beta and Generative Extend in Premiere Pro, which adds frames to existing clips.

  6. 06

    Custom GPTs can be configured to insert a sponsor's link into every single response, an early and little-noticed form of AI advertising.

  7. 07

    Perplexity is replacing Google as the hosts' default search, valued for accurate, sourced, zero-click answers instead of sorting through forum results.

Receipts · said on the record

“Can we just get a reroll button like is that so hard yeah to have to constantly load in the pictures again and start the whole problem so frustrating.”
Fast Hours His #1 complaint about Runway's key-frame workflow Play from 13:01
“No other tool can get that level of generation speed or that level of movement and like dynamic dynamic with the camera motion plus the character movement plus the action.”
Fast Hours On MiniMax's uniquely fast, dynamic camera and character motion Play from 12:16
“I tend to believe after doing this a million times that whatever you have in the beginning of your prompt gets weighted heavier than the end.”
Fast Hours His theory on token-order weighting in video prompts Play from 42:25
“We as marketers ruin everything. That's how it goes. … We ruin everything.”
Fast Hours His deadpan take on AI advertising creeping into every product Play from 1:43:19

Chapters

  1. 0:00:00 Introductions and community
  2. 0:03:24 Advancements in lip syncing
  3. 0:08:30 Adobe Max and new AI tools
  4. 0:14:39 Showcasing creative workflows
  5. 0:17:39 Prompting and production tips
  6. 0:22:10 Multimodal AI sound design
  7. 0:26:56 Industry trends and future
  8. 0:34:57 Leveraging AI for creative ads
  9. 0:48:08 Showcasing AI film projects
  10. 0:59:03 Storytelling and distribution
  11. 1:11:12 Operational challenges in AI
  12. 1:17:20 The future of image modeling
  13. 1:24:22 Business models and ads in AI
  14. 1:44:13 Closing thoughts and outlook

Questions this episode answers

What tools did Fast Hours' Rory and Drew rate highest for AI video in this pulse check?

Joining Chris Branch's Gen AI for Creators livestream, they praised MiniMax for its dynamic camera and character motion, Runway for ease of getting realistic motion (though they want a reroll button), and Kling for the most natural human movement.

What prompting tip helps get better motion out of an AI video model?

Rory recommends baking motion into your base image before generating video, like a mid-stride walking pose or spinning wheels, and putting motion descriptors like 'motion blur' early in the prompt, since earlier words are weighted more heavily.

What did Adobe announce at Adobe Max 2024 for video?

The hosts say Adobe unveiled a Firefly video tool in beta and Generative Extend in Premiere Pro, which can add new frames to an existing or generated clip.

Is AI search like Perplexity starting to run ads?

Yes. The hosts discuss Perplexity rolling out advertising and note that some custom GPTs already insert a sponsor's link into every response, an early, little-noticed form of AI advertising.

Show notes

Rory and Drew caught up with Chris Branch to discuss the latest happening in the world of Gen AI for creators.

They hit on a variety of topics including: Midjourney Runway Minimax Kling Krea Luma Flux

Great AI video creator videos are shown as examples of today's progress and tomorrow's promise.

Every word Read the full transcript

If you liked this one