How to pick an AI video model: run a bake-off on your own shots

Picking a model is trial and error, so make the trial fair and cheap: one still, one prompt, every model, one score sheet. Then our real bake-off of November 14, 2026: three shots, four models, 14 clips, and every verdict.

By Ricardo Rivero

Scaling consumer apps on TikTok and Instagram.

November 14, 2026

A coffee roaster in a denim shirt and apron leans over a row of identical cups of coffee with a tasting spoon, next to a blank score grid on the table

To pick an AI video model, run a bake-off. Choose the two or three shots you post most, make one still per shot, and run the same prompt at the same length on every model you are thinking about. Score each take on one sheet: did it pass the realism check, did it do what the prompt says in the right order, does the mouth match the voice, what did it invent, and what did it cost. The model that wins your shot is your model for that shot. A leaderboard or a demo reel cannot tell you that, because neither one ran your shot.

We ran one on November 14, 2026, in Hook Studio, an AI reel maker for TikTok and Instagram: a talking shot, a product shot, and a shot with three actions in a set order, on Kling 3, Kling 4, Seedance 2, and Seedance 2.5. Fourteen clips, one take each, 2,126 credits with the stills. No model passed every shot. Every take is on this page, failures included. The people are AI people from Hook Studio's premade cast. For what each model is good at, see which AI video model to use for each job.

The short answer

Test on your shots, not on demos. One still per shot, one prompt per shot pasted unchanged into every model, the same length on each. Score every take on the same five questions. One take is a sample: run two or three more on your finalists before you commit. Keep a log of which model wins which shot, spend most of your budget remaking with the winners, and re-run the bake-off when a new model comes out. In our test, Kling 3 was the only model whose talking takes passed, and the only one that failed both of the other shots.

Why picking a model is trial and error

Every model is good at some shots and bad at others, and the only way to find out which is which for your shots is to run them. Public leaderboards help you pick candidates, not winners. The Artificial Analysis video arena ranks models by blind votes on short clips. When we read its image-to-video board on November 14, 2026, Seedance 2.5 was first and Kling 3.0 was 23rd. On our talking shot the order flipped: Kling 3's takes passed in English and Spanish, and both Seedance 2.5 takes failed. A vote on someone else's clip does not score your prompt, your person, or your price.

The lineup also changes under you. Google shut down its Veo 3.1 models in the Gemini API on October 22, 2026, and points developers to Gemini Omni 1.2 Flash (Google's deprecation list). OpenAI closed the Sora app in April 2026 and its API in September (OpenAI). A bake-off is not a one-time verdict. It is a test you run again when a model you use goes away or a new one comes out.

The bake-off in seven steps

  1. 1Pick the two or three shots you post most. A talking hook, a product in someone's hands, a shot where a person does a few things in order. Test those, not a scene you will never post.
  2. 2Make one still per shot and approve it before any clip. Every model starts from the same first frame, so the still is your control. A still costs 11 credits or less in Hook Studio; one of ours took four tries.
  3. 3Write one clip prompt per shot and paste it unchanged into every model. Name the action, the order, the camera, and any spoken words in quotes. If you tweak the prompt for one model, you are testing the prompt, not the model.
  4. 4Run the same length on every model. We used 5 seconds. Write down the resolution too: Kling 3 renders 1080p only, so it ran at 1080p and the others at 720p.
  5. 5Score every take on the same sheet. Watch it muted, then with sound. Use the five questions below.
  6. 6Treat one take as a sample. Pick a finalist or two per shot and run two or three more takes of each before you commit. A model can pass once and fail the next take.
  7. 7Keep a log of which model wins which shot. Most of your budget goes to remaking your winners on the model that won. A smaller share tests new models and formats, and that is where the next bake-off comes from. That split is the 70/30 rule.
The score sheet: copy it, one per take
Shot: ________  Model: ________  Resolution: ____  Length: __ s  Take: __
Price: ____ credits

1. Realism check: passed / failed. What it flagged: ________
2. Did it do what the prompt says, in order? yes / partly / no. What it skipped: ________
3. Lip sync (talking shots): matched / out of step from __ s to __ s
4. What it invented or changed (people, props, text, camera): ________
5. Watched muted, then with sound. Would I post it as is? yes / no

Verdict: finalist / out

The realism check answers question 1 in Hook Studio: it flags what looks fake in each still and clip. It does not answer question 2. Whether the clip did what you asked, in the order you asked, you judge from the frames yourself. In our test, the check passed a Kling 4 take in which the painting on the wall changed. Once a model wins, the winning format decides what you remake with it.

Our bake-off: three shots, four models, one take each

We ran it in Hook Studio on November 14, 2026, in the organic style, which looks shot on a phone by someone who was there. Every clip is 5 seconds, starts from the same approved still for its shot, and uses the same prompt for its shot, word for word. Kling 3 renders 1080p only; the other three models ran at 720p. The talking shot ran on three models: Kling 3, Kling 4, and Seedance 2.5. The product and direction shots ran on all four. One take per model per shot, so read every verdict below as a sample, not a final ranking. Hook Studio is not affiliated with Kling (Kuaishou) or Seedance (ByteDance).

One cell of the grid: the talking shot on Kling 3
Camila, from the premade cast
Camila sits at a small table by the window of a Mexico City café with a cup of coffee and talks to her friend across the table.

Here's the still. The realism check passed it, with one note: it's framed to the waist, not the chest.

Camila at the café tableStill · 11 credits
Make her say: "Same photo, same line, different AI model. Which one looks real?" Run it on Kling 3, Kling 4, and Seedance 2.5.

Three clips, each waiting for your approval. The first:

5 s clip with speech · Kling 3 · 1080p · 143 creditsApprove

The Kling 3 take passed the realism check, and her mouth matches the voice in both sentences. The Kling 4 and Seedance 2.5 takes failed: both over-act the line.

Step one: the stills, and the three that failed first

Camila, a curly-haired woman in an emerald top, at a small round table by the window of a Mexico City café, with a cup of coffee
Talking shot. Passed the realism check on the first try, with one note: framed to the waist, not the chest.
Marco, a bearded man in a linen shirt, pouring coffee from a glass carafe into a sage green mug in a sunny kitchen
Product shot. Passed, with one note: the carafe's spout looks slightly odd.
Nia, a woman with natural curls in a white linen shirt, holding a white mug in a living room, with a small wooden shelf on the wall behind her
Direction shot, fourth try. Indoors, with no signs in the scene, it passed.

The talking and product stills passed on the first try. The direction still took four. We first put Nia outside a bakery, and the realism check failed it for readable made-up words on the awning, the door, a chalkboard, and the price tags. Two more tries outside failed because the storefront and then a brick wall ran off at an angle behind her, and we had asked for a straight-on view. Moving her indoors, in front of a plain wall with no signs, fixed it. Six stills, 64 credits, before a single clip ran.

Nia in sunglasses on a sidewalk in front of a bakery with a striped awning and price tags in the window
First try: failed. Readable made-up text on the awning, the door, a chalkboard, and the price tags, and an angled view.
Nia in sunglasses on a brick sidewalk, with the bakery front running away from the camera at an angle
Second try: failed. We asked for the bakery front level behind her; it ran off at an angle. The third try, at a plain wall, did the same.

Shot 1: talking to camera, in English and Spanish

Camila says one line to a friend across the table, in the clip's own voice. The Spanish takes use the same prompt with "in Mexican Spanish" added and the line "Misma foto, misma frase, otro modelo de IA. ¿Cuál se ve real?" Turn the sound on to hear each one.

The talking prompt, the same on every model
Seated at the café table, she is already talking to her friend across the table, calm and friendly, with a small natural nod; her hand stays near the cup. She says: "Same photo, same line, different AI model. Which one looks real?"

Camera: her friend, sitting across the table, eye level, handheld phone, slight natural hand sway. 5 seconds, with speech.

Kling 3 · 1080p

Passed143 credits

Lip sync matched. Note: a broad, toothy smile at the start.

Kling 4 · 720p

Failed134 credits

Her hand sweeps across the table, then a knit-brow “hmm” face. Lip sync matched.

Seedance 2.5 · 720p

Failed197 credits

A surprised “oh” face and pursed lips. Voice 0.3 s ahead of the mouth.

The same shot in Spanish:

Kling 3 · 1080p

Passed143 credits

A broad smile at the end. Voice 0.5 s ahead of the mouth from 4.0 s.

Kling 4 · 720p

Failed134 credits

Her eyes stay shut for about 3 seconds while she talks. Lip sync matched.

Seedance 2.5 · 720p

Failed197 credits

A pucker with her eyes shut. Voice 0.4 s ahead of the mouth from 4.0 s.

TakeRealism checkLip-sync check
Kling 3, EnglishPassed. Note: a broad, toothy smile in the first frameMatched, both sentences
Kling 4, EnglishFailed: her hand leaves the cup and sweeps across the table; a knit-brow "hmm" face; brows high, eyes wideMatched, all three sentences
Seedance 2.5, EnglishFailed: a surprised "oh" face; pursed lips, brows up with her eyes shutVoice 0.3 s ahead of the mouth, 1.5 to 3.4 s
Kling 3, SpanishPassed. Note: a broad smile with teeth at the endVoice 0.5 s ahead of the mouth, 4.0 to 4.9 s
Kling 4, SpanishFailed: her eyes stay shut for about 3 seconds while she talksMatched
Seedance 2.5, SpanishFailed: a pucker with her eyes shut; a pursed, mugging face at the startVoice 0.4 s ahead of the mouth, 4.0 to 4.9 s

Kling 3 was the only model whose talking takes passed, in both languages. Kling 4 and Seedance 2.5 over-acted the line. Kling 4 kept the mouth in time with the voice in both languages; Seedance 2.5 drifted in both. The Spanish Kling 3 take passed the realism check and still ran its voice half a second early at the end of the line. Hook Studio offered a lip-sync repair for 71 credits. Six talking takes cost 948 credits.

Shot 2: a product in someone's hands

Marco pours coffee from a glass carafe into a mug, then sets the carafe down. Liquid, glass, and two hands are hard for any video model, which is why it is in the test.

The product prompt
He is already pouring: the coffee streams from the carafe into the green mug and the mug fills about halfway; then he sets the carafe down on the counter beside the mug. Calm, unhurried, no talking.

Camera: his roommate, standing across the counter, chest height, handheld phone, slight natural hand sway. 5 seconds, no sound.

Kling 3 · 1080p

Failed96 credits

A stranger pops in at the right edge. The coffee turns into a foamy latte.

Kling 4 · 720p

Passed134 credits

Pours and sets the carafe down. The carafe barely empties.

Seedance 2 · 720p

Failed130 credits

The most believable coffee, but the camera pushes in until his face is cut off.

Seedance 2.5 · 720p

Passed197 credits

Steady pour, mug half full. The carafe never quite touches down.

Kling 4 and Seedance 2.5 passed. Kling 3 did the pour and the set-down, and invented a second man who looks in from the right edge, then leaves an arm behind. Seedance 2 made the most believable coffee of the four, and failed because the camera pushed in until his face was cut off. Four takes, 557 credits.

Shot 3: three actions, in order

This is the direction test. Nia does three things in a set order in 5 seconds: sip, set the mug on the shelf, wave with both hands. A model that follows direction does all three, in that order, without breaking the room.

The direction prompt
Three actions, in this order, starting at once: first she takes one sip from the white mug; then she steps toward the narrow wooden wall shelf at waist height and sets the mug down on it; then she turns back to the camera and waves with both hands, smiling. No talking.

Camera: her friend, standing about two meters in front of her in the living room, eye level, handheld phone. 5 seconds, no sound.

Kling 3 · 1080p

Failed96 credits

All three actions in order, but the shelf grows and the mug vanishes.

Kling 4 · 720p

Passed134 credits

All three actions in order. The painting changes; the check missed it.

Seedance 2 · 720p

Passed130 credits

All three actions in order. The wave is small, hands low.

Seedance 2.5 · 720p

Passed197 credits

All three actions in order, the clearest wave. A small jar appears.

All four models did the three actions in the right order. What separated them was the room. Kling 3 failed: the narrow shelf grew into a long one, and the mug she put on it was gone by the end. The other three passed. Seedance 2.5 had the clearest wave. Seedance 2 did everything, with a small wave and her hands low. Kling 4 changed the painting on the wall, which the realism check did not flag. Four takes, 557 credits.

Marco pours coffee while a second man the prompt never asked for looks in from the right edge of the frame
Kling 3, product shot, at 1.5 s: a second man the prompt never asked for, at the right edge.
The kitchen counter with the carafe and the mug, and Marco's face cut off above the mouth
Seedance 2, product shot, at 4.8 s: the camera has pushed in and cut off his face.
Nia waving with both hands in front of a long wall shelf with no mug on it
Kling 3, direction shot, at 4.8 s: the narrow shelf is now long, and the mug she set on it is gone.
Nia from behind, setting the mug on the shelf, under a painting with a new yellow block in it
Kling 4, direction shot, at 3.5 s: a yellow block has appeared in the painting. The realism check passed this take.

The filled-in score sheet

ModelTalking (EN, ES)ProductDirection
Kling 3 · 1080pPassed, passedFailed: an extra personFailed: the shelf grew, the mug vanished
Kling 4 · 720pFailed, failed: over-actedPassedPassed; the painting changed
Seedance 2 · 720pNot runFailed: the camera cut off his facePassed; a small wave
Seedance 2.5 · 720pFailed, failed: over-acted, lips out of syncPassedPassed; the clearest take

No model passed every shot. The model that won the talking shot failed both of the others. That is the point of running your own bake-off: a winner is a winner for one kind of shot.

What it cost

Talking (EN + ES)ProductDirectionTotal
Kling 3 · 1080p143 + 1439696478
Kling 4 · 720p134 + 134134134536
Seedance 2 · 720pNot run130130260
Seedance 2.5 · 720p197 + 197197197788
Six stills, three of them failed64
The whole bake-off2,126 credits

Credits are Hook Studio's prices on November 14, 2026, for 5 second clips, and the failed takes were charged like the others. Compare the cheapest take that passed, not the cheapest clip: 143 credits for talking (Kling 3), 134 for the product shot (Kling 4), and 130 for the direction shot (Seedance 2).

What goes to round two

One take per model gives you leads, not verdicts. From this round, the finalists are Kling 3 for talking, Kling 4 and Seedance 2.5 for the product shot, and Seedance 2.5 and Seedance 2 for the direction shot. Kling 4 passed the direction shot too, but it changed the painting, so it sits out. Each finalist gets two or three more takes of the same shot, on the same still and prompt, before it goes into the log as the winner.

What the bake-off taught us

  • Winners are per shot. Kling 3 won the talking shot in both languages and failed the product and direction shots. Log the winner next to the shot, not next to your account.
  • The realism check flags what looks fake, not what is wrong. It passed a Kling 4 take in which the painting changed. Check every take against the prompt yourself, frame by frame.
  • When every model changes the same thing, look at the still. Our still showed the shelf with one strap. All four models rebuilt it as a longer shelf with two straps; the check failed only Kling 3 for it. Show a prop whole in the still, or leave it out.
  • Keep words out of the still. Our first direction still failed for made-up text on a bakery's awning, door, chalkboard, and price tags. A plain wall fixed it. Put text on screen as an overlay instead.
  • Test each language you post in. Kling 3's English take matched the voice; its Spanish take ran the voice 0.5 s early at the end. Kling 4 failed for different reasons in each language.
  • Price the pass, not the clip. The cheapest clip in the test, Kling 3 at 96 credits, failed both silent shots. The cheapest take that passed the product shot cost 134.

What Hook Studio does not do

  • It does not score direction. The realism check judges what looks real. Whether the clip did what the prompt asks, in order, is your call.
  • There is no bake-off button. Each clip is its own job, with its own model and its own price to approve.
  • Failed takes cost the same as passed ones. Our three failed stills and seven failed clips were all charged.

For what each model is known for, beyond one bake-off, see which AI video model to use for each job, realism vs control, and Kling vs Seedance. For how to make the still and the clip in the first place, see how to make AI videos.

Frequently asked questions

What is the best AI video model?

The one that wins your shot, and it changes by shot. In our bake-off of November 14, 2026, Kling 3 was the only model whose talking takes passed, Kling 4 and Seedance 2.5 passed the product shot, and Kling 4, Seedance 2, and Seedance 2.5 passed the direction shot. No model passed all three.

How do I test AI video models fairly?

Start every model from the same approved still, paste the same prompt into each one, and run the same length. Score each take on the same questions: realism, did it follow the prompt in order, lip sync, what it invented, and the price.

How many takes do I need per model?

One per model finds your finalists. Then run two or three more takes of each finalist on the same still and prompt before you commit. A single take is a sample.

How much does a bake-off cost?

Ours cost 2,126 credits in Hook Studio: 64 for six stills, three of them failed, and 2,062 for 14 clips of 5 seconds. A smaller test, one talking shot on Kling 3, Kling 4, and Seedance 2.5, is 474 credits for the three clips.

Should I trust AI video leaderboards?

Use them to pick candidates. They rank blind votes on short clips, not your shot or your price. On November 14, 2026, Seedance 2.5 led the Artificial Analysis image-to-video board and Kling 3.0 was 23rd; on our talking shot, Kling 3 passed and Seedance 2.5 failed.

Do I need to test in Spanish too?

Yes, if you post in Spanish. The same model can match the voice in one language and drift in the other: Kling 3's Spanish take ran the voice 0.5 seconds early at the end of the line, and its English take matched.

Run your own bake-off

Approve one still, then see the price of each model's clip before it runs.

Make your first reel