Guide
English
Search the docs⌘K
4.8

Frame study

Want to make one of your own following someone else's film, or to lay out the structure of a final cut you already have? The quickest road is to have a model watch it once: DOTV's frame study breaks a video into four sets of references you can carry straight on with — shots, motion, music and script. This section covers what is on this card, what each of the four dimensions produces, where the output lands once it runs, and how the script is cut out one line per cut.

What is on the card

The clip to break downConnect a clip that is already generated — that is what the study takes apart. With nothing connected the card says to connect a generated video node.
1 / 3
Left is the clip to break down; the card on the right holds the source, the dimensions and Start study.

First wire in the clip it is to break down: connect a video node that has already generated (the one on the left in the picture). Once it is connected the card holds, in order:

  • Source video — the thumbnail of that clip, with its spec (duration · resolution) at the top right. Both numbers are read live by the browser, so it takes a moment; when the duration cannot be read nothing is quoted — better to show nothing than a number that has nothing to do with this clip.
  • Break down — the four kinds of output, each ticked separately (see the next section). The number at the top right is the credit estimate for this run, worked out from the clip's length.
  • Start study — the button at the bottom. With no dimension ticked, or with no clip connected, it is grayed out, and hovering says plainly why.

The four dimensions

Dimension What it produces
Shots A set of storyboard images, one per shot, landing in a shots group
Motion Camera-move clips, cut out shot by shot
Music The score from this clip
Script A script node holding this clip's shot list (see "Where the script comes from" below)

All four are ticked by default — unticking one saves very few credits, because the cost is almost all in sampling frames (the model watches the whole clip either way, and it is the same pass whatever you ask it to break out).

Once it runs

Nothing runs until you press Start study (this step is billed by sampled frames, so it is not pressed for you). While it runs the card is replaced by a placeholder panel with a pill saying where it has got to: Grabbing frames, Filling in the shot list 3/8, cutting motion clips, pulling the audio — those words follow the real progress. Meanwhile the dimension buttons are disabled and the main button spins; when it finishes, the four sets of output land to the right of this clip, numbered by shot.

Where the script comes from

The script is not the model grouping things by impression: the browser goes through this clip frame by frame first and finds the cut points from how the picture changes, one line per cut — so a fast cut every two or three seconds comes out too, instead of being merged into twenty-odd coarse shots the way the watch-through pass does. Each shot then has two frames taken, one earlier and one later, and handed to a vision model to fill in the picture, the shot size, the light and the camera move; the dialogue carries over from what the watch-through pass wrote down, split into the shots by time.

This pass happens in the browser and asks nothing of you in the way of installs. When no cut points can be found, or the vision model never answers, the script falls back to the rough draft from the watch-through pass — one fill-in failing does not fail the whole study.

If you have already run a study and simply find the script too coarse, there is no need to run it again (that would mean watching the clip again and adding a whole set of groups to the canvas): tell the Agent to re-split this script by cut points, and it replaces only the shot list inside the script node — it does not watch the clip, does not build groups, and keeps the assets, the look and anything you edited by hand.

Try it in DOTVReading only goes so far: open DOTV and make an AI video with the feature this section covers.