Video Segmentation

Video segmentation divides video into segments that end with a transition to the next scene. Video segmentation is similar to finding keyframes, but can handle more complex transitions.

Configuration Parameter Description
GradualChangeFrames The number of frames to consider when looking for gradual scene changes.
Input The input track.
MinSegmentDuration The minimum duration of a video segment.
MinStableFrames The minimum number of successive frames that must be similar for Media Server to consider a transition to be finished.
SampleInterval The interval at which frames are selected to be analyzed.
Type The engine to use. Set this parameter to VideoSegmentation.

Output Tracks

Output track Description Output1
Data Contains one record, describing the analysis results, per video frame. No
DataWithSource

The same as the Data track, but each record also includes the source frame.

No
Result

Contains one record, describing the analysis results, for each video segment. Each segment includes the transition to the next scene, so every video frame is included in exactly one segment. Each record includes the following fields.

  • transition provides the type of transition:

    • Cut or Cut to solid frame - a sudden change between two adjacent frames.
    • Transition or Transition to solid frame - successive "cuts" within MinStableFrames of each other, for example a rapid sequence of images.
    • Fade or Fade to solid frame - a reduction in contrast that happens over multiple frames.

    where "to solid frame" indicates that the transition ends on a mostly blank frame.

  • transitionDuration provides the duration of the transition, so the end of the useful content in a video segment can be determined by taking the end timestamp and subtracting the transitionDuration.
Yes
ResultWithSource

The same as the Result track, but each record also includes the best source frame.

No
Start

The same as the Data track, except it contains only the first record of each event.

No
End

The same as the Data track, except it contains only the last record of each event.

No