I want to do keyframe interpolation in matlab.
If I understand correctly, it uses splines to approximate the the motion of specific pixel points within the frames(through transforms). Correct me if I'm wrong.
I tried looking but there are no toolboxes or any code for it. Where can I start?
I will be working with video frames. At specific points (say after N frames, N~~100) the first frame encountered is labeled the keyframe.
These frames are the equivalent to what animator artists draw and then animate by getting the computer to approximate frames in between.
I'm interpolating image frames. Literal image frame pixel values.
Imagine this, there are some pixel values I select, then I call those pixel values features and decide to track those pixel values against the frames. Those pixel values must have some sort of trajectory. I want to interpolate pixel values at various points of a trajectory such that the trajectory approximates a smooth motion between the pixel values.
I know the per pixel affine transform matrices between frames, the warps they perform on any single pixel in the image give rise to displacement in the pixel in a frame-time plot and end up being a trajectory. I smooth this thing somehow and have another set of matrices now describing the same thing but smoother.