1
$\begingroup$

I want to do keyframe interpolation in matlab.

If I understand correctly, it uses splines to approximate the the motion of specific pixel points within the frames(through transforms). Correct me if I'm wrong.

I tried looking but there are no toolboxes or any code for it. Where can I start?

I will be working with video frames. At specific points (say after N frames, N~~100) the first frame encountered is labeled the keyframe.

These frames are the equivalent to what animator artists draw and then animate by getting the computer to approximate frames in between.

I'm interpolating image frames. Literal image frame pixel values.

Imagine this, there are some pixel values I select, then I call those pixel values features and decide to track those pixel values against the frames. Those pixel values must have some sort of trajectory. I want to interpolate pixel values at various points of a trajectory such that the trajectory approximates a smooth motion between the pixel values.

I know the per pixel affine transform matrices between frames, the warps they perform on any single pixel in the image give rise to displacement in the pixel in a frame-time plot and end up being a trajectory. I smooth this thing somehow and have another set of matrices now describing the same thing but smoother.

Image 1

Image 2

Image 3

$\endgroup$
  • 2
    $\begingroup$ You can not be helped until you describe what you interpolate. A keyframe is just the frame where you have no interpolation. But what is in thw keyframe. The underlying mathematical model is important to the interpolation. No model no interpolation. So how do you plan to track the pixels. Vague waving of hands does not help. $\endgroup$ – joojaa Jun 26 '16 at 9:13
  • 1
    $\begingroup$ Possible duplicate of How to do keyframe interpolation on matlab? Any toolboxes present? $\endgroup$ – flawr Jun 26 '16 at 22:19
  • $\begingroup$ @flawr yes it was me. My previous question got closed as mentioned. $\endgroup$ – MyBushisaNeonJungle Jul 7 '16 at 13:41
  • $\begingroup$ @joojaa I'm interpolating image frames. Literal image frame pixel values. Imagine this, there are some pixel values I select, then I call those pixel values features and decide to track those pixel values against the frames. Those pixel values must have some sort of trajectory. I want to interpolate pixel values at various points of a trajectory such that the trajectory approximates a smooth motion between the pixel values. $\endgroup$ – MyBushisaNeonJungle Jul 7 '16 at 13:42
  • 1
    $\begingroup$ Yes time to rewrite your question. Your not looking to interpolate pixels but interpolation of matrices. Is it 4 by 4 matrix? Please EDIT your question $\endgroup$ – joojaa Jul 7 '16 at 13:53

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Browse other questions tagged or ask your own question.