0
$\begingroup$

I want to do keyframe interpolation in matlab.

If I understand correctly, it uses splines to approximate the the motion of specific pixel points within the frames(through transforms). Correct me if I'm wrong.

I tried looking but there are no toolboxes or any code for it. Where can I start?

I will be working with video frames. At specific points (say after N frames, N~~100) the first frame encountered is labeled the keyframe.

These frames are the equivalent to what animator artists draw and then animate by getting the computer to approximate frames in between.

I'm interpolating image frames. Literal image frame pixel values.

Imagine this, there are some pixel values I select, then I call those pixel values features and decide to track those pixel values against the frames. Those pixel values must have some sort of trajectory. I want to interpolate pixel values at various points of a trajectory such that the trajectory approximates a smooth motion between the pixel values.

I know the per pixel affine transform matrices between frames, the warps they perform on any single pixel in the image give rise to displacement in the pixel in a frame-time plot and end up being a trajectory. I smooth this thing somehow and have another set of matrices now describing the same thing but smoother.

Image 1

Image 2

Image 3

Improve this question
$\endgroup$
11
  • 2
    $\begingroup$ You can not be helped until you describe what you interpolate. A keyframe is just the frame where you have no interpolation. But what is in thw keyframe. The underlying mathematical model is important to the interpolation. No model no interpolation. So how do you plan to track the pixels. Vague waving of hands does not help. $\endgroup$
    – joojaa
    Jun 26, 2016 at 9:13
  • 1
    $\begingroup$ Possible duplicate of How to do keyframe interpolation on matlab? Any toolboxes present? $\endgroup$
    – flawr
    Jun 26, 2016 at 22:19
  • $\begingroup$ @flawr yes it was me. My previous question got closed as mentioned. $\endgroup$
    – MyBushisaNeonJungle
    Jul 7, 2016 at 13:41
  • $\begingroup$ @joojaa I'm interpolating image frames. Literal image frame pixel values. Imagine this, there are some pixel values I select, then I call those pixel values features and decide to track those pixel values against the frames. Those pixel values must have some sort of trajectory. I want to interpolate pixel values at various points of a trajectory such that the trajectory approximates a smooth motion between the pixel values. $\endgroup$
    – MyBushisaNeonJungle
    Jul 7, 2016 at 13:42
  • 1
    $\begingroup$ Yes time to rewrite your question. Your not looking to interpolate pixels but interpolation of matrices. Is it 4 by 4 matrix? Please EDIT your question $\endgroup$
    – joojaa
    Jul 7, 2016 at 13:53

0

Reset to default

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge that you have read and understand our privacy policy and code of conduct.