I have a video that record the drawing sequence with a pencil by a painter. video screen

I want to reconstruction the sequence from the video. And I have google some keywords like drawing sequence reconstruction, sketch reconstruction, and have searched like moving object detection but cannot found what I want to find.

I want to know how to detect and recognize the drawing between different frames. I have thought the line detect algorithm may work but fail. And pixel comparison seems to be bad idea. Because that the new drawing may overlap the old ones.

Could you give me some information that I can read or some keywords to search? Sorry about that because I am not familiar with Computer Image Processing.

  • $\begingroup$ So essentially, you want to remove the hand and pencil from the drawing? So you can have just a time-lapse of the drawing over time? Did I understand you correctly? $\endgroup$ – RichieSams Jan 26 '16 at 16:37
  • $\begingroup$ Actually, I want to know how the painter draw. That is, the sequence of its drawing stroke. The painter will draw by hands on paper. Like that imgur.com/FeN1IPy $\endgroup$ – Jason Jan 26 '16 at 16:40
  • $\begingroup$ Remove the hand and pencil may benefit to analyze and it is good also. $\endgroup$ – Jason Jan 26 '16 at 16:40
  • $\begingroup$ So, sort of a vector field drawing showing the path the pencil takes on the paper? For example, each stroke would be an individual curve/arrow. $\endgroup$ – RichieSams Jan 26 '16 at 19:17
  • 1
    $\begingroup$ Meta discussion on whether this is on topic. $\endgroup$ – trichoplax Jan 28 '16 at 21:42

This is more a Computer vision question I think. I don't know how exactly you can achieve that but some ideas and keywords you may use to find additional resources:

Feature tracking of hand and pen can yield the movement of said things. Assuming you know that the camera is not moving I think that would give you good results. Related is maybe motion tracking. Any information you have about the hand and the camera can in some way be used to make more accurate estimates.

Removing the hand from the video could be much harder. I don't remember that part from my lecture. We copied parts of the image onto the part we want to remove and used image metrics to make sure it fits best possible... But since the hand covers a drawing we don't know much about this could be very hard to do in an convincing way.

| improve this answer | |
  • $\begingroup$ One could paint on a semitransparent surface and capture image from behind, use wacom tablet trough paper and so on... Reverse difference matte should also give the evolution. $\endgroup$ – joojaa Jan 27 '16 at 8:42
  • $\begingroup$ I understood he had the finished video from somewhere and now wants to reconstruct the process. $\endgroup$ – Dragonseel Jan 27 '16 at 10:14
  • $\begingroup$ Sure but sometimes, one really can not get a good measurement in hindsight. Anyway for the test video tracing works well, and since he has a test video maybe he also hasnt set up the system yet. $\endgroup$ – joojaa Jan 27 '16 at 10:21

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Not the answer you're looking for? Browse other questions tagged or ask your own question.