1
$\begingroup$

I have a video that record the drawing sequence with a pencil by a painter. video screen

I want to reconstruction the sequence from the video. And I have google some keywords like drawing sequence reconstruction, sketch reconstruction, and have searched like moving object detection but cannot found what I want to find.

I want to know how to detect and recognize the drawing between different frames. I have thought the line detect algorithm may work but fail. And pixel comparison seems to be bad idea. Because that the new drawing may overlap the old ones.

Could you give me some information that I can read or some keywords to search? Sorry about that because I am not familiar with Computer Image Processing.

Improve this question
$\endgroup$
8
  • $\begingroup$ So essentially, you want to remove the hand and pencil from the drawing? So you can have just a time-lapse of the drawing over time? Did I understand you correctly? $\endgroup$
    – RichieSams
    Commented Jan 26, 2016 at 16:37
  • $\begingroup$ Actually, I want to know how the painter draw. That is, the sequence of its drawing stroke. The painter will draw by hands on paper. Like that imgur.com/FeN1IPy $\endgroup$
    – Jason
    Commented Jan 26, 2016 at 16:40
  • $\begingroup$ Remove the hand and pencil may benefit to analyze and it is good also. $\endgroup$
    – Jason
    Commented Jan 26, 2016 at 16:40
  • $\begingroup$ So, sort of a vector field drawing showing the path the pencil takes on the paper? For example, each stroke would be an individual curve/arrow. $\endgroup$
    – RichieSams
    Commented Jan 26, 2016 at 19:17
  • 1
    $\begingroup$ Meta discussion on whether this is on topic. $\endgroup$
    – trichoplax is on Codidact now
    Commented Jan 28, 2016 at 21:42

1 Answer 1

Reset to default
2
$\begingroup$

This is more a Computer vision question I think. I don't know how exactly you can achieve that but some ideas and keywords you may use to find additional resources:

Feature tracking of hand and pen can yield the movement of said things. Assuming you know that the camera is not moving I think that would give you good results. Related is maybe motion tracking. Any information you have about the hand and the camera can in some way be used to make more accurate estimates.

Removing the hand from the video could be much harder. I don't remember that part from my lecture. We copied parts of the image onto the part we want to remove and used image metrics to make sure it fits best possible... But since the hand covers a drawing we don't know much about this could be very hard to do in an convincing way.

Improve this answer
$\endgroup$
3
  • $\begingroup$ One could paint on a semitransparent surface and capture image from behind, use wacom tablet trough paper and so on... Reverse difference matte should also give the evolution. $\endgroup$
    – joojaa
    Commented Jan 27, 2016 at 8:42
  • $\begingroup$ I understood he had the finished video from somewhere and now wants to reconstruct the process. $\endgroup$
    – Dragonseel
    Commented Jan 27, 2016 at 10:14
  • $\begingroup$ Sure but sometimes, one really can not get a good measurement in hindsight. Anyway for the test video tracing works well, and since he has a test video maybe he also hasnt set up the system yet. $\endgroup$
    – joojaa
    Commented Jan 27, 2016 at 10:21

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge you have read our privacy policy.

Not the answer you're looking for? Browse other questions tagged or ask your own question.