I'm developing a deep learning algorithm to find and classify (post consumption) plastic bottles on a conveyor belt. A way to train my model is to get tons of labeled images of each bottle, which for now is not feasible. Another possible option is to make a 3D scan of the bottle and render it in different angles thus creating synthetic training data.

The way I want to obtain the mesh is by using for example ReMake or CapturingReality and 2D images. The problem is that most of the bottles are transparent and are causing problems in those programs. I just ordered Chalk spray to paint them and with a marker add dots allover. Then hopefully I'd be able to render it with the specific material.

My question is, is there a way to add the visual details like the labels and the color of the bottle cap back to the mesh? I'll be using a RGB-D camera so the priorities are getting both the visual cues as well as the depth information as accurate as possible to what the camera will be classifying in a further stage.

Any advise and feedback will be highly appreciated, thanks in advanced!!

  • 1
    $\begingroup$ Why scan it? I mean most likely there is a model of the bottle somewhere (ask manufacturer) or then modeling it from scratch which usually is not a big deal. Also scanning is more work than taking a hundred pictures. $\endgroup$ – joojaa Mar 28 '17 at 5:13
  • 1
    $\begingroup$ I don't think a rendering approach will work well for you in this case, as a lot of the bottles on your belt will be crushed, which is quite hard to simulate. $\endgroup$ – Dan Hulme Mar 28 '17 at 8:57
  • $\begingroup$ @DanHulme I dont know we did it for testing a reverse vending machine for testing and it seemed to work quite well. Altough it is true that real thing has different levels of data. But it was quite much easier to have digital reolicates of 2000 bottles than actually go and buy them. as quite many of the models were available from the vendor with some emailing and asking nicely. $\endgroup$ – joojaa Mar 28 '17 at 14:17
  • $\begingroup$ @joojaa Yeah, in general it can be a really effective technique, but if it's for post-consumption plastic bottles you can't expect them to be the same shape as new bottles $\endgroup$ – Dan Hulme Mar 28 '17 at 14:24
  • $\begingroup$ @DanHulme Depends on where you are, in Finland where nearly all bottles and cans are recycled they will in fact all be 90% intact by the time they return as manhandling them means you will not get the deposit back. Glass bottles will be reused as bottles. $\endgroup$ – joojaa Mar 28 '17 at 14:27

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Browse other questions tagged or ask your own question.