So I wanted to create an application where kids can have their paper drawings to be displayed in real time on a screen. I have decided to provide several printed drawings of simple outline 3D shapes.

The kids can customize each shape's surfaces color by colored pencils or anything similar on paper before scanning them and Unity will detects the drawings and matches with similar meshes available in the game and displays the respective mesh on screen.

I wanted Unity detects the color effect as well, like an actual drawing from the kids coloring book, instead fully opaque colors.

So how do I replicate the same effects from actual drawing and mapping them on each respective surface on similar mesh? Thanks!

p.s: The kids drawing is supposed to be in 3D perspective view instead of flat 2D view The kids drawing is supposed to be in 3D perspective view instead of flat 2D view


closed as too broad by DMGregory Feb 12 at 10:09

Please edit the question to limit it to a specific problem with enough detail to identify an adequate answer. Avoid asking multiple distinct questions at once. See the How to Ask page for help clarifying this question. If this question can be reworded to fit the rules in the help center, please edit the question.

  • \$\begingroup\$ Can you give us an example of the kind of input you expect to get, and the kind of output you hope to produce? We can help you hash out the details of your technique, but as for inventing a technique from scratch, that could be a whole research project on its own - and may well be beyond the scope of what we can offer here. \$\endgroup\$ – DMGregory Feb 12 at 6:24
  • \$\begingroup\$ @DMGregory updated my question :) \$\endgroup\$ – Mira Feb 12 at 6:58
  • \$\begingroup\$ "I just need to generate 3D models from simple 2D doodles and I don't need multiple shots to construct a 3D model." Unfortunately what you are looking to do isn't that simple. Probably you can make a program that can recognise simple geometrical shapes, but children's doodles are quite complicated. But this creates more questions, if a child draws a triangle, how do you know it's a pyramid and not a 3D triangle? \$\endgroup\$ – TomTsagk Feb 12 at 9:12
  • 1
    \$\begingroup\$ It looks like you're asking more than one question here. "replicate the colour effect...like a digital coloring book" is one aspect we can likely help you with. Detecting a pre-defined set of simple shapes and mapping them to one of a pre-defined set of 3D meshes is a wholly different question we may be able to help with, though experts in computer vision may be better to consult — we don't do that often in games. Dynamically constructing a mesh with a particular form is another question yet. Deciding what 3D form we should make based on only a doodle is a cutting-edge AI research problem. \$\endgroup\$ – DMGregory Feb 12 at 10:09
  • \$\begingroup\$ I've put the question on hold as too broad for now..Please consider making edits to narrow the scope of the question down to one concrete step in the problem that you need game developer expertise to solve, and we can re-open the question for answers. \$\endgroup\$ – DMGregory Feb 12 at 10:11