Scientific Publication: Deep Normal Estimation for Automatic Shading of Hand-Drawn Characters by Trinity College Dublin

Published on

M Hudon, R Pagés, M Grogan, and A Smolić at Trinity College Dublin (Ireland) published last September a beautiful paper: "Deep Normal Estimation for Automatic Shading of Hand-Drawn Characters" and they decided to use the hand-drawn sources of Pepper&Carrot to run their test and illustrate the paper. I was very flattered to see Pepper and Carrot featured in this well-made study! This research made me think of the 'Illuminate 2D shape' GMIC filter we have already in the FLOSS community since May (something I never really played with).

While this new auto-shading method might not be useful for me for shading characters (I prefer to do it myself), it might be super useful for a large scene with crowd, particles (stones, drop of water, magical effect, clouds), or many small objects (like my episode with hundreds of flying potions). In the conclusion, the authors wish to see their method (with more training of the neural network to reach a higher quality) being incorporated into the animation pipelines to increase productivity of high quality series and movies. For sure, these types of tools have a lot of potential.

You can read the full paper as PDF, watch a demo video and see the code (open-source but proprietary license) at this address:

Link to the full publication:
https://www.scss.tcd.ie/~hudonm/publication/deep-normal-estimation-for-automatic-shading-of-hand-drawn-characters/




Previous post Next post
License: COPYRIGHTED Copyrighted by the owner(s) mentioned in this article
with a special permission to republish here, .
Unless otherwise mentioned in the article.

Tags:  #derivation  #paper  

Corrections and improvements are welcome:

Download article source  

8 comments

link Baptiste   - Reply

Ca a l'air très intéressant

link guruguru   - Reply

You are featured in yet another paper from Japan, too.
https://koyama.xyz/project/color_unblending/

link David Revoy Author, - Reply

Oh, thank you @guruguru; I'll have to turn this one into an article soon :)

link Hello   - Reply

Hi David,
Does this mean that digital colouring is automated?

link David Revoy Author, - Reply

Hi, it doesn't mean anything in itself; it means a couple of researchers trie to emulate 'shading' (the process of adding shadow and light) to a drawing. We are still really far of full automated coloring and shading ; and by the way I see evolution of automation, algorythm and neural network, we will wait for decades before looking at a code knowing how to replace the job of a beginner colorist. But this researchs are nice; and a small step on a long long road. I appreciate scientist who are brave enough to enter that challenges!

link Brian Jack   - Reply

If this can be implemented as a graphics pipeline shader it may be possible to use it for 2D games using cutout animation.

link David Revoy Author, - Reply

Yes, I read this article about it: https://medium.com/the-art-squirrel/digital-art-technique-using-normal-and-depth-maps-to-create-lighting-effects-in-2d-art-3c5d3fedaa5f
Very interesting way to shade 2D sprites.

link Linkfixer   - Reply

Link is broken, here's one that still works:
https://openaccess.thecvf.com/content_ECCVW_2018/papers/11131/Hudon_Deep_Normal_Estimation_for_Automatic_Shading_of_Hand-Drawn_Characters_ECCVW_2018_paper.pdf

Leave a reply

Comments will be moderated according the Citizens of Hereva Code of Conduct.

CapchaCapcha

Enter image code