a Team of programmers from the Institute of computer technology Chinese Academy of Sciences presented the system DeepFaceDrawing that can create high quality portraits from a “rough” outline. The article describing the algorithm, the authors explain the key idea of the system and the method.
System DeepFaceDrawing using the faces of real men, able to create based on the sketch any portrait. Moreover, the sketch can be very rough and sketchy: it may be missing details such as color of skin, eyes and lips, eyelids and other characteristic features of the face. For DeepFaceDrawing the sketch is the approximate basis for the image synthesis: the algorithm compares the line sketch with the database and creates a portrait based on lines.
the System consists of three main modules: CE (Component Embedding, component attachments), FM (Feature Mapping, mapping details) and IS (Image Synthesis, image synthesis). The CE module examines five features from the original sketch – eyes, nose, mouth and other parts of the sketch. Modules FM and IS form a different subnet and use it to transform every single component in a realistic image.
But the imagination of the user can affect the “creativity” of artificial intelligence: if the author voluntarily add additional details, such as hair, or podkorrektirovatj the shape of the face, the image will change. But while the resolution of the images is limited – it’s not bigger than 512×512 pixels.
Interesting fact: database of real individuals, mostly composed of women and men of South-American and Caucasian descent. It is unclear, whether accidentally Chinese scientists were limited to people with these roots or it was their conscious choice due to the fact that other data has not been integrated into the system.
the authors of the new algorithm claim that their tool is simple to use – they can use even those who are not an artist.
