Each DeepAffex Study potentially requires a unique set of facial landmarks.
However, there are currently
15 core facial landmarks used by the majority of
studies. These points provide details to the DFX
Collector from which it is
able to identify the regions of interest for blood-flow extraction.
In addition, there are 44 visual facial landmarks which are used for animation and rendering of which do not affect the measurement quality.
The 15 core facial data points are identified in this image by the red dot at the location and with the corresponding white label. The black box is the detected face rectangle provided to the Extraction Library along with the face points.
In addition to providing the black face bounding box, the 15 required point names are:
3.1, 3.2, 3.3, 3.4, 3.7, 3.8, 3.11, 3.12, 8.1, 8.2, 8.3, 8.4, 9.1, 9.2, 9.3
There are 44 animation points which are used to construct the visuals which end users typical see along the contour of the face. These points do not need to be tracked (or mapped) as accurately as the core measurement points as they are only for aesthetic purposes. It is actually difficult for most face engines to accurately track the outer profile of a face and so these points are anticipated to have much more inaccuracy in general. You can see in the positioning of the group 13 series below how they have drifted from the edge of the face in the following diagram.
The 44 points used for visual animation include:
2.2, 2.3, 2.4, 2.5, 2.6, 2.7, 2.8, 2.9, 4.1, 4.2, 4.3, 4.4, 8.10, 8.5, 8.6, 8.7, 8.8, 8.9, 9.12, 9.15, 9.4, 9.5, 12.1, 12.11, 12.12, 12.7, 12.8, 13.10, 13.11, 13.12, 13.13, 13.14, 13.15, 13.16, 13.17, 13.3, 13.4, 13.5, 13.6, 13.7, 13.8, 13.9, 14.1, 14.2
In order to help facilitate mapping a face tracker to the MPEG-4 points that the library leverages, the raw data for the annotated image is:
The first line in the CSV file is a header describing the data.
The next two lines are for the top left corner of the bounding box (
and the bottom right corner of the bounding box (
The rest of the data lines are for 174 landmarks points provided by the tracker
we used to produce this data.