Person Analysis Results

The following XML shows a single record produced by person analysis.

<record>
    <timestamp>
       ...
    </timestamp>
    <trackname>PersonAnalysis.Result</trackname>
    <PersonAnalysisResult>
        <id>466bf036-0b39-48fa-b17d-b082c61b3017</id>
        <hatColor>
            <identifier>None</identifier>
            <confidence>99.86</confidence>
        </hatColor>
        <hatStyle>
            <identifier>None</identifier>
            <confidence>99.86</confidence>
        </hatStyle>
        <hairColor>
            <identifier>Black</identifier>
            <confidence>59.88</confidence>
            <metadata>
                <item>
                    <key>color</key>
                    <value>64 64 64</value>
                </item>
            </metadata>
        </hairColor>
        <hairStyle>
            <identifier>Short</identifier>
            <confidence>59.88</confidence>
        </hairStyle>
        <facialHair>
            <identifier>No</identifier>
            <confidence>99.87</confidence>
        </facialHair>
        <upperColor>
            <identifier>Multiple</identifier>
            <confidence>97.93</confidence>
        </upperColor>
        <upperColorClusters>
            <cluster>
                <color>64 64 64</color>
                <colorname>Black</colorname>
                <proportion>61.37</proportion>
                <score>61.37</score>
            </cluster>
            <cluster>
                <color>64 64 128</color>
                <colorname>Blue</colorname>
                <proportion>22.63</proportion>
                <score>22.63</score>
            </cluster>
        </upperColorClusters>
        <upperStyle>
            <identifier>Long Sleeve</identifier>
            <confidence>99.14</confidence>
        </upperStyle>
        <lowerColor>
            <identifier>White</identifier>
            <confidence>99.9</confidence>
            <metadata>
                <item>
                    <key>color</key>
                    <value>224 224 224</value>
                </item>
            </metadata>
        </lowerColor>
        <lowerStyle>
            <identifier>Trousers</identifier>
            <confidence>100</confidence>
        </lowerStyle>
        <gender>
            <identifier>Male</identifier>
            <confidence>99.98</confidence>
        </gender>
        <region>
            <left>636</left>
            <top>108</top>
            <width>162</width>
            <height>297</height>
        </region>
    </PersonAnalysisResult>
</record>

The record contains the following information:

  • an id that matches the identifier of the input record received from face detection or object class recognition.
  • a region element that describes the region of the image or video frame that contains the person.
  • the following elements, which describe the person's appearance. Each element has an identifier containing the analysis result and a confidence score in the range 0 to 100.

    Element Possible identifier values Description
    hatColor Black, Blue, Brown, Green, Gray, Orange, Pink, Purple, Red, White, Yellow, Multiple, None Hat color ("None" if the person is not wearing a hat).
    hatStyle Beanie, Cap, Brim, Turban, Headscarf, Helmet, None Hat style ("None" if the person is not wearing a hat).
    hairColor Black, Brown, Blond, Red, Gray, Dyed Other, None Hair color ("None" if bald).
    hairStyle Bald, Short, Long Hair style.
    facialHair Yes, No Whether the person has facial hair.
    upperColor Black, Blue, Brown, Green, Gray, Orange, Pink, Purple, Red, White, Yellow, Multiple Color of clothing on upper body.
    upperStyle Short Sleeve, Long Sleeve Style of clothing on upper body.
    lowerColor Black, Blue, Gray, White, Other Color of clothing on lower body.
    lowerStyle Shorts/Skirt, Trousers Style of clothing on lower body.
    gender Male, Female The person's gender.
  • fields that contain color information (for example hairColor) include a metadata field named color. The value of this field is a typical example of the named color - and not necessarily the specific color value in the analyzed image. By default the color value is provided in RGB but you can set the parameter ColorSpace to choose a different color space.
  • the record includes an upperColorClusters element to provide more information when upperColor/identifier is "Multiple". For information about color cluster results, see Color Analysis Results.
  • the record includes a lowerColorClusters element to provide more information when lowerColor/identifier is "Other". For information about color cluster results, see Color Analysis Results.