Objective of this test

The objective of this article is to test if ChatGPT can correctly detection the emotions of some people. To perform the test, some pictures will be uploaded into ChatGPT, and I’ll ask ChatGPT what is the emotion of that person.

How the test is done

To do this test I uploaded a picture and I asked ChatGPT to express, in a sentence, what is the emotion that it is detecting. I then assigned the points to the evaluation with values ranging from 0 to 2. The meaning of this score is:

0 – ChatGPT didn’t get the expression

1 – ChatGPT partly matched the expression, was too generic or did some mistake in the description

2 – ChatGPT got it right

The pictures are taken from Pexels (Photo by Tima Miroshnichenko) and they include different ethnicities, different age and different sexes. This was done to make sure ChatGPT can obtain consistent results in different conditions

Discussion of the results

Looking at the table below, ChatGPT proven being very accurate, scoring 43 points out of 54. This translates in 79.63% accuracy, which is very high. ChatGPT did not only proven of being very accurate, but in some cases, it was more accurate and could capture more details than I could. The only two zeros that ChatGPT scored were with the elderly woman, where ChatGPT expressed a sense of anger, instead of an encouraging intention. The same happened with the same woman being upset, and ChatGPT saying that the woman was calm. In this last case though, the picture was taken from far, and the face was not the only subject. ChatGPT was consistent with the different pictures, and with the different conditions and didn’t show any particular pattern. Overall, ChatGPT results are very good and this is confirmed by the 79.63% accuracy.

Detailed results

The person in the image is displaying excitement and joy. Their wide open eyes, large smile, and raised hands suggest they are experiencing a strong, positive emotion, likely related to happiness or enthusiasm. The expression conveys a sense of excitement, as if they are celebrating or reacting to something thrilling.

The individual in this image is showing playful and cheeky emotions. Their wide-open eyes, tongue sticking out, and peace sign gesture indicate a carefree, fun attitude. This expression conveys light-heartedness and a sense of humor, suggesting that they are engaging in an amusing or playful moment.

The individual in this image seems to be conveying a neutral or serious emotion, possibly with a sense of contemplation or dissatisfaction. Their crossed arms and slightly furrowed brow suggest they may be feeling displeased or unsure. The lack of a smile and their focused expression further indicate a mood that is not joyful or relaxed, suggesting either irritation or deep thought.

In this image, the person appears to be feeling frustrated or annoyed, indicated by the furrowed brows, scrunched nose, and glaring eyes. The expression on their face suggests a sense of displeasure or irritation, with a tense posture that emphasizes their emotional response.

In this image, the person appears to be displaying a playful or mischievous emotion. With a slight smirk and a raised eyebrow, they seem to be engaging in a teasing or joking manner, possibly suggesting humor or a cheeky comment. The way they are pointing at something with their hands further emphasizes a fun or playful vibe.

In this image, the person is smiling widely, showing a genuine and joyful expression. Their bright eyes and beaming smile suggest a positive emotion, likely happiness or delight. The smile reaches their eyes, which indicates a sincere and warm mood, emphasizing a cheerful and content state of mind. The bright yellow background further enhances the overall cheerful vibe of the image.

In this image, the person is displaying a somber expression. Their lips are pressed together in a neutral or slightly frowning manner, and their eyes suggest a sense of contemplation or sadness. The overall demeanor is subdued, and their posture is slightly slumped, which emphasizes a feeling of resignation or a lack of enthusiasm. The red background provides a contrasting emotional tone, enhancing the feeling of a more serious or pensive mood.

The person in this image, with blonde hair and a serious expression, seems to be displaying anger or displeasure. The intense gaze and furrowed brows suggest a feeling of frustration or strong discontent.

The person in this image, smiling broadly with visible teeth and eyes squinting from joy, is clearly expressing happiness. The wide smile and enthusiastic expression suggest a carefree, joyful moment.

The person in this image, with their arms crossed and a slight frown, seems to be displaying an expression of displeasure or concern. The furrowed brow and averted gaze suggest discomfort or unease.

The person in the image appears to be puzzled or slightly confused. Their expression, with furrowed brows and a questioning look, suggests that they are unsure or in deep thought about something. The posture, with arms crossed and hands resting on the hips, adds to the sense of being slightly defensive or uncertain.

The person in the image appears to be extremely angry or frustrated. They are yelling loudly, which is clearly visible from their facial expression and wide-open mouth. The scrunched eyebrows and tensed facial muscles further suggest a heightened emotional state, possibly from strong irritation or anger. The expression is intense and emotional, capturing a moment of outburst.

The individual in the image appears to be deep in thought or contemplation. Their expression suggests that they are analyzing or pondering something, possibly evaluating a situation. The hand on their chin and the slightly furrowed brow indicate a focused and introspective state, showing they are thinking carefully or trying to solve a problem.

The person in this image appears to be looking upward with a thoughtful or curious expression. Their facial features suggest that they are pondering or contemplating something, possibly searching for inspiration or considering an idea. This pose, with the upward gaze, is commonly associated with deep thought or reflection.

The person in this image appears to be expressing surprise or shock. Their wide eyes and open mouth, along with their hands placed on their face, indicate a strong emotional reaction to something unexpected or startling. This gesture often suggests feelings of amazement or disbelief.

The person in this image appears to be expressing surprise or shock. Their wide eyes and open mouth, along with their hands placed on their face, indicate a strong emotional reaction to something unexpected or startling. This gesture often suggests feelings of amazement or disbelief.

The person in this image appears to be expressing distress or discomfort. The tightly shut eyes and furrowed brow indicate a facial reaction typically associated with pain, confusion, or frustration. Holding their face with one hand suggests they may be overwhelmed or attempting to manage their emotions.

The individual in this image appears to be expressing confusion, frustration, or distress. Their hand is placed on their head, a common gesture associated with feeling overwhelmed or perplexed. Their facial expression, with furrowed brows and a slightly tense mouth, suggests they are in a state of stress or are grappling with an issue.

The person in this image displays a serious and contemplative expression. Their furrowed brows, coupled with a neutral or slightly pursed mouth, suggest a feeling of concentration or concern. Their intense gaze and subtle tension in their face imply that they may be deep in thought or assessing a situation, indicating a state of reflection or seriousness.

In this image, the individual is displaying a strong sense of frustration or anger. Their intense gaze, coupled with furrowed brows, suggests irritation or disapproval. The raised hands with fingers spread out further emphasize the feeling of agitation, as if they are expressing their displeasure or confusion. This expression indicates an emotional response, likely in reaction to a challenging or upsetting situation.

In this image, the individual appears to be expressing frustration, stress, or perhaps confusion. The furrowed brows and serious expression suggest a deep emotional reaction, while the hand placed on the side of the head indicates possible discomfort or an attempt to process a difficult thought. The facial tension and overall posture convey a sense of mental strain or irritation.

In this image, the elderly woman appears to express a calm, neutral emotion, with no visible signs of distress or extreme emotion. She is standing with a slightly stern but composed facial expression, conveying an air of confidence, quiet strength, or perhaps contemplation. Her expression seems steady, making her appear relaxed but firm in her demeanor. The overall impression is one of quiet confidence, rather than any particular extreme emotion.

The young woman in the image appears to express confusion or surprise. Her eyes are wide, and her mouth is slightly open, which is typically indicative of these emotions. Her facial expression seems to reflect a moment of uncertainty or bewilderment. The overall impression is one of being startled or unsure about something happening in her surroundings.

The elderly woman in this image appears to be expressing frustration or anger. Her clenched fists, furrowed brows, and intense gaze suggest a strong emotional reaction, likely to a challenging or upsetting situation. The posture and facial expression convey a sense of determination or readiness to confront something, possibly in a defensive or assertive manner.

The person in this image appears to be conveying a neutral or slightly confused emotion. The slightly furrowed brows and direct gaze suggest contemplation or curiosity, but there is no strong expression of happiness, sadness, or anger. The subtle posture and expression give an impression of someone thinking or in a moment of uncertainty.

The person in this image is smiling gently, indicating a calm and content emotion. Their facial expression suggests a sense of friendliness or satisfaction, with slight wrinkles near the eyes and a soft smile. This conveys a peaceful and warm demeanor.

Copyright

Author: Simone Togni

Platform: aisciencetalk.blog

Appendix

Picture	Emotion Description	Evaluation	Comment
1	The person in the image is displaying excitement and joy. Their wide open eyes, large smile, and raised hands suggest they are experiencing a strong, positive emotion, likely related to happiness or enthusiasm. The expression conveys a sense of excitement, as if they are celebrating or reacting to something thrilling.	2
2	The individual in this image is showing playful and cheeky emotions. Their wide-open eyes, tongue sticking out, and peace sign gesture indicate a carefree, fun attitude. This expression conveys light-heartedness and a sense of humor, suggesting that they are engaging in an amusing or playful moment.	1	Eyes are not wide open
3	The individual in this image seems to be conveying a neutral or serious emotion, possibly with a sense of contemplation or dissatisfaction. Their crossed arms and slightly furrowed brow suggest they may be feeling displeased or unsure. The lack of a smile and their focused expression further indicate a mood that is not joyful or relaxed, suggesting either irritation or deep thought.	2
4	In this image, the person appears to be feeling frustrated or annoyed, indicated by the furrowed brows, scrunched nose, and glaring eyes. The expression on their face suggests a sense of displeasure or irritation, with a tense posture that emphasizes their emotional response.	2
5	In this image, the person appears to be displaying a playful or mischievous emotion. With a slight smirk and a raised eyebrow, they seem to be engaging in a teasing or joking manner, possibly suggesting humor or a cheeky comment. The way they are pointing at something with their hands further emphasizes a fun or playful vibe.	2
6	In this image, the person is smiling widely, showing a genuine and joyful expression. Their bright eyes and beaming smile suggest a positive emotion, likely happiness or delight. The smile reaches their eyes, which indicates a sincere and warm mood, emphasizing a cheerful and content state of mind. The bright yellow background further enhances the overall cheerful vibe of the image.	2
7	In this image, the person is displaying a somber expression. Their lips are pressed together in a neutral or slightly frowning manner, and their eyes suggest a sense of contemplation or sadness. The overall demeanor is subdued, and their posture is slightly slumped, which emphasizes a feeling of resignation or a lack of enthusiasm. The red background provides a contrasting emotional tone, enhancing the feeling of a more serious or pensive mood.	2
8	The person in this image, with blonde hair and a serious expression, seems to be displaying anger or displeasure. The intense gaze and furrowed brows suggest a feeling of frustration or strong discontent.	1	Anger, no frustration
9	The person in this image, smiling broadly with visible teeth and eyes squinting from joy, is clearly expressing happiness. The wide smile and enthusiastic expression suggest a carefree, joyful moment.	2
10	The person in this image, with their arms crossed and a slight frown, seems to be displaying an expression of displeasure or concern. The furrowed brow and averted gaze suggest discomfort or unease.	2
11	The person in the image appears to be puzzled or slightly confused. Their expression, with furrowed brows and a questioning look, suggests that they are unsure or in deep thought about something. The posture, with arms crossed and hands resting on the hips, adds to the sense of being slightly defensive or uncertain.	1	Arms are not crossed
12	The person in the image appears to be extremely angry or frustrated. They are yelling loudly, which is clearly visible from their facial expression and wide-open mouth. The scrunched eyebrows and tensed facial muscles further suggest a heightened emotional state, possibly from strong irritation or anger. The expression is intense and emotional, capturing a moment of outburst.	2
13	The individual in the image appears to be deep in thought or contemplation. Their expression suggests that they are analyzing or pondering something, possibly evaluating a situation. The hand on their chin and the slightly furrowed brow indicate a focused and introspective state, showing they are thinking carefully or trying to solve a problem.	2
14	The person in this image appears to be looking upward with a thoughtful or curious expression. Their facial features suggest that they are pondering or contemplating something, possibly searching for inspiration or considering an idea. This pose, with the upward gaze, is commonly associated with deep thought or reflection.	1	The person is lookin up at something that might need to fix or do
15	The person in this image appears to be expressing surprise or shock. Their wide eyes and open mouth, along with their hands placed on their face, indicate a strong emotional reaction to something unexpected or startling. This gesture often suggests feelings of amazement or disbelief.	2
16	The person in this image appears to be expressing surprise or shock. Their wide eyes and open mouth, along with their hands placed on their face, indicate a strong emotional reaction to something unexpected or startling. This gesture often suggests feelings of amazement or disbelief.	2
17	The person in this image appears to be expressing confusion or skepticism. The furrowed brows and tilted head suggest they are unsure about something or questioning a situation. This type of expression typically indicates doubt, curiosity, or contemplation.	2
18	The person in this image appears to be expressing distress or discomfort. The tightly shut eyes and furrowed brow indicate a facial reaction typically associated with pain, confusion, or frustration. Holding their face with one hand suggests they may be overwhelmed or attempting to manage their emotions.	1	The person is expressing desperation. ChatGPT is a bit neutral here
19	The individual in this image appears to be expressing confusion, frustration, or distress. Their hand is placed on their head, a common gesture associated with feeling overwhelmed or perplexed. Their facial expression, with furrowed brows and a slightly tense mouth, suggests they are in a state of stress or are grappling with an issue.	2
20	The person in this image displays a serious and contemplative expression. Their furrowed brows, coupled with a neutral or slightly pursed mouth, suggest a feeling of concentration or concern. Their intense gaze and subtle tension in their face imply that they may be deep in thought or assessing a situation, indicating a state of reflection or seriousness.	2
21	In this image, the individual is displaying a strong sense of frustration or anger. Their intense gaze, coupled with furrowed brows, suggests irritation or disapproval. The raised hands with fingers spread out further emphasize the feeling of agitation, as if they are expressing their displeasure or confusion. This expression indicates an emotional response, likely in reaction to a challenging or upsetting situation.	2
22	In this image, the individual appears to be expressing frustration, stress, or perhaps confusion. The furrowed brows and serious expression suggest a deep emotional reaction, while the hand placed on the side of the head indicates possible discomfort or an attempt to process a difficult thought. The facial tension and overall posture convey a sense of mental strain or irritation.	2
23	In this image, the elderly woman appears to express a calm, neutral emotion, with no visible signs of distress or extreme emotion. She is standing with a slightly stern but composed facial expression, conveying an air of confidence, quiet strength, or perhaps contemplation. Her expression seems steady, making her appear relaxed but firm in her demeanor. The overall impression is one of quiet confidence, rather than any particular extreme emotion.	0	The lady looks slightly upset. The serrated lips were not detected
24	The young woman in the image appears to express confusion or surprise. Her eyes are wide, and her mouth is slightly open, which is typically indicative of these emotions. Her facial expression seems to reflect a moment of uncertainty or bewilderment. The overall impression is one of being startled or unsure about something happening in her surroundings.	1	Confusion might be, but surprise is not appropriate
25	The elderly woman in this image appears to be expressing frustration or anger. Her clenched fists, furrowed brows, and intense gaze suggest a strong emotional reaction, likely to a challenging or upsetting situation. The posture and facial expression convey a sense of determination or readiness to confront something, possibly in a defensive or assertive manner.	0	The lady seems to encourage someone
26	The person in this image appears to be conveying a neutral or slightly confused emotion. The slightly furrowed brows and direct gaze suggest contemplation or curiosity, but there is no strong expression of happiness, sadness, or anger. The subtle posture and expression give an impression of someone thinking or in a moment of uncertainty.	1	The image convey a neutral emotion. I don’t see any confusion associated
27	The person in this image is smiling gently, indicating a calm and content emotion. Their facial expression suggests a sense of friendliness or satisfaction, with slight wrinkles near the eyes and a soft smile. This conveys a peaceful and warm demeanor.	2
	Total	43/54