The Effect of Reading Direction on Emotion Recognition: A Pilot Study

Page created by Ben Robertson
 
CONTINUE READING
Mental Health & Human Resilience International Journal
                                                                                                                   ISSN: 2578-5095

      The Effect of Reading Direction on Emotion Recognition:
                                                          A Pilot Study

Vargha B* and Labadi B
                                                                                                           Research Article
Department of Psychology, University of Pecs, Hungary
                                                                                                             Volume 3 Issue 1
                                                                                                      Received Date: January 25, 2019
*Corresponding author: Balint Vargha, Ph.D. student, Department of Psychology,
                                                                                                     Published Date: February 14, 2019
University of Pecs, Hungary, Tel: +36 72 501 516; Email: varghabalint@gmail.com                       DOI: 10.23880/mhrij-16000126

 Abstract
In this pilot study we tested whether or not the direction of reading (independently from its content) influences
participants’ emotional experience. We tested a small sample of 30 Japanese people in a repeated measure setting.
Participants completed a short emotion-recognition task following two different reading direction conditions: left-to-
right and top-to-bottom. Results show that reading direction tends to have an impact on recognition of expression of
emotion. Based on these positive results, we believe further research is necessary to verify the observed effects and to
refine present findings.

Keywords: Reading Direction; Reading; Perception; Emotion Recognition; Facial Expressions
Classification codes: 2340, 2360

Abbreviations: VT: Valence Theory; RVF: Right Visual                     studies have used an experimental setting designed to
Field; LVF: Left Visual Field; BPT: Bilateral Projection                 show a connection of this kind using nostril breathing,
Theory; SFT: Split Fovea Theory; LH: Left Hemisphere;                    face and hand muscles, and vibrotactile stimulations. In a
RH: Right Hemisphere; PVL: Preferred Viewing Location;                   series of studies, Schiff and Lamon (1989, 1994) [1,2]
OVP: Optimal Viewing Point; VWF: Visual Word Form; VH:                   demonstrated that unilateral stimulations induce
Valence Hypothesis; RHH: Right Hemisphere Hypothesis;                    different emotional states, depending on the side of the
VF: Visual Field; LR: Left-to Right; RL: Right-to Left; TB:              stimulation. A right-sided stimulation induced a positive
Top-to-Bottom; AWS: Approach/Withdrawal System;                          emotional experience, while a left-sided stimulation
JAFFE: Japanese Female Facial Expression; ARME: Asian                    induced a negative emotional experience. These findings
Reading the Mind in the Eyes; RME: Reading the Mind in                   are in line with the well-based valence theory (VT). Schiff
the Eyes                                                                 and Lamon argued that unilateral physical stimulation
                                                                         falls under the control of the contralateral hemisphere,
 The Effect of Reading Direction on                                      which then affects emotional experience according to the
                                                                         side of activation.
 Emotion Recognition
                                                                            In our research we wanted to test whether or not the
   Research shows that unilateral physical stimulations
                                                                         direction of reading as a physical stimulation has an effect
can influence emotional experiences. Besides research on
                                                                         similar to the other forms of unilateral stimulations
the effects of handedness on behavior and personality,

 The Effect of Reading Direction on Emotion Recognition: A Pilot Study                                  Ment Health Hum Resilience Int J
2
                                      Mental Health & Human Resilience International Journal
previously studied by Schiff and Lamon. We believe it is                          On the word (foveal) level, however, the picture is not
important to test the possibility of this connection                          so clear. There are two competing theories about
because we spend a lot of time reading every day.                             hemispheric projection linked to the foveal region. The
Therefore, if this effect exists and can be specified, then                   bilateral projection theory (BPT) posits that the
we need to understand this influence. Further, cultures                       information from the fovea region will project both to the
have different reading habits with different directions of                    left and right hemispheres regardless the point of fixation
reading. If the direction of reading affects emotional                        [4]. The split fovea theory (SFT) argues that the fovea is
experience, this could produce different interpretations of                   split in the middle, with information to the right of the
the emotional content of the same event, leading to                           center of the fovea projecting to the left hemisphere (LH)
misunderstandings between cultures with different                             and information to the left of the center of the fovea
reading habits.                                                               projecting to the right hemisphere (RH) [3].

    Following, first we will discuss how the act of reading                     Reading and Hemispheric Processing
is similar to a unilateral physical stimulation, then we
                                                                                 When we read, our fixation typically falls to the initial
move on and discuss the two models of hemispheric
                                                                              one-third of the word, called the preferred viewing
lateralization of emotion processing that were used to
                                                                              location (PVL). This also is where fastest and most
formulate hypotheses in this experiment. After that we
                                                                              accurate word recognition occurs and is the optimal
will describe how and why the experiment was conducted
                                                                              viewing point (OVP) for word identification [7-9]. If the
and form hypotheses based on our assumptions and the
                                                                              BPT is correct, then word-level information processing is
emotion-processing models. After the method and results
                                                                              done by both hemispheres equally, while sentence-level
section, we discuss our findings where we propose a
                                                                              processing is done mostly by the LH. If the SFT is the valid
possible explanation for our results, and finally we
                                                                              theory, however, then processing is mostly done by the
introduce other possible topics for further research
                                                                              LH on both the word and sentence level. Whichever the
related to reading direction and hemispheric laterality.
                                                                              case, the RVF and the LH are used more in reading than
Note that this is a pilot study so the conclusions drawn
                                                                              the LVF and the RH; therefore, we consider the direction
from this experiment are very limited and are more like
                                                                              of reading to be possibly an asymmetric physical
possible perspectives than irrefutable facts, which require
                                                                              stimulation in the case of (normal, everyday) left-to-right
further research for validity.
                                                                              reading.
    Hemispheric           Processing          of     Words         and
                                                                                RVF Superiority in Reading
    Sentences
                                                                                 The RVF superiority in reading found in the previous
    The role and function of visual fields (especially the                    experiments is attributed mainly to the hemispheric
foveal region) are important and well-studied topics in                       specialization of the LH for processing language-related
vision research of reading. Although it is an accepted fact
                                                                              stimuli (i.e., the Broca area and the visual word form
that parafoveal regions project contralaterally, there is an
                                                                              [VWF] area), but growing evidence suggests that it is, in
ongoing debate about whether the foveal region functions                      part, a result of perceptual learning. In a series of
as a whole in which information is projected to both
                                                                              experiments, Nazir, Ben-Boutayab, Decoppet, Deutsch,
hemispheres or whether information is processed
                                                                              and Frost (2004) [10] reinforced this supplementary
laterally similar to parafoveal vision [3-5].                                 explanation. They argued that because of the time people
                                                                              spend “practicing” discriminating orthographic material
    On the sentence level, contralateral projection to the
                                                                              and because of the regular use of the close-to-center
hemispheres is well supported by evidence found by                            landing site, reading improves in a way such that people
Pollatsek, Bolozky, Well, and Rayner (1981) [6] who
                                                                              will process more and more information in the visual field
arrived to the conclusion that English readers’ perceptual
                                                                              identical to the direction of visual scanning (i.e., in left-to-
span is asymmetric in a way that information falling to the
                                                                              right reading the right visual field). Because of that, those
right of the fixated word is more extensive (15–16                            who read in a left-to-right direction for a long time will
characters) than that falling to the left side (3–4
                                                                              use their RVF more and more compared to their LVF, thus
characters), thus occupying more area in the right visual
                                                                              making their LH more active compared to their RH while
field (RVF) than the left visual field (LVF). (The effect is                  reading.
reversed for readers reading Hebrew text, which is read
from right-to-left.)
                                                                                 Similarly, reinforcing the previous assumption Wong
                                                                              and Hsiao (2012) [11] found that the OVP effect for

    Vargha B and Labadi B. The Effect of Reading Direction on Emotion Recognition:                          Copyright© Vargha B and Labadi B.
    A Pilot Study. Ment Health Hum Resilience Int J 2019, 3(1): 000126.
3
                                      Mental Health & Human Resilience International Journal
reading musical notes was a consequence of long-term                          recognize the target expression better and faster when it
reading practice of musical notes. Novice, intermediate,                      is presented in the LVF [15-17]. The findings of these
and expert musicians read three-note sequences in the                         studies have been interpreted in favor of either the VH or
experiment. Their fixation point fell more and more to the                    the RHH, so the debate remains unresolved.
left of the center of the sequence as their level of
experience increased. From these results, it seems likely                       Physical Stimulations and Emotions
then that the LH’s superiority in processing written
                                                                                 Schiff and Lamon conducted a series of experiments in
material directed in a left-to-right direction is partly due
                                                                              which emotional processing was not tested by stimuli
to a learning process, namely to our habit of reading in
                                                                              presentations to visual fields but by using physical
this direction. In this case the scale of the asymmetry
                                                                              stimulations to generate emotional experience. They were
created by left-to-right reading is the product of a
                                                                              among the first researchers who found a laterality effect
learning mechanism instead of a pure, innate brain
                                                                              between physical activity and emotional experience.
activation mechanism. Now, we take a small detour to
                                                                              Small unilateral muscle contractions of the face [1] and
familiarize with emotion processing theories then we
                                                                              the hand [2], unilateral nostril breathing [18], and
move on to make our hypothesis based on our
                                                                              unilateral vibrotactile stimulations [19] all influenced
assumptions.
                                                                              emotional experience, depending on the side of
                                                                              contraction. Stimulations on the left side resulted in
    Hemispheric Processing of Emotions                                        negative states of emotion while stimulations on the right
    Hemispheric lateralization of emotions remains a                          side resulted in positive states of emotion. The authors
debated theory in the field of cognitive neuroscience                         explained their results on the basis of the VH.
despite several studies that used varied methods in an
attempt to support cerebral asymmetries. Currently two                          Present Research
competing theories attempt to explain these findings: the
                                                                                  The goal of this research was twofold. First, based on
valence hypothesis (VH) and the right hemisphere
                                                                              our theoretical background that VF use is unequal during
hypothesis (RHH).
                                                                              reading, we used the reading process as a physical
                                                                              stimulation to address the inconsistent findings of
    According to the VH, unilateral stimulations activate
                                                                              lateralized emotional processing, and at the same time
the contralateral hemisphere, which then affects
                                                                              prove that direction of reading can function as a unilateral
emotional experience (e.g., mood, performance). During a
                                                                              stimulation. We expected that the act of reading would
left-sided stimulation, the right hemisphere, which is
                                                                              generate     distinguishable      emotional      processing
specialized in negative emotion processing, will be
                                                                              reaffirming its unilateral stimulating nature and that it
activated. During a right-sided stimulation, the left
                                                                              would reaffirm or deny the competing models of
hemisphere, which is specialized in positive emotion
                                                                              hemispheric lateralization of emotions.
processing, will be activated. The RHH, however, suggests
that the right hemisphere is responsible for all emotion
                                                                                  Considering the SFT theory and the results of Pollatsek
processing, regardless of valence.
                                                                              et al. (1981) [6], we hypothesized that the asymmetric use
                                                                              of VFs during reading would generate a lateralized
   Researchers commonly try to deliberate between
                                                                              hemispheric activation that could be captured through
these two theories by using visual field (VF) experiments
                                                                              emotion processing as in the Schiff and Lamon
in which activation is attributed to the hemisphere
                                                                              experiments.
opposite the VF (i.e., if the stimulus is presented in the
RVF, then its processing is attributed to the LH).
                                                                                  Schiff and Lamon (1989, 1994) [1,2] induced
                                                                              stimulations of both the right and left side and then
    Despite the many research studies conducted in this
                                                                              compared the effects. In the current study, however, it
area, the results are still inconclusive. On one hand, there
                                                                              was difficult to set up a similar inverse condition (i.e., left-
are findings supporting the theory that positive emotions
                                                                              to right [LR] reading vs. right-to left [RL] reading) because
are better and faster recognized when presented in the
                                                                              the capacity to read in a different direction was lacking.
RVF (i.e., the left hemisphere processes positive emotions)
                                                                              Incapable of constructing an experimental situation
and vice versa for negative emotions [12-14]. On the
                                                                              where LR and RL reading conditions could be compared
other hand, in a divided visual field experiment, when the
                                                                              on the same sample in a within-subject design, we chose
stimuli of facial expressions are simultaneously presented
                                                                              to compare the conditions of LR and top-to-bottom (TB)
in both the right and left visual fields, participants tend to
                                                                              reading. Japanese can be read in both LR and TB

    Vargha B and Labadi B. The Effect of Reading Direction on Emotion Recognition:                          Copyright© Vargha B and Labadi B.
    A Pilot Study. Ment Health Hum Resilience Int J 2019, 3(1): 000126.
4
                                       Mental Health & Human Resilience International Journal
directions, using the same graphemes. Moreover, in this                       personal inquiry. Those who signed up for the experiment
setting, the sample shared the same lingual and cultural                      via advertisement received 1500¥ per session.
background contrary to settings in which two languages
are read by the same person [6] or in which different                           Materials
languages are read by different people. Kajii and Osaka
                                                                                  The stimulus material consisted of two standardized
(2000) [20] found that the OVP effect disappeared during
                                                                              test batteries that measure basic emotion recognition. The
TB reading in a Japanese sample, which means that while
                                                                              first was the Japanese Female Facial Expression (JAFFE)
reading in a TB direction both VFs are used equally for
                                                                              measure by Lyons, Akamatsu, Kamachi, and Gyoba (1998)
information processing, preventing the hemispheric
                                                                              [26]. The second was the Asian Reading the Mind in the
lateralization from occurring.
                                                                              Eyes (ARME) instrument by Adams et al. (2010) [27],
                                                                              which was used to measure more complex emotion and
   For testing, we chose a facial expression recognition
                                                                              state recognition.
task because it is easy to measure and the results are
simple to interpret. We made the following predictions
                                                                              Image material (Stimuli): We selected 48 pictures from
based on information from competing emotion-
                                                                              the JAFFE database: six faces for each basic emotion and
processing models such as the VH, RHH, and the
                                                                              12 neutral faces. The JAFFE images are of female actors
approach/withdrawal system (AWS) theory, and from
                                                                              showing facial expressions of the six basic emotions and
studies by Demaree, Everhart, Youngstrom, and Harrison
                                                                              neutral expressions.
(2005), Fusar-Poli et al. (2009), and Harmon-Jones,
Vaughn-Scott, Mohr, Sigelman, and Harmon-Jones (2004)
                                                                                  We administered all 36 pictures from the ARME,
[21-25].
                                                                              which is an adaptation of the Reading the Mind in the
                                                                              Eyes (RME) test originally developed by Baron-Cohen,
    First, due to the hemispheric lateralization created by
                                                                              Wheelwright, Hill, Raste, and Plumb (2001) [28] to
reading, we expected that the left-weighted asymmetric
                                                                              measure mind reading capabilities (considered an
use of the LH during LR reading would result either in
                                                                              advanced theory of mind test of typically developed
superior and faster recognition of emotions that are
                                                                              adults and adults with an autism spectrum disorder. We
attributed to the LH (e.g., anger1, happiness, surprise) or
                                                                              decided to use ARME pictures as a general emotion
inferior emotion recognition in general in concordance
                                                                              recognition variable because they present complex
with the RHH.
                                                                              emotional and mental states [29] and their valence is less
                                                                              confined than basic emotions, thus allowing a less
    Second, in the TB reading condition where the visual
                                                                              valence-specific processing. Participants were presented
fields are used evenly for information processing, we
                                                                              a series of images of the eye region of the face of an equal
expected either better performance and faster recognition
                                                                              number of female and male actors. Four complex mental
of emotions attributed to the RH (e.g., sadness, disgust,
                                                                              state descriptors were presented around each image, one
fear) or superior emotion recognition in general in
                                                                              at each corner, with one being the correct target word
accordance with the RHH.
                                                                              describing the mental state of the actor. Participants were
                                                                              instructed to choose the word that best described what
    Method                                                                    the person in the photo was thinking or feeling.
    Participants                                                                  The images for both batteries were presented on a 13-
   Thirty Japanese people (17 men and 13 women)                               inch laptop screen, administered by either DMDX (for
participated in the experiment. Their mean age was 30.8                       Windows) or Psyscope (for Mac) software. The
(SD ± 6.228). They were all residents of Tokyo and most                       instructions and the emotion labels used during the
of them were studying at Hitotsubashi University.                             presentation were written in the same direction as the
Recruitment was done both through advertisement and                           text the participants read during the reading task.

                                                                                  The pictures were grouped into two image sets in
    1
    We attributed anger to the LH based on studies conducted by Harmon-       order to be able to measure the performance of the same
    Jones and Allen (1998), Harmon-Jones, Sigelman, Bohling, and              test participant on both reading conditions. Each set
    Harmon-Jones (2003), and Harmon-Jones et al. (2004).
                                                                              contained three JAFFE pictures of each of the six basic
                                                                              emotions, six JAFFE pictures of neutral faces, and 18
                                                                              ARME pictures.

    Vargha B and Labadi B. The Effect of Reading Direction on Emotion Recognition:                        Copyright© Vargha B and Labadi B.
    A Pilot Study. Ment Health Hum Resilience Int J 2019, 3(1): 000126.
5
                                      Mental Health & Human Resilience International Journal
   The tests were scored by totaling the number of items                      JAFFE pictures, we added emotion as a third dimension,
(images) for which the participant correctly identified the                   resulting in a 2x2x7 design. We also ran separate
mental state and basic emotion portrayed. Reaction times                      repeated measures ANOVA for each emotion, using the
also were registered for each image task.                                     same mixed 2x2 design with reading direction as the
                                                                              within-subject variable and gender as the between-
Reading material (conditions): In the experiment, we                          subject variable.
used four reading texts that differed in two dimensions:
their content (Text A or Text B) and their direction of                         Results
reading (left-to-right or top-to-bottom). This created the
following conditions: (a) Text A read from left to right, (b)                     The analyses yielded several significant results for
Text A read from top to bottom, (c) Text B read from left                     reading direction as shown in Table 1. Besides the main
to right, and (d) Text B read from top to bottom. The texts                   effect between the two reading conditions in performance
were 24–25 pages long and were put together from                              for emotion recognition for the JAFFE pictures (F[1, 28] =
randomly selected tales from a Japanese website. All tales                    4.884), there were significant differences in the
appeared in only one of the texts and were written in                         recognition of angry (F[1, 28] = 18.545), sad (F[1, 28] =
Japanese Hiragana.                                                            26.693), and neutral faces (F[1, 28] = 9.967). There also
                                                                              was a tendency for difference in recognition of fearful
    Procedure                                                                 faces (F[1, 28] = 3.332).
    Each participant was tested individually in a
                                                                                  Although LR readers performed better on recognizing
soundproof room during two sessions. During the first
                                                                              basic emotions in general and three basic emotions in
session, participants listened to Sergei Rachmaninoff’s
                                                                              specific (anger, sadness, and fear), TB readers were
Allegro Vivace for 3 minutes to ensure a similar mood for
                                                                              superior at recognizing faces showing a neutral
each person before starting the experiment. Then the
                                                                              expression (Figure 1). In addition, LR readers tended to
participants were given one of the compilations of
                                                                              be faster in general in their judgment for ARME pictures
Japanese tales to read for 30 minutes. In the second
                                                                              (F[1, 28] = 3.624, p = .067, µ2 = .115, and MD = -959 [-
session, participants completed the facial expression
                                                                              1991, 73]) while TB readers showed a tendency to be
recognition task involving 24 pictures from the JAFFE
                                                                              faster specifically for fearful faces (F[1, 28] = 3.89, µ2
database and 18 pictures from the ARME test. The
                                                                              = .122, p = .059, and MD = 392 [-15,800]) (Figure 2).
experiment was repeated a week later. The order of the
conditions (including image sets, starting condition, and
                                                                                 The analysis showed only one difference related to
reading materials) was randomized and counterbalanced.
                                                                              gender. Women showed a tendency to recognize fearful
                                                                              faces faster than men (F[1, 28] = 3.155, µ2 = .106, p = .087,
    Statistical Method                                                        and MD = .339 [-.042, .721]).
   Response times from trials with errors were excluded,
and those response times greater than two standard                                Interestingly, we found an unexpected interaction
deviations above the mean were ignored as outliers. We                        between gender and reading direction in the performance
ran a repeated measures ANOVA for both performance                            scores for happy faces (F[1, 28] = 6.283, µ2 = .183, p < .05)
and response time data of the ARME and JAFFE pictures.                        (see Figure 3). The interaction between the two variables
For the ARME pictures, we used a mixed 2x2 design, in                         is significant. Although men are better at recognizing
which the within-subject variable was reading direction                       happy faces in the LR reading condition, the same is true
and the between-subject variable was gender. For the                          for women in the TB reading condition.

                      MS for LR group             MS for TB group                         ES                        MD and 95% CI
                      Perf        RT              Perf        RT                 Perf            RT              Perf            RT
                     12.73       6871            12.97       7826                                               -0.206          -959
       ARME                                                                    µ2= .007        µ2= .115t
                     (2.42)    (2079)            (2.16)     (3377)                                         [-1.125, .713]    [-1991, 73]
                      2.13       3976               2        4049                                               0.127            -72
       JAFFE                                                                  µ2= .149*        µ2= .008
                     (0.41)     (123)            (0.51)      (171)                                          [.009, .245]     [-389, 245]
                      2.13       3299             1.97       3632                                               0.111           -328
    Happiness                                                                  µ2= .015        µ2= .068
                     (0.78)     (731)            (0.62)     (1205)                                          [-.231, .453]    [-799, 143]
     Surprise         2.47       4341              2.6       4182              µ2= .031        µ2= .008         -0.145          -146

    Vargha B and Labadi B. The Effect of Reading Direction on Emotion Recognition:                           Copyright© Vargha B and Labadi B.
    A Pilot Study. Ment Health Hum Resilience Int J 2019, 3(1): 000126.
6
                                      Mental Health & Human Resilience International Journal
                     (0.78)        (1177)         (0.5)        (1189)                                  [-.458, .168]       [-787, 494]
                       2.1          3562           1.5          3721                                       0.602                192
     Sadness                                                                 µ2= .448***   µ2= .009
                       (1)         (1148)        (0.78)        (1647)                                   [.363, .840]       [-605, 988]
                      2.47          3746          1.77          4190                                       0.708               -473
       Anger                                                                 µ2= .400***   µ2= .049
                     (0.57)        (1175)        (1.17)        (2111)                                  [.372, 1.044]      [-1283, 336]
                       1.7          4951          1.37          4561                                       0.339                392
       Fear                                                                    µ2= .106t   µ2= .122t
                     (1.21)         (826)        (0.93)         (742)                                  [-.042, .721]        [-15, 800]
                      1.77          4416          1.37          4359                                       -0.387                91
      Disgust                                                                  µ2= .087    µ2= .004
                     (0.86)        (1077)        (0.68)        (1385)                                  [-.872, .098]       [-486, 668]
                      4.68          3608          5.36          3837                                       -0.338              -233
      Neutral                                                                 µ2= .263**   µ2= .023
                     (0.23)        (1754)        (0.16)        (1527)                                  [-.558, -.119]      [-826, 360]
Note. Significant differences are marked with asterisks and tendencies with a t.
t p < .1, *p < .05, **p < .01, ***p < .001

Table 1: Performance and Response Time (RT) Mean Scores.

                                            Note: Error bars indicate a 95% confidence interval.
                    Figure 1: Mean performance scores for ARME and JAFFE pictures in two reading conditions.

                                      Note: Error bars indicate a 95% confidence interval.
                   Figure 2: Mean response time scores for ARME and JAFFE pictures in two reading conditions.

    Vargha B and Labadi B. The Effect of Reading Direction on Emotion Recognition:                       Copyright© Vargha B and Labadi B.
    A Pilot Study. Ment Health Hum Resilience Int J 2019, 3(1): 000126.
7
                                      Mental Health & Human Resilience International Journal

                                            Note: Error bars indicate a 95% confidence interval.
    Figure 3: Mean performance scores for pictures showing happy facial expressions for men and women in both reading
    conditions.

    Discussion                                                                fear. In addition, they were not better at identifying any
                                                                              emotion, including ARME pictures. Instead, they were
    First, before discussing our results it is important to                   unexpectedly better at recognizing neutral faces (i.e.,
remind the reader that this experiment was a pilot study                      those free of valence).
with only a small sample size and a low number of trials
so the conclusions drawn from this experiment are very                            Despite the inconsistency between our hypothesis and
limited and needs further research for its verification and                   results we can propose a possible explanation. According
refinement.                                                                   to Killgore and Yurgelun-Todd’s (2007) [30] working
                                                                              model, the right hemisphere is responsible in early
   Keeping the previous in mind, from our results it                          emotion processing regardless of valence, while the left
seems that reading direction influence emotion                                hemisphere activates valence-specific functions in the
recognition. In the case of three basic emotions (anger,                      brain. In light of this theory, higher performance scores
sadness, and fear), the LR reading condition resulted in                      found in the LR reading condition for valence-specific
better recognition than the TB reading condition. This                        pictures could be explained by the assumed higher LH
also was true when we compared all the correct                                activation (compared to the RH). Likewise, the higher
responses for all the JAFFE pictures. Conversely,                             performance scores for neutral faces found for the TB
participants using the TB reading condition were better at                    reading condition could be due to the more symmetric
discerning neutrality.                                                        activation of the hemispheres. It remains unknown from
                                                                              this pilot study however, why anger, sadness, and fear
   Our results do not fit with our initial hypotheses based                   were recognized more accurately than surprise,
on current emotion-processing theories and results. The                       happiness, and disgust.
LR reading condition did not result in quicker judgments
of approach-relevant emotions such as anger and                                   In addition, Killgore and Yurgelun-Todd’s model can
happiness, and better performance among participants                          account for the slower response time during the
was not restricted to these emotions either. In our                           recognition of ARME pictures in the TB reading condition.
experiment, participants in the LR reading condition                          It is possible that although LR reading helps in attaching
performed better at recognizing anger, sadness, and fear,                     valence to pictures through a higher LH activation, thus
and they were faster at recognizing the ARME pictures,                        accelerating the recognition process, TB reading slows
which measured general emotion perception.                                    this down by rendering the facial expression on the
                                                                              picture back to neutral valence through a more symmetric
    Similarly, contrary to our prediction, participants in                    activation (i.e., less LH and more RH activation compared
the TB reading condition were not faster nor better at                        to LR reading), thus making judgments to be slower.
recognizing both of the two withdrawal-related emotions
(fear and disgust), but were only faster when recognizing

    Vargha B and Labadi B. The Effect of Reading Direction on Emotion Recognition:                        Copyright© Vargha B and Labadi B.
    A Pilot Study. Ment Health Hum Resilience Int J 2019, 3(1): 000126.
8
                                      Mental Health & Human Resilience International Journal
    In the exceptional case of fearful faces in which the TB                  when reading in a left-to-right direction than when they
reading condition enhanced faster detection, we believe                       read in a top-to-bottom direction. However, they were
that this could be due to the evolutionary importance that                    worse at correctly identifying neutral faces. There are two
exists for detecting (and reacting to) harmful events, in                     ways of interpreting these results from the point of view
this case by detecting fear on the faces of others. Thus, the                 of different perspectives. From a LR perspective (e.g. from
recognition of fear, which would be the function of the LH                    an English reader’s perspective), this could mean that in
would be more automatic and require less valence-                             the TB condition, LH activation was inferior and valence
specific processing. Despite this advantage in speed                          attribution to emotional stimuli was hindered. From a TB
(lower response time), however, we can see a                                  point of view (e.g. from the perspective of a Japanese
disadvantage in accuracy (lower performance) as                               reader who only read in a TB direction), however, the
compared to the LR reading condition, presumably                              inferior performance of LR readers in identifying neutral
because of the lower LH activation.                                           faces could be viewed as a heightened tendency to see
                                                                              emotions where there are none.
   Considering the above explanation, the results of this
study may fit with a supposed symmetric vs. left-sided                             Therefore, based on this pilot study we conclude that
asymmetric activation generated by reading in different                       it is possible that reading direction can influence the way
directions.                                                                   how we interpret and also construct our subjective
                                                                              understanding of emotions.
    Concerning gender differences, there were only two,
which were significant despite existing evidence for                            Future Research
different emotion processing between the sexes [31-33].
                                                                                 As mentioned earlier, further experiments with larger
   Women had a tendency to be faster at recognizing                           sample sizes and trial numbers are needed to be
fearful faces, which is in line with results from Han, Gao,                   conducted to validate the findings of this pilot research
Humphreys, and Ge (2008) and Hoffman et al. (2010)                            and, if sufficiently supported, develop an understanding
[31,34] as well as the theoretical assumptions of Campbell,                   on how direction of reading influences perception of
Muncer, and Bibel (2001) and Fetchenhauer and Buunk                           emotions.
(2005) [35,36], and women were better at recognizing
happy faces when reading in a TB direction while men                             In case of its verification in the future we would
were better in the same task when reading in a LR                             propose two main ideas for further research. First, we
condition.                                                                    would encourage clinical and health psychologists to
                                                                              consider whether or not reading direction may alter other
    Conclusion                                                                emotion-related processes such as emotion regulation.
                                                                              Researchers such as Johnstone and Walter (2014) [37]
   The goals of our experiment were to test whether or                        found a laterality effect in emotion regulation after
not reading could have the same effect as a unilateral                        stimulating or disrupting the dorsolateral prefrontal
physical stimulation and to test which emotion-                               cortex (dlPFC) region of the brain, which is responsible
processing model could better predict its effect. The                         for emotion regulation, through the use of electric
results could not reaffirm clearly either the VH or the RHH,                  currents. Given their results, it is possible that the
but they were in line with predictions made by the                            assumed lateralized activation patterns of the
working model of Killgore and Yurgelun-Todd (2007)                            hemispheres aroused during reading could alter emotion-
[30], where emotion processing is achieved through two                        regulation          capabilities         just          as
important initial steps. First, the right hemisphere detects                  electrostimulation/disruption does. According to Ochsner
an emotionally relevant stimulus, and second, it then                         and Gross (2014) [38], the working memory needed for
sends the stimulus to the left hemisphere where an                            reading seems to share the same dlPFC region with top-
evaluation process takes place and a valence is attached.                     down emotion-regulation functions such as attentional
In light of this, our experiment supports the idea that                       deployment, reappraisal, or expression suppression.
reading can function as a unilateral physical stimulation
and it also supports the emotion processing model                                 Second, given the vast literature on hemispheric
proposed by Killgore and Yurgelun-Todd.                                       lateralization, we believe it would be interesting to test
                                                                              whether reading direction could have any effect on other
   In this study, the Japanese participants were faster and                   cognitive systems such as iconic-propositional memory,
better at recognizing emotional stimuli (except fear)                         global-local attention, and divergent-convergent thinking,

    Vargha B and Labadi B. The Effect of Reading Direction on Emotion Recognition:                        Copyright© Vargha B and Labadi B.
    A Pilot Study. Ment Health Hum Resilience Int J 2019, 3(1): 000126.
9
                                      Mental Health & Human Resilience International Journal
It is very likely that results from future research will vary                 6.     Pollatsek A, Bolozky S, Well AD, Rayner K (1981)
and its almost certain that it will take many time and                               Asymmetries in the perceptual span for Israeli
work until we fully understand how the direction of                                  readers. Brain and Language 14(1): 174-180.
reading affects us. Nevertheless, it is undeniable
according to this pilot study that in some way reading                        7.     Brysbaert M (1994) Interhemispheric transfer and
direction influences emotion recognition and we believe                              the processing of foveally presented stimuli.
it’s worth researching.                                                              Behavioural Brain Research 64(1-2): 151-161.

                                                                              8.     O'Regan JK, Jacobs AM (1992) Optimal viewing
    Acknowledgements
                                                                                     position effect in word recognition: A challenge to
    I would like to give my most honest thanks to Junko                              current theory. Journal of Experimental Psychology:
Momoi and to my brother who both helped me a lot in                                  Human Perception and Performance 18(1): 185-197.
making this experiment become a reality. Without them it
                                                                              9.     Van der Haegen L, Drieghe D, Brysbaert M (2010) The
would have been impossible for me to do this research in
                                                                                     split fovea theory and the Leicester critique: What do
Japan. I would also like to thank my family and my
                                                                                     the data say?. Neuropsychologia 48(1): 96-106.
colleague Dr. Beatrix Labadi for their continuous support,
advice and patience during the writing phase of this                          10. Nazir TA, Ben-Boutayab N, Decoppet N, Deutsch A,
article. Finally, I would like to thank everyone with whom                        Frost R (2004) Reading habits, perceptual learning,
I got in touch with and provided me with support both                             and recognition of printed words. Brain and Language
professionally and emotionally in this past few years                             88(3): 294-311.
while I was working on this paper.
                                                                              11. Wong YK, Hsiao JH (2012) Reading direction is
    Statement                                                                     sufficient to account for the optimal viewing position
                                                                                  in reading: The case of music reading. In: N Miyake, et
   I hereby ensure that the work described has been                               al. (Eds.), Processing of the 34th Annual Conference of
carried out in accordance with The Code of Ethics of the                          the Cognitive Science Society, Austin, TX: Cognitive
World Medical Association (Declaration of Helsinki).                              Science Society, Pp: 2540-2545.

    References                                                                12. Baijal S, Srinivasan N (2011) Emotional and
                                                                                  hemispheric asymmetries in shifts of attention: An
1.     Schiff BB, Lamon M (1989) Inducing emotion by                              ERP study. Cognition and Emotion 25(2): 280-294.
       unilateral contraction of facial muscles: A new look at
       hemispheric specialization and the experience of                       13. Davidson RJ, Mednick D, Moss E, Saron C, Schaffer CE
       emotion. Neuropsychologia 27(7): 923-935.                                  (1987) Ratings of emotion in faces are influenced by
                                                                                  the visual field to which stimuli are presented. Brain
2.     Schiff BB, Lamon M (1994) Inducing emotion by                              Cognition 6(4): 403-411.
       unilateral contraction of hand muscles. Cortex 30(2):
       247-254.                                                               14. Jansari A, Rodway P, Goncalves S (2011) Identifying
                                                                                  facial emotions: Valence specific effects and an
3.     Ellis AW, Brysbaert M (2010) Split fovea theory and                        exploration of the effects of viewer gender. Brain and
       the role of the two cerebral hemispheres in reading: A                     Cognition 76(3): 415-423.
       review of the evidence. Neuropsychologia 48(2): 353-
       365.                                                                   15. Gainotti G (1972) Emotional behavior and
                                                                                  hemispheric side of the lesion. Cortex 8(1): 41-55.
4.     Jordan TR, Paterson KB (2009) Re-evaluating split-
       fovea processing in visual word recognition: A critical                16. Levy J, Heller W, Banich MT, Burton LA (1983)
       assessment of recent research. Neuropsychologia                            Asymmetry of perception in free viewing of chimeric
       47(12): 2341-2353.                                                         faces. Brain Cognition 2(4): 404-419.

5.     Van der Haegen L (2012) Visual word recognition in                     17. Torro-Alves N, Sousa JPMD, Fukusima SS (2011)
       the fovea (Unpublished doctoral dissertation). Ghent                       Hemispheric asymmetries on the perception of facial
       University, Belgium.                                                       expressions: A divided visual field study. Psicologia
                                                                                  USP 22(1): 181-196.

    Vargha B and Labadi B. The Effect of Reading Direction on Emotion Recognition:                          Copyright© Vargha B and Labadi B.
    A Pilot Study. Ment Health Hum Resilience Int J 2019, 3(1): 000126.
10
                                       Mental Health & Human Resilience International Journal
 18. Schiff BB, Rump SA (1995) Asymmetrical hemispheric                               autism. Journal of Child Psychology and Psychiatry
     activation and emotion: The effects of unilateral                                42(2): 241-251.
     forced nostril breathing. Brain and Cognition 29(3):
     217-231.                                                                  29. Stevenson MT, Soto JA, Adams RB Jr (2012) More
                                                                                   than meets the eye: The role of self-identity in
 19. Bassel C, Schiff BB (2001) Unilateral vibrotactile                            decoding complex emotional states. Emotion 12(5):
     stimulation induces emotional biases in cognition and                         882-886.
     performance. Neuropsychologia 39(3): 282-287.
                                                                               30. Killgore WD, Yurgelun-Todd DA (2007) The right-
 20. Kajii N, Osaka N (2000) Optimal viewing position in                           hemisphere and valence hypotheses: Could they both
     vertically and horizontally presented Japanese words.                         be right (and sometimes left)?. Social Cognitive &
     Perception & Psychophysics 62(8): 1634-1644.                                  Affective Neuroscience 2(3): 240-250.

 21. Demaree HA, Everhart DE, Youngstrom EA, Harrison                          31. Hoffmann H, Kessler H, Eppel T, Rukavina S, Traue HC
     DW (2005) Brain lateralization of emotional                                   (2010) Expression intensity, gender and facial
     processing: Historical roots and a future                                     emotion recognition: Women recognize only subtle
     incorporating “dominance.” Behavioral and Cognitive                           facial emotions better than men. Acta Psychol 135(3):
     Neuroscience Reviews 4(1): 3-20.                                              278-283.

 22. Fusar-Poli P, Placentino A, Carletti F, Allen P, Landi P,                 32. Rodway P, Wright L, Hardie SM (2003) The valence-
     et al. (2009) Laterality effect on emotional faces                            specific laterality effect in free viewing conditions:
     processing: ALE meta-analysis of evidence.                                    The influence of sex, handedness, and response bias.
     Neuroscience Letters 452(3): 262-267.                                         Brain and Cognition 53(3): 452-463.

 23. Harmon-Jones E, Allen JJB (1998) Anger and frontal                        33. Van Strien JW, Van Beek S (2000) Ratings of emotion
     brain activity: EEG asymmetry consistent with                                 in laterally presented faces: sex and handedness
     approach motivation despite negative affective                                effects. Brain and Cognition 44(3): 645-652.
     valence. Journal of Personality and Social Psychology
     74(5): 1310-1316.                                                         34. Han S, Gao X, Humphreys GW, Ge J (2008) Neural
                                                                                   processing of threat cues in social environments.
 24. Harmon-Jones E, Sigelman JD, Bohlig A, Harmon-                                Human brain mapping 29(8): 945-957.
     Jones C (2003) Anger, coping, and frontal cortical
     activity: The effect of coping potential on anger-                        35. Campbell A, Muncer SJ, Bibel D (2001) Women and
     induced left frontal activity. Cogn Emot 17(1): 1-24.                         crime: An evolutionary approach. Aggression and
                                                                                   Violent Behavior 6(5): 481-497.
 25. Harmon-Jones E, Vaughn-Scott K, Mohr S, Sigelman J,
     Harmon-Jones C (2004) The effect of manipulated                           36. Fetchenhauer D, Buunk BP (2005) How to explain
     sympathy and anger on left and right frontal cortical                         gender differences in fear of crime: Towards an
     activity. Emotion 4(1): 95-101.                                               evolutionary approach. Sexualities Evolution &
                                                                                   Gender 7(2): 95-113.
 26. Lyons M J, Akamatsu S, Kamachi MG, Gyoba J (1998)
     Coding facial expressions with Gabor wavelets.                            37. Johnstone T, Walter H (2014) The neural basis of
     Proceedings of the Third International Conference on                          emotion dysregulation. In: James J Gross (Eds.),
     Automatic Face and Gesture Recognition: 200-205.                              Handbook of Emotion Regulation 2nd (edn), The
                                                                                   Guilford Press, New York, pp: 58-75.
 27. Adams RB Jr, Rule NO, Franklin RG Jr, Wang E,
     Stevenson MT, et al. (2010) Cross-cultural reading the                    38. Ochsner KN, Gross JJ (2014) The neural bases of
     mind in the eyes: An fMRI investigation. J Cogn                               emotion and emotion regulation: A valuation
     Neurosci 22(1): 97-108.                                                       perspective. In: James J Gross (Eds.), Handbook of
                                                                                   Emotion Regulation 2nd (edn), The Guilford Press,
 28. Baron-Cohen S, Wheelwright S, Hill J, Raste Y, Plumb I                        New York, pp: 23-42.
     (2001) The “Reading the Mind in the Eyes” test
     revised version: A study with normal adults, and
     adults with Asperger syndrome or high-functioning

     Vargha B and Labadi B. The Effect of Reading Direction on Emotion Recognition:                         Copyright© Vargha B and Labadi B.
     A Pilot Study. Ment Health Hum Resilience Int J 2019, 3(1): 000126.
You can also read