Text/image interaction
The ways words and pictures share the meaning of a page: from repeating the same thing to expanding each other, telling different things, or contradicting each other.
What problem it addresses
It explains why an illustrated page can say more than its text, or something different. When illustrating, design decides which part of the message the picture carries and which part the words carry.
An example
An illustrative example: the same sentence, “Ana says she isn’t scared,” with two different drawings.
With the same words, the second page tells another story: Ana is putting on a brave face. Whoever looks finds out from the drawing, not from the text.
Why it happens
The text tells one part, what is read or heard.
The picture tells another, what is seen on the page.
The reader puts the two together and fills the gap or notices the clash between them.
Applications in design
Use it like this
Before illustrating, mark what the text already says and decide what the picture will do: repeat it, expand it, or tell something else.
Avoid
Letting the picture contradict the text by accident: one changed detail confuses whoever is looking.
Don’t fall for it
If you want the picture to contradict the text, leave clear clues so it reads as intentional.
17% and 33%
What the research says
Share of eye fixations that landed on the print while reading picturebooks: preschoolers and adults, measured with eye tracking (An, Wang and Sun, 2017).
Debated evidence. Evans and Saint-Aubin (2005) had already found that, while an adult reads aloud, preschoolers barely look at the print. For them, the picture is almost the whole page.
Connections
Related to
Authors and works
- 2000
Maria Nikolajeva and Carole Scott
Sorted the relationships between words and pictures in picturebooks: symmetrical, enhancing, complementary, counterpointing, and contradictory.
- 2017
An, Wang and Sun
Used eye tracking to measure how much children and adults look at print and at pictures when reading picturebooks.
Sources
Original sources
- Nikolajeva, M., & Scott, C. (2000). The dynamics of picturebook communication. Children’s Literature in Education, 31(4), 225–239.
- An, L., Wang, Y., & Sun, Y. (2017). Reading words or pictures: Eye movement patterns in adults and children differ by age group and receptive language ability. Frontiers in Psychology, 8, 791. View source: An, L., Wang, Y., & Sun, Y. (2017)
- Evans, M. A., & Saint-Aubin, J. (2005). What children are looking at during shared storybook reading. Psychological Science, 16(11), 913–920. View source: Evans, M. A., & Saint-Aubin, J. (2005)
Last reviewed: