Don Norman November 26, 2010
Why Design Education Must Change 1
WHY DESIGN EDUCATION MUST CHANGE
DONALD A. NORMAN1
Traditionally what designers lack in knowledge, they make up
for in craft skills. Whether it be sketching, modeling, detailing
or rendering, designers take an inordinate amount of pride in
honing key techniques over many years. Unfortunately many of
these very skills have limited use in the new design domains.
(Core 77 columnist Kevin McCullagh:
(http://www.core77.com/blog/columns/is_it_time_to_rethink
_the_t-shaped_designer_17426.asp)
I am forced to read a lot of crap. As a reviewer of submissions to design
journals and conferences, as a juror of design contests, and as a mentor and
advisor to design students and faculty, I read outrageous claims made by
designers who have little understanding of the complexity of the problems they
are attempting to solve or of the standards of evidence required to make
claims. Oftentimes the crap comes from brilliant and talented people, with
good ideas and wonderful instantiations of physical products, concepts, or
simulations. The crap is in the claims.
In the early days of industrial design, the work was primarily focused upon
physical products. Today, however, designers work on organizational structure
and social problems, on interaction, service, and experience design. Many
problems involve complex social and political issues. As a result, designers have
become applied behavioral scientists, but they are woefully undereducated for
the task. Designers often fail to understand the complexity of the issues and
the depth of knowledge already known. They claim that fresh eyes can produce
novel solutions, but then they wonder why these solutions are seldom
implemented, or if implemented, why they fail. Fresh eyes can indeed produce
insightful results, but the eyes must also be educated and knowledgeable.
Designers often lack the requisite understanding. Design schools do not train
students about these complex issues, about the interlocking complexities of
human and social behavior, about the behavioral sciences, technology, and
business. There is little or no training in science, the scientific method, and
experimental design.
Related problems occur with designers trained in engineering, for although
they may understand hard-core science, they are often ignorant of the so-
called soft areas of social and behavioral sciences. The do not understand
human behavior, chiding people for not using technology properly, asking how
they could be so illogical. (You may have all heard the refrain: “if only we
didn’t have people, our stuff would work just fine,” forgetting that the point of
1 Donald A. Norman. http://www.jnd.org email to: don at jnd.org. Column written for posting at
core77.com
Don Norman November 26, 2010
Why Design Education Must Change 2
the work was to help people.) Engineers are often ignorant of how people
actually behave. And both engineers and designers are often ignorant of the
biases that can be unwittingly introduced into experimental designs and the
dangers of inappropriate generalization.
The social and behavioral sciences have their own problems, for they generally
are disdainful of applied, practical work and their experimental methods are
inappropriate: scientists seek “truth” whereas practitioners seek “good
enough.” Scientists look for small differences, whereas designers want large
impact. People in human-computer interaction, cognitive engineering, and
human factors or ergonomics are usually ignorant of design. All disciplines have
their problems: everyone can share the blame.
Time to change design education
Where once industrial designers focused primarily upon form and function,
materials and manufacturing, today’s issues are far more complex and
challenging. New skills are required, especially for such areas as interaction,
experience, and service design. Classical industrial design is a form of applied
art, requiring deep knowledge of forms and materials and skills in sketching,
drawing, and rendering. The new areas are more like applied social and
behavioral sciences and require understanding of human cognition and
emotion, sensory and motor systems, and sufficient knowledge of the scientific
method, statistics and experimental design so that designers can perform valid,
legitimate tests of their ideas before deploying them.
Designers need to deploy microprocessors and displays, actuators and sensors.
Communication modules are being added to more and more products, from the
toaster to the wall switch, the toilet and books (now called e-books).
Knowledge of security and privacy, social networks, and human interaction are
critical. The old skills of drawing and sketching, forming and molding must be
supplemented and in many cases, replaced, by skills in programming,
interaction, and human cognition. Rapid prototyping and user testing are
required, which also means some knowledge of the social and behavior
sciences, of statistics, and of experimental design.
In educational institutions, industrial design is usually housed in schools of art
or architecture, usually taught as a practice with the terminal degree being a
BA, MA, or MFA. It is rare for in design education to have course requirements
in science, mathematics, technology, or the social sciences. As a result the
skills of the designer are not well suited for modern times.
The Uninformed Are Training the Uninformed
My experience with some of the world’s best design schools in Europe, the
United States, and Asia indicate that the students are not well prepared in the
behavioral sciences that are so essential for fields such as interaction and
experience design. They do not understand experimental rigor or the potential
biases that show up when the designer evaluates their own products or even
their own experimental results. Their professors also lack this understanding.
Designers often test their own designs, but with little understanding of
statistics and behavioral variability. They do not know about unconscious biases
Don Norman November 26, 2010
Why Design Education Must Change 3
that can cause them to see what they wish to see rather than what actually has
occurred. Many are completely unaware of the necessity of control groups. The
social and behavioral sciences (and medicine) long ago learned the importance
of blind scoring where the person scoring the results does not know what
condition is being observed, nor what is being tested.
The problem is compounded by a new insistence by top research universities
that all design faculty have a PhD degree. But given the limited training of
most design faculty, there is very little understanding of the kind of knowledge
that constitutes a PhD. The uninformed are training the uninformed.
There are many reasons for these difficulties. I’ve already discussed the fact
that most design is taught in schools of art or architecture. Many students take
design because they dislike science, engineering, and mathematics.
Unfortunately, the new demands upon designers do not allow us the luxury of
such non-technical, non science-oriented training.
A different problem is that even were a design school to decide to teach more
formal methods, we don’t really have a curriculum that is appropriate for
designers. Take my concern about the lack of experimental rigor. Suppose you
were to agree with me – what courses would we teach? We don’t really know.
The experimental methods of the social and behavioral sciences are not well
suited for the issues faced by designers.
Designers are practitioners, which means they are not trying to extend the
knowledge base of science but instead, to apply the knowledge. The designer’s
goal is to have large, important impact. Scientists are interested in truth, often
in the distinction between the predictions of two differing theories. The
differences they look for are quite small: often statistically significant but in
terms of applied impact, quite unimportant. Experiments that carefully control
for numerous possible biases and that use large numbers of experimental
observers are inappropriate for designers.
The designer needs results immediately, in hours or at possibly a few days.
Quite often tests of 5 to 10 people are quite sufficient. Yes, attention must be
paid to the possible biases (such as experimenter biases and the impact of
order of presentation of tests), but if one is looking for large effect, it should
be possible to do tests that are simpler and faster than are used by the
scientific community will suffice. Designs don’t have to be optimal or perfect:
results that are not quite optimum or les than perfect are often completely
satisfactory for everyday usage. No everyday product is perfect, nor need they
be. We need experimental techniques that recognize these pragmatic, applied
goals.
Design needs to develop its own experimental methods. They should be simple
and quick, looking for large phenomena and conditions that are “good enough.”
But they must still be sensitive to statistical variability and experimental
biases. These methods do not exist: we need some sympathetic statisticians to
work with designers to develop these new, appropriate methods.
Don Norman November 26, 2010
Why Design Education Must Change 4
When Designers Think They Know, But Don’t
Designers fall prey to the two ailments of not knowing what they don’t know
and, worse, thinking they know things they don’t. This last condition is
especially true when it comes to human behavior: the cognitive sciences.
Designers (and engineers) think that they understand human behavior: after
all, they are human and they have observed people all their lives. Alas, they
believe a “naive psychology”: plausible explanations of behavior that have little
or no basis in fact. They confuse the way they would prefer people to behave
with how people actually behave. They are unaware of the large experimental
and theoretical literature, and they are not well versed in statistical
variability.
Real human behavior is very contextual. It is readily biased by multiple factors.
Human behavior is driven by both emotional and cognitive processes, much of
which is subconscious and not accessible to human conscious knowledge. Gaps
and lapses in attention are to be expected. Human memory is subject to
numerous biases and errors. Different memory systems have different
characteristics. Most importantly, human memory is not a calling up of images
of the past but rather a reconstruction of the remembered event. As a result, it
often fits expectations more closely than it fits reality and it is easily modified
by extraneous information.
Many designers are woefully ignorant of the deep complexity of social and
organizational problems. I have seen designers propose simple solutions to
complex problems in education, poverty, crime, and the environment.
Sometimes these suggestions win design prizes (the uniformed judge the
uninformed). Complex problems are complex systems: there is no simple
solution. It is not enough to mean well: one must also have knowledge.
The same problems arise in doing experimental studies of new methods of
interaction, new designs, or new experiences and services. When scientists
(and designers) study people, they too are subject to these same human biases,
and so cognitive scientists carefully design experiments so that the biases of
the experimenter can have no impact on the results or their interpretation. All
these factors are well understood by cognitive scientists, but seldom known or
understood by designers and engineers. Here is a case of not knowing what is
not known.
Why Designers Must Know Some Science
Over the years, the scientific method evolved to create order and evaluation to
otherwise exaggerated claims. Science is not a body of facts, not the use of
mathematics. Rather, the key to science is its procedures, or what is called the
scientific method. The method does not involve white robes and complex
mathematics. The scientific method requires public disclosure of the problem,
the method of approach, the findings, and then the interpretation. This allows
others to repeat the finding: replication is essential. Nothing is accepted in
science until others have been able to repeat the work and come to the same
conclusion. Moreover, scientists have learned to their dismay that conclusions
are readily biased by prior belief, so experimental methods have been devised
to minimize these unintentional biases.
Don Norman November 26, 2010
Why Design Education Must Change 5
Science is difficult when applied to the physical and biological world. But when
applied to people, the domain of the social sciences, it is especially difficult.
Now subtle biases abound, so careful statistical procedures have been devised
to minimize them. Moreover, scientists have learned not to trust themselves,
so in the social sciences it is sometimes critical to design tests so that neither
the person being studied nor the person doing the study know what condition is
involved – this is called “double blind.”
Designers, on the whole, are quite ignorant of all this science stuff. They like
to examine a problem, devise what seems to be a solution, and then announce
the result for all to acclaim. Contests are held. Prizes are awarded. But wait–
has anyone examined the claims? Tested them to see if they perform as
claimed? Tested them against alternatives (what science calls control groups),
tested them often enough to minimize the impact of statistical variability?
Huh? say the designers: Why, it is obvious – just look – What is all this statistical
crap?
Journals do not help, for most designers are practitioners and seldom publish.
And when they do, I find that the reviewers in many of our design journals and
conferences are themselves ignorant of appropriate experimental procedures
and controls, so even the published work is often of low quality. Design
conferences are particularly bad: I have yet to find a design conference where
the rigor of the peer review process is satisfactory. The only exceptions are
those run by societies from the engineering and sciences, such as the
Computer-Human Interaction and graphics conferences run by the Institute of
Electronic and Electrical Engineers or the Computer Science society (IEEE, ACM
and the CHI and SIGGRAPH conferences). These conferences, however, favor
the researcher, so although they are favorite publication vehicles for design
researchers and workers in interaction design, practitioners often find their
papers rejected. The practice of design lacks a high quality venue for its
efforts.
Design Education Must Change
Service design, interaction design, and experience design are not about the
design of physical objects: they require minimal skills in drawing, knowledge of
materials, or manufacturing. In their place, they require knowledge of the
social sciences, of story construction, of back-stage operations, and of
interaction. We still need classically trained industrial designers: the need for
styling, for forms, for the intelligent use of materials will never go away.
In today’s world of ubiquitous sensors, controllers, motors, and displays, where
the emphasis is on interaction, experience, and service, where designers work
on organizational structure and services as much as on physical products, we
need a new breed of designers. This new breed must know about science and
technology, about people and society, about appropriate methods of validation
of concepts and proposals. They must incorporate knowledge of political issues
and business methods, operations, and marketing. Design education has to
move away from schools of art and architecture and move into the schools of
science and engineering. We need new kinds of designers, people who can work
across disciplines, who understand human beings, business, and technology and
the appropriate means of validating claims.
Don Norman November 26, 2010
Why Design Education Must Change 6
Today’s designers are poorly trained to meet the today’s demands: We need a
new form of design education, one with more rigor, more science, and more
attention to the social and behavioral sciences, to modern technology, and to
business. But we cannot copy the existing courses from those disciplines: we
need to establish new ones that are appropriate to the unique requirements of
the applied requirements of design.
But beware: We must not lose the wonderful, delightful components of design.
The artistic side of design is critical: to provides objects, interactions and
services that delight as well as inform, that are joyful. Designers do need to
know more about science and engineering, but without becoming scientists or
engineers. We must not lose the special talents of designers to make our lives
more pleasurable.
It is time for a change. We, the design community, must lead this change.
View publication statsView publication stats
https://www.researchgate.net/publication/235700801
Post
at least five
substantive notes
Substantive is as much about quality as quantity – you can ask questions, make connections to other things you’ve read or seen, or expand upon the author’s ideas. Your annotations should average around 50-75 words each.