Dr Eamon Fulcher
now browsing by tag
The role of working memory in intentions to purchase: A case study on menu design
Of all the marketing decisions that fast food restaurants face, the design of the menu is not often thought to be the most important. Yet, the constraints on the design of a menu are numerous and often pull in opposite directions. A menu has to (1) display the range of meals on offer, including starters, mains, side dishes, desserts, and drinks, (2) arrange items in categories (e.g., meat versus fish dishes, vegetarian options, kids deals, etc), (3) display the name of the item and a short description, (4) display quantity and price, (5) display dietary information, such as the number of calories, relevant to specific allergies, and so on. It also needs to be clear enough to direct attention to ‘favourites’ or a ‘meal-of-the-day’, to be easy to read, such that one can find something at-a-glance, to convey the brand values, and after all this is needs to be visually pleasing.
One has to balance the desire for the menu to look appealing while at the same time display sufficient information to meet the needs of different customers. The danger is on the one hand creating something that looks like a beautiful work of art but which conveys too little, while on the other hand presenting something that looks like an Excel spreadsheet.
When a menu contains too much information, it puts a significant strain on decision making
We were recently commissioned by a fast food company in the US to evaluate several menu designs that could meet this challenge. This is a fast food chain that is especially popular during lunchtimes and among local office workers, where most purchases are takeaways. According to the brief, one of the key problems was the build-up of a queue backlog during peak times. This was not necessarily due to shortage of staff or slowness of the delivery process, but more often caused by the amount of time it took customers to choose their meal. So the solution was to design a new menu board that would cover all of the needs described above, but at the same time help customers in the queue make quicker decisions. The creative team produced six main design themes, based firstly on aesthetics and then on the information conveyed through different kinds of layouts.
To evaluate the visual appeal of the designs we applied our IMPRESS platform, which was designed to deploy and analyse implicit reaction time tests rapidly. This test is used to provide a profile of a design based on a range of attributes, and in this case 30 relevant attributes. By careful selection of attributes it is possible to identify the strengths and weaknesses of a design (and how well each delivers the brand’s values) without directly asking respondents. As has been well documented elsewhere, traditional methods of gathering consumer evaluations over-rely on subjective views and there are several problems with this. Firstly, respondents may only be consciously aware of global and generalised feelings, but not more specific feelings. It has been argued that self-knowledge is often based on trying to rationalise one’s own behaviour, rather than by having a ‘privileged access’ into one’s deeper feelings. Attitudes and feelings can hence be very difficult to identify and put into words. Secondly, respondents may try to appear consistent in their responses. This results in poor discrimination as they assign all of their positive evaluations to the brand they prefer the most and all of the negative evaluations to the brand they prefer the least. Yet in reality, consumers often feel ambivalent towards brands and without a detailed, more discriminative response, a brand will never know its genuine strengths and weaknesses. A third problem with relying on subjective methods is that respondents may deliberately try to hide their feelings. This can happen when one is asking about certain behaviours that might be embarrassing, illegal, or socially less acceptable, or even if respondents want to hide their feelings for no obvious reason other than they just do not want to divulge the information.
Done properly, implicit reaction time tests abstract how a respondent feels about the design, brand, and packaging and so on without directly asking them. By presenting words and images on the screen very rapidly and requiring a quick response, it is possible to infer how they feel towards the brand. For this project, we employed our implicit test on each design and on regular customers, lapsed customers, and considerers.
The question concerning how menu information can be presented to maximise customer decisions required us to consider a range of candidate tests. One of the advantages of employing a team of experienced psychologists and neuroscientists is that they have familiarity with a range of cognitive tests, and so they are not restricted to the set of tools most often used in neuromarketing but open to scores of tests used in academia but which can have direct use in consumer research. For this, we identified a scientifically validated test of working memory. The logic for using this test is this:
Imagine that you have entered a restaurant you have never visited before. You are in the queue, unsure what you want, but your turn to order is rapidly approaching. You look at the menu board. There are so many options…you’re studying the menu board but it looks too much like an Excel spreadsheet. You consider one option and all it has to offer (a brief description, the quantity, its price, the number of calories), and then a second, but by the time you have considered option two, you have forgotten the first. You commit to an option, it might not be your ideal, but at least you got through the ordeal.
From a psychological viewpoint, we would argue that a poorly organised menu board will put a strain on working memory. This aspect of memory deals with immediate information that needs to be stored over the short-term. Examples, would be a shopping list held in memory, or a list of drinks ordered for you and your friends you store mentally as you wait to be served at a bar. Working memory has a fixed capacity and people differ in their working memory capacity – some people can easily recall a dozen or so items in the short term, while others have problems with more than three or so. The way information is presented can also impose limits working memory. Menu boards can differ in how well they support working memory. A poorly designed memory board places severe constraints on one’s working memory capacity, leading to problems in making a decision. A well organised menu board can make use of a person’s optimal working memory capacity. While there are some general rules about how to optimise working memory, not all of these are relevant to menu board design. So the method here was to test six layouts to identify the limits of working memory capacity for each design.
Menu boards consisted of four main sections. Each section was re-created using two different designs. This means that the total number of configurations was sixteen, meaning that one could create sixteen unique menu boards from these designs. However, for the client, several of these were ruled out due certain considerations (i.e., a mix of aesthetics and functionality). Hence we tested eight configurations implicitly and in terms of their effects on working memory. After an initial pilot phase, a further two configurations were ruled out and we subsequently tested four configurations in the implicit and working memory tests.
The sample was drawn from brand-aware respondents in the US, split into regular users, occasional users and light users. They evaluated each design on 30 attributes that covered the features and benefit of the brand, in an implicit test. We were then able to provide profiles of each menu design which quantifies the strengths and weaknesses of each.
In the next phase respondents took the working memory test which was similar to the change blindness method. Images were presented in quick succession and respondents had to press one of two keys, depending upon whether they thought the image was the same or different. A correct response occurs when the respondent detect a change or correctly detects no change and indicates good working memory. An incorrect response means the change was either missed or thought to be present when it wasn’t (false alarm) and indicates poor working memory.
For each menu element, we computed the probability of correct recall, hence in our data we had recall scores for 1, 2, and 3 items for each menu design, as well as an overall recall score for each design. Results for all sample (weighted), see below. The data shows that even when there is only one item, responses are not 100% correct, reflecting the difficulty of memorising menu items in the short term. This ability declines when there are two items, and falls even further with three items. In fact, for Menu Boards 4 and 6, recall is less than 50% with three items. Menu Boards 1 and 3 were significantly better in aiding working memory. Looking at the implicit data, Menu Board 6 was very clearly least able to deliver the brand values, whereas as Menu Boards 3 and 4 strongly delivered brand values around health and customer service, as well as purchase intent and advocacy, with menu Board 1 lagging behind these two.
Results of the working memory test. Probability of correct recall for each menu board containing 1, 2 or 3 menu items.
Results of the implicit test. Implicit association scores computed as an Association Index (%).
An important insight here is that a menu board design that visually delivers brand values may not be the best in terms of being easy to use at a functional level. If one wishes to prefer the design that is most congruent with the brand values then one could choose Menu Board 3 or 4. However, Menu Board 1 clearly works better at optimising working memory. Menu Board 3 may be the preferred option since it balances both constraints.
Further analysis revealed differences in both tests between males and females, between customers with varying frequency of visit, and between different age groups. For example, and as expected, the older group performed worse on the working memory test and the youngest group performed the best. It was interesting to note that high frequency visitors performed less well on the working memory test than did low frequency visitors, which is surprising given their greater familiarity (presumably) with the menu items. However, this may even be a symptom of the difficulties the company were having with the previous design, meaning that due to the difficulties in choosing from the menu, high frequency customers may habitually buy the same option. The more optimal design may therefore encourage their loyal customers to explore the range of options being offered.
Armed with this information, the company then chose the top design in the knowledge that it can drive the brand image whilst at the same time working as a functional, easier to use menu board. In addition, the company used the data gathered to optimise the design further by using learnings regarding individual components of the full set of designs.
The study shows what can be achieved by using a combination of objective psychological tests. Rather than simply invite consumers to state their preferences, these methods allow us to dig deeper and find a more optimal solution. The research shows that the many constraints put on menu design need to be researched objectively if the menu is to deliver its purpose effectively.
Of course, working memory is involved in many consumer activities, not just studying a menu. It is at work on the shelf in the supermarket, in fact in any shopper situation where comparisons of goods or offers are being made. Working memory is the hub through which all sensory stimuli are processed and integrated (consciously and unconsciously) with knowledge, beliefs, and intuitions. Its role in consumer psychology has only very recently been a subject of academic research. For brands, researching how their products are stored in working memory and how accessible they are, is crucial for a deeper understanding of the decisions made at various touchpoints, especially the intention to make a purchase.
Dr Eamon Fulcher, May 2019
Featured image by Waqas Saeed @waqart
in-cosmetics formulation summit
Dr Eamon Fulcher presented at the in-cosmetics formulation summit, London October 24, 2018
In its fourth year, the in-cosmetics Formulation Summit is an education-focused convention, that captures the strongest trends driving the industry.
This year it included a number of leading international experts for the benefit of R&D professionals, senior formulators, and decision makers from cosmetics brands, manufacturers and ingredient suppliers.
Dr Eamon Fulcher talked about how the brain rapidly evaluates all that we see, hear, smell, touch, and taste. Faces are a special case, because a significant proportion of the brain is dedicated to face recognition, hence we can recognise faces with incredible accuracy, distinguish between subtle variations in facial expression, and evaluate them very quickly on an array of important attributes. One of these is attractiveness. Evolutionary psychologists have argued that our biological imperative is to protect and propagate our genes. We can do this through reproduction and by searching for a healthy mate. This is important because our genes are more likely to survive if we partner with a healthy mate. Beauty becomes a proxy for health. The use of make-up to try to make oneself look more beautiful has been going on for at least seven thousand years, and can be traced back to the Egyptians and the ancient Greeks.
More recently, psychologists have established that the more beautiful a person is (or appears to be) the more likely they are to be perceived more positively on an array of desirable attributes, such as emotionally secure, sociable, interesting, confident, organised, popular, and intelligent (to name just a few). This is termed the halo effect, and works even when we see the same person with and without make-up. Even though we know they are the same person (and we know that personal attributes are pretty much stable), we can’t help but attribute these positive features to them when they appear more attractive. Even babies have been shown to prefer more attractive faces. It’s not surprising then that most of us would like to be perceived as attractive by most or at least some people! These ideas can help explain why the cosmetics industry is so huge.
One problem for cosmetic scientists is that sooner or later they will need to do some consumer testing on their beauty products. Here they meet the truth gap – people don’t always tell you how they truly feel (they may want just to please you or they may want to hide how they feel), people can’t always say how they feel (they can’t easily put into words how they feel or their feelings may be in their subconscious), and they don’t always do what they say they are going to do (like signing up for the gym on the 1st of January and never going again!). If one’s market research is based only on what consumers verbally tell us (subjective reports), then we are not going to get a true picture of the likely success of our products.
One way to circumvent this problem is to use a more objective method, and one that does not rely on asking questions to obtain explicit responses. Implicit reaction time tests offer a valuable tool to accompany traditional quantitative surveys. Implicit reaction time tests can detect the associations that consumers have with brand names, product endorsers, cosmetics packaging, new formulations, fragrances, and more.
During the talk, Eamon demonstrated how implicit testing, coupled with neural network technology (a form of artificial intelligence or deep learning), can help model consumer perception of the brand or product (or any formula or proposition). Hence one can build a neural network model of the brand or product. A model that represents how consumers perceive and feel. This can yield insights that really help identify the strengths, weaknesses, opportunities, and threats for the stimulus being tested, and in relation to other formulations and those of competitors.
Our Research for ITV Published
Our research for ITV revealed how positive younger viewers (Bright Young Things) are to adverts on view-on-demand TV. Ads were perceived as trusted, relevant, and high quality.
Download the pdf from itvmedia.co.uk
https://www.itvmedia.co.uk/index.php/download_file/force/5499/6527/
Dr Eamon Fulcher
Featured picture by Jens Kreuter @jenskreuter
How do respondents feel after taking an implicit reaction time survey?
We always like to finish a survey by asking respondents their experiences of the implicit elements of the survey. These are the themes that come from their responses.
1. Fun and engaging
“Fun to do”, “send me more”, “loved it”, “excellent”, “entertaining and friendly”, “a good experience”, “cool and enjoyable”, “interactive, “innovative”, “unique”, “a nice twist”, “like playing a game”, “aroused my curiosity”.
When respondents find a survey interesting and engaging, they are more likely to offer their true feelings.
2. Better than taditional surveys
“Not too wordy”, “less overwhelming and tiring”, “better than most surveys”, “better than multiple-choice questions”, “doesn’t beat about the bush”, “not too long”, “unlike open-ended questions, which are hard”.
Traditional surveys can be very lengthy and demanding, and hence less engaging.
3. I don’t understand how it works
“I didn’t understand the purpose”, “I don’t understand what it does”, “what was the point?”.
When respondents can’t work out exactly what you are asking, they have no incentive or opportunity to fake their responses.
4. It was quick
“It was very fast”, “not too long”, “reasonable length”, “easy to do”, “not difficult”, “short and sweet”, “more like this please”.
Implicit reaction time tests/surveys are quick and easy to do. This makes them easier to recruit respondents than lengthier, traditional surveys.
Update 18th Septemrber 2109
In our most recent survey, 80% thought the implicit element was enjoyable or very enjoyable.
For many, the survey was innovative and different, it was not the usual kind of survey and hence a ‘nice alternative’ and for some ‘all surveys should be in this format’.
Getting insights from data – getting to the “why?”
When you ask consumers about your products, make sure you are using the correct research method.
You may have read about the now famous story of Herman Miller’s Aeron office chair. He developed the chair through the cycle of development, market research, more development, more market research, and so on. Finally, deciding on the design we see now. His research focussed on asking consumers two questions (1) please rate the chair on comfort and (2) please rate the chair on aesthetics. His plan was to use the design which received the highest ratings on both. The trouble was that any design he created got very low ratings on both, even though in his mind he thought he had designed the perfect office chair. Notwithstanding this poor consumer feedback, he went to market…and it became the top selling office chair!
The moral of the story? When you ask someone to rate something new, if it is not simple and obvious or they really can’t verbalise how they feel, they will say they don’t like it. Often consumers will choose the least sophisticated option when they are forced to say why they like it.
The psychologist Tim Wilson has carried out a lot of research showing that when people say they actually like something they often make up a story – an explanation that has no resemblance to reality (in a typical experiment it is the manipulation that determined the liking rather than the story the participant made up). Infact, Tim Wilson has shown that people actually have very poor insights into their own inner worlds – he argues that we are strangers to ourselves.
Consumer Insights – Beyond Liking
To yield more effective consumer insights, we need to go beyond what is immediately visible and dig deeper. We need to examine why the consumer is doing what they are doing in their own world. Insights that are fresh, true, targeted and actionable are those we need to develop.
Split Second’s Implicit research methods go beyond liking. They seek to ask why a consumer prefers this brand, product, or packaging rather than that brand, product or packaging. It can tell us why and how one piece of advertising creative will work on one target audience but not another demographic. Split second’s implicit conusmer testing is able to characterise the feelings the consumer has towards the products, going much deeper than simple liking and disliking. The method is very consumer focussed and bypasses those biases that can influence verbal responses. Split second’s implicit tests are very difficult to fake, hence they provide a pure read-out of consumers’ feelings.
New product development should be cyclical: design the concept, test the market, design the prototype, test the market, develop several design options and test the market. Before implicit technology, this was a slow process, but now with the aid of our IMPRESS platform this product development cycle becomes a reality. We can turn around results in 48 hours, so your development team can get on with the business of optimising the product.
Dr Eamon Fulcher