Two Questions….Lots of Insights: Turn Customer Experience Observations into Valuable Insight
Customer experience researchers are constantly looking for ways to make their observations relevant, to turn observations into insight. Observing a behavior or service attribute is one thing, linking observations to insight that will maximize return on customer experience investments is another. One way to link customer experience observations to insights that will drive ROI is to explore the influence of customer experience attributes to key business outcomes such as loyalty and wallet share.
The first step is to gather impressions of a broad array of customer experience attributes, such as: accuracy, cycle time, willingness to help, etc. Make this list as long as you reasonably can without making the survey instrument too long.
For additional thoughts on survey length and research design, see the following blog posts:
Click Here: Maximizing Response Rates: Get Respondents to Complete the Survey
Click Here: Keys to Customer Experience Research Success – Start with the Objectives
The next step is to explore the relationship of these service attributes to loyalty and share of wallet.
Two Questions – Lots of Insight
In our experience, two questions: a “would recommend” and primary provider question, yield valuable insight into the relative importance of specific service attributes. Together, these two questions form the foundation of a two-dimensional analytical framework to determine the relative importance of specific service attributes in driving loyalty and wallet share.
Loyalty Question
Research has determined the business attribute with the highest correlation to profitability is customer loyalty. Customer loyalty lowers sales and acquisition costs per customer by amortizing these costs across a longer lifetime – leading to some extraordinary financial results.
Measuring customer loyalty in the context of a survey is difficult. Surveys best measure attitudes and perceptions. Loyalty is a behavior not an attitude. Survey researchers therefore need to find a proxy measurement to determine customer loyalty. A researcher might measure customer tenure under the assumption that length of relationship predicts loyalty. However, customer tenure is a poor proxy. A customer with a long tenure may leave, or a new customer may be very satisfied and highly loyal.
Likelihood of referral captures a measurement of the customer’s likelihood to refer a brand to a friend, relative or colleague. It stands to reason, if one is going to refer others to a brand, they will remain loyal as well, because customers who are promoters of a brand are putting their reputational risk on the line. This willingness to put their reputational risk on the line is founded on a feeling of loyalty and trust.
Any likelihood of referral question can be used, depending on the specifics of your objectives. Kinesis has had success with both a “yes/no” question, “Would you refer us to a friend, relative or colleague?” and the Net Promoter methodology. The Net Promoter methodology asks for a rating of the likelihood of referral to a friend, relative or colleague on an 11-point (0-10) scale. Customers with a likelihood of 0-6 are labeled “detractors,” those with ratings of 7 and 8 and identified as “passive referrers,” while those who assign a rating of 9 and 10 are labeled “promoters.”
In our experience asking the “yes/no” question: “Would you refer us to a friend, relative or colleague?” produces starker differences in this two-dimensional analysis making it easier to identify which service attributes have a stronger relationship to both loyalty and engagement.
Engagement Question
Similar to loyalty, customer engagement or wallet share can lead to some extraordinary financial results. Wallet share is the percentage of what a customer spends with a given brand over a specific period of time.
Also similar to loyalty, measuring engagement or wallet share in a survey is difficult. There are several ways to measure engagement: one methodology is to use some formula such as the Wallet Allocation Rule which uses customer responses to rank brands in the same product category and employs this rank to estimate wallet share, or to use a simple yes/no primary provider question.
Methodology
Using these loyalty and engagement measures together, we can now cross tabulate the array of service attribute ratings by these two measures. This cross tabulation groups the responses into four segments: 1) Engaged & Loyal, 2) Disengaged yet Loyal, 3) Engaged yet Disloyal, 4) Disengaged & Disloyal. We can now make comparisons of the responses by these four segments to gain insight into how each of these four segments experience their relationship with the brand.
These four segments represent: the ideal, opportunity, recovery and attrition.
Ideal – Engaged Promoters: This is the ideal customer segment. These customers rely on the brand for the majority of their in category purchases and represent lower attrition risk. In short, they are perfectly positioned to provide the financial benefits of customer loyalty. Comparing attribute ratings for customers in this segment to the others will identify both areas of strength, but at the same time, identify attributes which are less important in terms of driving this ideal state, informing future decisions on investment in these attributes.
Opportunity – Disengaged Promoter: This customer segment represents an opportunity. These customers like the brand and are willing to put their reputation at risk for it. However, there is an opportunity for cross-sell to improve share of wallet. Comparing attribute ratings of the opportunity segment to the ideal will identify service attributes with the highest potential for ROI in terms of driving wallet share.
Recovery – Engaged Detractor: This segment represents significant risk. The combination of above average share of wallet, and low commitment to put their reputational risk on the line is flat out dangerous as it puts profitable share of wallet at risk. Comparing attribute ratings of customers in the recovery segment to both the ideal and the opportunity segments will identify the service attributes with the highest potential for ROI in terms of improving loyalty.
Attrition – Disengaged Detractor: This segment represents the greatest risk of attrition. With no willingness to put reputational risk on the line, and little commitment to placing share of wallet with the brand, retention strategies may be too late for them. Additionally, they most likely are unprofitable. Comparing the service attributes of customers in this segment to the others will identify elements of the customer experience which drive attrition and may warrant increased investment, as well as, elements that do not appear to matter very much in terms driving runoff, and may not warrant investment.
By making comparisons across each of these segments, researchers give managers a basis to make informed decisions about which service attributes have the strongest relationship to loyalty and engagement. Thus identifying which behaviors have the highest potential for ROI in terms of driving customer loyalty and engagement. This two-dimensional analysis is one way to turn customer experience observations into insight.
Guest Return Intent Drivers in the Restaurant Experience
The business attribute with the highest correlation to profitability is loyalty. Loyalty lowers sales and acquisition costs per guest by amortizing these costs across a longer lifetime – leading to some extraordinary financial results. However, the question remains, what service attributes drive guest loyalty?
To answer this question from a behavioral standpoint Kinesis conducted 400 restaurant mystery shops with the purpose of determining which service attributes/behaviors drive guest return intent. Forty-six service attributes were observed across five dimensions of the guest experience: environment, food & beverage quality, greeting, personal attention and timing of food and beverage delivery.
The attributes measured grouped into these five dimensions as follows:
Environment
- Table maintained appropriately throughout the meal
- Dining room clean, organized and well maintained
- Exterior building, parking lot, walkways and planters clean
- Silverware, china, glassware and your table clean
- Men’s restroom clean and stocked with supplies
- Lighting fixtures clean and working
- Lobby area clean and organized
- Menus clean and in good condition
- Women’s restroom clean and stocked with supplies
- Bar clean, organized and well maintained
- Room temperature level comfortable
Food & Beverage Quality
- Entrees presented attractively, and tasted good
- Appetizer presented attractively, and tasted good
- Drinks attractively presented, and tasted good
- Dessert presented attractively, and tasted good
Greeting
- Greeting made feel welcome
- Prompt greeting
- Staff members greet with a friendly smile as being seated
- Thanked and encouraged to visit again
- Ask specific questions about your experience upon leaving
Service: Personal Attention
- Server attentive and prompt throughout the meal
- Server discuss the beverage menu, suggest an item or ask about your preferences
- Server discuss the appetizer menu, suggest an item or ask about your preferences
- Server promote daily specials
- Host carry on a conversation as being seated
- Server discuss the beverage menu or ask about preferences
- Receive appetizer in a timely manner
- Manager engage guests in conversation
- Server smiling and enjoying time with all the guests
- Acknowledged by a server in a timely manner
- Attentive to needs while in the bar area
- Server discuss the dessert menu, suggest an item or ask about preferences
- Server knowledgeable and confident when responding to questions
- Manager present
- Server try and entice you to order their favorite appetizer(s)
- Resolve any service, food or beverage issues
Service: Timing
- Food and beverage service timed well
- Receive entrees in a timely manner
- Receive starter soup/ salad in a timely manner
- Receive appetizer in a timely manner
- Manager engage guests in conversation
- Receive drink orders in timely manner
- Receive dessert in a timely manner
- Cashed out in a timely manner
- Acknowledge and get order in a timely manner
- Drinks arrive in a timely manner
In order to determine the relationship of these attributes to return intent, Kinesis asked mystery shoppers if, based on the guest experience, they intended to return to the restaurant. This independent variable was then used as a basis for cross-tabulation to determine the frequency with which the behaviors were observed in shops with positive return intent and negative return intent.
The results of this cross tabulation is as follows:
| Environment | Shops with … | |
| Positive Return Intent | Negative Return Intent | |
| Table maintained appropriately throughout the meal | 96% | 73% |
| Dining room clean, organized and well maintained | 100% | 90% |
| Exterior building, parking lot, walkways and planters clean | 100% | 94% |
| Silverware, china, glassware and your table clean | 98% | 94% |
| Men’s restroom clean and stocked with supplies | 96% | 91% |
| Lighting fixtures clean and working | 98% | 95% |
| Lobby area clean and organized | 100% | 98% |
| Menus clean and in good condition | 99% | 97% |
| Women’s restroom clean and stocked with supplies | 93% | 92% |
| Bar clean, organized and well maintained | 99% | 98% |
| Room temperature level comfortable | 95% | 94% |
| Food & Beverage Quality | Shops with … | |
| Positive Return Intent | Negative Return Intent | |
| Entrees presented attractively, and tasted good | 98% | 58% |
| Appetizer presented attractively, and tasted good | 97% | 88% |
| Drinks attractively presented, and tasted good | 97% | 88% |
| Dessert presented attractively, and tasted good | 97% | 97% |
| Greeting | Positive Return Intent | Negative Return Intent |
| Thanked and encouraged to visit again | 95% | 63% |
| Ask specific questions about your experience upon leaving | 35% | 8% |
| Greeting made feel welcome | 93% | 70% |
| Prompt greeting | 93% | 76% |
| Staff members greet with a friendly smile as being seated | 60% | 44% |
| Service: Personal Attention | Positive Return Intent | Negative Return Intent |
| Server attentive and prompt throughout the meal | 93% | 45% |
| Server discuss the beverage menu, suggest an item or ask about your preferences | 80% | 43% |
| Server discuss the appetizer menu, suggest an item or ask about your preferences | 68% | 33% |
| Server promote daily specials | 64% | 33% |
| Host carry on a conversation as being seated | 70% | 41% |
| Server discuss the beverage menu or ask about preferences | 63% | 35% |
| Manager engage guests in conversation | 73% | 47% |
| Server smiling and enjoying time with all the guests | 97% | 73% |
| Acknowledged by a server in a timely manner | 96% | 73% |
| Attentive to needs while in the bar area | 92% | 72% |
| Server discuss the dessert menu, suggest an item or ask about preferences | 81% | 65% |
| Acknowledge and get order in a timely manner | 94% | 80% |
| Server knowledgeable and confident when responding to questions | 98% | 86% |
| Manager present | 43% | 31% |
| Server try and entice you to order their favorite appetizer(s) | 64% | 57% |
| Resolve any service, food or beverage issues | 53% | 67% |
| Service: Timing | Positive Return Intent | Negative Return Intent |
| Food and beverage service timed well | 92% | 51% |
| Receive entrees in a timely manner | 92% | 59% |
| Server promote daily specials | 64% | 33% |
| Receive starter soup/ salad in a timely manner | 91% | 60% |
| Receive appetizer in a timely manner | 93% | 65% |
| Receive drink orders in timely manner | 96% | 73% |
| Receive dessert in a timely manner | 95% | 77% |
| Cashed out in a timely manner | 97% | 81% |
| Acknowledge and get order in a timely manner | 94% | 80% |
| Drinks arrive in a timely manner | 98% | 85% |
Putting all this together, the ten attributes with the largest difference between shops with positive and negative return intent are:
| Top 10 Attributes | ||
| Dimension | Attributes | Difference |
| Service: Personal Attention | Server attentive and prompt throughout the meal | 48% |
| Service: Timing | Food and beverage service timed well | 41% |
| Food | Entrees presented attractively, and tasted good | 40% |
| Service: Personal Attention | Server discuss the beverage menu, suggest an item or ask about your preferences | 37% |
| Service: Personal Attention | Server discuss the appetizer menu, suggest an item or ask about your preferences | 35% |
| Service: Timing | Receive entrees in a timely manner | 33% |
| Service: Personal Attention | Server promote daily specials | 31% |
| Greeting | Thanked and encouraged to visit again | 31% |
| Service: Timing | Receive starter soup/ salad in a timely manner | 30% |
| Service: Personal Attention | Host carry on a conversation as being seated | 29% |
Of the ten attributed with the strongest relationship to return intent, five belong to the personal attention dimension, three belong to the timing dimension, the food & beverage quality and greeting dimensions round out the top ten with one attribute each.
Directing our attention from specific attributes to broader dimensions, the following chart shows the average difference in shops with positive return intent to shops with negative return intent:
Outside of the timing of food and beverage delivery, the dimensions of the customer experience with the strongest correlation to return intent are the greeting and personal attention, followed by food and beverage quality and the physical environment.
Beyond Loyalty: Engagement/Wallet Share
In two earlier posts we discussed 1) including a loyalty proxy as part of your brand perception research and 2) determining the extent to which your desired brand image is reflected in how customers actually perceive the brand.
Now, we expand the research plan to move beyond loyalty and brand perception, and investigate customer engagement, or the extent to which customers are engaged with the brand through share of wallet.
Comparison to Competitors
The first step in measuring customer engagement is capturing top-of-mind comparisons of your brand to competitors. There are many ways to achieve this research objective, perhaps the simplest is to present the respondent with a list of statements regarding the 4-P’s of marketing (product, promotion, place and price) and asking customers to compare your performance relative to your competitors.
The statements you present to customers should be customized around your industry and business objectives, but they may look something like the following:
- Their products and services are competitive
- They are more customer-centric
- They have lower fees
- They have better service
- They offer better technology
- They are more nimble and flexible
- They are more innovative
Similar to the brand perception statements discussed in the previous post, these competitor comparison statements can be used to determine which of these service attributes have the most potential for ROI in terms of driving loyalty, again, by cross tabulating responses to the customer loyalty proxy.
Primary Provider
The next step in researching customer engagement is to determine if the customer considers you or another brand their primary provider. This is easily achieved by presenting the customer with a list of providers, including yourself, and asking them which of these the customer consider their primary provider.
Finally, we can tie industry comparisons to primary provider by asking why they consider their selection as a primary provider. This is best accomplished by using the same list of competitor comparison statements above, and asking which of these statements are the reasons they consider their selection to be the primary provider.
Similar to the brand perception statements discussed in the previous post, these competitor comparison statements can be used to determine which of these service attributes have the most potential for ROI in terms of driving loyalty, by cross-tabulating responses to these statements to the loyalty segments.
Image/Perception: A Mirror to Your Brand
In an earlier post we discussed including a loyalty proxy as part of your brand perception research.
Establishing and measuring loyalty proxies is important, but your brand perception research should not end there. Brand perception research should produce insight beyond loyalty. It should determine the extent to which customers impressions of the brand are aligned with your desired brand image. Additionally, perceptions of the brand among the most loyal and engaged customers should be compared to those who are deemed less loyal or engaged to identify opportunities to improve perceptions of the brand among customers at either risk of defection, or not fully engaged
In a subsequent post, we will address ways to measure engagement/wallet share.
Brand Definition
The first step in measuring your brand perception is to define your desired brand. Ask yourself: if your brand were a person, what personality characteristics would you like your customers to describe you with? What adjectives would you want used to describe your brand?
In addition to describing your brand personality with adjectives, come up with a list of statements that describe your desired personality. For example, you may include statements such as:
- We are easy to do business with.
- We are knowledgeable.
- We are like a trusted friend.
- We are interested in customers as people, not just the bottom line.
- We are committed to the community.
So, we defined the brand in terms of personality adjectives and statements. Both will be used in designing the survey instrument.
The Survey Instrument
Unaided Top-of Mind
The first step in the survey instrument, is asking customers for their unaided top-of-mind perceptions of the brand. This will uncover the first thing that comes to customers’ minds about your brand prior to the effects of any bias introduced by the research instrument itself. There are many ways to capture unaided top-of-mind impressions. We like a simple approach, where you ask the customer for the one word that they would use to describe the company. This research question will yield a list adjectives that can be quantified by frequency and used to determine the extent to which customers top-of-mind impressions match the desired brand image.
Aided Image
After we have defined top of mind impressions of the brand, we recommend comparing brand perception to your desired brand identified in the brand definition exercise described above. This is a fairly simple process of presenting the customers with your list of brand personality adjectives and asking the customer which of these adjectives would the customer use to describe the company.
In a much earlier post we discussed using word clouds to interpret brand personality adjectives.
The next step in comparing the reality of brand perception to your branding goals is to ask the customers to what extent do they agree with each of the brand personality statements described above. As with the list of adjectives, this holds a mirror up to your desired image and measures the extent to which customers agree that you are perceived in the manner that you want to be.
Identifying Attributes with the Most ROI Potential
The value of these brand perception statements goes beyond just evaluating if you live up to your brand. Used in conjunction with the loyalty proxies discussed in the previous post, they become tools to determine which of these brand personality attributes will yield the most ROI in terms of improving customer loyalty. This is achieved with a simple cross-tabulation of agreement with these statements by customer loyalty segment. For example, if NPS is used as the loyalty proxy, then we simply compare agreement to these statements from promoters to detractors to determine which attributes have the largest gaps between promoters and detractors. Those with the largest gaps have the most ROI potential in terms of customer loyalty.
Loyalty: The Foundation of Brand Perception
Customer loyalty is the business attribute with the strongest correlation to profitability. Loyalty lowers sales and acquisition costs per customer by amortizing these costs across a longer lifecycle, leading to extraordinary financial results. A 5% increase in customer loyalty can translate, depending on the industry, into a 25% to 85% increase in profits.
Many customer experience managers want to include a measure of loyalty in their customer experience research. Indeed loyalty and how brand perception drives loyalty is the foundation of any brand perception research. However, loyalty is a behavior measured longitudinally over time, and surveys best measure customer attitudes. As a result, researchers typically use attitudinal proxies for customer loyalty. Generally the two most common proxies are either a “would recommend” or a “customer advocacy” question.
- Would Recommend: A “would recommend” question is typically Net Promoter (NPS) or some other measure of the customer’s likelihood of referring to a friend, relative or colleague. It stands to reason, if one is going to refer others to a brand, they will remain loyal as well. Promoters’ willingness to put their reputational risk on the line is founded on a feeling of loyalty and trust.
- Customer Advocacy: A customer advocacy question asks if the customer agrees with the following statement, “the brand cares about me, not just the bottom line.” The concept of trust is perhaps more evident in customer advocacy. Customers who agree with this statement trust the brand to do right by them, and not subjugate their best interests to profits. Customers who trust the brand to do the right thing are more likely to remain loyal.
We’ve seen some loyalty surveys (particular those employing the NPS methodology), which only ask the loyalty proxy with little or no other areas of investigation. We believe this is a bad practice for a number of reasons:
- Customer Experience: Customers who have affirmatively taken the action of clicking on the survey want to give you their opinion (they want to participate in the survey), and based on their experience are expecting a multiple question survey. Presenting them with just one rating scale risks alienating them as they may feel they didn’t get an appropriate opportunity to share their opinion, and ultimately feel it was not worth their time to participate. Secondly, some customers may conclude the survey system is broken in some way as it only presented them with one question, resulting in customer confusion.
- Actionable Research Results: A survey consisting of one NPS rating is not going to yield any information from which to draw conclusions about how customers feel about the brand. It will produce an average rating and frequency of promoters and detractors, but no context in which to interpret the results.
Establishing and measuring loyalty proxies are an important first step in evaluating brand perception. Additional areas of investigation should include indentifying and comparing customer impressions of the brand to your desired brand personality, and evaluate customer engagement or wallet share.
In a subsequent post, we will address ways to measure the brand personality.
Also, in a subsequent post, we will explore ways to measure engagement/wallet share.
Build Call to Action into Your Brand Perception Research
These days, post-transaction surveys are ubiquitous. Brands large and small take advantage of internet-based survey technology to evaluate the customer experience at almost every touch point. Similarly, loyalty proxy methodologies such as Net Promoter (NPS) are very much in vogue. However, many NPS surveys are fielded in a post-transaction context (potentially exposing the research to sampling bias as a result of only hearing from customers who have recently conducted a transaction), and are not designed in a manner that will give managers appropriate information upon which to take action on the research.
At their core, loyalty proxies are brand perception research – not transactional. We believe it is a best practice to define the sample frame as the entire customer base, as opposed to customers who have recently interacted with the brand. Ultimately, these surveys are image and perception research of the brand across the entire customer base.
Happily, this perception research offers an excellent opportunity to gather customer perceptions of the brand, compare them to your desired brand image, as well as measure engagement or wallet share. An excellent survey instrument to accomplish this is a survey divided into three parts:
- Loyalty Proxy: Consisting of the NPS rating or some other appropriate measure and 1 or 2 follow up questions to explore why the customer gave the NPS rating they did.
- Image perception: consisting of 3 or 4 questions to determine how customers perceive the brand.
- Engagement/Wallet Share: consisting of 3 or 4 questions to determine if the customer considers the brand their primary provider, and to gauge share of wallet of various financial products & services across the brand and its competitors.
This research plan will not only yield an NPS, but it will provide insight into why the customers assigned the NPS they did, evaluate the extent to which the entire customer base’s impressions of the brand matches your desired brand image, as well as identify how the brand is perceived by promoters and detractors. This plan will also yield valuable insight into share of wallet, and how wallet share differs for promoters and detractors.
Such a survey need not be long, the above objectives can be accomplished with 10 – 12 questions and will probably take less than 5 minutes for the customer to complete.
In a subsequent posts, we will explore each of these 3-parts of the survey in more detail:
Contact Center Behavioral Purchase Intent Drivers: Empathy & Competence
As bank contact centers transition from service hubs to sales centers. It is instructive to investigate which service attributes and behaviors will yield the most ROI in terms of driving sales through the contact center channel.
Beyond the attributes measured in the previous post, Kinesis also performed mystery shop observations of specific behaviors across six institutions with national scope to determine their relationship to purchase intent.
Greeting Behaviors
While the importance of a good first impression is true, across the four greeting behaviors measured, there does not appear to any significant differences between shops with positive purchase intent and shops with negative purchase intent.
| Greeting | Increased Purch Intent | Decreased Purch Intent |
| Greet by identifying the name of the institution | 99% | 97% |
| Greet by identifying themselves | 100% | 97% |
| Ask name | 78% | 71% |
| Ask how they could assist | 100% | 98% |
This is mostly due to the high rate of performance across these greeting behaviors. Greetings are strong across all shops regardless of purchase intent.
Service Behaviors
With respect to broader service behaviors, the behaviors with the largest gaps between shops with positive purchase intent and those with negative purchase intent are: suggesting additional products and asking for the business (each with about 2 times as many shoppers who experience positive purchase intent observing these behaviors compared to shoppers who experience negative purchase intent). Use name, use of understandable descriptions and clarity of speech round out the next three.
Hold & Transfer Behaviors
When the shopper was placed on hold, five behaviors were measured. Of these, giving an estimate of how long the customer will be on hold, and returning if the hold time exceed the original estimate to advice of the status of the call were the behaviors with the strongest relationship to purchase intent. Again, both with about 2 times as many shoppers who experienced positive purchase intent observing these behaviors compared to shoppers who experienced negative purchase intent.
Additionally, five transfer behaviors were measured. Of these, the behavior with the strongest relationship to purchase intent by far is returning to explain any delay after 60 seconds. With five times as many shoppers who reported positive purchase intent observing this behavior relative to those who reported negative purchase intent.
Call Conclusion
Finally, at the conclusion of the call, asking how else the agent could be of assistance and thanking the shopper for choosing the institution were the two behaviors with the strongest relationship to purchase intent.
Of the behaviors measured, a couple of common themes tend to be present in the behaviors with strong relationships to purchase intent. The behaviors with strong relationships to purchase intent tend to deal with the themes of personalized service and valuing the customer.
These behaviors with strong relationships to purchase intent group into these two themes as follows:
Personalized Service/Empathy
- If transfer hold time exceeds 60 seconds, explain delay and ask if customer wants to continue (this behavior 5 times more likely in shops with positive purchase intent compared to negative)
- Give estimate of hold time (2.1 times more frequent in shops with positive purchase intent compared to negative)
- If hold exceeds estimate, return with status update (1.8 times more frequent)
- If transfer, stay on line until completed (1.6 times)
- Use of name (1.5 times)
- Ask how else could assist (1.5 times)
Valuing Customer
- Suggest additional products or services (2.1 times more frequent in shops with positive purchase intent)
- Ask for business (1.9 times)
- Thanks for choosing the institution (1.5 times)
To maximize purchase intent, focus agents on behaviors which personalize the service in an empathetic manner (care for the customer and their needs) and value their business.
Click here for a cross-tabulation of the raw data by purchase intent.
