Gathering and Using Information: Marketing Research and Market Intelligence

Internally Generated Data and Reports

As we explained, an organization generates and records a lot of information as part of its daily business operations, including sales and accounting data, and data on inventory levels, back orders, customer returns, and complaints. Firms are also constantly gathering information related to their Web sites, such as clickstream data. Clickstream data is data generated about the number of people who visit a Web site and its various pages, how long they dwell there, and what they buy or don’t buy. Companies use clickstream data in all kinds of ways. They use it to monitor the overall traffic of visitors that a site gets, to see which areas of the site people aren’t visiting and explore why, and to automatically offer visitors products and promotions by virtue of their browsing patterns. Software can be used to automatically tally the vast amounts of clickstream data gathered from Web sites and generate reports for managers based on that information. Netflix recently awarded a $1 million prize to a group of scientists to plow through Web data generated by millions of Netflix users so as to improve Netflix’s predictions of what users would like to rent (Baker, 2009). (That’s an interesting way to conduct marketing research, don’t you think?)

Being able to access clickstream data and other internally generated information quickly can give a company’s decision makers a competitive edge. Remember our discussion in Chapter 9 “Using Supply Chains to Create Value for Customers” about how Walmart got a leg up on Target after 9/11? Walmart’s inventory information was updated by the minute (the retailer’s huge computing center rivals the Pentagon’s, incidentally); Target’s was only updated daily. When Walmart’s managers noticed American flags began selling rapidly immediately following the terrorist attacks on 9/11, the company quickly ordered as many flags as possible from various vendors—leaving none for Target.

Click on the following link to watch a fascinating documentary about how Walmart, the world’s most powerful retailer, operates: http://www.hulu.com/watch/103756/cnbc-originals-the-new-age -of-walmart.

Many companies make a certain amount of internal data available to their employees, managers, vendors, and trusted partners via intranets. An intranet looks like the Web and operates like it, but only an organization’s employees have access to the information. So, for example, instead of a brand manager asking someone in accounting to run a report on the sales of a particular product, the brand manager could look on her firm’s intranet for the information.

However, big companies with multiple products, business units, and databases purchased and installed in different places and at different times often have such vast amounts of information that they can’t post it all on an intranet. Consequently, getting hold of the right information can be hard. The information could be right under your nose and you might not know it. Meet people like Gary Pool: Pool works for BNSF Railway and is one of BNSF’s “go-to” employees when it comes to gathering marketing data. Pool knows how to access different databases and write computer programs to extract the right information from the right places at BNSF, a process known as data mining. Combining data into one location is called data warehousing, and makes Pool’s analysis easier. He then captures the information and displays it in dashboards, screens on the computer that make the data easily understood so that managers can detect marketing trends. While a dashboard may display a piece of information, such as the number of carloads sold in West Virginia, the manager can click on the number and get more detail.

Analytics Software

Increasingly, companies are purchasing analytics software to help them pull and make sense of internally generated information. Analytics software allows managers who are not computer experts to gather all kinds of different information from a company’s databases—information not produced in reports regularly generated by the company. The software incorporates regression models, linear programming, and other statistical methods to help managers answer “what if” types of questions. For example, “If we spend 10 percent more of our advertising on TV ads instead of magazine ads, what effect will it have on sales?” Oracle Corporation’s Crystal Ball is one brand of analytical software.

The camping, hunting, fishing, and hiking retailer Cabela’s has managed to refine its marketing efforts considerably using analytics software developed by the software maker SAS. “Our statisticians in the past spent 75 percent of their time just trying to manage data. Now they have more time for analyzing the data with SAS, and we have become more flexible in the marketplace,” says Corey Bergstrom, director of marketing research and analysis for Cabela’s. “That is just priceless” (Zarello, 2009).

The company uses the software to help analyze sales transactions, market research, and demographic data associated with its large database of customers. It combines the information with Web browsing data to gain a better understanding of the individual customers marketing channel preferences as well as other marketing decisions. For example, does the customer prefer Cabela’s’ one-hundred-page catalogs or the seventeen-hundred-page catalogs? The software has helped Cabela’s employees understand these relationships and make high-impact data-driven marketing decisions (Zarello, 2009).

Market Intelligence

A good internal reporting system can tell a manager what happened inside his firm. But what about what’s going on outside the firm? What is the business environment like? Are credit-lending terms loose or tight, and how will they affect what you and your customers are able to buy or not buy? How will rising fuel prices and alternate energy sources affect your firm and your products? Do changes such as these present business obstacles or opportunities? Moreover, what are your competitors up to?

Not gathering market intelligence leaves a company vulnerable. Remember Encyclopedia Britannica, the market leader in print encyclopedia business for literally centuries? Encyclopedia Britannica didn’t see the digital age coming and nearly went out of business as a result. (Suffice it to say, you can now access Encyclopedia Britannica online.) By contrast, when fuel prices hit an all-time high in 2008, unlike other passenger airline companies, Southwest Airlines was prepared. Southwest had anticipated the problem, and early on locked in contracts to buy fuel for its planes at much lower prices. Other airlines weren’t as prepared and lost money because their fuel expenses skyrocketed. Meanwhile, Southwest Airlines managed to eke out a profit. Collecting market intelligence can also help a company generate ideas or product concepts that can then be tested by conducting market research.

Gathering market intelligence involves a number of activities, including scanning newspapers, trade magazines, and economic data produced by the government to find out about trends and what the competition is doing. In big companies, personnel in a firm’s marketing department are primarily responsible for their firm’s market intelligence and making sure it gets conveyed to decision makers. Some companies subscribe to news service companies that regularly provide them with this information. LexisNexis is one such company. It provides companies with news about business and legal developments that could affect their operations. Other companies subscribe to mystery shopping services, companies that shop a client and/or competitors and report on service practices and service performance. Let’s now examine some of the sources of information you can look at to gather market intelligence.

Can Market Intelligence Be Taken Too Far?

Can market intelligence be taken too far? The answer is yes. In 2001, Procter & Gamble admitted it had engaged in “dumpster diving” by sifting through a competitors’ garbage to find out about its hair care products. Although the practice isn’t necessarily illegal, it cast P&G in a negative light. Likewise, British Airways received a lot of negative press in the 1990s after it came to light that the company had hacked into Virgin Atlantic Airways’ computer system¹.

Gathering corporate information illegally or unethically is referred to as industrial espionage. Industrial espionage is not uncommon. Sometimes companies hire professional spies to gather information about their competitors and their trade secrets or even bug their phones. Former and current employees can also reveal a company’s trade secret either deliberately or unwittingly. Microsoft recently sued a former employee it believed had divulged trade secrets to its competitors². It’s been reported that for years professional spies bugged Air France’s first-class seats to listen in on executives’ conversations (Anderson, 1995).

To develop standards of conduct and create respect for marketing professionals who gather market intelligence, the Society of Competitive Intelligence Professionals has developed a code of ethics. It is as follows:

• To continually strive to increase the recognition and respect of the profession.
• To comply with all applicable laws, domestic and international.
• To accurately disclose all relevant information, including one’s identity and organization, prior to all interviews.
• To avoid conflicts of interest in fulfilling one’s duties.
• To provide honest and realistic recommendations and conclusions in the execution of one’s duties.
• To promote this code of ethics within one’s company, with third-party contractors and within the entire profession.
• To faithfully adhere to and abide by one’s company policies, objectives and guidelines³.

Marketing Research

Marketing research is what a company has to resort to if it can’t answer a question by using any of the types of information we have discussed so far—market intelligence, internal company data, or analytics software applied to data. As we have explained, marketing research is generally used to answer specific questions. The name you should give your new product is an example. Unless your company has previously done some specific research on product names—what consumers think of them, good or bad—you’re probably not going to find the answer to that question in your internal company data. Also, unlike internal data, which is generated on a regular basis, marketing research is not ongoing. Marketing research is done on an as-needed or project basis. If an organization decides that it needs to conduct marketing research, it can either conduct marketing research itself or hire a marketing research firm to do it.

So when exactly is marketing research needed? Keep in mind marketing research can be expensive. You therefore have to weigh the costs of the research against the benefits. What questions will the research answer, and will knowing the answer result in the firm earning or saving more money than the research costs?

Marketing research can also take time. If a quick decision is needed for a pressing problem, it might not be possible to do the research. Lastly, sometimes the answer is obvious, so there is no point in conducting the research. If one of your competitors comes up with a new offering and consumers are clamoring to get it, you certainly don’t need to undertake a research study to see if such a product would survive in the marketplace.

Alex J. Caffarini, the president and founder of the marketing research firm Analysights, believes there are a number of other reasons companies mistakenly do marketing research. Caffarini’s explanations (shown in parentheses) about why a company’s executives sometimes make bad decisions are somewhat humorous. Read through them:

• “We’ve always done this research.” (The research has taken on a life of its own; this particular project has continued for years and nobody questioned whether it was still relevant.)
• “Everyone’s doing this research.” (Their competitors are doing it, and they’re afraid they’ll lose competitive advantage if they don’t; yet no one asks what value the research is creating.)
• “The findings are nice to know.” (Great—spend a lot of money to create a wealth of useless information. If the information is nice to know, but you can’t do anything with it, you’re wasting money.)
• “If our strategy fails, having done the research will show that we made our best educated guess.” (They’re covering their butts. If things go wrong, they can blame the findings, or the researcher.)
• “We need to study the problem thoroughly before we decide on a course of action.” (They’re afraid of making a tough decision. Conducting marketing research is a good way to delay the inevitable. In the meantime, the problem gets bigger, or the window of opportunity closes.)
• “The research will show that our latest ad campaign was effective.” (They’re using marketing research to justify past decisions. Rarely should marketing research be done after the fact) (Caffarini).

Is Marketing Research Always Correct?

To be sure, marketing research can help companies avoid making mistakes. Take Tim Hortons, a popular coffee chain in Canada, which has been expanding in the United States and internationally. Hortons recently opened some self-serve kiosks in Ireland, but the service was a flop. Why? Because cars in Ireland don’t have cup holders. Would marketing research have helped? Probably. So would a little bit of market intelligence. It would have been easy for an observer to see that trying to drive a car and hold a cup of hot coffee at the same time is difficult.

That said, we don’t want to leave you with the idea that marketing research is infallible. As we indicated at the beginning of the chapter, the process isn’t foolproof. In fact, marketing research studies have rejected a lot of good ideas. The idea for telephone answering machines was initially rejected following marketing research. So was the hit sitcom Seinfeld, a show that in 2002 TV Guide named the number-one television program of all time. Even the best companies, like Coca-Cola, have made mistakes in marketing research that have led to huge flops. In the next section of this chapter, we’ll discuss the steps related to conducting marketing research. As you will learn, many things can go wrong along the way that can affect the results of research and the conclusions drawn from it.