The Power of Near-Real Time Food Trend Volatility Analysis

Is your food company busy addressing rising Vegan, Vegetarian, DASH, Anti-Inflammatory, ABS or Paleo diet trends today? If not, why not? These are among today’s top-10 diet trends driving consumer food choices.

Although Internet and social media analysis techniques are still in their infancy, these “big data” bases should not ignored: they best reflect what consumers think and say about their food choices. Think of the Internet as a very large consumer survey population that can be sampled at-will, at very low cost and on a near-real time basis. Internet chatter analysis also reveals trends not easily discernable using conventional analysis techniques, such as retail product scanning, new product placement tracking and consumer surveys…in near-real time! There is the problem of information clutter, however: the Internet has a very low signal-to-noise ratio and it can often be difficult to discern between what is important or relevant and what is not. Also, Internet search engines are fickle and just finding the most applicable search terms can be challenging.

This post references work undertaken at BEST VANTAGE Inc. ( to establish new tools for consumer trends analysis, drawing on techniques developed by the financial industry. Previous work undertaken on this challenge is referenced here and here. In this posting, we demonstrate how volatility analysis, using our VIC™ internet chatter volatility indices, can rapidly prioritize emergent trends not readily detectable using conventional market analysis tools. The earlier warned, the faster that companies can adapt to and capture the high ground of new consumer opportunities.

Why volatility? Volatility is a leading indicator of change. Whether in nature, societies, economies or financial markets, “volatility” marks rapid exchanges of material and information that signal impending change. Internet chatter surges or wanes as individuals adapt to new information and adjust their demands and expectations accordingly. Internet chatter volatility denotes activity and information exchange: it does not explain the underlying reasons for change, which requires a more forensic analysis of the Internet database. Thus, a surge in Internet chatter signals that change is pending and that a more in-depth analysis of the underlying reasons for volatility is likely warranted.

In the chart below, the VIC™ volatilities of the top 9 diet trends (out of 40 analyzed) are presented together. It is clear that, already in late-2009 (six years ago), interest in vegetarianism surged, followed by a surge in vegan diet-related chatter beginning in 2013. These are the markers that should have signaled to the processed food, foodservice and food ingredient companies to closely track these diet trends and adjust their product lines and strategic plans accordingly. This period (2009 – present) also exhibited very significant spikes in Internet chatter volatility pertaining to high-protein, low-carb Paleo and ABS diet-related Internet chatter.

Top-9 Trend Volatility

A look at annualized growth trends in Internet chatter suggests how rapidly these four trends will remake our industry. Between 2013 and 2014 alone, BEST VANTAGE observed the following growth rates (i.e., velocity) in Internet chatter, presented along with 5-year annualized growth rates as benchmarks.

  • Vegan Diet (1-yr: 590%; 5-yr Annualized Growth Rate: 89%)
  • ABS Diet (1-yr: 315%; 5-yr Annualized Growth Rate: 115%)
  • Paleo Diet (1-yr: 159%; 5-yr Annualized Growth Rate: 101%)
  • Vegetarian Diet (1-yr: 152%; 5-yr Annualized Growth Rate: 85%)

Internet volatility and velocity analysis should not be used in place of conventional market tracking techniques. They do offer powerful early indicators of emergent trends, helping companies to know where to look and how to respond to the most volatile index of all, consumer behavior. In a future posting, I will explain the value of using Internet chatter volatility and velocity analyses as strategic decision-making tools.

Gainers and Losers: Dietary Trends and Proteins

Diet trends rank high in consumer consciousness and food and beverage purchase decisions. This can be direct or indirect, as social clusters exchange information and influence each other’s food preferences: friends influence friends. Some diet trends reflect value systems (e.g., veganism); some reflect self-actualization (weight-control diets); some reflect health concerns (e.g. gluten-free diets) and still others draw on scientifically generated, whole-health recommendations (e.g., the DASH diet). Two key questions are: which diets predominate in the consumer consciousness and how will they affect consumer food and beverage choices?

One way to track consumer diet preferences is through the Internet. Internet chatter provides a “big data” measure of what society is talking about, ergo its priorities. On May 5th, Daniel Best of BEST VANTAGE Inc. will demonstrate how Internet chatter analysis, using tools developed by the financial industry to analyze stock market activity, can be utilized to quantify and prioritize dietary trend activity in a presentation titled “Proteins: Quantifying the Odds for Market Success” [Global Food Forums’ Protein Trends & Technologies Seminar, May 5-6 in the Chicago area].

The presentation’s prioritization and analysis of forty diet trends should help companies identify and react to major trend shifts on a near-real time basis and also help them avoid Black Swan events. For example, the graph presented below ranks leading diet trends by their average annual growth rates over a 10-year period. But how should these 10-year trends influence near term-decision making? The tools presented should help quantify and rationalize strategic planning protocols as well as provide guidance on how to better engage in the battle of ideas on the Internet. Internet chatter analysis will provide valuable insights into consumers’ protein preferences, with respect to sourcing, processing and consumption.

10-yr Annual Diet Trends

Taking stock of consumer food trends

Can tools utilized to analyze the stock market be similarly applied to the Internet? Both the Internet and stock market represent large “big data” databases reflective of consumer sentiment and valuation judgments. Food companies’ futures hinge upon their ability to rapidly analyze and respond to continuously evolving consumer trends. However, Internet data is plagued by low signal-to-noise ratios and search engines can be highly erratic. In a presentation titled “Proteins: Quantifying the Odds for Market Success” (Global Food Forums’ 2015 Protein Trends and Technologies Seminar, by Chicago, Illinois on May 5-6), Daniel Best of BEST VANTAGE Inc. will demonstrate how Internet chatter-based volatility analysis can be used as a near-real time tool to red-flag trend shifts for food companies. He will suggest ways to exploit such data to advantage and help reduce Black Swan risks. For example, Internet traffic analysis indicates that while the “Paleo” Diet (unfavorable to dairy, soy, cereal and legume proteins) has been rapidly rising in consumer consciousness, it has also been highly volatile since late-2010, suggesting that major shifts are underway. This contrasts with the gluten-free trend, which has exhibited rapid and steady growth but low-volatility in Internet chatter, an indicator of category stability.Paleo Trend

Daniel Best (BEST VANTAGE Inc.) to speak at April 2014 “Proteins Trends and Technologies” Seminar.

Daniel Best will speak at the Global Food Forum’s 2nd Annual “Protein Trends and Technologies Seminar” (April 8-9, in Arlington Heights, IL) on the topic of how to establish practical working criteria in choosing between different protein ingredient options.

The food industry will soon face a plethora of different protein ingredient selections, even as global demands for protein are soaring. Best’s presentation, “Sooo many proteins, so little time: how to choose” is designed to help food, beverage and nutritional industry professionals make clear-eyed choices based not just on protein functionality, but business and legal considerations as well.

The first day (April 8th) of the two-day Protein Trends and Technologies Seminar, “Strategic Insights for Business Growth”, will emphasize marketing, business and regulatory aspects of the surging protein ingredients industry. The second day, “Formulating with Proteins”, will focus on the technical and quality challenges of incorporating protein ingredients into finished food, beverage and nutritional products. For more information on this conference and how to register, please visit:

Note: This 2nd Annual Seminar continues 2013’s highly acclaimed “Proteins” seminar hosted by Global Food Forums, a complete Conference Report on which can be downloaded from this Link: