Can all the competitive intelligence be conducted online?

For competitive intelligence consultants like me, the Internet has been a blessing.  It has lowered our cost of doing business and has improved the quality of our output.  Not only are companies providing a lot of information online (oversharing is a problem not just among regular folks — even smart business professionals are engaging in oversharing, and giving away valuable information to their competitors, merely to gain followers or fans on social media or receive minor bump in sales), a lot of documents that we needed to make photocopies at remote town halls are now accessible with just a few clicks and maybe tens of dollars (rather than thousands that it cost us to get on a plane and then spend all the time in driving to town halls and often waiting for a day or two to receive copies of documents).

So is it really true that there is no need to leave your desk and you can do it all yourself?  This is a very tempting feeling but the competitive intelligence business would have been dead by now if the Internet had all the answers.  I always encourage my clients to find whatever they can on the web if they have the resources to do so cost effectively themselves (we can do this part of the research quite cost effectively because I have low-cost, trained colleagues who specialize in this work).  It is better to use this as the base research to build on with help from consultants like me.  The value consultants like me provide is our ability to connect with industry insiders and make sense of all the public information.  It is through these discussions that we can develop a context for whatever is reported online.  It is also through these discussions that we can verify if press releases and media coverage is accurate (it is fairly routine to release confusing and/or misleading information for competitive reasons).

Is it legal to collect competitive intelligence?

This is one of the most common questions that I receive from business managers who confused competitive intelligence and industrial/economic/corporate espionage.  The former is a perfectly legal activity when conducted by professionals like me who follow a code of conduct.  The latter is a crime.

What is the difference between corporate espionage and competitive intelligence?  In answering this question to my very confused clients, I use a simple example.  Let us say that you are a gas station owner and you compete mostly with the gas station across the street.  If you would want to collect competitive intelligence on your competitor, it is perfectly legal for you to

  1. Watch their prices daily from the sign and enter into a spreadsheet.
  2. You could even hire an intern to count the type and number of vehicles pumping gas (an easy way to calculate how much gasoline is sold everyday by assuming that the average amount of gallons pumped at your station is no different than theirs; from the type of vehicles, you could develop customer profiles, for example, Lexus-owning rich mothers who prefer full service versus bargain hunting cheapos).
  3. You could even go to your local town office and file a request for all the documents filed by the business (typically it is best to do this through a consultant since the owner of the business will eventually have access to individuals who has viewed their records).  These documents can give you details on layouts, equipment, etc.
  4. You can also contact various government agencies to inspect documents filed by the business (yet again, something that should be done through third parties).
  5. You can hire their current or ex-employees.
  6. You can interview their customers and suppliers.
  7. You can conduct searches online to read what their employees, customers, suppliers, and others are saying.
  8. Since the station is open to the public, you can visit as often as you like.

What counts as espionage?  What you cannot do are hack into their computers/phones, surreptitiously install cameras on their property to monitor something, bribe or threaten employees/customers/suppliers to divulge proprietary information or trade secrets or provide documents to you, or use deceptive methods to pry information out of them.  All these actions amount to espionage and are illegal.

Obviously, the data collected through competitive intelligence is not exactly what you want but experts like me are trained to comb through several data sets and develop fairly accurate models.  In any case, you should not want to access confidential information on your competitors.


Can a consultant find competitive intelligence on private companies?

Chances are that some of your major competitors are privately held and you are wondering how to collect competitive intelligence on them.  The short answer is that consultants like me do this all the time, but before I say more on this, here are a few things to remember:

  1. It is easier to collect competitive intelligence on large, public companies than on privately held companies, particularly if they are also small.
  2. The culture of privately held businesses varies and the amount of information they put out varies (while there are differences among public companies as well, they are mandated to publish some types of information by law).  Many private companies use the media to drum up business and end up giving out valuable information, while others are run by very secretive folks.
  3. Collecting intelligence on private companies is costlier, the data is less reliable, and in some cases, despite best effort, answers to key questions may not be found (particularly in the timeframe that many clients specify).

So how do I go about digging up information on private companies?

Because it is harder, not surprisingly, competitive intelligence professionals like me get hired more often to work private companies.  Many clients prefer to gather intelligence on public companies internally because they can do so on an ongoing basis by simply compiling public information (though, it is not always enough and outsiders are often needed to find information not available through traditional means).

My preferred sources of information, obviously, are the documents that are filed even by private companies (they are a lot harder to find and since they leave a paper trail of who accessed them, it is best to let a CI professional do it for you).  The other great resource is conversations with employees who have retired or are no longer with the firm.  Even better are Internet forums where employees often talk about their work and end up giving up out nuggets of information that are worth their weight in gold to the competitors.

I conducted one assignment in which a Fortune 500 companies wanted to know who the private label supplier was to their key accounts.  It was such an important piece of information for them that they were willing to pay me tens of thousands of Dollars to dig it up.  Obviously, I used all the tools in my toolbox, but the breakthrough came when an intern I hired to conduct web searches had a breakthrough (it is very tempting to believe that a quick Google search will dig up everything on the topic you are researching, but it is important to know that not every single page on the Internet is searchable with Google  — professionals like me use other tricks to find information that is not included by search engines).  She ran into a forum for women in the town in which the manufacturing plant was located.  Without realizing how much useful information they were giving away, these innocent women were discussing whatever their spouses were talking about with them about their jobs — salaries, bonuses, mean bosses, customers, brands, sales, profits, etc.  We spent a few weeks in that forum, collected what we needed, and then simply verified that information through other means.  In the end, I was spot on.  Not only did I tell the client who the competitor was, but also was able to provide them with complete details on high-level financials, strategy, and cost structure.