article » Why More Companies Should Submit To Peer Review

Why More Companies Should Submit To Peer Review

August 27, 2014
3 min read

Academia is governed by a process called “peer review,” which ensures research is validated and reasoning is sound. More simply, it weeds out the real insights from the fluff. Meanwhile, most corporate data (think surveys, white papers) is made public after only an internal, inherently biased review. With recent backlash toward Facebook’s emotions experiment, being cognizant and transparent with data is more important than ever.

As an academic, my expectation when I joined the private sector was that the white papers and collateral released by companies in this space would be based on large sample sizes, best-in-class empirical methods and rigorous interpretation. Suffice to say, that was not the case.

There are relatively few tech companies that support analytics-minded academics and are willing to put in the time to hold the company’s work accountable to a much higher standard. Peer review is an incredibly time-intensive process, but worth it for stronger, more accurate content. And though recent news of a “peer review ring” does show the system isn’t without its faults, with technology’s help, the methods can scale. Here are my top three reasons why companies should invest in academic peer review.

Content Is More Credible

In the peer-review process, once a team of researchers has completed a paper, they submit it to a journal that then circulates it to two to three peer experts for critique. Academic journals use a double-blind process so the authors don’t know the identity of the reviewers and vice versa, with the intention being to ensure that the process is as rigorous and objective as possible.

Although the finished product is inevitably better than the initial submission, the process requires a tremendous amount of work and can last as long as two years from start to finish. Utilizing a process even near this intensive ensures that research is truly rigorous. Outside, educated analysis makes sure that the facts and framing are sound and not biased. This adds much more credibility to content than, say, a survey revealing the importance of secure storage vetted by a security software vendor.

Thought Leadership Is More Authentic

Most companies will naturally conduct research and develop content in areas relevant to their business. But there is a fine line between self-serving content and authentically helpful insights that benefit customers. Peer-reviewed research demonstrates that a company isn’t just claiming expertise—it is offering evidence validated by others.

The Bar for Ethics and Accuracy Rises

In my role as a chief analytics officer, I often act as an internal referee—I refuse to release any research that wouldn’t withstand submission to a top-tier academic journal. That means suppressing findings that aren’t sufficiently supported by the data and publishing results that may be unpopular but accurate. This discipline substantiates the integrity of the work.

Even if readers don’t fully understand technical concepts like fixed effects or clustered standard errors, they value knowing the analysis is methodologically sound. Spurious conclusions released into the public domain can lead to poor decisions, especially when individuals and companies rely on this research to guide real investments.

The rigor of academic research and the lax standards of many industry papers represent two extremes. One demands months or years of careful scrutiny; the other often requires none at all. My hope is that the technology industry can find a middle ground—educating readers to ask better questions, encouraging transparency, and raising standards without sacrificing speed or relevance.

We’ve already seen this ethos succeed through open source, which has strengthened infrastructure across the web and data ecosystems. Applying similar openness and rigor to analytics research—while keeping peer review transparent and diverse—will only strengthen the industry.

To access the original article, click here.

Share: