There Is Almost No Good Science in the Movie 'What the Health'

Is eating meat killing you? That's what you may think after watching the popular new movie What the Health on Netflix.

WTH portrays itself as a documentary by filmmaker Kip Anderson, who sets out in his trusty blue van from San Francisco to answer questions about a healthy diet. Since Anderson is already a vegan whose previous movie, Cowspiracy, argued that cows drive the destruction of the planet, we're pretty sure where he's going to end up.

Sure enough, despite his effort to appear shocked and surprised at his "discoveries" along the way, he concludes that not only is a plant-based diet best for health, but also that animal foods cause death and disease to all people who eat them.

Let's give Anderson some credit: His film is so unrelentingly terrifying and convincing that by the end, one wants to jump right on his vegan bandwagon and cease forever from eating cheese, which one person in the film calls "coagulated cow pus" or the "pure garbage" of "dead, decaying animal flesh," which are Anderson's terms for meat.

The film makes 37 health claims, and for this review, I investigated every single one. (WTH also makes a myriad of claims about contaminants and issues of environmental impact, but these are outside my field of expertise, so I looked only at the claims on health.)

Before diving into these claims, however, I'm going to make a few comments on the film's tactics, go over a housekeeping point, and do a quick background primer on the science.

First, I'm no expert in movies, but this looks an awful lot like a horror flick to me, with scenes of Anderson driving ominously through shadowy tunnels or all alone in an unlit room, googling mysteries on his computer. Interviews are lit seemingly from a single bulb, as if talking to a mafia informant, and ominous music pulses in the background, creating an omniscient feeling of dread.

The danger lurking everywhere is, of course, animal foods, which, via toxins, chemicals, hormones, antibiotics, steroids, pesticides, mad-cow disease, bacteria, pus-filled flesh, or an endless array of chronic disease-causing powers, are apparently bound to kill us.

Scary videos of pregnant women (the most vulnerable!) with needles poking into their bellies are intermingled with revolting images of fatty, pulsating bodily tissues pierced by scalpels or incised by surgical devices. We see animations of a happily pregnant mother or innocent child drinking milk aglow in neon orange to signify its hidden dangers and then see that neon color suffuse their unaware bodies—if they only knew! "Choose your poison," says one of the film's experts, referring to the various ways that animal foods kill. "It's a question of whether you want to be shot or hung."

According to Anderson, the reason that we don't know about these dangers is that the meat, dairy and egg industries are like "Big Tobacco," the ultimate bad corporate actor that famously used underhanded tactics to cover up the dangers of a harmful product. Casting the animal-food industries in this role has been a successful tactic employed by vegetarian groups ever since the 1970s, but WTH takes this effort into hyper-drive.

Hot dogs in the mouths of children are transformed into fat, smoking cigars, and a nutritional "Fact Sheet" on eggs is re-imagined as a handout on the health benefits of cigarettes. "An egg a day is like smoking five cigarettes," asserts Michael Greger, MD, the film's most prominent expert. By my count, the film employs Big Tobacco or tobacco products as an analogy for the meat, dairy or egg industries along with their products at least a dozen times.

The film also suggests our health problems are in part due to the excessive influence of Big Food and Big Pharma on our trusted public health institutions, such as the American Diabetes Association and American Heart Association (AHA). Here I agree, although the film should have fleshed out the picture: WTH cites funding only from meat and dairy companies when in fact the full range of food industries are in on this game.

Such donations make it hard for these associations to recommend healthy diets (e.g., the AHA puts its "healthy check mark" on sugar-laden cereals) or even advise people to choose better nutrition over drugs and medical devices. I'm also pleased to agree with another WTH point, made repeatedly throughout the film (in the scariest possible way), namely that these diseases take a huge toll on the health and wealth of our nations. Indeed they do.

Now, the housekeeping point. I come to this film with an obvious bias, since I've written a book, The Big Fat Surprise: Why Butter, Meat, and Cheese Belong in a Healthy Diet. The book's central argument is that saturated fats and cholesterol have been unfairly maligned and are not, after all, bad for health.

Therefore, I don't buy the film's idea that animal foods are unhealthful based on these reasons (for a complete run-down on these arguments, read my book or for a brief overview, this recent piece in Medscape or this piece I wrote in the Wall Street Journal). Still, the film presents other arguments against animal foods, and I'm open to these.

Finally, a note on science. WTH, on its website, provides many links to data for its claims, so I've come up with a grading system. WTH cites the following types of evidence:

Most of the claims in the film come from epidemiological studies. These are fundamentally limited in that they can only show associations and cannot establish causation. Therefore, this data is really meant only to generate hypotheses and can only rarely 'prove' them. Among the many problems with epidemiological studies are:

• The extreme unreliability of "food frequency questionnaires," which depend upon people accurately remembering what they ate over the last six or 12 months.
• The impossibility of fully adjusting for confounding variables. For instance, how does one adjust for the fact that heavy red-meat eaters are obviously people who've ignored their doctors' orders about meat (since nearly all doctors now advise patients to cut down on red meat), and thus, these people are also probably ignoring "healthy living" advice in many other ways? They probably smoke more and fail to visit the doctor regularly or attend cultural events—all factors linked to poorer health outcomes and none of which epidemiologists can ever properly measure or adjust for. Moreover, researchers don't actually know to what extent various foods like sugar or high-fructose corn-syrup cause disease, so they cannot even begin to adjust for those; that is just the beginning of the discussion on problems in confounding.
• Epidemiologists cross-calculate hundreds of food and lifestyle variables against death rates from different ailments, resulting in a huge number of associations. Just as a matter of probability, some of the positive results will be spurious. Statistical adjustments can be made to avoid this problem, but the Harvard epidemiologists whose papers are principally cited by WTH rarely make such adjustments.

Thus, for all these reasons and more, scientists in most fields (except nutrition) agree that small associations—one way to spot this is via "risk ratios" of less than 2—are not reliable.

Epidemiological studies with ratios less than 2 are therefore coded in red.

(Note that a risk ratio is completely separate from those scary "relative change" numbers that articles report. An article might say: "meat increases the chances of breast cancer 68%!" Yet this number is exaggerated and often meaningless, as explained here.)

This is a more rigorous kind of evidence that can show cause and effect. I graded trials roughly according to the following criteria: Was it randomized? Did it have a control group? Was it sizeable? Was it on a relevant population? Did enough people finish the trial to make it meaningful? Do its results support the claim?

Clinical trials that fail to meet most of these standards are coded in red. Clinical trials that might support the claim are coded in green.

These include either studies that do not support the claim or evidence that is highly preliminary, such as papers speculating on possible hypotheses, case studies on one or two people, or test-tube studies on cell cultures. These represent the most preliminary types of research and cannot be considered conclusive evidence. All these non-conclusive studies will be coded in red.

Because these are not peer-reviewed, they can't be considered rigorous sources of evidence, although some publications are better than others. Articles by biased sources (e.g., vegan diet doctors) will be coded in red, because they have both commercial and intellectual conflicts of interest. Mainstream media outlets that fact check their articles are more reliable, though still not a source of peer-reviewed science, so they will be coded in yellow.

To review:

• Items in red cannot be considered support for the claim.
• Items in yellow are weak support for the claim.
• Items in green support the claim.

And… drumroll… here's the evidence:

In sum, 96 percent of the data do not support the claims made in this film. The film does not cite a single rigorous randomized controlled trial on humans supporting its arguments. Instead, WTH presents a great deal of weak epidemiological data, case studies on one or two people, or other inconclusive evidence. Some of the studies cited actually conclude the opposite of what is claimed.

Moreover, the majority of "papers" turn out to be posts by vegan diet doctors, mainly Michael Greger and Neal Barnard. Both of these men are passionate animal welfare activists, so one can never know if they are seeking truth about a healthy diet or have started from the premise that they'd like to end all domestication of animals and proceed to cherrypick the science back from there.

Given the weak-to-non existent data presented in the film, the latter seems to be a pretty good possibility. In fact, WTH, based on zero sound science, is quite likely a piece of animal-welfare advocacy masquerading as a public health film.

For a comprehensive list of every WTH health claim, and the exact support, see this PDF document.

The film's defenders might say that better studies are buried in all those posts by vegan diet doctors, but any researcher knows to cite primary sources rather than secondary ones. Where's the science? It appears not to exist.

And we can assume that if the science has been so distorted and misrepresented for the claims on health, probably the same has been done for claims on other issues, on environmental impact, toxins, antibiotics, hormones, the evolution of humans, etc.

If this is the best evidence that a vegan diet can promote good health, then I'm not convinced. I'm more skeptical, even, based on a few solid observations:

• No human population in the history of civilization has ever been recorded surviving on a vegan diet.
• The vegan diet is nutritionally insufficient, lacking not only vitamin B12 but deficient in heme iron and folate (meaning that we should refer to it always as a "vegan diet plus supplements").
• A near-vegan diet, in rigorous clinical trials, invariably causes HDL cholesterol to drop and sometimes raises triglycerides, which are both signs of worsening heart attack risk; Over the last 30 years, as rates of obesity and diabetes have risen sharply in the US, the consumption of animal foods has declined steeply: whole milk is down 79 percent; red meat by 28 percent and beef by 35 percent; eggs are down by 13 percent and animal fats are down by 27 percent. Meanwhile, consumption of fruits is up by 35 percent and vegetables by 20 percent. All trends therefore point towards Americans shifting from an animal-based diet to a plant-based one, and this data contradict the idea that a continued shift towards plant-based foods will promote health.
• There's the entire Indian subcontinent, where beef is not eaten by the large majority of people, which has seen diabetes explode over the past decade.

It's also false that WTH is the movie that "health organizations don't want you to see!" as it claims, since the president of the American College of Cardiology, interviewed in the film, expresses adamant support of the vegan diet, and the expert committee for the US Dietary Guidelines in 2015 proposed eliminating meat from the list of "healthy foods."

Thus, these two major public health institutions would presumably be happy for you to see this film. In fact, the plant-based diet has proponents in many high places, including the Harvard Chan School of Public Health, which produces many of the weak epidemiological associations cited in the movie. Claiming to be a Michael-Moore style underdog therefore appears merely to be one of the film's rhetorical tricks.

Finally: I'd like to comment on this film as act of journalism. In WTH, Anderson's role as a 'reporter' fails to meet any normal standards of the field. Not only does he hop a barbed-wire fence in what appears to be an act of illegal trespassing onto a hog farm in North Carolina, he also conducts a series of interviews that just made me laugh.

Any journalist knows that if you want some information from, say, the American Cancer Institute, American Heart Association, or American Dietetics Association, as Anderson does, you call the media relations department and ask to be put in touch with the appropriate expert. Anderson doesn't seem to know this, or so he feigns, and thus instead asks his questions of operators answering the phones or, amusingly, a security guard manning a lobby desk.

Zounds! "Yet again… more questions no one can answer," intones Anderson. Yep, because these people have been hired to be operators and security guards, Mr. Anderson, not scientific experts. In the film, Anderson portrays these encounters as a series of "gotcha" moments in which he's being stonewalled, but really, it's nothing but illusion.

And that's the whole film: scary images, compelling language, and the illusion of certainty and data, when in fact, there is none. Go ahead and eat your eggs, dairy and meat, folks, because there's no sound evidence to show that these traditional, whole foods are bad for health.

This article originally appeared on dietdoctor.com.