SARAH S. VANCE, District Judge.
Plaintiffs move to exclude portions of two reports and related testimony of Dr. John H. Johnson, IV, the proposed expert of defendants Pool Corporation, SCP Distributors LLC, and Superior Pool Products (collectively, "Pool").
This is an antitrust case that direct-purchaser plaintiffs (DPPs) and indirect-purchaser plaintiffs (IPPs) filed against Pool and the Manufacturer Defendants—Hayward Industries, Inc., Pentair Water Pool and Spa, Inc., and Zodiac Pool Systems, Inc. Pool is the country's largest distributor of products used for the construction and maintenance of swimming pools (Pool Products). The Manufacturer Defendants are the three largest manufacturers of Pool Products in the United States. As defined in DPPs' Second Consolidated Amended Class Action Complaint and IPPs' Third Amended Class Action Complaint, Pool Products are the equipment, products, parts, and materials used for the construction, renovation, maintenance, repair, and service of residential and commercial swimming pools. Pool Products include pumps, filters, covers, drains, fittings, rails, diving boards, and chemicals, among other goods. Pool buys Pool Products from manufacturers, including the three the Manufacturer Defendants, and in turn sells them to DPPs, which include pool builders, pool retail stores, and pool service and repair companies (collectively referred to as "Dealers").
DPPs filed two consolidated amended complaints-the first on June 29, 2012
IPPs filed three amended complaints, the most recent on July 16, 2013.
When expert testimony offered by one party is subject to a Daubert challenge, the Court must act as a "gatekeeper" under Federal Rule of Evidence 702.
A district court has considerable discretion to admit or exclude expert testimony under Rule 702. See Gen. Elec. Co. v. Joiner, 522 U.S. 136, 138-39 (1997); Seatrax, Inc. v. Sonbeck Int'l, Inc., 200 F.3d 358, 371 (5th Cir. 2000). Rule 702, which governs the admissibility of expert witness testimony, provides:
Fed. R. Evid. 702.
In Daubert v. Merrell Dow Pharmaceuticals, Inc., the Supreme Court held that Rule 702 requires the district court to act as a gatekeeper to ensure that "any and all scientific testimony or evidence admitted is not only relevant, but reliable." 509 U.S. at 589; see also Kumho Tire Co., Ltd. v. Carmichael, 526 U.S. 137, 147 (1999) (clarifying that the Daubert gatekeeping function applies to all forms of expert testimony). The Court's gatekeeping function thus involves a two-part inquiry into reliability and relevance.
First, the Court must determine whether the proffered expert testimony is reliable. The party offering the testimony bears the burden of establishing its reliability by a preponderance of the evidence. See Moore v. Ashland Chem. Inc., 151 F.3d 269, 276 (5th Cir. 1998). The reliability inquiry requires the Court to assess whether the reasoning or methodology underlying the expert's testimony is valid. See Daubert, 509 U.S. at 592-93. The aim is to exclude expert testimony based merely on subjective belief or unsupported speculation. See id. at 590.
The Court in Daubert articulated a flexible, non-exhaustive, five-factor test to assess the reliability of an expert's methodology: (1) whether the expert's theory can be or has been tested; (2) whether the theory has been subject to peer review and publication; (3) the known or potential rate of error of a technique or theory when applied; (4) the existence and maintenance of standards and controls; and (5) the degree to which the technique or theory has been generally accepted in the scientific community. Id. at 593-95. The Supreme Court has emphasized, however, that these factors "do not constitute a `definitive checklist or test.'" Kumho, 526 U.S. at 150 (quoting Daubert, 509 U.S. at 593). Rather, district courts "must have considerable leeway in deciding in a particular case how to go about determining whether particular expert testimony is reliable." Id. at 152. Courts have also considered whether experts are "proposing to testify about matters growing naturally and directly out of research they have conducted independent of the litigation, or whether they have developed their opinions expressly for purposes of testifying," Daubert v. Merrell Down Pharms., Inc., 43 F.3d 1311, 1317 (9th Cir. 1995), whether the expert has adequately accounted for obvious alternative explanations, see Claar v. Burlington N.R.R., 29 F.3d 499 (9th Cir. 1994), and whether the expert "is being as careful as he would be in his regular professional work outside his paid litigation consulting," Sheehan v. Daily Racing Form, Inc., 104 F.3d 940, 942 (7th Cir. 1997).
A district court's gatekeeper function does not replace the traditional adversary system or the role of the jury within this system. See Daubert, 509 U.S. at 596. As the Supreme Court noted in Daubert: "Vigorous crossexamination, presentation of contrary evidence, and careful instruction on the burden of proof are the traditional and appropriate means of attacking shaky but admissible evidence." Id. The Fifth Circuit has held that, in determining the admissibility of expert testimony, district courts must accord proper deference to "the jury's role as the proper arbiter of disputes between conflicting opinions. As a general rule, questions relating to the bases and sources of an expert's opinion affect the weight to be assigned that opinion rather than its admissibility and should be left for the jury's consideration." United States v. 14.38 Acres of Land, More or Less Situated in Leflore Cty., Miss., 80 F.3d 1074, 1077 (5th Cir. 1996) (quoting Viterbo v. Dow Chem. Co., 826 F.2d 420, 422 (5th Cir. 1987)).
Nonetheless, expert testimony "must be reliable at each and every step or else it is inadmissible. The reliability analysis applies to all aspects of an expert's testimony: the methodology, the facts underlying the expert's opinion, the link between the facts and the conclusion, et alia." Knight v. Kirby Inland Marine Inc., 482 F.3d 347, 355 (5th Cir. 2007) (citation omitted). "Where the expert's opinion is based on insufficient information, the analysis is unreliable." Paz v. Brush Engineered Materials, Inc., 555 F.3d 383, 388 (5th Cir. 2009).
In Joiner, the Supreme Court explained that "nothing in either Daubert or the Federal Rules of Evidence requires a district court to admit opinion evidence that is connected to existing data only by the ipse dixit of the expert." 522 U.S. at 146. Rather, "[a] court may conclude that there is simply too great an analytical gap between the data and the opinion proffered." Id.; see also LeBlanc v. Chevron USA, Inc., 396 F. App'x 94, 98 (5th Cir. 2010).
Second, the Court must determine whether the expert's reasoning or methodology is relevant. The question here is whether the reasoning or methodology "fits" the facts of the case and will thereby assist the trier of fact to understand the evidence. See Daubert, 509 U.S. at 591. "[F]undamentally unsupported" opinions "offer[] no expert assistance to the jury" and should be excluded. Guile v. United States, 422 F.3d 221, 227 (5th Cir. 2005) (citing Viterbo, 826 F.2d at 422).
Plaintiffs challenge four aspects of Dr. Johnson's opinion, all of which pertain to his conclusion that Dr. Rausser's Common Factors regression and Overcharge regression are fundamentally flawed. The Court begins by summarizing the challenged portions of Dr. Johnson's opinion and methodology. The Court then assesses plaintiffs' challenges to Dr. Johnson's opinion.
To summarize the challenged portions of Dr. Johnson's opinion and methodology, the Court begins with an overview of Dr. Rausser's opinion, specifically his evaluation of the effect of Pool's pricing on plaintiffs.
Dr. Rausser opined that Pool could charge inflated prices for Pool Products as a result of a mixture of conduct by Pool and the Manufacturer Defendants. In his report, Dr. Rausser conducts a "liability analysis," detailing several instances of conduct by defendants, which in Dr. Rausser's opinion, had an anticompetitive impact on prices in the relevant market and thereby on plaintiffs. Dr. Rausser summarized the alleged effect of defendants' conduct as follows:
According to Dr. Rausser, his "liability analysis" (or aggregate causation analysis, as the Court has called it) demonstrates the impact of the defendants' conduct on Pool's prices.
Having concluded that an impact exists, Dr. Rausser then evaluated whether that impact would be "common" across the class. Dr. Rausser concluded that the allegedly supracompetitive pricing "caus[ed] an impact across all Class members,"
Next, Dr. Rausser used a "before-and-after" analysis to quantify the alleged impact on the class. The before-and-after analysis seeks to quantify damages by comparing two time periods: a "before" time period, when the allegedly anticompetitive conduct was still underway, and an "after" time period, also referred to as the "benchmark" period, when most of the allegedly anticompetitive conduct had supposedly stopped. To compare the two time periods, Dr. Rausser ran his "Common Factors" regression, but added one additional variable, a "dummy" variable, which is set to 1 during the class period and to 0 during the benchmark period. Dr. Rausser calls this regression his "Overcharge" regression. He used November 21, 2011, as the dividing date between the before period (January 1, 2007, to November 20, 2011) and the benchmark period (November 21, 2011, to September 30, 2012), because that is the date the Federal Trade Commission "publicly announced its investigation into Pool Products distribution" and "[d]uring that benchmark period, Pool[] was effectively prohibited from engaging in their previous anticompetitive conduct."
In his Rebuttal Expert Report and again in his Written Critique, Dr. Johnson opines that Dr. Rausser's Common Factors Regression (what Dr. Johnson calls the "Impact regression model") "fails to account for customerspecific characteristics."
To support his conclusion, Dr. Johnson applies Dr. Rausser's Common Factors regression to various subsets of the proposed direct purchaser class. Dr. Johnson conducted a regression for each of Pool's geographic divisions, product departments, and customer types (i.e., pool builders, pool retailers, pool service entities, and others).
Plaintiffs argue that Dr. Johnson's application of Dr. Rausser's regression models to subsets of the data, rather than the full data set that Dr. Rausser used, is impermissible "data mining." According to plaintiffs, Dr. Johnson has no economic theory for testing the regressions in this manner and that therefore the Court must exclude Dr. Johnson's "separate regressions" as unreliable.
In applying Dr. Rausser's regression models, Dr. Johnson also utilized the available data differently from Dr. Rausser in two ways. First, Dr. Johnson had to address the "unit-of-measure issue." The Court has previously explained the issue as follows. For some sales transactions, Pool records a quantity of "one," indicating that one unit of a product was sold. For others, a quantity of "one" indicates "one case," meaning that twelve (or some other number greater than one) units of the product were sold. Thus, without the unit-of-measure variable, it is impossible to know whether the price given for a particular transaction is the price for one unit or for multiple units.
It is undisputed that unit-of-measure information is not consistently available throughout the relevant time period—specifically, unit-of-measure information is unavailable in Pool's data from June 2012 to September 2012. To address this problem, Dr. Johnson used only those transactions containing unit-of-measure information. In other words, Dr. Johnson excluded from his regression analysis all sales transactions after May 2012. In a footnote, Dr. Johnson explains that "[t]o rule out that the different time period is driving the difference in the estimated overcharge," Dr. Johnson estimated an additional regression using the full data and obtained similar results.
Plaintiffs complain that Dr. Johnson's regressions using the unit-ofmeasure field should be excluded as unreliable. Plaintiffs argue that Dr. improperly "thr[ew] away millions of transactions" when the data did not contain unit-of-measure information, thus eliminating all transactions after May 2012, or approximately forty percent of Dr. Rausser's benchmark period in the Overcharge regression.
Second, in applying Dr. Rausser's regression models, Dr. Johnson used Pool's "replacement costs" (or "procurement costs"), meaning the price Pool paid for its products from the manufacturers, as an explanatory variable. Dr. Rausser used a proxy for costs by averaging the producer price indices (PPIs) for certain raw materials identified in Pentair's Forms 10-K for each year of the class period.
Plaintiffs argue that Dr. Johnson's use of actual costs as an explanatory variable in a regression that attempts to explain resulting prices is improper due to "endogeneity" or "simultaneity."
Dr. Johnson also conducted "statistical tests" of Dr. Rausser's regression models to determine whether any variables omitted in Dr. Rausser's regressions contribute to changes in prices, the dependent variable tested by the regressions.
Plaintiffs seek to exclude Dr. Johnson's F-tests as "meaningless" because, according to plaintiffs, any statistical significance revealed by the testing results is due only to the large sample size of transactions tested.
For all these reasons, plaintiffs argue, Dr. Johnson's opinion and related testimony should be excluded.
The Court addresses each of plaintiffs' four challenges in turn.
Dr. Johnson opines that Dr. Rausser's Common Factors regression does not support Dr. Rausser's conclusion of common impact across the class because, when applied to various subsets of the available data, the regression instead reveals that individualized factors (the type of customer, the product the customer purchased from Pool, and the customer's geographic location) translate to price differences for different members of the proposed class. Plaintiffs argue that Dr. Johnson's regression analyses lack any underlying economic theory, and are therefore unreliable, because Dr. Johnson does not tether the data subsets tested to his definition of the relevant product or geographic market in this case. According to plaintiffs, Dr. Johnson's "arbitrary" selection of data subsets is impermissible "data mining." "Data mining" is defined in various ways, but plaintiffs use the term to mean arbitrarily manipulating available data to achieve a desired result. See, e.g., A.H. Studenmund, Using Econometics: A Practical Guide 184 (6th ed. 2011) ("[D]ata mining involves estimating a variety of alternative specifications before [a] `best' equation has been chosen."); Jeffrey M. Wooldridge, Introductory Econometrics: A Modern Approach 677 (4th ed. 2009) (explaining "data mining" as "try[ing] different models, different estimation techniques, or perhaps different subsets of data" after obtaining "puzzling results" from a "very careful" data model "until the results correspond more closely to what was expected"); Peter Kennedy, A Guide to Econometrics 394 (5th ed. 2003) ("The undesirable version of data mining occurs when one tailors one's specification to the data, resulting in a specification that is misleading because it embodies the peculiarities of the particular data at hand.").
Pool defends Dr. Johnson's approach as a "sensitivity analysis" of Dr. Rausser's model to determine whether Dr. Rausser's results hold true upon further evaluation. A "sensitivity analysis" involves "estimating a variety of alternative specifications after a potential `best' equation has been identified" or otherwise "analyzing data in different ways to see how results depend on methods or assumptions." Studenmund, supra, at 184; accord David H. Kaye & David A. Freedman, Reference Guide on Statistics, Reference Manual on Scientific Evidence 296 (Federal Judicial Center, 3d ed. 2011). Pool contends that Dr. Johnson selected the particular data subsets in an economically rational manner—that is, Dr. Johnson applied Dr. Rausser's regression model to Pool's different geographic areas, product categories, and customer types because "copious documentary and testimonial evidence . . . show[] that economic conditions varied in relation to such differences."
Econometrics literature and antitrust case law support Dr. Johnson's use of sub-regressions to test the results of Dr. Rausser's regression models. For example, an ABA Section of Antitrust Law monograph on econometrics encourages analysts to further test regression results when using regression analyses as a method of proof for classwide impact. According to this source:
Econometrics, supra, at 357-58. Similarly, Professor A.H. Studenmund writes:
Courts have also recognized the usefulness of sub-regressions in antitrust class actions. Indeed, in In re Processed Egg Products Antitrust Litigation, the United States District Court for the Eastern District of Pennsylvania addressed a Daubert challenge to Dr. Rausser's Common Factors regression based on the defense expert's "us[ing] Dr. Rausser's regression model on various subsets of the data and f[inding] inconsistent results." 81 F.Supp.3d 412, 433 (E.D. Pa. 2015). As plaintiffs do here, the plaintiffs in Processed Egg argued that the defense expert's sub-regressions constituted "inappropriate data mining." Id. The court ultimately found Dr. Rausser's Common Factors regression admissible, but added:
Id. at 434.
In light of the foregoing sources, the Court finds that Dr. Johnson's use of sub-regressions is sufficiently reliable to be admissible under Daubert.
The Court also finds that Dr. Johnson's choice of data subsets is sufficiently grounded in the facts of this case to be admissible. As explained, Dr. Johnson conducted regressions across geographic division, product category, and customer type—categories reflected by Pool's sales transaction data. Plaintiffs contend that these classifications are "arbitrary" because Dr. Johnson does not opine that any of these classifications is the relevant product or geographic market in this case, and Dr. Rausser conducted his regressions based on his definition of the relevant market. But as Dr. Johnson explained at his deposition, these subsets are not meant to "direct[ly] overlap with where . . . pricing is determined or how pricing is determined but rather, [Dr. Johnson's regressions] demonstrate[e] that even at this level of aggregation, [Dr. Rausser's] model still fails."
Plaintiffs also seek to exclude the regressions in which Dr. Johnson included sales transactions that contained unit-of-measure information but excluded sales transactions that did not. Plaintiffs argue that Dr. Johnson's approach is "improper" and that Dr. Johnson should have not used the unitof-measure field at all or should have imputed a value for the unit-ofmeasure in those transactions where it was missing. Plaintiffs concede that Dr. Johnson validly determined that using the limited data led to similar results as the using the data for the full time period. Nonetheless, plaintiffs argue that Dr. Johnson "got lucky" and that his regressions using limited data should be excluded "regardless of their outcome."
Plaintiffs fail to cite any econometrics literature or case law for their argument that Dr. Johnson's approach is "improper" and unreliable. Indeed, the only authority plaintiffs rely on supports Dr. Johnson's approach. In that text, the author notes that "complete case analysis," which "simply discard[s]" any observations with missing values, remains "the standard treatment of missing data" and "the most common method in the absence of readily available alternatives." Roderick J.A. Little, Regression with Missing X's: A Review, 87 J. Am Statistical Ass'n 1227, 1229, 1236 (Dec. 1992). Antitrust commentators also note that excluding observations is a reasonable solution. See Econometrics, supra, at 59 ("One solution to the problem of missing data is to drop observations with missing data."). Moreover, plaintiffs ignore that their own expert determined that the "missing information is not . . . driving the results" of the Overcharge regression. Dr. Johnson's approach to the missing data is therefore not unreliable, and the Court will not exclude his opinion on this basis.
In applying Dr. Rausser's regression models, Dr. Johnson used Pool's actual costs, as reflected by Pool's internal data, as an explanatory variable to test the dependent variable, price. As noted, plaintiffs complain that these regressions are unreliable due to an "endogeneity" or "simultaneity" problem. In other words, plaintiffs argue that the regressions are unreliable because Pool's actual costs and the prices Pool charges are jointly determined.
Plaintiffs rely on Dr. Rausser's opinion for this conclusion. According to a footnote in his Supplemental Report, Dr. Rausser is concerned about endogeneity for two reasons.
As an initial matter, part of Dr. Rausser's opinion that endogeneity exists here assumes that collusion among Pool, Pentair, Hayward, and Zodiac distorted the prices of the hundreds or thousands of other Pool Products manufacturers. Notably, the Court has dismissed, either on the pleadings or at summary judgment, all claims involving collusion by Pool and the Manufacturer Defendants and among the Manufacturer Defendants inter se. Dr. Rausser's second theory explains how Pool's procurement costs affect Pool's prices, but it does not explain how increases in the prices Pool charges to its customers must increase the prices manufacturers charge to all of their customers, including those other than Pool. Thus, while Dr. Rausser refers to a theoretical "feedback loop," he does not point to any record evidence that such feedback, in fact, exists between Pool's prices and Pool's costs.
In Dr. Johnson's opinion, "costs unquestionably affect" the prices Pool charges its customers, "but there is no reverse relationship between the two," and thus endogeneity, simultaneity, and feedback are not issues.
Dr. Johnson's reasoning on this issue is sufficiently reliable to allow the trier of fact to consider his opinion, notwithstanding Dr. Rausser's competing position. As noted, plaintiffs have not provided any empirical evidence for their contention that Dr. Johnson's use of actual costs renders his regression analyses wholly unreliable. And as Dr. Rubinfeld explains in his discussion of simultaneity in the Federal Judicial Center's Manual on Scientific Evidence, "there are no basic direct statistical tests for determining the direction of causality; rather, the expert, when asked, should be prepared to defend his or her assumption based on an understanding of the underlying behavior evidence relating to the businesses or individuals involved." See Rubinfeld, supra, at 322-23. Here, both experts have sufficiently explained the basis for their assumptions about the direction of causality.
The case on which plaintiffs rely to exclude Dr. Johnson's opinion, In re Polypropylene Carpet Antitrust Litigation, actually stands for the principle that regressions using a proxy for actual costs and regressions using firm-specific actual costs are both admissible. See 93 F.Supp.2d 1348 (N.D. Ga. 2000). In finding the plaintiffs' expert's opinion admissible in Polypropylene Carpet, the court rejected the defendants' argument that "firm-specific data necessarily is more appropriate than industry-wide data." Id. at 1368. The court also rejected the plaintiffs' argument about the defense expert's approach. The defense expert used internal cost data, including data to which the defendant had "made adjustments." Id. The court held that plaintiffs failed to show that the defense expert's use of internal cost data "affect[ed] the reliability of [his] damages estimate." Id. The same is true here.
Plaintiffs have not demonstrated that econometricians routinely avoid using actual cost data in conducting regressions to predict changes in price. See Fed. R. Evid. 703 (authorizing experts to base an opinion on data upon which "experts in the particular field would reasonably rely"); Sheehan v. Daily Racing Form, Inc., 104 F.3d 940, 942 (7th Cir. 1997) ("Daubert . . . requires the district judge to satisfy [herself] that the expert is being as careful as he would be in his regular professional work outside his paid litigation consulting."). Moreover, plaintiffs have not shown that Dr. Johnson's use of actual costs here is unreliable; they have shown only that Dr. Rausser theorizes that it is and that, for this reason, Dr. Rausser chose to use a proxy instead. Because plaintiffs have not pointed to any record evidence or econometrics test that mandates a different conclusion, Dr. Johnson's competing theory about the direction of causality is no basis to find his opinion unreliable. This dispute is a topic for cross-examination.
Dr. Johnson relies on F-tests to support his conclusion that Dr. Rausser inappropriately pooled numerous sales transactions, regardless of geographic location, product category, or customer type involved in the transactions, when conducting his Common Factors regression and Overcharge regression. Plaintiffs argue that any statistical significance shown by Dr. Johnson's F-tests are due only to the large sample size of sales transactions tested. Thus, plaintiffs contend that Dr. Johnson's F-tests are "meaningless" and therefore "irrelevant and unreliable."
Econometrics literature generally encourages the use of F-tests in data analyses. See, e.g., David S. Moore, et al., The Practice of Statistics for Business and Economics 602 (3d ed. 2011) (noting that F statistics test "the null hypothesis that a collection of . . . explanatory variables all have coefficients equal to zero"); Wooldridge, supra, at 153 (noting that "[t]esting exclusion restrictions is by far the most important application of F statistics"). For example, antitrust commentators explain that F-tests, or Chow tests,
Econometrics, supra, 358. The econometrics literature also warns that large sample sizes of data, in and of themselves, may lead to statistically significant results. See, e.g., Kennedy, supra, 394 ("Very large sample sizes . . . can give rise to estimated coefficients with very small standard errors [that] may test significantly different from zero, creating a misleading impression of what is important."). What the parties' cited literature does not say, however, is at what point a sample size becomes too large to be helpful in testing the relevant hypothesis.
Here, Dr. Johnson conducted F-tests for subsets of data grounded in the facts of this case. He applied the F-tests using variables representing Pool's geographic divisions, product categories, and customer types, as reflected by Pool's internal sales transaction data. As noted, the F-test is well-accepted in econometrics. Without some evidence that Dr. Johnson used a sample size that is too large—from an econometrics standpoint, not merely as a matter of plaintiffs' assertion—this criticism of his statistical testing results is a cross-examination point. See generally In re Vitamin C Antitrust Litig., No. 06-MD-1738, 2012 WL 6675117, at *8 (E.D.N.Y. Dec. 21, 2012) ("Ask[ing] the Court to take sides in a dispute between experts about the intricacies of econometric modeling . . . is not the proper function of [] Daubert."); Manual for Complex Litigation (Fourth) § 23.24 (2004) ("Where the expert's conclusion is drawn from a reliable methodology . . . the correctness of that conclusion is still an issue for the finder of fact.").
In sum, all of plaintiffs' challenges to Dr. Johnson's opinion affect the weight to be assigned to his opinion, rather than its admissibility. See generally United States v. 14.38 Acres of Land, More or Less Situated in Leflore Cty., Miss., 80 F.3d 1074, 1077 (5th Cir. 1996) (quoting Viterbo v. Dow Chem. Co., 826 F.2d 420, 422 (5th Cir. 1987)). Affording the "proper deference to the jury's role as the arbiter of disputes between conflicting opinions," the Court denies plaintiffs' motion to exclude Dr. Johnson's opinion and related testimony. See id.