LUCY H. KOH, District Judge.
On January 9, 2014, Defendants jointly moved to strike portions of Dr. Edward Leamer's reply report. ECF No. 557 ("Strike Mot."). Plaintiffs filed an opposition. ECF No. 600 ("Strike Opp."). Defendants filed a reply. ECF No. 714 ("Strike Reply"). On January 10, 2014, Defendants jointly moved to exclude the testimony of Dr. Leamer. ECF No. 570 ("Leamer Mot."). Plaintiffs filed an opposition. ECF No. 604 ("Leamer Opp."). Defendants filed a reply. ECF No. 715 ("Leamer Reply."). On January 9, 2014, Defendants filed a joint motion for summary judgment based on their motion to exclude Dr. Leamer's testimony. ECF No. 556. Plaintiffs filed an opposition. ECF No. 603. Defendants filed a reply. ECF No. 712.
The Court held a hearing on these motions on March 27, 2014. Having considered the briefing, relevant law, and oral argument, the Court GRANTS in part and DENIES in part Defendants' motion to strike Dr. Leamer's report, DENIES Defendants' motion to exclude Dr. Leamer's testimony under Daubert, and DENIES Defendants' joint motion for summary judgment.
Plaintiffs Michael Devine, Mark Fichtner, Siddharth Hariharan, and Daniel Stover, on behalf of themselves and a class of those similarly situated, filed the instant litigation against Defendants Adobe Systems Inc. ("Adobe"), Apple Inc. ("Apple"), Google Inc. ("Google"), Intel Corp. ("Intel"), Intuit Inc. ("Intuit"), Lucasfilm Ltd. ("Lucasfilm"), and Pixar. ECF No. 65. Plaintiffs allege that the Defendants entered into several bilateral agreements with each other pursuant to which the parties to the agreement would not cold call each other's employees. Id. ¶ 55. The crux of Plaintiffs' complaint is that these bilateral agreements together form an overarching conspiracy that suppressed wages for all of Defendants' employees. Id. Plaintiffs contend that Defendants' agreements violated Section 1 of the Sherman Antitrust Act, 15 U.S.C. § 1, and Section 4 of the Clayton Antitrust Act, 15 U.S.C. § 15.
Plaintiffs filed a Consolidated Amended Complaint, the operative complaint, on September 13, 2011. See id. Defendants filed a Joint Motion to Dismiss the consolidated amended complaint on October 13, 2011, see ECF No. 79, and, with leave of the Court, Lucasfilm filed its separate Motion to Dismiss on October 17, 2011, see ECF No. 83. Following full briefing on both motions and a hearing on January 26, 2012, see ECF No. 108, the Court granted in part and denied in part Defendants' Joint Motion to Dismiss and denied Lucasfilm's Motion to Dismiss on April 18, 2012, see ECF No. 119.
On October 1, 2012, Plaintiffs filed their motion for class certification, in which Plaintiffs sought to certify a class made up of all of Defendants' employees during the conspiracy period. After full briefing and a hearing, the Court granted in part and denied in part the motion on April 5, 2013. See ECF No. 382 ("April Order"). In that order, the Court denied the motion to certify the class, but appointed interim Co-Lead Counsel and Class Counsel. Id. The Court's analysis focused on the predominance requirement of Rule 23(b)(3) of the Federal Rules of Civil Procedure. The Court found that Plaintiffs had not demonstrated that common questions would predominate with respect to the antitrust impact element of Plaintiffs' claim. Id. at 29. The Court, however, gave Plaintiffs leave to amend to address the Court's concerns in light of the fact that Defendants had not produced the discovery needed for class certification. Id. at 47, 52.
On May 10, 2013, Plaintiffs filed a supplemental motion for class certification, seeking certification of a narrower class of technical employees. While the motion was pending, Plaintiffs reached a settlement with Pixar, Lucasfilm, and Intuit, which the Court has preliminarily approved. After full briefing and a hearing, the Court granted Plaintiffs' motion for class certification on October 24, 2013. ECF No. 531 ("October Order"). The Court certified the class of technical employees because Plaintiffs had met their burden under Rule 23. Defendants sought interlocutory review of the Court's class certification order. On January 14, 2014, however, the Ninth Circuit exercised its discretion to deny Defendants' petition for immediate review. ECF No. 594.
On March 28, 2014, after full briefing, the Court denied the Defendants' individual motions for summary judgment filed by Adobe, Apple, Google, and Intel. See ECF No. 771. This Order addresses Defendants' joint motion to strike Dr. Leamer's reply report, Defendants' joint motion to exclude Dr. Leamer's testimony under Daubert, and Defendants' joint motion for summary judgment based on their motion to exclude the testimony of Dr. Leamer.
Federal Rule of Evidence 702 allows admission of expert opinions based on "scientific, technical, or other specialized knowledge" if such an opinion would "help the trier of fact to understand the evidence or to determine a fact in issue." Fed. R. Evid. 702. Expert testimony is admissible if it is both relevant and reliable. Daubert v. Merrell Dow Pharms., Inc., 509 U.S. 579, 589 (1993). When considering expert testimony, the trial court acts as a "gatekeeper" by assessing the soundness of the expert's methodology to exclude "junk science." Estate of Barabin v. AstenJohnson, Inc., 740 F.3d 457, 463 (9th Cir. 2014); see Kumho Tire Co. v. Carmichael, 526 U.S. 137, 147-48 (1999); Daubert, 509 U.S. at 589-90. An expert witness may provide opinion testimony if: (1) the testimony is based upon sufficient facts or data; (2) the testimony is the product of reliable principles and methods; and (3) the expert has reliably applied the principles and methods to the facts of the case. Fed. R. Evid. 702. Under Daubert, in determining reliability, courts can consider (1) whether a theory or technique "can be (and has been) tested;" (2) "whether the theory or technique has been subjected to peer review and publication;" (3) "the known or potential rate of error;" and (4) whether there is "general acceptance" of the methodology in the "relevant scientific community." Daubert, 509 U.S. at 593-94.
Rule 702 "mandates a liberal standard for the admissibility of expert testimony." Cook v. Rockwell Int'l Corp., 580 F.Supp.2d 1071, 1082 (D. Colo. Dec. 7, 2006); Daubert, 509 U.S. at 588 (Rule 702 is part of the "liberal thrust" of the Federal Rules of Evidence); Dorn v. Burlington N. Sante Fe R.R. Co., 397 F.3d 1183, 1196 (9th Cir. 2005) ("The Supreme Court in Daubert [] was not overly concerned about the prospect that some dubious scientific theories may pass the gatekeeper and reach the jury under the liberal standard of admissibility set forth in that opinion[.]"). Thus, the inquiry into admissibility of expert opinion is a "flexible one," where "[s]haky but admissible evidence is to be attacked by cross examination, contrary evidence, and attention to the burden of proof, not exclusion." Primiano v. Cook, 598 F.3d 558, 564 (9th Cir. 2010) (citing Daubert, 509 U.S. at 596). The "district judge is `a gatekeeper, not a fact finder.' When an expert meets the level established by Rule 702 as explained in Daubert, the expert may testify and the jury decides how much weight to give that testimony." Id. (citation omitted).
Rule 26(a)(2)(B) provides that an expert witness's opening report must contain "a complete statement of all opinions the witness will express and the basis and reasons for them" together with "the facts or data considered by the witness in forming them" and "any exhibits that will be used to summarize or support them." Fed. R. Civ. P. 26(a)(2)(B)(i)-(iii). Rebuttal disclosures of expert testimony are "intended solely to contradict or rebut evidence on the same subject matter identified by another party" in its expert disclosures. Fed. R. Civ. P. 26(a)(2)(D)(ii). "Rule 37(c)(1) gives teeth to these requirements by forbidding the use at trial of any information required to be disclosed by Rule 26(a) that is not properly disclosed." Yeti by Molly, Ltd. v. Deckers Outdoor Corp., 259 F.3d 1101, 1106 (9th Cir. 2001). This rule requires the exclusion of untimely expert witness testimony, unless the "part[y's] failure to disclose the required information is substantially justified or harmless." Id. (citation omitted). The moving party bears the burden of showing a discovery violation has occurred. See Hernandez ex rel. Telles-Hernandez ex-rel. Telles-Hernandez v. Sutter Medical Center of Santa Rosa, 2008 WL 2156987, at *13 (N.D. Cal. May 20, 2008). Once that burden is satisfied, the burden shifts and the nonmoving party must prove that its failure to comply with Rule 26 was either justified or harmless. Yeti by Molly, 259 F.3d at 1107.
Defendants move to strike portions of Dr. Leamer's December 2013 reply report and to exclude Dr. Leamer's testimony under Daubert. Specifically, Defendants move to strike Dr. Leamer's use of a 50% statistical significance theory to defend his "conduct regression," Dr. Leamer's arguments relating to the "total new hires" variable in his conduct regression, and Dr. Leamer's arguments relating to his use of real compensation in his conduct regression. Defendants move to exclude under Daubert Dr. Leamer's testimony, raising four specific challenges to his conduct regression model.
The Court first sets forth the relevant history of expert reports submitted in this case, a summary of Dr. Leamer's conclusions, and a summary of significance testing as necessary context and background for Defendants' motions to strike and exclude Dr. Leamer's testimony. For reference, the Court notes that all the challenges in Defendants' motion to strike and motion to exclude pertain solely to Dr. Leamer's conduct regression model detailed below.
At the class certification stage, Dr. Leamer submitted four expert reports on Plaintiffs' behalf: (1) October 1, 2012 ("Class Cert. Opening Rep."), ECF No. 190; (2) December 10, 2012 ("Class Cert. Reply Rep."), ECF No. 558-4; (3) May 10, 2013 ("Suppl. Class Cert. Rep."), ECF No. 558-5; and (4) July 12, 2013 ("Suppl. Class Cert. Reply Rep."), ECF No. 454-4. In addition, at the class certification stage, defense expert Dr. Kevin Murphy submitted a report on November 12, 2012 ("Murphy Class Cert. Rep."), ECF No. 230,
On October 28, 2013, Dr. Leamer
Plaintiffs submitted four reports from Dr. Leamer in support of their argument at the class certification stage that common issues predominate for the purpose of assessing classwide impact and damages.
As explained below, Dr. Leamer's analysis with respect to the first question proceeded in two steps. First, Dr. Leamer explained that economic theory, documentary evidence, and multiple regression analyses were capable of showing that the anti-solicitation agreements tended to suppress employee compensation generally by preventing class members from discovering the true value of their work. Id. ¶¶ 11(a)-(b), 63. Second, Dr. Leamer illustrated how economic theory, documentary evidence, and statistical analyses are capable of showing that this suppression of compensation affected all or nearly all class members. Id. ¶¶ 11(c), 64.
Dr. Leamer first concluded that classwide evidence was capable of showing that the anti-solicitation agreements suppressed compensation of class members generally. This first step was supported by principles of information economics, such as "market price discovery." Dr. Leamer noted that, when evaluating labor markets, economists often use a market equilibrium model, which "presume[s] that market forces . . . work rapidly enough that virtually all transactions occur at approximately the same price—the `market price' which equilibrates supply and demand." Id. ¶ 71. In reality, when labor market conditions change, high transaction costs and limited information flow can slow the process by which transaction prices reach market equilibrium. Id. ¶¶ 72-73. "Market price discovery" is the process by which participants in a market search for this equilibrium. Id. ¶ 71.
Dr. Leamer opined that the high transaction costs—including time, money, and personal dislocation—involved in searching for high tech jobs limit the number of existing workers seeking new employment. Id. ¶ 74. Defendants and other high tech companies value potential employees who are not actively looking for new employment opportunities ("passive candidates") more than those who are looking for new jobs ("active candidates") because currently satisfied employees: (1) tend to be perceived as more qualified, diligent, and reliable; (2) often have training, on-the-job experience, and track records that save the hiring company search and training costs; and (3) are valuable assets that, if hired away from rivals, can harm competitors. Id. ¶ 62. Thus, recruiting these passive candidates by cold calling is both an important tool for employers and a key channel of information for employees about outside opportunities. Id. ¶¶ 57-62, 75.
Dr. Leamer hypothesized that, by restricting cold calling and other competition over employees, Defendants' anti-solicitation agreements impaired information flow about compensation and job offers. Defendants' inhibition of employees' ability to discover and obtain the competitive value of their services meant employees were afforded fewer opportunities to increase their salaries by moving between firms and deprived of information that could have been used to negotiate higher wages and benefits within a firm. Id. ¶¶ 71-76. In addition, by limiting the information available to employees, Defendants could avoid taking affirmative steps, such as offering their employees financial rewards and other forms of profit sharing, to retain employees with valuable firm-specific skills. Id. ¶¶ 77-80.
Dr. Leamer relied on documentary evidence as further support for the link between the anti-solicitation agreements and compensation reduction. Id. ¶¶ 81-88. He also performed regression analyses
Dr. Leamer's second step was to opine that economic theory, documentary evidence, and statistical analyses were capable of showing that this compensation suppression had widespread effects—i.e., that suppression of compensation affected all or nearly all class members. Id. ¶ 101. Dr. Leamer first relied on economic theories of loyalty, fairness, and internal equity to explain how the adverse effects on compensation due to Defendants' anti-solicitation agreements would have been felt by employees who would have received a cold call or had a significant chance of receiving a cold call and employees who are linked to these groups due to internal equity considerations. Suppl. Class Cert. Reply Rep. ¶¶ 27-28. In other words, Dr. Leamer contended that labor markets rely on committed long-term relationships built on trust, understanding, and mutual interests. Class Cert. Opening Rep. ¶ 102. Thus, both employers and employees seek ways to turn the market transaction into secure long-term relationships, which "can come either from commitment (emotional or financial) to the mission of the organization, or from jointly owned firm-specific assets." Id. Companies thus attempt to create loyalty "by getting buy-in from the firm's mission and by making the place of work as appealing as possible." Id. ¶ 103.
"One foundation of employee loyalty is a feeling of fairness that can translate into a sharing of . . . [a firm's] rewards with more equality than a market might otherwise produce." Id. ¶ 104. Firms seek to promote a feeling of fairness among employees to maintain or to increase employees' commitment and contentment, which also leads to higher levels of productivity. Suppl. Class Cert. Rep. ¶ 16. Dr. Leamer explained that, "[t]o maintain loyalty, it is usually better for a firm to anticipate rather than to react to outside opportunities, since if a worker were to move to another firm at a much higher level of compensation, coworkers left behind might feel they have not been fairly compensated. That can have an adverse effect on worker loyalty, reducing productivity and increasing interest in employment elsewhere." Class Cert. Opening Rep. ¶ 105.
Dr. Leamer opined that the information conveyed by an outside offer or a cold call could stimulate a response by management that could extend beyond the specific individual who received the cold call. Suppl. Class Cert. Rep. ¶ 15. Even though the market may not mandate a rise in compensation for these similar individuals until they actually receive an outside offer, "preemptive improvements" can minimize the disruption to employee loyalty that might occur when an employee discovers the she was undercompensated. Class Cert. Opening Rep. ¶ 105. Thus, "[c]old-[c]alling—as well as just the threat of [c]old-[c]alling—puts upward pressure on compensation." Id. ¶ 106. Dr. Leamer opined that "a broad preemptive response is completely analogous to salary increases that are tied to information provided by employment services regarding the compensation offered by the `market.'" Suppl. Class Cert. Rep. ¶ 15. Essentially, Dr. Leamer opined that the "response to bursts of cold calls and, even more, the response to the threat of cold calls" would raise internal equity concerns that would spread the impact throughout the class. Suppl. Class Cert. Reply Rep. ¶ 27. Dr. Leamer also noted that the documentary evidence showed that Defendants each employed company-wide compensation structures that included grades and titles, and that high-level management established ranges of salaries for grades and titles, which left little scope for individual variation. Class Cert. Opening Rep. ¶¶ 121-22.
Dr. Leamer also utilized statistical analyses as evidence that the anti-solicitation agreements broadly affected members of the class. Id. ¶¶ 120-34. These regressions were based on Defendants' salary structures and compensation data. Id. ¶¶ 127-30, Figs. 11-14. These "Common Factors Analyses" assessed Defendants' "firmwide compensation structures, and the formulaic way in which total compensation was varied over time." Id. ¶ 128. According to Dr. Leamer, approximately 90 percent of the variation in any individual employee's compensation could be explained by common factors "such as age, number of months in the company, gender, location, title, and employer." Id.; see also id., Figs. 11-14. Dr. Leamer concluded that "[t]he fact that nearly all variability in class member compensation at any point in time can be explained by common variables means there was a systematic structure to employee compensation at each of the Defendant firms." Id. ¶ 130. Dr. Leamer opined that these rigid wage structures, and the fact that the coefficients in his regressions did not vary substantially over time, suggested that "compensation of class members tended to move together over time and in response to common factors," such that the effects of the anti-solicitation agreements would be expected to be experienced broadly. Id.
The second question Plaintiffs asked Dr. Leamer to assess was whether there was a classwide method of quantifying the total amount of suppressed compensation suffered by the class generally. Id. ¶ 10(b). Dr. Leamer concluded that a regression could quantify the estimated cost to the class resulting from Defendants' challenged conduct—in terms of wage suppression during the periods when anti-solicitation agreements were in effect for each Defendant. Id. ¶¶ 141-48. This is the regression model Defendants challenge in Defendants' instant motion to strike and motion to exclude Dr. Leamer's testimony. Dr. Leamer's model, to which the Court previously referred as the "conduct regression," uses the real annual compensation of each employee in each year as the dependent variable, and includes various independent variables designed to account for factors including: (1) age, sex, and years at the company; (2) the effects on compensation caused by the anti-solicitation agreements; (3) the effects caused by factors specific to each Defendant (e.g., firm revenue, total number of new hires, etc.); and (4) the effects caused by the industry. Id.; id. Fig. 23.
The model is intended to predict the average effect of the anti-solicitation agreements on compensation, holding other compensation-related variables constant. The critical independent variable is the general "conduct variable," which represents "the fraction of months in each year during which the employer was involved in one or more of the agreements." Id. ¶ 145. This variable "estimate[s] the immediate impact of the illegal conduct." Id. ¶ 146. The model also includes three interaction variables representing the interaction between the general conduct variable and employee age, employee age squared, and the hiring rate at an employee's firm
More specifically, the conduct regression estimates the effect of the anti-solicitation agreements by contrasting compensation during the periods when the anti-solicitation agreements were in effect with compensation before and after the anti-solicitation agreements. Class Cert. Opening Rep. ¶ 136; Class Cert. Reply Rep. ¶ 72. The model generates percentages—or regression estimates—by which Defendants undercompensated the class employees in each of the conspiracy years. See Class Cert. Opening Rep., Fig. 24 ("Estimated Impact on Technical Employee Class Total Compensation").
In his October 2013 opening merits report, Dr. Leamer explained that his original conduct regression that utilized individual employee compensation data and was outlined in his October 2012 report (hereinafter "original conduct regression") continued to be the best approach for estimating the total impact on the class as well as the damages the class suffered. Leamer Opening ¶¶ 24, 29-31.
The Court now provides an overview of null hypothesis testing, which is discussed throughout Defendants' motions. Statisticians often measure the accuracy of a regression model's estimates using what is called "significance testing" or "null hypothesis testing." Ref. Manual at 241. Statisticians determine whether the results are statistically significant enough such that they can reject the "null hypothesis" of zero effect, which means that the independent variable being tested has no actual impact on the dependent variable and that whatever relationship is shown in the model occurred due to random chance. Id. at 342, 354. In this case, the null hypothesis of zero effect would be that the anti-solicitation agreements had no actual impact on compensation.
"Significance level" is a term of art used in significance testing. Id. at 287. "The significance level measures the probability that the null hypothesis will be rejected incorrectly." Id. at 320. If there is less than an X% probability the independent variable's coefficient could have occurred simply due to random chance, then the null hypothesis can be rejected at the X% significance level. If there is more than X% probability that the result occurred by chance, the null hypothesis cannot be rejected at the X% significance level. In other words, if the coefficient is statistically significant at the 5% significance level, there is no more than a 5% likelihood that one would observe that relationship between the independent variable and dependent variable merely by chance. A 5% significance level "indicates that the demonstrated relationship between the variables would occur in a random sample five times out of one hundred[.]" White v. City of San Diego, 605 F.2d 455, 460 (9th Cir. 1979). The smaller the significance level at which one rejects the null hypothesis, the greater the confidence one has that the null hypothesis has been correctly rejected and that the regression's estimate is correct.
Statistical significance is determined by reference to a "p-value." Ref. Manual at 241. A "p-value" for a variable tests the null hypothesis that the coefficient for that variable is equal to zero.
Statisticians can also test the null hypothesis by looking at the variable's "t-statistic." Ref. Manual at 342. If the t-statistic is less than 1.96 in magnitude, then at the 5% level, the statistician cannot reject the hypothesis that the estimate equals zero, so the estimate is said to not be statistically significant at the 5% level. Id. at 343. Conversely, if the t-statistic is greater than 1.96 in absolute value, the statistician concludes the true value of the coefficient is unlikely to be zero, the null can be rejected, and the estimate is deemed statistically significant at the 5% level. Id.
Defendants move to strike three sections of Dr. Leamer's December 2013 reply report, claiming these new opinions should have been included in his October 2013 opening merits report. Strike Mot. at 1-2. For the reasons set forth below, the Court GRANTS IN PART AND DENIES IN PART Defendants' motion. The Court addresses each of Defendants' three contentions in turn.
First, Defendants contend Paragraphs 75-90 & Figs. 15-16 should be stricken as improper rebuttal because Dr. Leamer argues for the first time that his original conduct regression with clustered standard errors, see Leamer Opening, Exhibit 3, should be evaluated using a 50% statistical significance level if null hypothesis testing is to be used to assess the reliability of his model. Strike Mot. at 3-4. The Court agrees, and thus precludes Dr. Leamer from testifying about that opinion at trial.
In his December 2013 reply report, Dr. Leamer argues for the first time that if null hypothesis testing is to be used, a 50% level should be used to determine the statistical significance of the variables' coefficients in his original conduct regression with clustered errors, and opines that the coefficient on the general conduct variable is statistically significant at that level. Leamer Reply Rep. ¶¶ 75-90 & Figs. 15-16. Dr. Leamer presents the theory that this 50% level is the necessary result of balancing the risks and costs of "Type I" and "Type II" statistical errors,
Plaintiffs argue that Dr. Leamer's analysis in his reply is proper rebuttal because it responds to Dr. Stiroh's criticism that Dr. Leamer's original conduct regression with clustered errors is unreliable because it fails to meet the 1%, 5%, or 10% levels, and also because Dr. Murphy never made this criticism, so Dr. Leamer "could not possibly have anticipated this [argument in his opening merits report]." Strike Opp. at 4. Plaintiffs are incorrect. Below, the Court first sets forth where Dr. Murphy made this precise criticism, and sets forth Dr. Leamer's responses to that criticism in Dr. Leamer's various reports, which notably do not mention any theory that a 50% significance level should be used to evaluate his original conduct regression model with clustered errors. Dr. Leamer had four expert reports in which he could have responded to Dr. Murphy's criticism in the manner he does in his December 2013 reply report, but he did not.
In his November 2012 class certification report, Dr. Murphy explicitly made the criticism that Dr. Leamer's original conduct regression with clustered errors is unreliable because it fails to meet the 1%, 5%, or 10% levels. More specifically, Dr. Murphy explained that Dr. Leamer's conduct regression failed to account for the fact that compensation for employees within the same firm is correlated. Murphy Class Cert. Rep. ¶ 126. Dr. Murphy contended that, given this correlation, Dr. Leamer should have clustered the standard errors in his model. Id. Critically, Dr. Murphy opined that when the errors are clustered, the general conduct variable's coefficient is not statistically significant at the 1%, 5%, and 10% levels when null hypothesis testing is conducted, and also that Dr. Leamer's final "undercompensation" percentages were not statistically significant at the 5% level. Id. ¶ 128; Ex. 21B ("Dr. Leamer's [] Regression Using Corrected Standard Errors"); Ex. 22B ("Dr. Leamer's Undercompensation Estimates Are Not Statistically Significant [at the 5% level]."). Dr. Murphy further noted, "The p-values imply that Dr. Leamer's estimates are completely consistent with there being no true effect of the desired conduct and his estimates resulting entirely from random factors unrelated to that conduct. Thus, once properly analyzed, Dr. Leamer's conduct regression provides no meaningful evidence that the challenged agreements reduced compensation[.]" Id. ¶ 128. He also emphasized Dr. Leamer did "not even acknowledge in his report that his reported standard errors and resulting t-statistics . . . were not meaningful." Id. ¶ 126.
Dr. Leamer responded to Dr. Murphy's critique in his December 2012 reply report but did not do so by setting forth his theory that a 50% significance level should be used to evaluate his original conduct regression with clustered errors. Rather, he argued that clustering standard errors is only one way of controlling for correlations between employees. Class Cert. Reply Rep. ¶¶ 76, 78, 82-83. Another approach would be to include variables to explain the commonalities across firms and capture the common sources of variation between employees. Id. ¶ 76, 83.
In his May 2013 supplemental class certification report, Dr. Leamer did not respond to Dr. Murphy's criticism.
In his October 2013 opening merits report, Dr. Leamer addressed Dr. Murphy's criticism, but did so in a different way than his December 2012 reply report by actually running his original conduct regression with clustered errors as Dr. Murphy had recommended. Leamer Opening ¶ 28; Ex. 2 ("Compensation Model [Without Clustered Standard Errors]"); Ex. 3 ("Compensation Model with Clustered Standard Errors"). Dr. Leamer opined that although clustering the errors changed the standard errors for each variable (in comparison to his regression which did not cluster the errors), the change had "no impact on the estimates of damages" because the variables had the same exact coefficients in both models. Id. ¶¶ 26-28; Exs. 2 & 3. Again here, Dr. Leamer did not set forth his theory that a 50% significance level should be used to evaluate his original conduct regression with clustered errors.
As the above timeline reflects, the fact that Dr. Murphy made the exact same criticism as Dr. Stiroh in Dr. Murphy's November 2012 report demonstrates that Dr. Leamer knew about this criticism long before Dr. Stiroh's report and thus had four reports before Dr. Leamer's December 2013 reply in which he could have set forth his theory that a 50% significance level should be used to evaluate his original conduct regression with clustered errors. Yet he did not. For example, in his December 2012 reply, Dr. Leamer did not defend the reliability of his original conduct regression with clustered errors against Dr. Murphy's attack by rebutting that the statistical significance of that regression should be evaluated at the 50% level. Rather, he ran an alternative regression he claimed obviated the need for clustering. Class Cert. Reply Rep. ¶ 103, 106. In his October 2013 merits report, Dr. Leamer did run his original conduct regression with clustered errors but still did not defend the reliability of that model by stating that statistical significance should be evaluated at the 50% level. To the contrary, Dr. Leamer's own exhibit displaying the regression with clustered errors reports that the general conduct variable's coefficient is not statistically significant at the 1%, 5%, and 10% levels,
This Court's April Order further illuminates why Dr. Leamer's new theory is untimely disclosed. The Court held that "the fact that, when the errors are clustered, the Conduct Regression's results are not statistically significant at the 95 percent level
In sum, because Plaintiffs waited until after Defendants had filed their last expert report for Dr. Leamer to offer a new theory, Plaintiffs have violated Rule 26(a)(2)(B)'s requirement that an expert witness's opening report contain "a complete statement of all opinions the witness will express and the basis and reasons for them" together with "the facts or data considered by the witness in forming them." Fed. R. Civ. P. 26(a)(2)(B)(i)-(iii). Plaintiffs will not be allowed to "sandbag" Defendants with new analysis that should have been included at the very least in Dr. Leamer's opening merits report. Oracle Am., Inc. v. Google Inc., No. C 10-03561 WHA, 2011 WL 5572835, at *3 (N.D. Cal. Nov. 15, 2011) (granting motion to strike and noting expert disclosure schedule "was designed to forestall `sandbagging' by a party with the burden of proof who wishes to save its best points for reply, when it will have the last word, a common litigation tactic."). Dr. Stiroh had no chance to rebut Dr. Leamer's theory because expert discovery has closed. "This immunity, combined with the element of surprise, would be unfair." Id. While Defendants have proven a discovery violation, Plaintiffs have not proven that their failure to comply with Rule 26 was either justified or harmless. See Yeti by Molly, 259 F.3d at 1107; Negrete v. Allianz Life Ins. Co. of N. Am., 2013 WL 6535164, at *24 (C.D. Cal. Dec. 9, 2013) ("[P]laintiffs do not explain how their tardy disclosure was either substantially justified or harmless under Fed. R. Civ. P. 37(c)(1).").
The Court now addresses Defendants' request to strike Paragraphs 115-20 & Figs. 17-18 of Dr. Leamer's reply on the ground that these sections contain new arguments in support of Dr. Leamer's "total new hires" variable.
Third, Defendants seek to strike Paragraphs 108-110 on the grounds that Dr. Leamer "introduces for the first time a justification for using real compensation as a metric in Dr. Leamer's model instead of nominal compensation." Strike Mot. at 9. The Court denies Defendants' request. Dr. Leamer has utilized real compensation in all his regressions since his October 2012 report. See, e.g., Class Cert. Opening Rep. Figs. 20 & 23 (dependent variable is total annual compensation of each employee divided by the CPI to adjust for inflation); Leamer Opening ¶¶ 20, 41, Exs. 2-6. Dr. Murphy did not challenge Dr. Leamer's use of real compensation in any of Dr. Murphy's reports in opposition to class certification. In her rebuttal report, Dr. Stiroh opines that Dr. Leamer's conduct regression is unreliable because he utilizes real compensation by adjusting the model for inflation; Dr. Stiroh claims that "running the model on nominal figures would be expected to produce a more accurate result." Stiroh Rebuttal ¶ 174. Dr. Stiroh opines that when nominal compensation is utilized, the resulting damages estimate is $1.8 billion as opposed to the $3.06 billion Dr. Leamer's model estimates. Id. ¶¶ 175-76; Ex. V1.1. Dr. Stiroh thus claims that Dr. Leamer's damages appear to be caused by "changes in inflation[.]" Id. ¶ 176. In response, Dr. Leamer claims Dr. Stiroh's critique is invalid because using nominal compensation assumes that the labor market determines nominal, not real wages, which is contrary to mainstream economic thinking. Leamer Reply Rep. ¶¶ 108-110. Such an opinion is appropriate rebuttal because Dr. Leamer is entitled to respond to Dr. Stiroh's criticism.
Defendants move to exclude Dr. Leamer's conduct regression under Daubert on four grounds: (1) the general conduct variable lacks statistical significance and the Court should reject Dr. Leamer's attempt to justify his model based on a 50% significance level; (2) the regression fails to distinguish between any alleged impact from the anti-solicitation agreements and conduct not at issue; (3) the "total new hires" variable is inconsistent with Plaintiffs' theory of harm; and (4) the regression is incapable of showing each class member was injured. Leamer Mot. at 1-2.
As a preliminary matter, the Court notes that it held in its October Order that Dr. Leamer's conduct regression was "statistically robust," supported by the economic literature, and "capable of calculating classwide damages." October Order at 82; see also April Order at 35. Further, numerous courts have held that regression analysis is generally a reliable method for determining damages in antitrust cases and is "a mainstream tool in economic study." In re Industrial Silicon Antitrust Litig., No. 95-2104, 1998 WL 1031507, at *2 (W.D. Pa. Oct. 13, 1998); Petruzzi's IGA Supermarkets. Inc. v. Darling-Delaware Co., Inc., 998 F.2d 1224, 1237-41 (3d Cir. 1993) (admitting regression analysis for use in calculating antitrust damages); In re Flat Glass Antitrust Litigation, 191 F.R.D. 472, 486 (W.D. Penn. Nov. 5, 1999) ("[R]egression analysis is one of the mainstream tools in economic study and it is an accepted method of determining damages in antitrust litigation.") (citation omitted). With this context in mind, the Court addresses each of Defendants' arguments in turn below.
Defendants' first challenge is that Dr. Leamer's conduct regression is unreliable because two of its variables lack statistical significance at the 1%, 5%, and 10% levels when null hypothesis testing is used.
In null hypothesis testing, "standard errors" determine the statistical significance of a variable's coefficient—i.e., determine whether the model provides statistically reliable evidence that the true value of the estimate (the independent variable's coefficient) is different from zero. ECF No. 574, "Stiroh Decl." ¶ 3. In addition, the fact that a coefficient is not statistically significant at a certain significance level means the null hypothesis (that the independent variable has no actual effect on the dependent variable) cannot be rejected at that significance level. Here, Dr. Leamer's own exhibit, which reports the results of his original conduct regression model with clustered standard errors, reports that two of his variables, including the general conduct variable, are not statistically significant at the 1%, 5%, and 10% levels. Leamer Opening, Ex. 3. Defendants argue this means Dr. Leamer's regression has been unable to estimate those variables' coefficients "with sufficiently reasonable precision to conclude their true value — or the impact of the challenged agreements — is different from zero." Leamer Mot. at 7.
The Court finds that the fact that these two variables are not statistically significant at the 1%, 5%, and 10% levels goes to the weight, not the admissibility of Dr. Leamer's model. As an initial matter, the Court acknowledges that there is certainly ample evidence that these three levels are the "conventional" levels statisticians typically use. ATA Airlines, 665 F.3d at 895 (noting that a 95% confidence interval — which reflects a statistical significance level of 5% — is "the standard criterion of reasonable confidence used by statisticians"); Contreras v. City of L.A., 656 F.2d 1267, 1273 n.3 (9th Cir. 1981) ("[A] .05 level of statistical significance . . . is generally recognized as the point at which statisticians draw conclusions[.]") (citation omitted); Madani v. Equilon Enterprises LLC, CV 04-10370 JVS JTLX, 2009 WL 2148664 (C.D. Cal. July 13, 2009) ("The `generally accepted' rates in the economic community [are] 5-10 %[.]") (citation omitted); Ref. Manual at 251-52 (statistical analysts typically use the 5% and 1% levels); Omnibus Brown Decl., ECF No. 716, Ex. H, Jeremy Foster et al., Understanding and Using Advanced Statistics 1, 6 (2006) (noting that these are the three conventional levels used); id. Ex. K, MARNO VERBEEK, A GUIDE TO MODERN ECONOMETRICS 31 (2d ed. 2004) (same); id., Ex. N, R. Carter Hill, William E. Griffiths & Guay C. Lim, PRINCIPLES OF ECONOMETRICS 710 (4th ed. 2011) (same); Rubinfeld at 431 (same).
This notwithstanding, the fact that Dr. Leamer's model fails to meet these three levels does not convince the Court that his model is so methodologically flawed as to warrant exclusion. For one thing, Plaintiffs cite evidence that null hypothesis testing is not a requirement of statistical analysis, because it is not the only test of reliability statisticians use. Plaintiffs also present evidence that some scholars believe that the conventional levels should not be blindly applied in every case but that a level should be selected after a careful consideration of the particular study at hand. See Harvey Decl., ECF No. 607, Ex. 20, William H. Kruskal, Tests of Significance, in 2 INT'L ENCYCLOPEDIA OF STATISTICS 955 (William H. Kruskal & Judith M. Tanur ed., 1978) ("Significance testing is an important part of statistical theory and practice, but it is only one part, and there are other important ones."); id., Ex. 19, PETER KENNEDY, A GUIDE TO ECONOMETRICS 61 (2003) (noting that the opinion that "hypothesis testing is overstated, overused, and practically useless as a means of illuminating what the data in some experiment are trying to tell us" is "shared by many") (citation omitted); id., Ex. 17, R.A. FISHER, STATISTICAL METHODS AND SCIENTIFIC INFERENCE 45 (3d. ed. 1973) ("[I]t would clearly be illegitimate for one to choose the actual level of significance . . . as though it were his lifelong habit to use just this level."). There is also case law in support of these scholarly positions. See, e.g., Cook, 580 F. Supp.2d at 1091 ("[S]cientific endeavor takes many forms, many of which do not involve hypothesis testing."); Kadas v. MCI Systemhouse Corp., 255 F.3d 359, 362 (7th Cir. 2001) ("The 5 percent test is arbitrary; it is influenced by the fact that scholarly publishers have limited space and don't want to clog up their journals and books with statistical findings that have a substantial probability of being a product of chance rather than of some interesting underlying relation between the variables of concern.").
Second, Defendants have not cited, nor has this Court found, any case holding that a regression model must reject a null hypothesis of zero effect at least at the 10% significance level in order to be admissible.
Finally, the Ninth Circuit has held that lower courts are "not to confuse the role of judge and jury by forgetting that `vigorous cross-examination, presentation of contrary evidence, and careful instruction on the burden of proof,' rather than exclusion, `are the traditional and appropriate means of attacking shaky but admissible evidence.'" United States v. Chischilly, 30 F.3d 1144, 1154 (9th Cir. 1994) (quoting Daubert, 509 U.S. at 596). Heeding this admonition, this Court previously denied Defendants' Daubert challenge to Dr. Leamer's conduct regression at the class certification stage by holding that "the fact that, when the errors are clustered, the Conduct Regression's results are not statistically significant at the 95 percent level does not persuade the Court that the regression is inadmissible (although this failure might affect the model's probative value)." April Order at 42 (rejecting Defendants' Motion to Strike Dr. Leamer's Testimony, ECF No. 210, at 16). The Court reasoned it was sufficient that Dr. Leamer's model could be "attacked by cross examination, contrary evidence, and attention to the burden of proof." Id. at 50 (citing Primiano, 598 F.3d at 564). Because Defendants have provided no compelling reason why the Court should deviate from that conclusion, Defendants' first Daubert challenge is DENIED.
Defendants' second Daubert challenge is that Dr. Leamer's regression is incapable of segregating the impact on compensation attributable to the challenged agreements from the effects on compensation attributable to Defendants' other agreements and unilateral conduct. Leamer Mot. at 10-12. Defendants cite to agreements Intel had with Pixar and Apple, and unilateral policies Google adopted with respect to two non-defendant companies.
The Ninth Circuit has held that an antitrust plaintiff is required to distinguish between losses attributable to lawful competition and those attributable to unlawful anticompetitive conduct. City of Vernon v. Southern California Edison Co., 955 F.2d 1361, 1371-72 (9th Cir. 1992). This is because the antitrust laws are intended to compensate plaintiffs only for losses caused by a defendant's unlawful behavior Litton Sys., Inc. v. Honeywell, Inc., CV 90-4823 MRP (EX), 1996 WL 634213, at *2 (C.D. Cal. July 24, 1996). The Supreme Court recently affirmed the rationale underlying this principle in a case concerning whether a class could be certified under Rule 23, noting that "a model purporting to serve as evidence of damages . . . must measure only those damages attributable to that theory." Comcast Corp. v. Behrend, 133 S.Ct. 1426, 1433 (2013).
As a preliminary matter, the Court notes that although it need not resolve this question, Defendants' challenge at least appears to present a purely hypothetical problem. Dr. Leamer explained his model in fact controls for any compensation suppression effects stemming from unchallenged conduct, unless all the unchallenged agreements or policies were the same exact duration as the unlawful agreements—i.e., started on the first day of the class period in 2005 and ended on the last day of the class period in 2009. ECF No. 573, Ex. 1, Oct. 2012 Leamer Dep. at 340; see also Oct. 2012 Leamer Dep. at 1025-27, 1029 ("[I]f there were comparable [unchallenged] agreements struck in place prior to the conspiracy period and after the conspiracy, then [the unchallenged conduct's effects are controlled for] in the statistical analysis.") (emphasis added)). Because Defendants have not presented evidence that the unchallenged conduct satisfies this criteria,
Yet even assuming Dr. Leamer's damages estimate includes some effects from unchallenged conduct—i.e., that Dr. Leamer should have included a special control to account for effects of unchallenged conduct without simply assuming, as he did, that it was not the case that all the unchallenged agreements or policies were the same exact duration as the unlawful agreements, see Oct. 2012 Leamer Dep. at 1028-29—the Court finds that Dr. Leamer's model need not be excluded under Daubert for failure to satisfy the disaggregation requirement, as explained below.
First and foremost, it is not clear that the Supreme Court's holding in Comcast, a case arising in the Rule 23 class certification context, is applicable in the present Daubert context, when the Court is tasked with evaluating whether expert testimony is reliable and relevant to the jury's consideration at trial of the facts as applied to substantive antitrust law. In Comcast, the plaintiffs, more than two million Comcast subscribers, had alleged four different types of antitrust injury that they claimed collectively resulted in subscribers overpaying for cable TV service, Comcast, 133 S. Ct. at 1430-31, but the district court only found one theory amenable to common proof at the class certification stage. Id. at 1431. Despite this determination, the district court accepted the plaintiffs' damages model even though it holistically calculated damages stemming from all four impact theories. Id.
Yet even assuming Comcast and the Ninth Circuit cases citing the disaggregation principle do apply in the Daubert context,
Here, Dr. Leamer's model does not suffer from the critical flaw in Comcast. It is undisputed that Dr. Leamer's model evaluates damages resulting from only one theory of antitrust injury—a decrease in compensation due to the challenged anti-solicitation agreements. Nor is Dr. Leamer's model one that "does not even attempt to" measure damages stemming only from the challenged agreements. Id. His model expressly controls for many other variables that impact compensation in an effort to ensure that the estimated damages result only from the challenged conduct. See Leamer Opening ¶ 19; Leamer Reply Rep. ¶¶ 91-93. This includes factors like employees' age and gender, worker tenure, and location differences, industry effects including San Jose information sector hiring, and employer effects including firm revenue and firm hiring. Id.
The Court now addresses Defendants' third Daubert challenge that Dr. Leamer's "total new hires" variable is inconsistent with Plaintiffs' theory of harm. Leamer Mot. at 12-14. Defendants rely on Comcast's requirement that "any model supporting a plaintiff's damages case must be consistent with its liability case[.]" Comcast, 133 S. Ct. at 1433 (citation omitted).
Defendants argue Dr. Leamer's conduct regression is inconsistent with Plaintiffs' theory of harm because it fails to account for the fact that under Plaintiffs' theory, the impact of a Defendant's "increased recruiting and hiring [] on another Defendant would depend on whether there was a[n anti-solicitation] agreement between those two firms."
The Court is not convinced that Dr. Leamer's decision to use an aggregated total new hires variable means his model "is at odds with Plaintiffs' theory of harm," Leamer Reply at 8. Defendants' argument is based on the assumption that under Plaintiffs' theory, "the impact of a Defendant's increased recruiting and hiring [] on another Defendant would depend on whether there was a[n anti-solicitation] agreement between those two firms," and accordingly, the "impact of an increase in recruiting and hiring activity at Intel, [for example,] would be different with respect to an employee at Google (which had a[n anti-solicitation agreement] with Intel) than it would be for an employee at Adobe (which did not have a[n anti-solicitation agreement] with Intel)." Leamer Mot. at 13. Yet Defendants fail to persuasively explain why or how Plaintiffs' theory must lead to this conclusion. The contours of Defendants' argument are not entirely clear. However, Defendants' argument appears to be that, under Plaintiffs' theory, the impact on compensation—i.e. on employees' wages—of one Defendant's increase in hiring should be smaller on a second Defendant who had an anti-solicitation agreement with the first Defendant as compared to the impact on a third Defendant who did not have an agreement with the first Defendant.
The Court need not resolve the question whether Plaintiffs' theory necessarily leads to this conclusion, as Defendants claim it does, because the critical point is that Defendants have failed to explain, both in their briefing and at the hearing, why and how Dr. Leamer's inclusion of an aggregated total new hires variable in his model means his model is "inconsistent" with this allegedly logical implication of Plaintiffs' theory. Further, Defendants' argument is particularly unpersuasive given that Dr. Leamer's model not only includes a total new hires variable to control for the overall demand for labor by all defendants, but also "include[s] a different variable of hiring by each firm," Leamer Reply Rep. ¶ 131; Leamer Opening, Ex. 3, variable #27. The Court notes that Defendants did not respond to the Court's question at the hearing regarding why the existence of individual hiring variables for each firm in Dr. Leamer's model, see Leamer Reply Rep. ¶ 131, does not address Defendants' concern that Dr. Leamer's use of an aggregated total new hires variable means his model is somehow inconsistent with Plaintiffs' theory of harm.
Ultimately, while framed as an argument that Dr. Leamer's model violates Comcast, Defendants' argument is, in essence, that Dr. Leamer's model fails to include variables that take into account the "distinction between hiring among Defendants with a[n anti-solicitation] agreement and other hiring." Leamer Reply at 8. That is a prototypical concern that goes to weight, not admissibility. Bazemore v. Friday, 478 U.S. 385, 400 (1986) ("Normally, failure to include variables will affect the analysis' probativeness, not its admissibility."). Accordingly, the Court rejects Defendants' argument that without Dr. Stiroh's suggested changes to Dr. Leamer's model, Dr. Leamer's model is inconsistent with Plaintiffs' theory of harm and must be excluded.
In the section concerning their third Daubert challenge, Defendants also take issue with how the total new hires variable has a negative coefficient, which they claim is "contrary to basic economic principles" because it indicates a negative relationship between Defendants' total hiring and employee compensation —i.e., that as Defendants hire more employees, they pay their employees less. Leamer Mot. at 13-14 (summarizing Stiroh Rebuttal ¶ 163). The Court is not persuaded that the variable's negative coefficient deems Dr. Leamer's model so unreliable such that it fails Daubert's reliability prong, for Dr. Leamer provides various plausible explanations as to why the negative coefficient is not necessarily an unexpected outcome. First, he explains that "dynamic" regressions like this one sometimes lead to results that may appear counterintuitive at first. Leamer Reply Rep. ¶ 60; see also Cisneros Decl., ECF No. 605, Ex. NNN, Leamer Nov. 2013 Dep. at 1008.
In connection with their third Daubert challenge, Defendants also claim Dr. Leamer's regression is unduly "sensitive" to changes in Intel's hiring and that the "the damages allegedly caused by [anti-solicitation] agreements between other Defendants turns on Intel's behavior." Leamer Mot. at 14; Leamer Reply at 10. In support, Defendants pose a hypothetical they claim demonstrates that "changing the start date of Intel's alleged participation [from 2005 to 2006] has an enormous and irrational influence on the estimates of Dr. Leamer's model." Leamer Mot. at 14. Defendants claim that when the 2006 date is utilized, Dr. Leamer's damage estimate is reduced by over one billion dollars, and that "the enormous effect this relatively minor change has on Dr. Leamer's model underscores its inherent unreliability." Id. at 14 n.6 (summarizing Stiroh Rebuttal ¶¶ 179-80). The Court concludes that any alleged sensitivity in Dr. Leamer's model to Intel's data does not deem his model so inherently unreliable such that it must be excluded from the jury's consideration under Daubert.
The Court recognizes that sensitivity tests can be utilized as one way to test the reliability of regression estimates, as Dr. Leamer himself has acknowledged. Brown Decl., ECF No. 215, Ex. 1 at 351 (noting a "sensitivity analysis . . . [is an] exploration of how sensitive [a model's] conclusions are to a choice of variables."); Leamer Reply Rep. ¶ 92;
Even putting aside the question whether Dr. Leamer's damages estimate is improperly driven by Intel's data, Defendants do not cite, nor has this Court found, any case holding that the sensitivity of a dependent variable to one or more independent variables categorically means the model must be deemed "junk science" under Daubert.
The Court now addresses Defendants' fourth and final Daubert challenge. Defendants claim "Dr. Leamer cannot rely on his conduct regression to establish the existence of classwide impact when he admits the model is incapable of showing that each class member was injured." Leamer Mot. at 15. Defendants accordingly assert that "Dr. Leamer's opinion that there was a classwide impact must be excluded." Id. The Court denies Defendants' request.
In antitrust cases, "[p]roof of injury (whether or not an injury occurred at all) must be distinguished from calculation of damages (which determines the actual value of the injury)." Newton v. Merrill Lynch, Pierce, Fenner & Smith, Inc., 259 F.3d 154, 188 (3d Cir. 2001); Catlin v. Washington Energy Co., 791 F.2d 1343, 1350 (9th Cir. 1986) ("[T]he requirement that plaintiff prove `both the fact of damage and the amount of damage . . . are two separate proofs.'") (emphasis in original) (citation omitted). Defendants' challenge implicates the element of "[a]ntitrust `impact'—also referred to as antitrust injury—[which] is the `fact of damage' that results from a violation of the antitrust laws." In re Dynamic Random Access Memory (DRAM) Antitrust Litig., No. 02-1486, 2006 WL 1530166, at *7 (N.D. Cal. June 5, 2006). Courts have indeed held that plaintiffs must prove every class member was injured by the alleged violation in order to prove the element of impact. See In re Hydrogen Peroxide Antitrust Litig., 552 F.3d 305, 311 (3d. Cir. 2008) ("[E]very class member must prove at least some antitrust impact resulting from the alleged violation."); Blades v. Monsanto Co., 400 F.3d 562, 571-72 (8th Cir. 2005) (plaintiffs must be able to prove injury to each class member); DRAM, 2006 WL 1530166, at *7 (same).
Here, Defendants correctly note that Dr. Leamer concedes his regression does not determine whether any individual class member was impacted. Brown Decl., ECF No. 573, Ex. 1, Oct. 2012 Leamer Dep. at 44, 56-57.
Putting this mischaracterization aside, the Court observes that Defendants also frame their argument in a different way by claiming the regression must be excluded because "Plaintiffs cannot use such a model to satisfy their burden of proving classwide impact." Leamer Mot. at 2 (emphasis added). This argument also fails because it rests on either one or both of two faulty assumptions— first, that Dr. Leamer's regression must singlehandedly suffice to prove that each class member was impacted in order to be admissible evidence, and second, that Dr. Leamer's regression is not relevant to the question of whether each class member was impacted. The former assumption is incorrect because, while the Court made no finding at the class certification stage that the regression itself was capable of demonstrating impact to every class member,
As for the latter assumption, to the extent Defendants' argument is that Plaintiffs should not be able to rely on Dr. Leamer's model as evidence that each class member was injured—i.e., that Dr. Leamer's regression is irrelevant to the issue of classwide impact—their argument fails. This Court already concluded, when ruling on Plaintiffs' first class certification motion, that Dr. Leamer's conduct regression was a reasonable methodology capable of showing that the anti-solicitation agreements caused "generalized harm to the class." April Order at 38, 43. The Court reaffirmed that conclusion in its October Order. October Order at 60 ("[T]he Conduct Regression analysis is also capable of demonstrating a general classwide impact."). The Court now concludes that even though Dr. Leamer's model is not capable of demonstrating specific injury to each class member on its own accord, it is highly probative to that issue. See In re TFT-LCD (Flat Panel) Antitrust Litig., M 07-1827 SI, 2012 WL 555090, at *5 (N.D. Cal. Feb. 21, 2012) ("Even if regression models are not enough, standing alone, to establish classwide impact, they may nevertheless be relevant to the issue."). This is because a reasonable jury could find that Dr. Leamer's model—which this Court has held is capable of proving generalized impact to the class—in combination with the other evidence presented by Dr. Leamer and documentary evidence separate from Dr. Leamer's analysis, strongly suggests that each class member was impacted. Notably, Dr. Leamer provides substantial evidence that economic theory, documentary evidence, and statistical analyses separate from his conduct regression are capable of showing that the anti-solicitation agreements suppressed the compensation of "all or virtually all" class members. See supra, Part III.A.1. The Court also held in its October Order that "Plaintiffs marshal substantial evidence, including documentary evidence and expert reports . . . [which] suggests that all technical employees—not just those who would have received cold calls but for the anti-solicitation agreements—may have been impacted by the agreements." October Order at 31 (emphasis added); id. at 51 ("The extensive documentary evidence Plaintiffs present [] supports their theory that they will be able to prove the impact of the antitrust violations on a classwide basis."); id. at 33 (concluding "Plaintiffs submitted thousands of pages of documents . . . which support Plaintiffs' theories of classwide harm.").
Ultimately, the Court concludes the jury is the proper body to decide whether or not and, if so, to what extent, Dr. Leamer's model should be discredited based on the various objections Defendants have raised. Bouman v. Block, 940 F.2d 1211, 1225 (9th Cir. 1991) ("Whether the statistics are undermined or rebutted in a specific case would normally be a question for the trier of fact."). The Ninth Circuit has held that "as a general matter, so long as the evidence is relevant and the methods employed are sound, neither the usefulness nor the strength of statistical proof determines admissibility under Rule 702." See Obrey, 400 F.3d at 696. This Court held at the class certification stage that Dr. Leamer's conduct regression was "statistically robust," supported by the economic literature, and "capable of calculating classwide damages." October Order at 82. None of Defendants' arguments persuades the Court to change that conclusion, and thus Defendants' challenge to Dr. Leamer's conduct regression is denied.
Defendants jointly move for summary judgment based on their motion to exclude Dr. Leamer's testimony. ECF No. 556. Defendants' sole argument in support of their joint motion for summary judgment is that "[w]ithout Dr. Leamer's expert report and testimony, Plaintiffs have no evidence of classwide impact or damages and cannot prove the essential elements of their antitrust claim." Id. at 1. Because this Court denies Defendants' motion to exclude Dr. Leamer's testimony in full, Defendants' joint motion for summary judgment based on their motion to exclude Dr. Leamer's testimony is also DENIED.
For the foregoing reasons, the Court GRANTS IN PART and DENIES IN PART Defendants' motions: