GREGORY H. WOODS, District Judge.
Plaintiff Kewazinga Corp. ("Kewazinga") commenced this action against Defendant Microsoft Corporation ("Microsoft") on May 21, 2018. Plaintiff asserts that Microsoft has infringed, and continues to infringe, three patents which teach telepresence systems, devices, and methods that enable one or more users to navigate imagery through a remote environment. The three patents at issue are (1) the February 8, 2013 patent numbered 6,522,325 (the "'325 Patent");
(2) the March 18, 2013 patent numbered 6,535,226 (the "'226 Patent"); and (3) the June 9, 2015 patent numbered 9,055,324 (the "'234 Patent," and collectively, the "Asserted Patents"). The '325 and '226 Patents are both titled "Navigable Telepresence Method and System Utilizing an Array of Cameras." The '234 Patent is titled "Navigable Telepresence Method and System."
The parties are before the Court seeking claim construction.
Additionally, Defendant asserts that the following terms are indefinite:
The Court's construction is detailed below, and summarized in Attachment A to this opinion.
In order to protect effectively an inventor's rights, patents must describe the exact scope of an invention. See Markman v. Westview Instruments, Inc., 517 U.S. 370, 373 (1996) ("[A] patent must describe the exact scope of an invention and its manufacture to secure to [the patentee] all to which he is entitled, [and] to apprise the public of what is still open to them.") (alterations in quoted material) (internal quotation marks and citation omitted). "It is well established that determining infringement is a two-step process" whereby, the court must first construe a patent's claim limitations to define the meaning and scope of the invention, and second, must compare the accused device to the construed claims. See Innova/Pure Water, Inc. v. Safari Water Filtration Sys., Inc., 381 F.3d 1111, 1115-16 (Fed. Cir. 2004) (citations omitted).
"`[T]he construction of a patent, including terms of art within its claim,' is not for a jury but `exclusively' for `the court to determine.'" Teva Pharmaceuticals USA, Inc. v. Sandoz, Inc., 135 S.Ct. 831, 835 (2015) (quoting Markman, 517 U.S. at 390). In deciding matters of claim construction, district courts have discretion regarding the procedure by which to reach a final determination. See Ballard Med. Prods. v. Allegiance Healthcare Corp., 268 F.3d 1352, 1358 (Fed. Cir. 2001) ("District courts have wide latitude in how they conduct the proceedings before them, and there is nothing unique about claim construction that requires the court to proceed according to any particular protocol. As long as the trial court construes the claims to the extent necessary to determine whether the accused device infringes, the court may approach the task in any way that it deems best.").
In addition, the Court need only construe claims that are "in controversy" and only "to the extent necessary to resolve the controversy." Vivid Techs., Inc. v. Am. Sci. & Eng'g, Inc., 200 F.3d 795, 803 (Fed. Cir. 1999) (citation omitted); see also Ballard, 268 F.3d at 1358 ("If the district court considers one issue to be dispositive, the court may cut to the heart of the matter and need not exhaustively discuss all the other issues presented by the parties."). Further, the Court is "not required to construe every limitation present in a patent's asserted claims," but rather, the focus is on "resolution of disputed meanings and technical scope . . . for use in determination of infringement." O2 Micro Int'l Ltd. v. Beyond Innovation Tech. Co., 521 F.3d 1351, 1362 (Fed. Cir. 2008) (emphasis omitted) (citations omitted). In the event "the parties chose to treat [certain] terms across [separate] patents as rising and falling together" the Court need not "separately address [every] Patent." X2Y Attenuators, LLC v. Int'l. Trade Commn., 757 F.3d 1358, 1363 n.2 (Fed. Cir. 2014).
Courts must construe patent claims "objectively and without reference to the accused device." Vivid Techs., 200 F.3d at 803. This means that courts must "seek[ ] to accord a claim the meaning it would have to a person of ordinary skill in the art at the time of the invention" (to a "POSITA"). Innova/Pure Water, Inc., 381 F.3d at 1116 (citations omitted). In doing so, a court considers three primary sources within the intrinsic evidence of record: (1) the language of the claims; (2) the specification; and (3) the prosecution history. Secure Web Conference Corp. v. Microsoft Corp., No. 13-cv-2642-JG, 2014 WL 4954644, at *1 (E.D.N.Y. Oct. 2, 2014) (citing Vitronics Corp. v. Conceptronic, Inc., 90 F.3d 1576, 1582 (Fed. Cir. 1996)).
First, the Court "look[s] to the words of the claims themselves, both asserted and nonasserted, to define the scope of the patented invention." HowLink Global LLC v. Network Commc'ns Int'l. Corp., 561 F. App'x 898, 905 (Fed. Cir. 2014) (quoting Vitronics, 90 F.3d at 1582). In making such a determination, "[t]he words of the claim are the controlling focus." Secure Web, No. 13-cv-2642, 2014 WL 4954644, at * 2 (citing Digital Biometrics, Inc., v. Identix, Inc., 149 F.3d 1335, 1344 (Fed. Cir. 1998)).
In general, the language of a claim is given its ordinary and customary meaning unless a distinct definition is employed in the specification or prosecution history. See Digital Biometrics, 149 F.3d at 1344 ("The written description is considered, in particular to determine if the patentee acted as his own lexicographer, as our law permits, and ascribed a certain meaning to those claim terms. If not, the ordinary meaning, to one skilled in the art, of the claim language controls.") (citing York Prods., Inc. v. Central Tractor Farm & Family Ctr., 99 F.3d 1568, 1572 (Fed. Cir. 1996)). The ordinary and customary meaning of a claim term is that which one of "skill in the art at the time of the invention" would understand. Innova/Pure Water, 381 F.3d at 1116 (citations omitted); see also InTouch Techs, Inc. v. VGO Commc'ns Inc., 751 F.3d 1327, 1339 (Fed. Cir. 2014) ("Generally, a claim term is given the ordinary and customary meaning as understood by a person of ordinary skill in the art at the time of invention.") (citation omitted)); Interactive Gift Exp., Inc. v. Compuserve Inc., 256 F.3d 1323, 1332 (Fed. Cir. 2001) ("Throughout the construction process, it is important to bear in mind that the viewing glass through which the claims are construed is that of a person skilled in the art.") (citations omitted)).
In interpreting claim terms, courts have applied the doctrine of "claim differentiation." This doctrine "stems from the common sense notion that different words or phrases used in separate claims are presumed to indicate that the claims have different meanings and scope," and creates a "presumption that two independent claims have different scope when different words or phrases are used in those claims." Seachange Int'l, Inc. v. C-COR, Inc., 413 F.3d 1361, 1368-69 (Fed. Cir. 2005) (internal quotation marks and citations omitted). The Court of Federal Claims has applied this doctrine in declining to "infer that two different words within a claim . . . have the same meaning." TDM Am., LLC v. United States, 85 Fed. Cl. 774, 794 (2009) (citing Andersen Corp. v. Fiber Composites, LLC, 474 F.3d 1361, 1369 (Fed. Cir. 2007)).
Claim differentiation, however, is "a guide, not a rigid rule." Laitram Corp. v. Rexnord, Inc., 939 F.2d 1533, 1538 (Fed. Cir. 1991) (quoting Autogiro Co. of Am. v. United States, 384 F.2d 391, 404 (Ct. Cl. 1967)); accord Marine Polymer Techs., Inc. v. HemCon, Inc., 672 F.3d 1350, 1359 (Fed. Cir. 2012) (citations omitted). Accordingly, it "is not as strong across related patents as it would be if the different claim limitations appeared in the same patent." Clare v. Chrysler Grp. LLC, 819 F.3d 1323, 1330 (Fed. Cir. 2016).
Next, the Court looks at a patent's specification, as "[c]laims must be read in view of the specification, of which they are a part." Markman v. Westview Instruments, Inc., 52 F.3d 967, 979 (Fed. Cir. 1995) (citations omitted), aff'd, 517 U.S. 370 (1996). "The specification contains a written description of the invention which must be clear and complete enough to enable those of ordinary skill in the art to make and use it." Vitronics, 90 F.3d at 1582. Consequently, "the specification is always highly relevant to the claim construction analysis," "is the single best guide to the meaning of a disputed term," and is "[u]sually . . . dispositive." Id.
In setting out a clear and complete written description, a patent's specification may also include a particular definition of a term that supersedes the term's "plain and ordinary meaning." See Stryker Corp. v. Zimmer, Inc., 837 F.3d 1268, 1272 (Fed. Cir. 2016) (noting exception to the general rule that courts look to terms' plain and ordinary meanings "when a patentee sets out a definition and acts as her own lexicographer") (citations omitted)).
Therefore, the specification may assist in the Court's determination of whether the inventor intentionally used any terms in the claims in a manner inconsistent with their ordinary meaning; however, this intention must be clear. See Vitronics, 90 F.3d at 1582 ("[A] patentee may choose to be his own lexicographer and use terms in a manner other than their ordinary meaning, as long as the special definition of the term is clearly stated in the patent specification or file history.") (citations omitted).
Additionally, where a specification discloses an embodiment, a claim construction that renders the embodiment outside the scope of the claim "is rarely, if ever, correct and would require highly persuasive evidentiary support." Id. at 1583 (citations omitted). Further, "it is improper to read limitations from a preferred embodiment described in the specification—even if it is the only embodiment—into the claims absent a clear indication in the intrinsic record that the patentee intended the claims to be so limited." Liebel-Flarsheim Co. v. Medrad, Inc., 358 F.3d 898, 913 (Fed. Cir. 2004) (citations omitted).
Third, the Court may consider the prosecution history of the patent, if it is in evidence. Phillips v. AWH Corp., 415 F.3d 1303, 1317 (Fed. Cir. 2005) (citing Markman, 52 F.3d at 980); accord Amhil Enterprises Ltd. v. Wawa, Inc., 81 F.3d 1554, 1559 (Fed. Cir. 1996) ("The prosecution history, in addition to being used while considering the factual issue of infringement and whether prosecution history estoppel places any limitations on what infringes a claim, should also be used when considering the legal issue of proper claim construction.") (citations omitted)). The prosecution history contains a complete record of all the proceedings before the Patent and Trademark Office, including any express representations made by the applicant regarding the scope of the claims. As such, the record before the Patent and Trademark Office is often of critical significance in determining the meaning of the claims. See Markman, 52 F.3d at 980.
Importantly, "[t]he prosecution history limits the interpretation of claim terms so as to exclude any interpretation that was disclaimed during prosecution." Southwall Tech., Inc. v. Cardinal IG Co., 54 F.3d 1570, 1576 (Fed. Cir. 1995) (citations omitted). However, "[a]bsent a clear disavowal or contrary definition in the specification or the prosecution history, the patentee is entitled to the full scope of its claim language." Home Diagnostics, Inc. v. LifeScan, Inc., 381 F.3d 1352, 1358 (Fed. Cir. 2004).
Accordingly, a party asserting prosecution history disclaimer has the "burden of proving the existence of a `clear and unmistakable' disclaimer that would have been evident to one skilled in the art." Trivascular, Inc. v. Samuels, 812 F.3d 1056, 1063-64 (Fed. Cir. 2016) (citation omitted).
Finally, although it is well-settled that courts should look primarily to the intrinsic evidence of record in resolving a claim construction dispute, extrinsic evidence may be considered when ambiguity remains after consulting the intrinsic evidence. Vitronics, 90 F.3d at 1583. Extrinsic evidence has been defined to include evidence external to the patent and prosecution history, such as expert testimony, inventor testimony, dictionaries, and relevant treatises or articles. See Secure Web, 2014 WL 4954644, at *2 (citing Phillips, 415 F.3d at 1317); accord Vitronics, 90 F.3d at 1584 (citations omitted).
"[E]xtrinsic evidence in general, and expert testimony in particular," however, "may be used only to help the court come to the proper understanding of the claims; it may not be used to vary or contradict the claim language." Vitronics, 90 F.3d at 1584 (citing Markman, 52 F.3d at 980). Further, "extrinsic evidence is `less significant than the intrinsic record in determining the legally operative meaning of claim language.'" Secure Web, 2014 WL 4954644, at *2 (quoting Phillips, 415 F.3d at 1317). Consequently, in permitting consideration of extrinsic evidence, "[t]he Federal Circuit has cautioned courts not to place too much reliance on extrinsic evidence and too little reliance on intrinsic sources." Id. at *2 (citing Phillips, 415 F.3d at 1320).
"The purpose of claim construction is to "determin[e] the meaning and scope of the patent claims asserted to be infringed." O2 Micro Intern., 521 F.3d at 1360 (Fed. Cir. 2008) (quoting Markman, 52 F.3d at 976). "When the parties raise an actual dispute regarding the proper scope of these claims, the court, not the jury, must resolve that dispute." Id. (citation omitted) (emphasis added).
Here, the parties have disputed the meaning of numerous terms within the claims of the Asserted Patents, which may impact the ultimate determination as to infringement. Accordingly, the Court is obligated to construe those terms.
For many of the terms at issue, Plaintiff contends that construction is unnecessary, and offers its proposed construction only in the alternative. Plaintiff does not, however, adequately explain how the Court can avoid its "duty" to construe disputed claim terms. Id. ("When the parties present a fundamental dispute regarding the scope of a claim term, it is the court's duty to resolve it."). Accordingly, the Court will construe the claim terms subject to a "fundamental dispute." Id.
However, "district courts are not (and should not be) required to construe every limitation present in a patent's asserted claims." Id. Indeed, there is no utility to claim construction that merely inserts "meaningless verbiage into the definition of the claimed invention." Harris Corp. v. IXYS Corp., 114 F.3d 1149, 1152-53 (Fed. Cir. 1997). Accordingly, the Court will not construe dependent terms, whose meanings are clear in light of the Court's construction of the term on which they depend. Nor will the Court construe terms whose meaning is no longer subject to dispute. See Attachment A.
Plaintiff's Proposed Construction: "creating imagery assembled from a plurality of images, or portions thereof, including an alignment process and a composition process."
Defendant's Proposed Construction: "generating a seamless image by combining two or more overlapping images that were captured at different camera locations."
For the reasons that follow, the Court adopts Plaintiff's proposed construction. Also for the reasons that follow, the Court construes the term "mosaic imagery" as "images created by mosaicing."
The term "mosaicing" appears in the claims of the '325 Patent, and the term "mosaic imagery" appears in the claims of the '234 Patent. Neither patent, however, purports to teach a system or method for "mosaicing" or the creation of "mosaic images." Rather, the '325 Patent teaches a "telepresence system for providing a first user with a first display of an environment and a second user with a second display of the environment," '325 Patent, Claim 1, 20:56-59. The '325 Patent anticipates the deployment of an "array of cameras,"
After incorporating the Burt Patent by reference, the '234 and '325 Patents provide the following description of the "mosaicing" process:
'234 Patent 17:37-57, '325 Patent 13:21-42 (indent in original).
The Burt Patent expressly teaches a "system for automatically generating a mosaic from a plurality of input images," as refered to in the '234 and '325 Patents. Burt Patent, Abstract. Figure 3 of the Burt Patent, reproduced below, is the patent's reference point for what it refers to as the "Mosaic Construction System." Burt Patent, 5:36-44.
Referencing Figure 3, the Burt Patent teaches that the "mosaicing" process taught by the Burt Patent involves the following steps. First, in the image input step, an image or preexisting mosaic is selected. "If a mosaic does not currently exist, i.e., the input image is the first image of a sequence of images, then the first [non-mosaiced] image is used as a previously constructed mosaic." Burt Patent, 5:52-55. Next, the input image is aligned with the preexisting mosaic. Id. at 5:50-6:3.
Then, the mosaic composition process ensues. Within the composition process are two sub-processes. In the first, the "selection process selects which portions of the input image and current mosaic will be used to form an updated mosaic." Id. at 10-11. Then the "combination process" takes place:
Id. at 6:18-25.
In light of the Burt Patent's teaching of "mosaicing," and the '234 and '325 Patents' reference to the Burt Patent's "mosaicing" system, which is incorporated by reference into the '234 and '325 Patents, Plaintiff's proposed construction, "creating imagery assembled from a plurality of images, or portions thereof, including an alignment process and a composition process" is accurate. No party contests, nor plausibly could contest in light of the intrinsic evidence, that "mosaicing" as taught in the `Burt Patent, and incorporated into the '234 and '325 Patents, involves the creation of imagery from a plurality of images or portions thereof, or that mosaicing involves an alignment process and a combination process. Rather, Defendant contends, through its proposed construction and its argumentation, that "mosaicing" has three additional requirements: (1) that the result of "mosaicing" must be seamless; (2) that images to be "mosaiced" must be overlapping; and (3) that the images to be "mosaiced" must have been captured at different camera locations. For the reasons that follow, none of those proposed requirements are properly included in the Court's construction.
Defendant's proposed requirement that "mosaicing" result in a seamless image is rejected for the reasons that follow.
The Burt Patent makes clear that a mosaic can be formed even if that mosaic is not perfectly seamless.
Burt Patent, 1:20-25.
Plaintiff's expert, Dr. Hanna, concurs, citing the above quoted text of the Burt Patent to support his contention that "while a mosaic may be seamless, it is not required to be." Decl. of Keith Hanna ("Hanna Decl."), Dkt. No. 43, ¶ 27; Supp. Decl. of Keith Hanna, Dkt. No. 48, 4 ("The ordinary meaning of the term `mosaic' to a POSITA does not require a seamless image.").
Taken together, the intrinsic and extrinsic evidence cited above establishes that a mosaic need not be seamless. While that is strong evidence that "mosaicing" does not require a seamless output, it does not fully resolve whether, or to what extent, seamlessness is a requirement of "mosaicing."
There is a gap, unaddressed by either party, between the term "mosaic," which no party has asked the Court to construe, and the term "mosaicing," which Court must construe, and that gap is potentially relevant to the question of whether the product of "mosaicing" must be a seamless image. In making this observation, the Court notes Dr. Hanna's carefully crafted statements quoted above, in which he clearly states that a mosaic need not be seamless, but does not go so far as to say that "mosaicing" as used in the '234 and '325 Patents is divorced from the requirement of seamlessness, or some degree of effort to achieve seamlessness, regardless of whether those efforts are fully successful in eliminating any seams.
This linguistic distinction is somewhat grammatically analogous to the terms "drafting" and "draft," used in the context of drafting a document. It may be the case that the a given "draft" has not been proof-read. It does not necessarily follow, however, that the "drafting" process does not include proof-reading. Similarly, here, the fact that a "mosaic" need not be seamless does not necessarily mandate that the "mosaicing" process not include steps aimed at minimizing the seams in the resulting image.
Returning to the language of the Burt Patent quoted above, while the Burt Patent makes it clear that a mosaic can be formed prior the additional processing "performed to ensure that the seams between the images are invisible," Burt Patent, 1:20-25, the same section of the Burt Patent also indicates that such additional processing would be performed. Id. ("Additional image processing is performed") (emphasis added). The question presented, therefore, is whether that additional processing is necessarily part of the "mosaicing" process.
As discussed above, the "mosaicing" system described in the Burt Patent, and the application of that system in the '234 and '325 Patents, both anticipate the use of image processing with the aim of reducing seams in the resulting image. This, perhaps, is why Dr. Hanna was so careful to cabin his comments to the noun "mosaic," rather than to the term before the Court, "mosaicing." However, while there are multiple references to seamlessness in pertinent parts of the intrinsic evidence, the Court finds that Defendant's proposed requirement of perfect seamlessness cuts too broadly, and is accordingly rejected for the reasons that follow.
During the deposition of Defendant's expert, Dr. Stevenson, the following exchange took place.
March 12, 2019 Deposition of Robert L Stevenson, Dkt. No. 52-1, 156:9-22. This testimony highlights a fundamental flaw with the proposed requirement of seamlessness as applied to "mosaicing"—seamlessness can only be determined a posteriori. According to Dr. Stevenson, if a seam can be detected, then the image is not seamless, and no mosaic was formed.
Id. 185:22-186:5. If Dr. Stevenson's view of mosaic formation were imported into the Court's construction of "mosaicing," the outcome would be untenable. According to Dr. Stevenson, one cannot determine whether a mosaic has been formed until one determines whether any image processing algorithms employed were successful in rendering the image perfectly seamless. If applied to the term "mosaicing" that same logic would imply that whether the "mosaicing" process took place could only be determined a posteriori, with full knowledge of whether any image processing techniques employed during the "mosaicing" process successfully rendered the resulting image seamless. Applying such an outcome-based requirement to the construction of "mosaicing," would be inconsistent with the Burt Patent, which teaches systems and methods for "mosaicing." Returning to the previous example based on drafting, the Court observes that the presence of a typo in a draft does not imply that the drafting process does not have a proof-reading step, and the failure to correct a typo in a draft does not prevent a document from being a draft, even if proof-reading is assumed to be a mandatory step of drafting.
From all of this, the Court concludes as follows: First, that the mere fact that a mosaic can be formed such that it has seams does not necessitate that "mosaicing" does not involve image processing aimed at removing those seams. And second, that incorporating the proposed requirement of seamlessness into the construction of the term "mosaicing" is inappropriate because that requirement would render a determination of whether "mosaicing" took place contingent on the outcome of the "mosaicing" process, rather than the utilization of that process, contrary to the intrinsic evidence. For all these reasons, the Court rejects Defendant's contention that "mosaicing" must result in a seamless image.
Defendant contends that "mosaic imagery" and "mosaicing" must includes two additional requirements: (1) that the images combined to form a mosaic are overlapping; and (2) that the images to be "mosaiced" must have been captured at different camera locations. Defendant's proposed requirements are contradicted by the intrinsic evidence, and are accordingly rejected.
The '234 Patent is instructive in regard to the proposed requirement that the constituent images to be "mosaiced" must be overlapping. The summary section of the '234 Patent states: "The system receives electronic imagery of progressively different perspectives of the environment having overlapping fields of view and generates electronic mosaic imagery of the environment." '234 Patent at 3:18-22. In that passage, the use of overlapping images is required not by the term "mosaic imagery," but is instead a requirement imposed by surrounding language on the types of "electronic imagery" utilized in the '234 Patent."
Similarly, any requirement in the '325 Patent that the imagery to be "mosaiced" must be overlapping is an artifact of surrounding claim language, rather than inherent in the term "mosaicing." This is seen, for example, in the following text:
'325 Patent, Claim 5, 21:66-22:8.
Furthermore, the Burt Patent teaches that methods for filling gaps between images to be mosaiced is within the scope of the "mosaicing" process:
Id., 11:51-53.
Burt Patent, 1:31-33. Such gap filling would presumably not be required if the images in the mosaic were necessarily overlapping, as Microsoft argues. Accordingly, Defendant's proposed requirement of overlapping images is contrary to the intrinsic evidence, and is rejected.
Defendant's contention that "mosaicing" and "mosaic imagery" should be understood as requiring the use of images captured at different camera locations is similarly unavailing. As explained above, the Burt Patent was incorporated by reference, and teaches a process for "mosaicing" that was otherwise insufficiently articulated in the Asserted Patents. And the Burt Patent teaches a process for the creation of "mosaic imagery" without imposing any specific requirements on the methods by which the images to be processed were captured or generated. The natural consequence of that element of the intrinsic evidence is that a POSITA would not understand the terms "mosaicing" and "mosaic imagery" to inherently require that the images to be processed were captured at different locations or by different cameras. This also accords with the claim language, in which any requirement as to the use of imagery captured at different camera locations stems from the language surrounding the term "mosaicing," such as the phrase "progressively different perspectives," not the meaning of the term itself. E.g. '234 Patent, Claim 1, 20:25 (store electronic imagery of progressively different perspectives of the enjoinment having overlapping fields of view . . . generate mosaic imagery from the electronic imagery").
Accordingly, while Defendant points to numerous examples of these terms being used in contexts which may require the use of multiple cameras at different locations,
For the reasons articulated above, the Court adopts Plaintiff's proposed construction of the term "mosaicing," and construes the term to mean "creating imagery assembled from a plurality of images, or portions thereof, including an alignment process and a composition process."
As discussed above, the Court construes the term "mosaic imagery" as having the same requirements as the term "mosaicing." This is in keeping with the parties' positions. Plaintiff contends the term should be construed as "images created by mosaicing." Joint Claim Terms Chart ("JCT"), Dkt. No. 38-2, 1. Defendant advocates for a different construction, but also tacitly admits that the definition of the term "mosaic imagery" is dependent on the definition of the term "mosaicing." Indeed, Defendant proposes identical definitions for the two terms—save for the insertion of the word "generating" as the first word in its proposed construction of `mosaicing."
Having construed those three terms, the following terms do not require construction: "mosaic imagery along the [first] [second] view," "mosaicing the selected outputs of cameras in the [first] [second] view;" "mosaicing the first image with the second image and then mosaicing the second image with the third image," and "displaying the first, second, third and mosaic images in sequence to obtain a seamless view through the environment." Those terms do not require independent construction as their meaning is fully determined and unambiguous in light of the Court's construction of the terms "mosaicing," "mosaic imagery," and "mosaic images."
Plaintiff's Proposed Construction: "generating synthetic imagery from acquired imagery to show movement and transition between the acquired imagery."
Defendant's Proposed Construction: "creating an interpolated image in between two images captured at different camera locations by using local scene characteristics to monitor movement among the camera locations."
For the reasons that follow, the Court construes the term "tweening" as "generating synthetic imagery from acquired imagery, and utilizing that synthetic imagery between the acquired imagery, in order to show movement and transition between the acquired imagery."
The term "tweening" appears in the claims of the '325 and the '234 Patents. As with the term "mosaicing," neither patent sufficiently articulates a system or process for "tweening" within the body of the patents. And both patents incorporate by reference another patent, here U.S. Patent No. 5,529,040 entitled, "Method for Determining Sensor Motion and Scene Structure and Image processing System" (the "Hanna Patent"). '234 Patent 17:64-18:2; '325 Patent 13:50-56. The Hanna Patent is expressly incorporated as one example of potentially applicable "tweening" methodologies. '234 Patent 17:64-18:2; '325 Patent 13:50-56 ("One example of the tweening process is disclosed in the [Hanna Patent]") (emphasis added).
There is no contention that Plaintiff's proposed construction of `tweening" is inherently inaccurate. Rather, Defendant again seeks to narrow Plaintiff's proposed construction through the addition of three requirements: (1) that it involves the creation of an interpolated image; (2) which is deployed between two images captured at different camera locations; and (3) uses local scene characteristics to monitor movement among the camera locations. For the reasons that follow, none of those requirements are supported by the intrinsic evidence—and Defendant's construction is rejected. However, as Plaintiff's proposed construction fails to adequately account for the inherent requirement that the synthetic imagery be utilized between the acquired imagery, the Court has modified Plaintiff's construction as indicated above.
The phrases "synthetic imagery" and "interpolated images" do not appear in the Asserted Patents. Indeed, both parties admit that their proposed constructions, in this respect, go beyond the language of the '234 and '325 Patents. Accordingly, the Court will evaluate the usage of these proposed terms in light of the intrinsic evidence, the ordinary meaning of the terms, and extrinsic evidence, to the extent that extrinsic evidence is germane and does not contradict the intrinsic evidence.
The Court begins with a preliminary analysis of the term itself. "Tweening," strongly implies a link to the phrase "in between." This construction is supported by the description of a "tweening" process in the preferred embodiments of the '234 and 325 Patents. That process is described, in pertinent part, as an iterative process, one step of which is described as "warping one of the outputs toward the other output using the current estimates of the models at the given image resolution." '234 Patent, 18:31-33; '325 Patent 14:18-20. That language supports the Court's observation that "tweening" is linked to the phrase "in between" in that it describes a process by which imagery is created and utilized to facilitate a transition between existing imagery. See Hanna Decl. at ¶ 34 ("One of ordinary skill in the art would recognize the following definitions. . . `
In light of that analysis, the Court turns to the proposed constructions themselves. The phrases "generating synthetic imagery . . . to show movement and transition between the acquired imagery" and "creating an interpolated image in between two images" have similar meanings. Both involve the creation of new imagery to link images. However, Defendant's proposed construction is more restrictive in that it requires a singular interpolated image to be inserted between the two images to be "tweened."
The use of the singular "an image" in Defendant's proposed construction calls for the insertion of a singular interpolated image. That requirement is somewhat in tension with the iterative "tweening" process described in the specifications of the '234 and '325 Patents. It may be that Defendant's construction calls for the use of a singular interpolated image during each iterative cycle, but it also could be interpreted to limit the "tweening" process to the insertion of one interpolated image—in contrast to the described iterative process. The Court is also concerned that Defendant's proposed utilization of the term "interpolated" may require, without justification from the intrinsic evidence, that an interpolated image be composed of pixels from each acquired image to be "tweened." Accordingly, the intrinsic evidence is, at least somewhat, in tension with Defendant's proposed construction.
However, as the intrinsic evidence presented is insufficient to fully resolve this issue, the Court looks to the extrinsic evidence to determine the ordinary meaning of these terms, as understood by a POSITA. Dr. Hanna, the listed inventor of the Hanna Patent, has opined that the synthetic imagery is a broad term, which encompasses the full scope of image generation that a POSITA would understand "tweening" to entail. Sup. Decl. of Keith Hanna, ¶10. Dr. Hanna has further opined that interpolation is but one method "to generate synthetic imagery to show movement and transition between other imagery" but that there are other potentially applicable techniques that accomplish the same goal. See id. ¶ 34. From this extrinsic evidence, the Court has determined that Defendant's construction is a narrowing of the understanding of a POSITA— despite the fact that Defendant has not adequately explained the impact of its proposed construction nor cited intrinsic evidence which supports that construction over Plaintiff's. Thorner v. Sony Computer Ent. Am. LLC, 669 F.3d 1362, 1367 (Fed. Cir. 2012) ("The patentee is free to choose a broad term and expect to obtain the full scope of its plain and ordinary meaning unless the patentee explicitly redefines the term or disavows its full scope.").
For all of these reasons, the Court finds Plaintiff's construction more persuasive in this regard and that it more accurately reflects the understanding of a POSITA. However, the Court is troubled by the fact that Plaintiff's proposed construction does not include a requirement that the synthetic imagery be deployed in between the acquired imagery, which a POSITA would understand to be part of the ordinary meaning of the term "tweening." See Hanna Decl. at ¶ 34. Accordingly, the Court construes the term "tweening" largely in accord with Plaintiff's construction, but inserts the phrase "and utilizing that synthetic imagery between the acquired imagery" into its construction.
The Court rejects both of these proposed restrictions, which Defendant contends should be included in the construction of the term "tweening," as they are contradicted by the intrinsic evidence.
In asserting that "tweening" necessarily involves images captures at different camera locations, Defendant points to language in the specification of the '325 Patent which teaches that "tweening enables the server [] to process the structure of a view from two or more camera outputs of the view. Opp. at 21 (quoting '325 Patent, 13:56-57). There is no dispute that the Asserted Patents teach the utility of "tweening" images acquired from different camera locations. However, in making this assertion Defendant fails to adequately account for Claim 11 of the '325 Patent, which specifically teaches a system in which "camera output[s]" and "additional source output[s]" are "mix[ed]" by "tweening" those outputs. '325 Patent 13:3-11. Indeed, the sole distinction between the system described in Claim 10 of the '325 Patent, and Claim 11 of that patent, is that Claim 11 allows for the tweening of non-camera source outputs. Id. at 22:38-23:11. Accordingly, while "tweening" camera outputs is certainly taught in the '325 Patent, the term "tweening" cannot be construed as requiring that the images to be "tweened" were necessarily acquired from different camera locations. Seachange Int'l, Inc. v. C-COR, Inc., 413 F.3d 1361, 1368-69 (Fed. Cir. 2005) (observing that claim differentiation "stems from the common sense notion that different words or phrases used in separate claims are presumed to indicate that the claims have different meanings and scope," and creates a "presumption that two independent claims have different scope when different words or phrases are used in those claims.") (internal quotation marks and citations omitted).
As for the proposed requirement that "tweening" must involve the use of "local scene characteristics," that proposed requirement is also clearly contradicted by the claims asserted in the '234 Patent.
'234 Patent at 26:1-8. Accordingly, Defendant's proposed requirement that tweening must involve the use of local scene characteristics would render the entirety Claim 7 of the '234 Patent surplusage.
For all these reasons, the Court construes the terms "tweening" to mean "generating synthetic imagery from acquired imagery and utilizing that synthetic imagery between the acquired imagery, in order to show movement and transition between the acquired imagery."
As with the Court's construction of "mosaic imagery," the Court construes the term "tweened imagery" as having the same requirements as the term "tweening." This is, again, in keeping with the parties' positions. Plaintiff contends that the term should be construed as "images created by tweening." JCT at 3. Defendant advocates for a different construction, but also tacitly admits that the definition of the term "tweened imagery" is dependent on the definition of the term "tweening."
Having construed those terms, the following terms do not require independent construction: "tweened;" "tweening the selected outputs of cameras in the [first] [second] path;" "tweening the image of a current camera in the sequence to the image of a next camera in the sequence;" "cause imagery on two or more different perspectives long the first view to be tweened;" "tweening imagery of two or more different perspectives along the first view;" and "tweening the first image with the second image to obtain a first tweened image and then tweening the second image with the third image to obtain a second tweened image." Those dependent terms do not require independent construction as their meaning is unambiguous and fully determined in light of the Court's construction of the terms "tweening" and "tweened imagery."
Plaintiff's Proposed Construction: Plaintiff contends that this term does not require construction. In the alternative, Plaintiff proposes that the term be construed as "a configuration of cameras, where such configuration can include movable cameras and reusing a camera in multiple locations."
Defendant's Proposed Construction: "a set of multiple cameras, each fixed to capture images at a different location, to provide a view through the environment without having to move any camera."
For the reasons that follow, the Court construes the term "array of cameras" as "a set of multiple cameras, each fixed in relation to each other."
The term "array of cameras" appears in claims of the '325 and '226 Patents. "Arrays of cameras" are at the heart of the those patents, which each self-describe themselves as teaching "a navigable camera array telepresence system[s] and method[s] of using same." '325 Patent, 1:20-21; '226 Patent, 1:15-16. In its specification, the '325 Patent teaches a preferred embodiment of the invention which "uses modular, interlocking arrays of microcameras. The cameras are on rails with each rail holding a plurality of cameras. These cameras, each locked in a fixed relation to every adjacent camera on the array and dispersed dimensionally in a given environment. . . ." '325 Patent 3:66-4:4. As Plaintiff has pointed out, however, the '325 and '226 Patents teach that an "array of cameras" can be arranged in nearly any configuration:
Br. at 14-15. In all of the multitude of configurations contemplated in the patents, however, the cameras in each array are always fixed in geometric relation to each other. As discussed below, the fixed geometric relationship between the cameras within an array is crucial to permitting users to navigate the environment captured by that array.
The '325 and '226 Patents devote substantial portions of their specifications describing the "arrays of cameras" to be used in various preferred embodiments. E.g. Br. at 14-15, above. The Court construes the language of the claims "in light of" those descriptions of the term "array of cameras." Phillips, 415 F.3d at 1323 (Fed. Cir. 2005).
Both the '325 and '226 Patents describe themselves as addressing the need "for an improved telepresence system that provides the ability to better simulate a viewer's actual presence in a venue, preferably in real time." '325 Patent 2:61-63; '226 Patent 2:59-63. The Patents further teach methods, systems and devices that allow multiple users to navigate the environment simultaneously and independently. E.g. '325 Patent, Claim 10, 226 Patent, Claim 55. Throughout the specifications and claims of those patents, that goal—to allow one or more users to virtually navigate an environment, preferably in real time—is consistently reflected in those patents' description of "arrays of cameras" and visual representations of such arrays.
'325 Patent 6:37-46;
As the above images indicate, the specifications of the '325 and '226 Patents consistently highlight how each camera in the array is fixed in relation to the other cameras in the array.
The claims of the '325 and '226 Patents are in accord with the description of "arrays of cameras" contained in the specifications. For example, in Claim 1 of the '325 Patent, the taught telepresence system includes "an array of cameras, each having an associated view of an environment and an associated camera output representing the associated view, the array including at least one camera path wherein each path is defined by a series of cameras having progressively different perspectives of the environment." '325 Patent, Claim 1, 20:67-21:4. Claim 1 of the '226 Patent uses similar language: "an array of cameras including a first series of cameras defining the first path through the environment, wherein the cameras in the first series have progressively different perspectives of the environment along the first path, and a second series of cameras defining the second path through the environment, wherein the cameras in the second series have progressively different perspectives of the environment along the second path." '226 Patent, Claim 1, 17:52-60. The fixed geometric relationship between the cameras in the array is central to the use of the array—indeed that geometric relationship is how a path through the array of cameras can be defined. See Stevenson Dep., ¶ 127:6-11 ("in the '226, because you have this fixed array of cameras, you have the geometric relationship between new cameras known. That's a data that is stored in the node that is used in mosaicing or tweening.").
Reading the claims in light of the specification, a POSITA would understand that, in these patents, an array of cameras means "a set of multiple cameras, each fixed in relation to each other." Fixing the cameras into in relation to each other allows for for the creation of progressively different perspectives, which can be "mosaiced," "tweened" or otherwise mixed or processed to allow a user to navigate images of the environment captured by the array. See id.
The critical nature of that fixed geometric relationship is further highlighted by the '325 Patents specification, which provides the only exemplar of the effect of modifying the cameras' relationship to each other in the '325 or '226 Patents. As detailed below, when one or more cameras' positions relative to each other is altered, the '325 Patent teaches that those alterations result in the creation of a separate and distinct array—emphasizing the requirement that within each array, the cameras' relation to each other is fixed.
The '325 Patent teaches a telepresence system in which a cylindrical "array of cameras" is deployed, each camera's image recorded, and then the array is removed from the environment. '325 Patent, Claim 22-24; see id. 19-5-20:27; Fig. 11, above. Each array comprises cameras fixed in relation to each other. As described in the '325 Patent, after the first array records images, it may be removed and a second array may be deployed. That second array then records images of the environment. As shown in Figure 11 of the '325 Patent, reproduced above, the utilization of multiple removable arrays ultimately allows a user to navigate towards or away from the central object, without the internal arrays of cameras interfering with the user's shifting perspective.
The system represented by Figure 11 is taught in Claim 22 of the '325 Patent, which further emphasizes that arrays with different geometric relationships between the constituent cameras are to be considered separate arrays. Claim 22 teaches a teaches telepresence system involving "a plurality of removable arrays" deployed at "different lengths" from the environment, which parallels the system discussed above and represented in Figure 11. The use of plural "arrays" is notable in Claim 22, as it is a departure from the more typical and singular phrase "an array of cameras" used elsewhere in the claims. E.g. '325 Patent, Claim 1, 4, 10, 13. The use of plural "arrays" in Claim 22 highlights the requirement that the cameras in the array are fixed in relation to each other by emphasizing that when, as in Figure 11, the geometric relationship between the constituent cameras with an array changes, a new array is created. For all these reasons, a POSITA would understand an "array of cameras" to mean "a set of multiple cameras, each fixed in relation to each other."
Defendant's proposed limitation—that the cameras be fixed at specific locations—goes too far, and is contradicted by the intrinsic evidence. This is illustrated by the following language from the '226 Patent:
'226 Patent, 3:56-65.
Id. 4:12-18. While that language highlights the Court's construction—that each cameras' relation to the other cameras in the array is fixed—it also demonstrates that less restrictive terms such as "positioned" and "dispersed" are used to describe the location of each camera. This is consistent with other embodiments discussed in the Asserted Patents, which teach, for example, that an array can be wheeled into position. Defendant's proposed requirement that each camera must be fixed at a specific location is inconsistent with wheeling the array into position, or removing the array after it captures its images, both of which are taught, as disused above.
On the other hand, Plaintiff's contention that the cameras can be moved or reused also goes too far and lacks intrinsic support. A careful review of the various configurations of "arrays of cameras" contemplated in the Asserted Patents provided reveals that there is not one single example in the intrinsic evidence of an array of cameras in which the cameras are not fixed relative to each other. As discussed above, the cameras are carefully deployed to create the necessary fields of view. Were that not the case, a user, let alone multiple independent users, might not be able to navigate through the environment utilizing the array. Accordingly, a POSITA would understand that cameras that did not have "fixed" fields of view relative to the other cameras in the array would be contrary to the teachings of the '325 and '226 Patents. In this context, Plaintiff's contention that cameras can be moved or reused is troubling. Moving a camera, without moving the entire array, would change its geometric relationship with the other cameras within the array, which, as explained above, would create a new array. Accordingly, the Court rejects Plaintiff's contention that a camera within an array can be moved and still constitute the same array as it is divorced from the intrinsic evidence.
Plaintiff's contention that cameras within an array can be reused is also rejected as overbroad. It is true that, from the perspective of a user of one of the claimed telepresence systems, a camera in an array may be reused in certain applications. For example, hypothetically, the user could navigate from camera A to camera B, and then back to camera A within the scope of the claimed inventions. However, if, in the example represented by Figure 11 above, a camera in array 12-1 were reused in array 12-2, array 12-1 and array 12-2 would still constitute separate and distinct arrays. Accordingly, the contention that a camera can be reused within an array as proposed by Plaintiff rejected as overbroad and likely to cause juror confusion.
Defendant's proposed construction contains the additional requirement that an array of cameras "provide a view through the environment without having to move any camera." The Court rejects that additional proposed requirement for the reasons that follow.
Defendant's proposed requirement speaks to the function of the array. The Claims of the '325 and '234 Patents are replete with language which may limit those claims along the lines proposed by Defendant. However, any such restriction is a function of the language of the claims as a whole, not the meaning of the term "array of cameras." For example, Claim 1 of the '325 Patent teaches:
From that language, a POSITA would understand that in Claim 1 of the '325 Patent, the array of cameras must include cameras with perspectives which sequentially define at least one path though the environment. A POSITA would also understand that the various views associated with the cameras within the array must, in aggregate, provide a view through the environment without having to move any camera. However, that limitation is not imposed by the term "array of cameras." Rather, it is imposed by the language following the term "array of cameras." See Phillips v. AWH Corp., 415 F.3d 1303, 1314 (Fed. Cir. 2005) ("the claim in this case refers to `steel baffles,' which strongly implies that the term "baffles" does not inherently mean objects made of steel."). As the limitations proposed by Defendant in the phrase "provide a view through the environment without having to move any camera" are best understood as limitations imposed by claim language surrounding the term "array of cameras," rather than limitations intrinsic to the term "array of cameras," the Court declines to import those terms into its construction.
For all these reasons, the Court construes the term "array of cameras" as "set of multiple cameras, each fixed in relation to each other."
Plaintiff's Proposed Construction: Plaintiff contends that this term does not require construction. In the alternative, Plaintiff proposes that the term be construed as "attributes of a local region."
Defendant's Proposed Construction: "information about the environment derived from imagery captured at different camera locations."
For the reasons that follow, the Court construes the term "local scene characteristics" as "information about the environment."
The term "local scene characteristics" appears in the claims of the '234 Patent. The pertinent claims, along with relevant sections of the claims on which they depend, are excerpted below.
(emphasis added).
The Court observes that Plaintiff's proposed construction, "attributes of a local region," and the base of Defendant's proposed construction, "information about the environment," appear to be nearly identical in meaning. However, Defendant's proposed construction goes on to add two additional restrictions: (1) that the data must be derived from imagery, and (2) that the data must be gathered from different camera locations. Neither of those proposed restrictions is appropriate.
As to the proposed requirement that the data be gathered from different camera locations, that requirement is contrary to the intrinsic evidence. The term "local scene characteristics" appears only twice in the claims of the '234 Patent, both times in the context of using "tweening" "electronic imagery." The parties have not requested that the Court construct the term "electronic imagery," and the Court does not do so in this opinion. The Court observes, however, that the term "electronic imagery" is used in the '234 Patent to describe the images which are processed to facilitate navigation of an environment—as opposed to the '325 and '226 Patents which instead describe how an "array of cameras" would capture said imagery. Accordingly, the Court rejects Defendant's contention that "local scene characteristics" must be derived from camera data, collected at different camera locations, as an inappropriate narrowing of the '234 Patent, which does not utilize camera specific language in its claims.
As to the proposed requirement that "local scene characteristics" be limited to data derived from imagery, that proposed limitation is contrary to the intrinsic evidence as understood by a POSITA. As indicated in the claim language quoted above, the term "local scene characteristics" is only used in the claims of the '234 Patent in the context of "tweening." Dr. Hanna, the inventor of the Hanna Patent which was incorporated by reference into the '234 Patent as an exemplar of `tweening" has testified that the Hanna Patent discloses local scene characteristics that are not "derived from imagery." Hanna Decl. ¶¶ 56, 57, Hanna Supp. Decl. ¶¶ 41-42. Examples of such data include "scene structure and shape of a local region, such as the orientation and depth/range of a planar surface in a local region." Id.
Turning to the language of the Hanna Patent, which as described above is incorporated into the '234 Patent as an exemplar of "tweening," the Court notes that the Hanna Patent discloses the use of "image sensors" as opposed to cameras. This distinction is relevant because the Hanna Patent's use of the term "image sensor" is broader than the term "camera" in that it encompasses types of image sensors which are capable of capturing data other than light or its absence. Hanna Patent 11:67-12:3 ("Other image sensors include radar detectors, optical line sensors or other electromagnetic or sonic detectors or any other sources of signals."). The outputs from such sensors are not limited to the type of imagery generated by cameras. Accordingly, neither the intrinsic nor the extrinsic evidence support Defendant's proposed restriction that "local scene characteristics" must be derived from imagery.
As both of Defendant's proposed restrictions have been rejected as contrary to the intrinsic evidence, the Court is left with two nearly synonymous potential constructions "attributes of a local region" and "information about the environment." No party has suggested that those phrases have different meanings, and the Court does not understand there to be a dispute as to any differences between those phrases. However, Plaintiff's proposed construction is disfavored because it repeats the word "local" in the construction of the term "local scene characteristics," which renders the proposed construction somewhat circular and less informative. Furthermore, the phrase "region" is untethered from the Asserted Patents, while the term "environment" is a common term in the Asserted Patents, referring to the environment to be navigated by the telepresence system. E.g. '234 Patent, Claims 1, 7.
For all of these reasons, the Court construes the term "local scene characteristics" to mean "information about the environment."
Plaintiff's Proposed Construction: Plaintiff contends that this term does not require construction. In the alternative, Plaintiff proposes that the term be construed as "transforming the positions of pixels in imagery."
Defendant's Proposed Construction: "modifying an image captured at one camera location to bring the image closer to matching another image captured at a different camera location."
For the reasons that follow, the Court holds that the term "warping imagery" is to be given its full ordinary meaning, and thus construes it to mean "warping imagery."
The term "warping imagery" appears only twice in the claims of the Asserted Patents— specifically in Claims 5 and 21 of the '234 Patent. The pertinent sections of those claims are reproduced below:
'234 Patent, Claim 5, 25:55-61;
'234 Patent, Claim 21, 27:56-59.
The related term "warping" also appears in the specification of the '325 Patent as part a described "tweening" process:
'325 Patent, 14:18-20.
Neither proposed construction adds any justifiable refinement to the ordinary meaning of the term "warping imagery." Plaintiff's expert contends, and Defendant's expert does not contest, that the term "warping imagery" has an ordinary meaning that a POISITA would understand. See Reply at 9 (collecting citations). Nonetheless, Plaintiff's alternative construction incorporates a reference to "pixels," without citation to any support in the intrinsic evidence for the use of that word. On the other hand, Defendant's proposed construction must also be rejected as it improperly attempts to incorporate a requirement of multiple camera locations into the '234 Patent, when the '234 Patents' claims are devoid of any reference to the term "camera," or requirements as to how the images to be processed were captured. And while Defendant's proposed construction does add the concept of directionality to the term "warping imagery" through the phrase "towards another image," that sense of directionality should not be construed as part of the term "warping imagery." Rather, the directionality implicit in the utilization of the term "warping imagery" in the patents stems from the surrounding claim language, which as quoted above, consistently described the technology as "warping imagery . . . toward" other imagery. For all these reasons, the Court rejects both proposed constructions, and holds that the term "warping imagery" is to be given its full ordinary meaning, and accordingly construes it as "warping imagery."
Plaintiff's Proposed Construction: Plaintiff contends that neither "perspective" nor "point perspective" requires construction. In the alternative, Plaintiff proposes that both terms be construed as "view from a location."
Defendant's Proposed Construction: Defendant contends that both terms should be construed as "camera location."
For the reasons that follow, the Court construes both terms to mean "view from a location."
One or both of these terms appears in the claims in all of the Asserted Patents. The Court notes that natural reading of the terms may lead to a presumption that that the term "point perspective" may have a different meaning than the term "perspective."
The term "perspective" has a broad and commonly understood ordinary meaning. Plaintiff's proposed construction, "view from a location" is well within that ordinary meaning. The first claims of the '234 and '325 Patents are instructive as to the usage of the terms within the Asserted Patents.
'234 Patent, Claim 1, 25:20-23.
'325 Patent, Claim 1, 20:63-21:4
The claim language quoted above demonstrates an inherent flaw in Defendant's proposed construction. In both of those claims, substituting the term "camera locations" for "perspectives" as Defendant proposes, is inappropriate. In the '234 Patent, doing so would incorporate camera location into claims which, as discussed in § II(B)(1)(b) above, do not otherwise reference the term camera. And in the '325 Patent, doing so would be, at best, highly awkward, as the phrase "cameras having progressively different camera locations of the environment" borders on the nonsensical.
The '325 Patent contains language which further clarifies the construction of the terms.
'325 Patent, 18:59-67 (emphasis added). As this language indicates, a zoom-capable camera can modify its field of view through the use of zoom without modifying its "point perspective." Accordingly, while a camera's location and orientation may be relevant to determine a cameras' "perspective or "point perspective," the use of features such as zoom is not. Those distinctions are encompassed in the term "view from a location" as applied to a specific camera, and are inadequately accounted for in Defendant's proposed construction. For all of these reasons, the Court construes the terms `perspective" and "point perspective" as "view from a location."
The Court declines to construe the terms "different perspective;" "prospectively different perspective(s);" "different point perspective;" "having an associated view of the environment from a progressively different point perspective;'" and "[first] [second] perspectives," as they are dependent terms whose meaning is unambiguous and fully determined in light of the Court's construction of "perspective" and "point perspective."
In their original Joint Claim Terms Chart, the parties listed several terms whose construction they, at that time disputed, but which no longer appear to be in dispute Those terms are "compositing imagery of the different perspectives of the environment along the first view;" "compositing imagery of the first perspective of the environment and imagery of the second perspective of the environment;" and "mixing the first image with the second image to produce a mixed image." As Defendant did not brief the construction of these terms, and Plaintiff contends they require no construction, the Court understands there is no dispute as to these terms, and so the Court declines to construct them.
In their Joint Claim Construction Statement, Dkt. No. 38, the parties agree to the construction of the following terms:
The Court understands there to be no dispute as to the construction of those terms and adopts the parties' agreed upon constructions of them.
Defendant contends that Claims 5 and 14 of the '325 Patent, as well as Claims 91 and 94 of the '226 Patent are indefinite. For the reasons that follow, all of those claims, "viewed in light of the specification and prosecution history, inform those skilled in the art about the scope of the invention with reasonable certainty." Nautilus, Inc. v. Biosig Instruments, Inc., 572 U.S. 898, 910 (2014). Accordingly, they are not indefinite.
One facet of the validity of a patent concerns the definiteness of its claims; summarily speaking, an indefinite claim is an invalid claim. See generally 35 U.S.C. § 112. "Indefiniteness is a matter of claim construction, and the same principles that govern claim construction are applicable to determining whether allegedly indefinite claim language is subject to construction." Praxair, Inc. v. ATMI, Inc., 543 F.3d 1306, 1319 (Fed. Cir. 2008) (quoting Datamize, LLC v. Plumtree Software, Inc., 417 F.3d 1342, 1348 (Fed. Cir. 2005)). Like claim construction, the question of indefiniteness is a question of law for the Court. ePlus, Inc. v. Lawson Software, Inc., 700 F.3d 509, 517 (Fed. Cir. 2012). Under 35 U.S.C. § 112, every patent must contain claims that set out what "the applicant regards as his invention"—this is, in effect, "a public notice function, ensuring that the patent specification adequately notifies the public of the scope of the patentee's right to exclude." Praxair, 543 F.3d at 1319.
While patents need not set forth the parameters of an invention with complete precision— "[s]ome modicum of uncertainty . . . is the price of ensuring the appropriate incentives for innovation"—a patent "viewed in light of the specification and prosecution history, [must] inform those skilled in the art about the scope of the invention with reasonable certainty." Nautilus, Inc. v. Biosig Instruments, Inc., 134 S.Ct. 2120, 2128-29 (2014) (internal quotation marks and citations omitted). The Nautilus court clarified that a patent claim is not definite simply because "a court can ascribe some meaning to a patent's claims" in a post hoc review, id. at 2130, and it is thus "not enough . . . to identify some standard for measuring the scope of the phrase," Interval Licensing LLC v. AOL, Inc., 766 F.3d 1364, 1370-71 (Fed Cir. 2014) (internal quotation marks and citations omitted). To withstand definiteness review, a claim must contain objective boundaries to provide sufficient notice to those of skill in the art to understand the invention. Id. at 1371; Berkheimer v. HP Inc., 881 F.3d 1360, 1364 (Fed. Cir. 2018). While claim terms can be defined by way of examples in the specification, the use of examples will not always provide a sufficiently definite boundary. Interval Licensing, 766 F.3d at 1373-74 (citing Enzo Biochem, Inc. v. Applera Corp., 599 F.3d 1325, 1336 (Fed. Cir. 2010)).
In sum, [a] lack of definiteness renders the claims invalid," Berkheimer, 881 F.3d at 1363 (citing Nautilus, 134 S.Ct. at 2125), and where "a skilled artisan is still left to wonder what other forms" of the device in question fall into the ambit of the inventor's patent, a claim is not sufficiently definite to inform the relevant audience the scope of what the inventor has reserved the right to exclude. Interval Licensing, 766 F.3d at 1374. Defendant bears the burden to prove any fact supporting its challenge by clear and convincing evidence.
Claims 5 and 14 of the '325 Patent contain the phrase "each camera in the sequence having a different point perspective and a field of view that overlaps that of an adjacent cameras." Defendant contends that the mismatch between the singular "an" and the plural "cameras" renders these claims indefinite. However, one skilled in the art would not be confused by this phrase, for the reasons that follow.
The use of the singular "an" and plural "cameras" appears to be a drafting error. However, both reasonable constructions of the phrase lead to the same outcome, preventing confusion. If the phrase is read as concluding with "a field of view that overlaps that of an adjacent camera," then the condition—overlapping—is satisfied if the field of view overlaps with one, or more, adjacent cameras.
On the other hand, if the phrase is construed as concluding with "a field of view overlapping those of adjacent cameras" the condition—again overlapping—is satisfied if the field of view overlaps with all adjacent cameras. Accordingly, in this construction, the condition is again satisfied by overlap with multiple cameras, if the camera is adjacent to multiple cameras, or one camera, if the camera is only adjacent to one camera.
As both of the two plausible constructions have the same meaning, one skilled in the art can determine, with "reasonable certainty" what is claimed, despite the error in drafting. Nautilus, Inc. v. Biosig Instruments, Inc., 572 U.S. 898, 910 (2014). Accordingly, these claims are not indefinite.
Claim 94 of the '226 Patent is dependent on Claim 91. Those claims are excerpted, in pertinent part, below.
Claim 91 contains what appears to be another typographical error, as the preamble of Claim 91 describes itself as both a device and a system. Defendant contends that, as a result, both Claim 91 and 94 are indefinite, as a person of skill in the art could not reasonably determine whether the claim is as to a device or a system. This issue is compounded by the fact that Claims 92 and 93 refer back to Claim 91 using the antecedent preamble, "the device of claim
The use of the terms "device" and "system" within Claim 91, however, does not render it or any other claim indefinite. Claim 91 contains both a reference to being a device and a system. Accordingly, the claims dependent on Claim 91 find antecedent support in Claim 91 regardless of whether they refer to a system or a device. As the link between Claim 91 and its dependent claims remains intact, the Court turns to the question of whether a person skilled in the art would be unable to determine the scope of the invention with "reasonable certainty" given the usage of both the terms "device" and "system" in the preamble of Claim 91. Nautilus, 134 S.Ct.at 2128-29.
A person of reasonable skill in the art would not be confused or uncertain as to the scope of the invention due to the inconsistent use of the words "device" and "system." Indeed, Defendant has failed to advance any argument or to adduce any evidence as to the difference between a system and a device in the context of these claims.
Turing to the structure of Claim 91, the Court observes that the words device and system, beyond indicating that the Claim relates to a machine, are not highly descriptive of the nature of the invention claimed. Rather, the invention claimed is defined by the descriptive portion of the preamble "for providing a user with a display of an environment in response to user inputs," and the following descriptive sections which detail the array of cameras, memory storage capacity, and processing element(s) which comprise the claimed invention, and which give meaning to the terms "device" and "system." Accordingly, a person skilled in the art would be able to understand what was claimed with reasonable certainty despite this error. For all these reasons, these claims are not indefinite.
For the reasons that follow, the Court construes the disputed terms as described above, and as summarized in Attachment A.
SO ORDERED.
As discussed below, the Court agrees with Dr. Stevenson that the cameras must be fixed in relation to each other, but disagrees that they must be fixed to individual locations in order to preserve the operational geometry about which Dr. Stevenson testified.