REPORT AND RECOMMENDATION
MARY PAT THYNGE, Magistrate Judge.
I. INTRODUCTION
This is a patent case. On June 18, 2012, Hand Held Products, Inc. ("HHP") filed suit alleging Amazon.com, Inc., AMZN Mobile LLC, AmazonFresh LLC, A9.com Inc., A9 Innovations LLC, and Quidsi, Inc. (collectively, "Amazon") of infringing U.S. Patent No. 6,015,088 ("the `088 patent").1 Currently before the court is Amazon's motion for summary judgment of non-infringement.2
II. BACKGROUND OF THE INVENTION
The `088 patent is titled "Decoding of Real Time Video Imaging." "This invention relates to image capturing apparatus, and more particularly to a method of capturing and decoding bar code information in real time from a continuously displayed video signal of a particular target."3 The abstract recites:
A process allows an image capturing apparatus to be integrated with a personal computer to continuously display a video image of the imaging apparatus. Upon proper input by a user, or automatically after a timed interval, a snapshot of the video image is captured. An autodiscrimination process of the captured video image automatically decodes any bar-coded information present in the captured image and outputs the information.4
III. CLAIMS AT ISSUE
HHP asserts Amazon infringes independent claim 1 and claims 8, 10, and 12 which depend therefrom.5
Claim 1 recites:
1. A process for capturing and decoding bar-code information in real time from a continuously displayed image video signal, comprising the steps of:
aiming an imaging apparatus at a target of interest, said target having at least one of optically readable and bar coded information contained thereupon;
continually displaying a real time image of said target from said imaging apparatus;
selectively capturing and storing an instantaneous image of said target into the memory of a computer;
determining if bar-coded information is present in said stored image;
decoding bar-code information if bar-code readable information is contained on said instantaneous stored image while maintaining the display of said real-time image; and
outputting the decoded bar-coded information.
IV. LEGAL STANDARD
A grant of summary judgment pursuant to FED. R. CIV. P. 56 is appropriate if materials on the record, such a deposition, documents, electronically stored information, admissions, interrogatory answers, affidavits and other like evidence show that there is no genuine issue as to any material fact, and the moving party is entitled to judgment as a matter of law.6 This standard is applicable to all types of cases, including patent cases.7 The movant bears the burden of establishing the lack of a genuinely disputed material fact by demonstrating "that there is an absence of evidence to support the nonmoving party's case."8 "Facts that could alter the outcome are `material,' and disputes are `genuine' if evidence exists from which a rational person could conclude that the position of the person with the burden of proof on the disputed issue is correct."9 "Where the record taken as a whole could not lead a rational trier of fact to find for the non-moving party, there is no genuine issue for trial."10 In a patent case, "[s]ince the ultimate burden of proving infringement rests with the patentee, an accused infringer seeking summary judgment of noninfringement may meet its initial responsibility either by providing evidence that would preclude a finding of infringement, or by showing that the evidence on file fails to establish a material issue of fact essential to the patentee's case."11 "An accused device cannot infringe, as a matter of law, if even a single limitation is not satisfied."12 If an accused infringer demonstrates an absence of material fact, the patent owner "must come forward with `specific facts showing that there is a genuine issue for trial.'"13
V. DISCUSSION
The court issued a Report and Recommendation ("R&R") construing the term "selectively capturing . . . an instantaneous image" by construing the constituent terms within that phrase: "selectively," "capturing," and "instantaneous image."14 The court construed "selectively" to mean "selected by the user based on the displayed image."15 The court construed "capture" as "converting the live analog video signal into a single digital image."16 "[A]n instantaneous image" was construed to mean: "an instant in time selected by the user based on the displayed image, converting the live analog video signal into a single digital image that is output for storage into computer memory."17 Based on those constructions, the court construed "selectively capturing . . . an instantaneous image" to mean "at an instant in time selected by the user based on the displayed image, converting the live analog video signal into a single digital image that is output for storage into computer memory."18
After considering HHP's objections to the R&R's construction, Judge Richard part of the legal standard for infringement, because such failure will render all other facts immaterial."). Andrews rejected HHP's arguments and adopted the construction of that term set forth in the R&R.19 After that decision, HHP served revised infringement contentions which purportedly demonstrate how the Accused Apps infringe under the court's construction of the "selectively capturing" term.
The accused products in this case are Amazon mobile applications ("Amazon Apps") which are loaded on consumers' smartphones and used to find and purchase Amazon products.20 One way the Amazon Apps can be used to find a product on Amazon is by scanning the barcode on the product.21 The barcode scanning capability of the Amazon Apps is what HHP accuses of infringing the `088 patent. That barcode scanning capability is referred to as the "Accused Apps."22
The devices on which the Amazon Apps are used run operating systems. Those operating systems include Apple's iOS operating system, Google's Android operating system, and Microsoft's Windows Phone 7 operating system.23 An operating system is a collection of software programs and libraries that manages the hardware on a device as well as all of the other software programs that run on the device.24 As is relevant to this case, an operating system manages the Amazon Apps.25 The Amazon Apps HHP accuses of infringement and the operating systems they are alleged to run on in order to infringe are: Amazon Mobile (iOS, Android, WP7), Price Check (iOS, Android), Student (iOS, Android), AmazonFresh (iOS, Android), Flow (iOS, Android), AmazonLocal Merchants (iOS, Android), BeautyBar (iOS), Diapers (iOS, Android), Wag (iOS, Android), YoYo (iOS), Soap (iOS, Android), Casa (iOS), Afterschool (iOS), Bookworm (iOS), and Vine (iOS).26 Each of those Apps is available for download by the general public, free of charge, from an online App store such as Apple's App Store, Google Play, Amazon's Appstore for Android, and Windows Store.27
Amazon cites the `088 patent specification's explanation of how an image is selectively captured in the disclosed embodiment. The specification describes a system that combines a conventional video camera, a general purpose computer, a conventional "video capture card," and conventional barcode decoding software to allow a user to take a "snapshot" of an object having barcodes on it so the barcodes can be decoded.28 According to the specification: (i) a user aims the video camera at an object having a barcode on it and the video camera generates a live video display of the object on a computer monitor;29 (ii) when the user determines by looking at the computer monitor that the object is properly focused and a resolved image appears on the monitor,30 the user takes a "snapshot" picture of the object by, for instance, pressing a key on a computer keyboard or clicking a mouse;31 (iii) when the user snaps the picture, within the computer a single image from the analog video is converted into digital form by the "video capture card";32 (iv) the single digital snapshot is stored;33 and (v) the barcode decoding software automatically decodes barcodes within the snapshot.34
Amazon contends HHP's new infringement contentions fail because the Accused Apps purportedly do not allow a user to take a picture or otherwise select an instant in time and, even if they did, they do not convert images from analog to digital form.35 Amazon also maintains HHP's opposition to its summary judgment motion largely relies on arguments made during claim construction that were rejected and, therefore, cannot be the basis for denying its motion.36
Amazon argues the Accused Apps do not function in the manner described in the `088 patent and, specifically, do not perform "selectively capturing" as construed by the court. According to Amazon, to a user of the Accused Apps, each works in substantially the same way.37 Once a user initiates the Accused App, a live video is presented on the smartphone's screen showing whatever the camera is initially pointed at.38 Overlaid on top of the video display are two orange brackets (referred to as "arrows").39 Text above the arrows reads "Center barcode between the arrows"; text below the arrows reads "Barcode will scan automatically. Try to avoid shadows and glare."40
Amazon contends it is undisputed that a user of the Accused Apps cannot take the requisite snapshot by pressing a shutter button, setting a timer, or in any other manner.41 Even if a user watching the live video wanted to select a particular instant in time to capture a single video image, the Accused Apps do not provide any mechanism by which they could communicate that selection to the Accused App.42 Amazon insists a user of the Accused Apps simply is not able to select any image or any instant in time based on the display.43 Amazon maintains, therefore, that the Accused Apps cannot infringe the asserted claims because a user of the Accused Apps is unable to make that selection as required by the court's construction of the "selectively capturing" terms: "at an instant in time selected by the user based on the displayed image, converting the live analog video signal into a single digital image that is output for storage into computer memory."
The court agrees with Amazon that the Accused Apps provide no mechanism by which a user selects an instant in time to capture a barcode image and, therefore, the Accused Apps do not infringe the asserted claims of the `088 patent.
HHP contends that one flaw in Amazon's argument is that Amazon improperly limits the mechanisms for user selection to a key or button.44 First, the court's construction of "selectively capturing" did not include any limitation on the manner in which the user selects an instant in time to capture an image. Nor did it imply such a codes" (iOS and Android). Id. As relevant to Amazon's motion, however, the operation of the Flow Apps is the same as that of the other Accused Apps. Id. at ¶¶ 11, 15-16. limit in its discussion of the term "selectively": "the specification explicitly states `regardless of the mode selected,' e.g., keyboard mouse, or timer . . . ."45 Second, Amazon did not include that limitation. The portion of Amazon's opening brief HHP cites in support of its contention states the Accused Apps do not infringe because a user cannot select an image by "pressing a shutter button, not be setting a timer, and not by doing anything else."46
Because the court did not construe "selectively capturing" to be limited to a user utilizing a keypad, mouse click, or timer, HHP contends the user "selectively captures" a barcode image by aiming the camera at a barcode, centering the image, and holding the camera steady.
Once the camera has been aimed at the target of interest and the camera is turned on, the user will continue to center the camera image by centering it in the proper zone on the display and holding the camera steady. The user selectively captures the barcode by putting it within the measurement region of the camera and adjusting the image so that the barcode is appropriately aligned and reasonably stable within the measurement region. The live analog video signal (from the sensor) is converted into a single digital image that is output for storage in computer memory then placed into the computer memory.47
Despite the fact that aiming is not part of the "selectively capturing" limitation, it is a separate limitation, i.e. the first step set forth in claim 1, "aiming an imaging apparatus at a target of interest, said target having at least one of optically readable and bar coded information contained thereupon,"48 HHP contends the user aiming the camera at a barcode is part of how the user purportedly selectively captures an image. HHP states the Accused Apps measure and respond to two aspects of user input reflecting an instant in time selected by the user: "Has the user placed a pattern in my measurement region?" and "is my accelerometer stability measurement within range?"49 According to HHP, these inputs from the user are measured by the smartphone's camera and its accelerometer, as called for by the Accused Apps, and are analogous to the mouse click, keyboard, and/or timer inputs described in the specification of the `088 patent.50 HHP maintains that unless the user puts the barcode within the designated region or field of view of the camera and also holds the camera steady on the barcode, no copy of the digital image is made into RAM for further processing.51
HHP notes Amazon specifically instructs and assists the user to make those inputs to the application based upon the displayed image. Amazon instructs users to use the displayed image by placing it within a desired measurement region, improving the image, and holding the smartphone within accelerometer limits:
"Center barcode between the arrows. . . Try to avoid shadows and glare"
"1. Try reducing the glare on the item 2. Move the camera closer, but stay in focus"
"Hold steady . . ."
"Center Barcode between the arrows"52
HHP further points out Amazon employs graphics (either blue floating dots or capture bars that change color on the screen) to assist the user in making this selection;53 the bars are orange until the user places an appropriately aligned barcode within them, at which point the capture bar turns green, and the image is captured for the user.54 The blue dots of other Accused Apps help the user orient the phone and capture a barcode.55
The court does not agree with HHP that a user aiming the camera, centering the barcode, and holding the camera steady is analogous selecting a particular image using a mouse click, keyboard, and/or timer inputs described in the specification of the `088 patent because it is the Accused Apps that make the selection despite the fact that the user takes those preliminary actions. As HHP acknowledges, "[t]he issue . . . really comes down to the proper application of the Court's construction to the facts set forth in Hand Held's contentions."56 Despite the infringement contention, above, stating the user selectively captures an image by taking those preliminary actions, in subsequent contentions, HHP alleges the Accused Apps, not the user, performs the "selectively capturing" step.
The selective capturing and storing of an instantaneous image of said target into the memory of a computer is performed by Amazon Mobile by establishing and/or applying criteria that determine what images and/or which portions of the images will be selected, designated for further detection and decoding, and stored.57
The Mobile application monitors current and historical readings from the accelerometer as well as the camera to determine when the user is holding the camera steady enough to obtain reliable image data. Based on this assessment of user behavior, the Mobile applications selectively captures and stores an instantaneous image of the target into the memory of the device and attempts to detect and decode a barcode symbol in the image.58
Additionally, the Mobile application selectively captures based on the possibility of being aimed at a barcode. After the user has adjusted the image so that the barcode is within the preferred measurement region, appropriately aligned, and reasonably stable, the live analog video signal (from the sensor) is converted into a single digital image that is output for storage in computer memory then placed into the computer memory.59
It is the user who must make the selection of the instant in time to capture the barcode image, not the Accused Apps. Judge Andrews previously rejected HHP's suggestion to the contrary. In its objection relating to the to the R&R's "selectively capturing" construction, HHP offered a new construction that did not require a user to select the image. HHP proposed a modification of the R&R's construction of the "selectively capturing" term to allow the processor, rather than the user, to make the selection: "at an instant in time selected by the user based on the displayed image or the processor, converting the live analog video signal into a single digital image that is output for storage into computer memory.60 Judge Andrews held "[t]his proposal was not before the Magistrate Judge and is therefore not timely raised. Even if it were, however, the Court agrees with the Magistrate Judge's construction requiring a user to selectively capture the image."61
Because a user of the Accused Apps cannot make the selection of an instantaneous image to capture, the "selectively capturing" limitation is not met by those applications and summary judgment of noninfringement is warranted.62
VI. RECOMMENDED DISPOSITION
Consistent with the findings contained in the Report and Recommendation,
IT IS RECOMMENDED that Amazon's motion for summary judgment (D.I. 257) be GRANTED and Amazon's motion for leave to respond to HHP's sur-reply (D.I. 282) be DENIED as MOOT.
Pursuant to 28 U.S.C. § 636(b)(1)(B), FED. R. CIV. P. 72 (b)(1), and D. DEL. LR 72.1, any objections to the Report and Recommendation shall be filed within fourteen (14) days limited to ten (10) pages after being served with the same. Any response shall be limited to ten (10) pages.
The parties are directed to the Court's Standing Order in Non-Pro Se Matters for Objections Filed under FED. R. CIV. P. 72 dated November 16, 2009, a copy of which is found on the Court's website (www.ded.uscourts.gov.).