Video storage and delay device for use with an in-car video system
Claim Score by NHIP
Abstract
An in-car video apparatus and method is provided where a real time continuous video supplied by a vehicle-mounted camera and an audio microphone is processed for storage in a memory in a time-sequential manner for a pre-set time interval to create a time-delayed video stream. Upon activation of the in-car video system by a law enforcement officer (which occurs at an arbitrary reference time), a vehicle-mounted recording device records the time-delayed video stream to create a video recording of the events captured by the video camera. Because the time-delayed video stream is recorded rather than the real time video stream, the start time of the video recording precedes the reference time by the pre-set time interval. The invention provides an ability to create a complete record of a police-citizen encounter, including the initial incident that prompted the officer's subsequent activation of the in-car video system.

Term
Term ended
Projected expiry passed 23 January 2022, 4.7 years ago.
- Priority and filed
- Published
- Projected expiry
- Today
40 claims: 5 independent, 35 dependent
- 1A method of operating a vehicle-mounted surveillance system including a camera and vehicle-mounted recording device that creates video recordings having a start time and a stop time, the method comprising the steps of:capturing a stream of live video of an area of surveillance using the camera;processing the live video stream to impose a delay of pre-set time interval on the live video stream to generate a time-delayed video stream;and activating the recording device, upon an occurrence of an event at a reference time, to record the time-delayed video stream so that a video recording is created of the surveillance area and the start time of the video recording precedes the reference time by the pre-set time interval.
- 10A video data storage and delay device arranged to provide a delay of a pre-set time interval to a real time video stream received from a vehicle-mounted video system, the vehicle-mounted video system including a video camera and recording device, comprising:an input interface for receiving the real time video stream from the video camera;a processor to process data representative of the received real time video stream and for writing the data to storage and reading the data from storage so as to create the time delay between the input and output of the video data storage and delay device;a memory coupled to the processor to temporarily store the processed data for the pre-set time interval;and an output interface for transmitting the delayed video signal to the recording device.
- 38A method of operating a vehicle-mounted recording device, the method comprising the steps of:capturing a stream of real time video of an area of surveillance using a video camera;buffering the stream of real time video in a time-sequential manner for a pre-set time interval to create a buffered stream of video that is time delayed compared with the real time video stream;and outputting the buffered and time delayed video stream to a vehicle-mounted recording device that is adapted to selectively record the buffered and time delayed video stream.
- 39Broadest claimClaim Score 71, broad(NHIP)A method of operating a vehicle-mounted surveillance system including a camera and vehicle-mounted recording device, the method comprising the steps of:capturing a continuous stream of real time video of an area of surveillance using the camera;imposing a delay of pre-set time interval on the real time video stream to create a time delayed video stream;and recording the time delayed video stream onto a storage medium using the recording device.
- 40A video recorder adapted for use in a vehicle-mounted surveillance system, comprising an input interface for receiving a real time video stream from a video source;a processor to process data representative of the received real time video stream and for writing the data to storage and reading the data from storage so as to create a time delayed version of the real time video stream;a memory coupled to the processor to temporarily store the processed data for the set time interval;and a recording device for recording video and audio onto a storage medium, the recording device being coupled to the processor for receiving the time delayed version of the real time video stream.
Independent claims5
64 paragraphs in 4 sections, as filed
BACKGROUND OF THE INVENTION
[0001] This invention is related generally to surveillance systems, and more particularly to a video storage and delay device for use with an in-car video system.
[0002] Vehicle-mounted surveillance systems, including in-car video systems, are seeing increased use in the security industry and law enforcement community as an effective means to provide an indisputable video and audio record of encounters involving officers and citizens. In these systems, a video camera is typically mounted on the police car's dashboard or windshield and is generally arranged to have a field of view of the area to the immediate front of the car. The field of view approximately corresponds to what an officer would see when seated in the car's front seat.
[0003] The video camera is operably coupled to a recording device, such as a video cassette recorder (“VCR”), mounted in the police car, often in the trunk. Generally, video recordings are not made continuously during routine police patrol. Instead, to reduce videotape costs and avoid excessive wear and tear on the recording equipment (particularly, the recording heads), recordings are made only during incidents of interest, such as traffic stops and pursuits, for which an evidentiary record is desired. A videotape recording may be started manually by the officer, or in some systems, the videotaping is started automatically when, for example, the officer activates the police car's emergency systems (such as overhead lights and/or sirens), or when a vehicle speed-measuring radar unit is operated.
[0004] In-car video systems generally employ a wireless microphone carried on the person of a law enforcement officer to record an audio soundtrack that accompanies the visual scene captured on videotape. The audio soundtrack is an extremely valuable complement to the recorded video because it acts as a transcript of what was said, by whom and when. In some systems, additional wired microphones may be deployed in other locations within the car, such as the rear seat passenger area, to record sounds and conversations emanating from those locations.
[0005] In-car video systems serve to enhance prosecution of traffic, DWI/DUI and controlled dangerous substances offenses (to name just a few) by contributing detailed graphical and auditory evidence in a time-sequential manner that is inherently unbiased and objective. Such evidence is a valuable adjunct to eyewitness and officer testimony. Videotaped evidence is also increasingly used to substantiate the legal basis, referred to as “probable cause,” for a stop, arrest, search, or the issuance of a citation (i.e., ticket).
[0006] In addition, as with other quality-improvement initiatives where conduct is surveyed and recorded, in-car video system usage has been shown to assist in the maintenance of high professional standards among law enforcement personnel. Police-community relations have improved and citizen complaints of police misconduct have lessened in many jurisdictions where in-car video systems are used, often as a result of the inherently high-quality evidence provided by such systems. Videos taken with in-car video systems are also valuable training aids to law enforcement personnel.
[0007] Videotape evidence is protected (and the evidentiary chain of custody readily established) because the video cassette recorder and video recording medium (i.e., videotape) are typically “locked”, often both mechanically and electronically, within a tamperproof security enclosure in the car that is only accessible by law enforcement command personnel. In addition, the in-car systems are configured to prevent erasure or over-recording of a recorded encounter to ensure the integrity of the videotaped evidence. In-car video systems may superimpose time and date stamps on the recorded video image as a further enhancement to the evidentiary strength of the videotape.
[0008] Current in-car video systems perform very well in many applications. However, the fact that most systems are not videotaping continuously means that some evidence may miss being recorded before the officer has the chance to activate the video recorder. For example, a car driving through a stop light or weaving erratically through traffic may prompt the officer to hit the “record” button to manually begin a video recording, or activate the emergency lights to automatically start the recording in anticipation of effecting a car stop. Unfortunately, by the time the video recording starts, the initial incident (i.e., the disregarded traffic control device or erratic driving) that prompted the officer's attention has already occurred and can not be recorded. If the driver does not engage in additional unlawful behavior, then current in-car video systems will only capture a record of the vehicle pulling over and the officer's subsequent interaction with the suspect. However, the probable cause to support the car stop, and any subsequent traffic ticket, search or arrest may not necessarily be part of the videotaped record.
SUMMARY OF THE INVENTION
[0009] An in-car video apparatus and method is provided where a real time (i.e., “live”) continuous video stream supplied by a vehicle-mounted camera is processed for storage in a memory in a time-sequential manner for a pre-set time interval to create a time-delayed video stream. Upon activation by a law enforcement officer (which occurs at an arbitrary reference time), a vehicle-mounted recording device records the time-delayed video stream to create a video recording of the events captured by the video camera. Because the time-delayed video stream is recorded rather than the real time video stream, the start time of the video recording precedes the reference time by the pre-set time interval. The invention thus provides an ability to record an event after it has already occurred.
[0010] In an exemplary embodiment of the invention, an in-car video camera sends a continuous analog real time video stream to a video delay and storage device. An audio microphone captures an analog audio soundtrack that accompanies the video images. The audio and video streams are received through an input interface at the video delay and storage device. An analog-to-digital converter digitizes the analog video and audio streams into a digital data stream that is then compressed by a digital encoder. A central processor in the video delay and storage device sequentially processes the compressed digital data stream for storage in a coupled memory. The compressed digital data is temporarily held in the memory for a pre-set time interval and is then sequentially output to a digital decoder that decompresses the digital data. A digital-to-analog converter converts the digital data into analog form. Analog video and audio streams that are time-delayed by the pre-set interval (compared with the real time video and audio streams) are output through an output interface of the video delay and storage device. The central processor controls the overall signal flow and processing throughout the video delay and storage device. Upon activation, a vehicle-mounted recording device, such as a VCR, records the time-delayed video stream from the video delay and storage device.
[0011] In other embodiments of the invention, a discrete (i.e., self-contained and requiring only external power and signal connections) video storage and delay device is provided with a pre-set time interval (i.e., the amount of time-delay) that is user-definable. In addition, either analog or digital signals may be accepted at a standard input interface of the video storage and delay device, and both digital and analog time-delayed output streams are provided. Two audio tracks—one for a wireless microphone and the other for a rear seat microphone—are also processed and output via a standard interface by an embodiment of the digital storage and delay device.
[0012] The invention provides many advantages. By buffering the real time video and audio streams to create the time-delayed video and audio stream, the officer has a period of time equal to the pre-set time interval to react to a witnessed event, such as a traffic infraction, and activate the video recorder. For example, if the time-delay is six seconds, then the officer is provided with up to six seconds in which to activate the video recorder and still be able to record the witnessed event on videotape. Accordingly, the invention provides a complete record of a police-citizen encounter, including the initial incident, event or behavior that captured the officer's attention in the first place. The odds that evidence supporting probable cause is contained in the videotaped record are thus greatly enhanced.
[0013] When the principles of the invention are embodied in the self-contained video storage and delay device, further advantages are realized. Once connected to the real time video and audio sources and external power, the video storage and delay device operates transparently without requiring any extra user intervention or attention. By using standard I/O interfaces, the inventive arrangement may be simply serially connected between the signal sources (i.e., video camera and microphone) and the video recorder using standard signal connections. Advantageously then, the video storage and delay device may be retrofitted to existing in-car video systems to thereby realize the benefits in the ability provided by the invention to record an event after it has occurred.
BRIEF DESCRIPTION OF THE DRAWINGS
[0014]FIG. 1 is a simplified functional block diagram of an illustrative arrangement of the present invention and depicts an in-car video surveillance system including a windshield mounted camera and trunk-mounted video recorder, a wireless microphone, a rear seat microphone, a control head, a video monitor, and a video storage and delay device;
[0015]FIG. 2 depicts the sequential storage of a real time video stream used to create a time-delayed video stream, in accordance with the invention;
[0016]FIG. 3 depicts a group of timelines showing that the present invention provides an ability to create a permanent record of an event that begins prior to the activation of the in-car video recorder;
[0017]FIG. 4 shows a real time video stream, a time-delayed video stream and an exemplary video sequence, in accordance with the invention;
[0018]FIG. 5 is a simplified block diagram of a video storage and delay device, in accordance with the invention;
[0019]FIG. 6 is a simplified block diagram of a video storage and delay device having an optional user interface, in accordance with the invention; and
[0020]FIG. 7 is a pictorial representation of a user interface having user-accessible controls and a visual display.
DETAILED DESCRIPTION
[0021] Referring now to FIG. 1, there is shown a simplified functional block diagram of an illustrative arrangement of the present invention. Shown is in-car video system <b>100</b> that includes a camera <b>110</b> that is typically mounted to look out through the windshield and/or rear window of the car. The in-car video system <b>100</b> further includes a rear seat microphone <b>185</b>, video monitor <b>120</b>, control head <b>170</b>, and a video storage and delay device <b>150</b>. Each of these components is coupled via a wiring bus <b>135</b>, as shown in FIG. 1, that provides signal and power connections in a conventional manner.
[0022] A video recorder <b>162</b>, for example a VCR, is coupled to the video storage and delay device <b>150</b> by wiring bus <b>155</b>. Thus, in accordance with the invention, video storage and delay device <b>150</b> may be arranged to be connected serially between the signal sources (i.e., camera <b>110</b> and microphones <b>125</b> and <b>185</b>) and video recorder <b>162</b>, as shown in FIG. 1. Video storage and delay device <b>150</b> is typically embodied in a small enclosure that may be located in a convenient area of the vehicle including the passenger compartment (such as in glove box, under the dashboard or front seat, or in the electronic and emergency equipment console that is typically located in the center area of the vehicle by the front seats) or in the trunk.
[0023] In an alternative arrangement of the invention, the features and functions of video storage and delay device <b>150</b> may be directly incorporated (i.e., “built-in”) to other components of the in-car video system <b>100</b>. For example, a video recorder and the video storage and delay device of the present invention may be combined into a single unit. Thus, in accordance with the invention, video storage and delay device <b>150</b> may be a discrete, self-contained device, or be integrated as a functional module at the front end (i.e., located at the input) of a video recorder. The integrated arrangement is represented by reference numeral <b>190</b> in FIG. 1 where both a video recording mechanism and a video storage and delay device of the present invention are combined within a common enclosure represented by the dashed rectangle.
[0024] The video recorder <b>162</b> is typically located in secure enclosure that may be contained in the trunk of the car. In addition, depending upon the requirements of the specific application, the video recorder <b>162</b> may also be located within the passenger compartment of the vehicle. For example, video recorder <b>162</b> may be mounted in an overhead console, under the front seat, in or under the dashboard, in the glove box, or in the electronic and emergency equipment console. Some of these mounting locations may be facilitated by the use of a video recorder that uses small form-factor videotape such as 8 mm videotape.
[0025] The enclosure containing the video recorder <b>162</b> is generally quite rugged, both to provide deterrents against tampering or improper access to the videotape, and also to protect the tape in the event that the vehicle is involved in a crash. The enclosure may also be environmentally controlled to keep the video recorder <b>162</b> and videotape within acceptable operating conditions. It is noted that video recorder <b>162</b> is merely representative of any of a number of recording devices that are arranged to record video and audio, either as a single device or a combination of devices. Such recording devices include those that record on tape as well as those that use other media, such magnetic media (including disk-drives and cartridge drives), electronic media (including volatile and non-volatile memory), and optical media (including optically writeable disks). Video recorder may thus be configured, for example, as a digital video recorder or a conventional analog VCR.
[0026] The control head <b>170</b> is located in the vehicle near the driver and is operably coupled to video recorder <b>162</b> via bus <b>135</b> and bus <b>155</b> to allow the video recorder <b>162</b> to be conveniently controlled by the officer from within the vehicle. Control head <b>170</b>, in this illustrative embodiment, is arranged with typical controls such as “RECORD”, “STOP”, “REWIND”, “PLAY”, “FORWARD” and “POWER” buttons which operate the video recorder <b>162</b> accordingly. These controls are indicated by reference numerals <b>171</b>, <b>173</b>, <b>174</b>, <b>176</b>, <b>178</b> and <b>179</b>, respectively, in FIG. 1.
[0027] Camera <b>110</b> may be selected from the wide variety of available cameras. Preferably, camera <b>110</b> is a compact camera (to reduce the likelihood of obstructing the officer's view out the windshield) with color capabilities such as a solid-state CCD (“charge-coupled device”) camera that can operate in low-light environments. Camera <b>110</b> may be optionally configured with digital and/or optical zoom capabilities. Camera <b>110</b>, in the illustrative arrangement shown in FIG. 1, is an analog video camera with low-light color capabilities. In most applications, camera <b>110</b> is vehicle-mounted, however other camera arrangements may also be used (alone or in combination with a vehicle-mounted camera) including portable, hand held, remote, and officer-worn cameras that operate in an extra-vehicular manner.
[0028] A wireless microphone <b>125</b> is depicted in FIG. 1. Wireless microphone <b>125</b> is typically carried on the person of the officer, and thus, may be located both inside and outside of the vehicle at any given time. Wireless microphone <b>125</b> may be a conventional uni-directional (i.e., transmit-only) microphone or, as disclosed in our co-pending U.S. patent application Ser. No. 09/911,086, filed Jul. 23, 2001, be equipped with bi-directional RF communications capabilities. Wireless microphone <b>125</b> communicates with in-car video system <b>100</b> via a wireless link that is identified by reference numeral <b>127</b> in FIG. 1.
[0029] Video monitor <b>120</b> may be selected from the available pool of small and lightweight monitors, but typically comprises a color liquid crystal flat panel display (“LCD”) having an active or passive matrix display. Video monitor <b>120</b> may be mounted in the car to allow the operator to monitor either the real time video feed from the camera, or to view a previously recorded tape.
[0030] The in-car video system <b>100</b> is typically mounted in a vehicle (not shown in FIG. 1) such as a police cruiser. However, it is emphasized that the features and benefits of the present invention may be equally applicable to a wide variety of vehicle types, and further that the invention is not limited to law enforcement applications. Applications of the invention to the security and the transportation industries may be readily made, for example. Therefore, the term “officer” in the description that follows should be understood to refer to the user or operator of the inventive in-car video system in non-law enforcement applications.
[0031] Turning now to FIG. 2, there is shown a simplified diagram of the sequential storage of the real time video stream that is used to create a time-delayed video stream, in accordance with the invention. Signal sources <b>210</b>, comprising camera <b>110</b> and microphones <b>125</b> and <b>185</b> provide a real time video stream <b>215</b>. Thus, video stream <b>215</b> includes three signal components—one video component and two audio components (one corresponding to each microphone <b>125</b> and <b>185</b>). In this illustrative embodiment, the real time video stream <b>215</b> is in a conventional analog format.
[0032] It is noted that the term “video” as used in this detailed description means a sequence of images that is used to display full motion on equipment such as television and video monitors, along with an associated soundtrack having one or more channels. However, it is emphasized that the principles of the invention apply equally well to video or audio alone. Therefore, while the term “video” is used in this detailed description as a convenient way to describe a combined signal having a video component and one or more audio components, a combined signal is not required by the invention, nor should the use of a combined signal in this illustrative embodiment be construed as a limitation on the invention.
[0033] The term “video stream” refers to video that is continuous over some time period. The term “real time video” refers to video that corresponds to a live event (i.e., the video images of the event are created as the event occurs in actual time) but without taking into account latency and other time delays that are inherent in electronic devices.
[0034] Referring back to FIG. 2, real time video stream <b>215</b> includes video frames <b>1</b> to N that represent a NTSC (National Television Standards Committee) analog video signal having a rate of 30 frames per second, each having two interlaced fields. It is noted that the use of NTSC-defined video is merely illustrative and other formats or frame rates (e.g., PAL and SECAM) may be advantageously used in some applications of the invention. A sequential buffer <b>223</b>, the function of which is incorporated in video storage and delay device <b>150</b> (FIG. 1), utilizes a First In First Out (“FIFO”) methodology to hold each frame of video for a time period ΔT:
Δ<i>T=t</i><sub>f</sub><i>−t</i><sub>s</sub> (1)
[0035] where t<sub>f </sub>is defined as the time a video frame <b>215</b> is read from the buffer <b>223</b> and t<sub>s </sub>is the time the video frame <b>215</b> is written to the buffer. For example, as shown in FIG. 2, if frame <b>215</b><sub>1 </sub>is written to the buffer <b>223</b> at some arbitrary reference time t=t<sub>REF</sub>, then it is read out from the buffer <b>223</b> at time t=t<sub>REF</sub>+ΔT. In many applications, a time-delay ΔT of between 5 and 10 seconds is a sufficient period of time for an officer to react to a witnessed event and activate the video recorder. Thus, for a five second delay, approximately 150 frames of video are buffered at any given point in time based on the standard NTSC-defined video signal used in this illustrative example.
[0036] As time progresses, each real time video frame <b>215</b> is written to the buffer <b>223</b> in time-sequential fashion. That is, each frame follows it predecessor in the real time-time video stream <b>215</b> into the buffer <b>223</b>. As indicated by reference numeral <b>212</b> in FIG. 2, the video frames translate from left to right as time progresses. After being held for the time-delay period ΔT, each frame is read from the buffer <b>225</b> in a time-sequential fashion to generate a time-delayed video stream <b>225</b> that, except for the time offset ΔT from actual time, corresponds to the real time video stream <b>215</b> in sequence and content.
[0037] In accordance with the invention, the time-delayed video stream <b>225</b> may be selectively recorded by video recorder <b>162</b>, as shown in FIG. 2. When the video recorder <b>162</b> is activated at time t=t<sub>activate</sub>, the effective start time of the video recording, t<sub>rec start</sub>, is offset by the time-delay period ΔT:
<i>t</i><sub>rec start</sub><i>=t</i><sub>activate</sub><i>−ΔT</i> (2)
[0038]FIG. 3 depicts a group of exemplary timelines showing that the present invention provides an ability to create a permanent record of an event that begins prior to the activation of the in-car video recorder. FIG. 3 includes a live timeline <b>310</b>, an in-car video system operation timeline <b>326</b>, and a timeline <b>332</b> representing the effective time of recording made by video recorder <b>162</b>. At the bottom of FIG. 3, a reference timeline <b>345</b> is shown. Each timeline is given an arbitrary initial time t=t<sub>0</sub>.
[0039] Referring to timeline <b>310</b>, a traffic infraction occurs that is observed by an officer on patrol in vehicle equipped with the inventive in-car video system <b>100</b>. As depicted on timeline <b>310</b> at reference numeral <b>312</b> (and referring to the reference timeline <b>345</b>) the infraction occurs at time t<sub>observe</sub>=t<sub>0</sub>+4 seconds. As the incident continues to unfold, after witnessing infraction and determining that a traffic stop is called for, the officer reacts and activates the emergency lights and video recorder <b>162</b> of the in-car video system so that the incident is recorded on videotape. As shown at reference numeral <b>328</b> on timeline <b>326</b> (and referring to reference timeline <b>345</b>) the officer takes three seconds to make the decision to effectuate a traffic stop and activate the video recorder <b>162</b>, thus t<sub>activate</sub>=t<sub>0</sub>+7 seconds. From the time t=t<sub>activate </sub>onward, the in-car video system <b>100</b> is operational, as shown by timeline <b>326</b> in FIG. 3.
[0040] Referring now to timeline <b>332</b> which is the effective recording time, reference numeral <b>334</b> indicates that t<sub>rec start</sub>=t<sub>0</sub>+1 second, based on a time-delay period ΔT of six seconds in this illustrative example. From the time t=t<sub>rec start </sub>onward, the video recorder <b>162</b> is making a permanent videotaped record of the incident where start time of the recording, t<sub>rec start</sub>, precedes the time that the infraction is observed by the officer, t<sub>observe</sub>, by three seconds, in this illustrative example.
[0041]FIG. 4 shows a real time video stream, a time-delayed video stream and an exemplary video sequence, in accordance with the invention. A continuous real time video stream <b>215</b> (also shown in FIG. 2 and described in the accompanying text) is generated by camera <b>110</b> and is provided to video storage and delay device <b>150</b> via bus <b>135</b> (FIG. 1). The continuous real time video stream <b>215</b> includes an exemplary video sequence <b>420</b> including frames <b>425</b>, <b>427</b>, and <b>429</b>, as shown in FIG. 4. As indicated by the superimposed time and date in the upper right hand comer of the video image, frames <b>425</b>, <b>427</b> and <b>429</b> are several illustrative frames within a video sequence that spans a time period that starts at 14:02.06 (i.e., six seconds past 2:02 p.m.) and ends at 14:02.12 (i.e., 12 seconds past 2:02 p.m.). In frame <b>425</b>, a vehicle is shown approaching a red light at an intersection. In frame <b>427</b>, which depicts the scene several seconds later, the vehicle has driven through the intersection in apparent disregard of the traffic signal. In frame <b>429</b>, which depicts the scene six seconds after that depicted in frame <b>425</b>, the car has moved outside the field of view of the camera.
[0042] As with the example provided in the text accompanying FIG. 3, the officer determines that a car stop is called for after the infraction is witnessed at 14:02.09. Assuming a three-second reaction time as with the previous example, the officer activates the video recorder at 14:02.12, as shown in FIG. 4.
[0043]FIG. 4 also depicts a time-delayed video stream <b>225</b> (also shown in FIG. 2 and described in the accompanying text). The time-delayed video stream <b>225</b> is generated by the video storage and delay device <b>150</b> from real time video stream <b>215</b> received at its input, as described above, in accordance with the invention. The time-delayed video stream <b>225</b> includes an exemplary video sequence <b>440</b>, including frames <b>442</b>, <b>444</b>, and <b>446</b>, that is the same as video sequence <b>420</b> in sequence and content, but is offset from actual time by the time delay period ΔT.
[0044] The time-delayed video stream <b>225</b> is buffered in the video storage and delay device <b>150</b> so that it has a time delay ΔT of six seconds, as shown in FIG. 4. Accordingly, upon activation of the video recorder <b>162</b> by the officer at 14:02.12, the effective start time of the video recording, t<sub>rec start</sub>, is 14:02.06 which precedes the time of the observed infraction, t<sub>observe</sub>, by three seconds.
[0045] Referring now to FIG. 5, a simplified functional block diagram of an exemplary video storage and delay device <b>150</b> is shown. Video storage and delay device <b>150</b> includes an input interface <b>524</b> and an output interface <b>542</b>. These I/O interfaces include signal connections for one video signal and two audio signals. In many applications, and in this exemplary embodiment, the two audio signal connections are used for audio streams associated with the wireless microphone <b>125</b> and rear seat microphone <b>185</b>. The I/O interfaces <b>524</b> and <b>542</b> may also include control signal connections so that control signals from control head <b>170</b> may be passed through to the video recorder <b>162</b> that is coupled to the video storage and delay device <b>150</b> (as shown in FIG. 1 and described in the accompanying text). In addition, it may be desirable to adapt the I/O interfaces <b>524</b> or <b>542</b> with a power connection, for example, to accept +12V DC power from the vehicle. The signal connections at both the input interface <b>524</b> and the output interface <b>542</b> are realized, in this exemplary embodiment of the invention, using standard RCA-type co-axial connectors. Video and audio pass through connections (not shown in FIG. 5) may be optionally provided at the I/O interfaces <b>524</b> and <b>542</b> to implement a straight through signal path that bypasses the functions of the video storage and delay device <b>150</b>.
[0046] The input interface <b>524</b> is adapted to receive real time analog signals in the exemplary embodiment of the invention depicted in FIG. 5. However, in some applications of the invention it may be desirable to accept digital signals, both digital and analog signals, or either digital or analog signals in a switchable input mode arrangement. In this exemplary embodiment, at input connection <b>504</b>, a real time analog audio stream is received from the wireless microphone <b>125</b>. At input connection <b>508</b>, a real time analog audio stream is received from rear seat microphone <b>185</b>. At input connection <b>512</b>, a real time analog video stream is received from camera <b>110</b>.
[0047] The following description relates to the processing of the real time video stream received at input connection <b>512</b>. The processing of the two audio streams received at input connections <b>504</b> and <b>508</b> is performed in a similar (but parallel) process. The received video stream is passed from the input to an analog-to-digital converter <b>525</b> (sometime referred to as an analog decoder). The analog-to-digital converter <b>525</b> converts the NTSC-formatted analog video stream into a digitized component data stream (having color difference and luminance components, Cb, Cr and Y, respectively) that complies with the CCIR <b>601</b> digital coding standard (Consultative Committee for International Radio, also commonly referred to as the International Telecommunications Union recommendation ITU-R BT.601-5). In this exemplary embodiment of the invention, the video image has a field size of 720×243 pixels.
[0048] The output of the analog-to-digital converter <b>525</b> is fed to a digital encoder <b>532</b> as shown in FIG. 5. The digital encoder <b>525</b> takes the CCIR <b>601</b> digitized data stream and compresses the stream to reduce downstream storage and processing requirements using conventional entropy coding schemes. A dynamic random access memory (“DRAM”) device <b>536</b> is coupled to the digital encoder <b>525</b> via bus <b>534</b>, as shown in FIG. 5, to provide a temporary buffer for transform and other transient data that is generated during the compression process.
[0049] Those skilled in the art will recognize that the level of compression can be chosen according to the requirements of the particular application. In some applications it may be desirable to implement low loss or loss-less compression levels, while other applications may be less sensitive to the signal degradation that typically accompanies higher compression ratios.
[0050] A central processor <b>550</b> receives the compressed digitized data stream from the encoder <b>532</b> on bus <b>538</b>. The central processor <b>550</b> writes data from the received stream into a memory <b>558</b> that is coupled to the central processor <b>550</b> through bus <b>554</b>. The memory <b>558</b> is preferably implemented using static RAM (“SRAM”). After data has been held in the memory <b>558</b> for a pre-set time interval, the central processor <b>550</b> reads the data out of the memory <b>558</b> and forwards the data to decoder <b>562</b> over bus <b>552</b>. The central processor sequentially and continuously processes the received data stream through the memory <b>558</b> (including the steps of writing, holding and reading) and outputs a continuous compressed digitized data stream that is time-delayed compared with the received stream. Accordingly, central processor <b>550</b>, in combination with memory <b>558</b>, implements the FIFO buffer arrangement shown in FIG. 2 and described in the accompanying text. In addition to performing the write and read functions, the central processor <b>550</b> controls the overall signal flow and data processing throughout the video storage and delay device <b>150</b>.
[0051] The decoder <b>562</b> and digital-to-analog converter <b>572</b> work in a reverse manner as encoder <b>532</b> and analog-to-digital converter <b>525</b> to restore the data stream received from the central processor <b>550</b> to substantially its original uncompressed analog form (although the stream remains time-delayed). The decoding and digital-to-analog conversion is implemented in a conventional fashion. As with the encoder <b>532</b>, a DRAM device <b>566</b> is coupled through bus <b>564</b> to decoder <b>562</b> to provide a buffer for transient data that is generated during the decoding process.
[0052] The resultant time-delayed analog video stream is output on interface <b>542</b> via connections <b>582</b>, <b>584</b>, and <b>588</b>. Connection <b>582</b> provides a time-delayed analog output stream associated with the wireless microphone <b>125</b>. Connection <b>584</b> provides a time-delayed analog output stream associated with the rear seat microphone <b>185</b>. Connection <b>588</b> provides a time-delayed analog video stream associated with the camera <b>110</b>.
[0053] The video storage and delay device <b>150</b> may be advantageously configured as a self-contained unit which, once installed and set-up, will operate transparently in the background without requiring additional user intervention. That is, the video storage and delay device <b>150</b> needs only signal inputs and an output connection to a video recorder to create the time-delayed video stream. No modifications to the other components in the in-car video system <b>100</b> (FIG. 1) are required in order to implement the invention. The use of standard interfaces, for example the RCA co-axial connectors of the exemplary embodiment shown in FIG. 5, facilitates the use of the invention in retrofit scenarios with existing in-car video systems. In addition, very little extra training is required for an officer to be able to effectively operate the in-car video system <b>100</b> equipped with the video storage and delay device of the invention because the physical operation of the system is the same as with current in-car video systems. The officer need only be trained to understand that the selected duration of the pre-set time delay equals the amount of reaction time the officer has to activate the video recorder after witnessing an event of interest. Once this training is provided, it can be expected that officers will quickly realize the benefit provided by the invention in its ability to record an event after it has already occurred in actual time.
[0054]FIG. 6 a simplified functional block diagram of an exemplary video storage and delay device <b>610</b> equipped with an optional user interface <b>620</b>. User interface <b>620</b> is optionally utilized in some applications of the invention to implement user-selected control of certain operating parameters of the video storage and delay device <b>610</b>. The other elements shown in FIG. 6 are similar in form and operation to those depicted in FIG. 5. It is noted that the optional user interface <b>620</b> may also be utilized in embodiments of the invention where the video storage and delay device is physically integrated with a video recorder. In such a case, the user interface <b>620</b> may be used alone or in combination with other controls that may be located on the video recorder itself, or with controls that are located on the remote control head (for example, control head <b>170</b> in FIG. 1).
[0055] By interacting with the controls, the user may set-up and configure the video storage and delay device <b>610</b>, in accordance with the invention. For example, in some applications it may be particularly advantageous to allow a user to define the amount of time-delay ΔT. Thus, police departments are able to fine-tune the particular amount of time-delay implemented in their in-car video systems to their specific needs or operational environment. In other applications, it may be desirable for video storage and delay device <b>610</b> to selectively supply a date and time stamp that is superimposed onto the recorded video image (as shown in exemplary video sequences <b>420</b> and <b>440</b> in FIG. 4). Video storage and delay device <b>610</b> may supply such information in those instances where other components of an in-car video system would not otherwise have the capability to record the date and time of the captured scene. Thus, video storage and delay device <b>610</b> may be retrofitted to provide the additional date/time feature upgrade to older in-car video systems.
[0056] The user interface <b>620</b> is shown in FIG. 6 as being disposed on an external surface of the video storage and delay device <b>610</b>. However, in some applications of the invention, it may be desirable to arrange the user interface <b>620</b> as a module that may be located remotely from the main body of the video storage and delay device. For example, the video storage and delay device <b>610</b> may be located in the trunk of the car, while the user interface is located remotely in the passenger compartment.
[0057] User interface <b>620</b> includes a group of user-accessible controls, such as buttons, that are located on a panel <b>621</b>. The controls are indicated by reference numerals <b>622</b>, <b>625</b>, <b>626</b>, <b>626</b>, <b>627</b>, <b>628</b>, <b>629</b>, and <b>632</b>, respectively, for controls “START,” “STOP,” “PLAY,” “DATE,” “UP,” DOWN,” and “SET.” The “START” and “STOP” buttons <b>622</b> and <b>625</b> turn on and off the video storage and buffering feature on the invention. In some applications of the inventions it may be desirable to arrange the video storage and delay device <b>610</b> so that it is always operational upon power up. In such a case, the “START” and “STOP” buttons <b>622</b> and <b>625</b> would be deleted from user interface <b>620</b> or otherwise made inoperative.
[0058] A user-viewable digital display <b>635</b>, such as an LCD display, is also included in the user interface <b>620</b>. FIG. 7 shows a pictorial representation of the user interface panel <b>621</b> with user-accessible controls and LCD display <b>635</b>.
[0059] A user interacts with the controls on user interface <b>620</b> to set up (i.e., configure) the video storage and delay device <b>610</b>. Such set up may be facilitated by the display and use of an appropriate interactive menu provided LCD display <b>635</b> in a conventional manner. For example, the menu may include selections pertaining to setting of the date and time, enabling and disabling the date/time superimposition feature, positioning the superimposed digits to a desired location on the video image (e.g., left or right, top or bottom), and setting the time delay ΔT.
[0060] The menu may be displayed on LCD display <b>635</b>, for example, by pressing and holding “SET” button <b>632</b>. The user may navigate through various menu selections using the “UP” and “DOWN” buttons <b>628</b> and <b>629</b> and choose a setting by pressing the “SET” button <b>632</b>. To change a numerical setting, the user may position a blinking cursor (or other visual indicator) on LCD display <b>635</b> over a digit to be changed using multiple presses of the “SET” button <b>632</b>. The “UP” and “DOWN” buttons <b>628</b> and <b>629</b> may be pressed accordingly to increment or decrement the digit as desired.
[0061] A user may press a button directly to set up a function as an alternative to a menu-driven set up. For example, LCD display <b>635</b> will display the last set time and date when the “DATE” button <b>627</b> is pressed. The user may change or correct the date and time by pressing and holding the “DATE” button <b>627</b>. A blinking cursor is then positioned over the appropriate digit that may then be changed up or down with the “UP” and “DOWN” buttons <b>628</b> and <b>629</b>.
[0062] Other features of the invention are contained in the claims that follow.
Contents4
8 sheets
Sheet 1 Sheet 2 Sheet 3 Sheet 4 Sheet 5 Sheet 6 Sheet 7 Sheet 8
Every citation, both ways
| Document | Relation | Office | Cited during |
|---|---|---|---|
| US9871993B2 | Cited by | United States of America | Applicant |
| WO2005041581A1 | Cited by | World Intellectual Property Organization (WIPO) | International search |
| US7817905B2 | Cited by | United States of America | Applicant |
| US9049371B2 | Cited by | United States of America | Applicant |
| US2006055521A1 | Cited by | United States of America | Pre-grant |
| US10269384B2 | Cited by | United States of America | Applicant |
| US2003016834A1 | Cited by | United States of America | Pre-grant |
| GB2416948B | Cited by | United Kingdom | Search report |
| US10370102B2 | Cited by | United States of America | Applicant |
| US10446183B2 | Cited by | United States of America | Applicant |
| US10063805B2 | Cited by | United States of America | Applicant |
| US2006023081A1 | Cited by | United States of America | Pre-grant |
| US10848717B2 | Cited by | United States of America | Applicant |
| US2007030351A1 | Cited by | United States of America | Pre-grant |
| US10152858B2 | Cited by | United States of America | Applicant |
| US9774816B2 | Cited by | United States of America | Applicant |
| US2010118147A1 | Cited by | United States of America | Pre-grant |
| US9660744B1 | Cited by | United States of America | Applicant |
| US10872636B2 | Cited by | United States of America | Applicant |
| US10194239B2 | Cited by | United States of America | Search report |
| CN102377923A | Cited by | China | Search report |
| US2005146458A1 | Cited by | United States of America | Pre-grant |
| US10986307B2 | Cited by | United States of America | Applicant |
| US2015030313A1 | Cited by | United States of America | Pre-grant |
| US10409621B2 | Cited by | United States of America | Applicant |
| US2010060734A1 | Cited by | United States of America | Pre-grant |
| US2009251545A1 | Cited by | United States of America | Pre-grant |
| US9888205B2 | Cited by | United States of America | Applicant |
| US10789840B2 | Cited by | United States of America | Applicant |
| US10354689B2 | Cited by | United States of America | Applicant |
| US10347286B2 | Cited by | United States of America | Search report |
| US9602761B1 | Cited by | United States of America | Applicant |
| US10341605B1 | Cited by | United States of America | Applicant |
| US7119832B2 | Cited by | United States of America | Applicant |
| US2003081121A1 | Cited by | United States of America | Pre-grant |
| US7728874B2 | Cited by | United States of America | Applicant |
| CN104581066A | Cited by | China | Search report |
| US9756279B2 | Cited by | United States of America | Applicant |
| US8350907B1 | Cited by | United States of America | Applicant |
| US10516940B2 | Cited by | United States of America | Search report |
| US10901754B2 | Cited by | United States of America | Applicant |
| US10250433B1 | Cited by | United States of America | Applicant |
| US2006077256A1 | Cited by | United States of America | Pre-grant |
| US9923651B2 | Cited by | United States of America | Applicant |
| US2018244200A1 | Cited by | United States of America | Search report |
| CN104581040A | Cited by | China | Search report |
| CN104581041A | Cited by | China | Search report |
| US10172436B2 | Cited by | United States of America | Applicant |
| US10848368B1 | Cited by | United States of America | Applicant |
| US2011158309A1 | Cited by | United States of America | Pre-grant |
| US9699401B1 | Cited by | United States of America | Search report |
| US10075669B2 | Cited by | United States of America | Applicant |
| US2014126751A1 | Cited by | United States of America | Pre-grant |
| US10165171B2 | Cited by | United States of America | Applicant |
| GB2416948A | Cited by | United Kingdom | Search report |
| US10334249B2 | Cited by | United States of America | Applicant |
| US10192277B2 | Cited by | United States of America | Applicant |
| US9860536B2 | Cited by | United States of America | Applicant |
| AU2005225086B2 | Cited by | Australia | Search report |
| US8446469B2 | Cited by | United States of America | Applicant |
| US8174577B2 | Cited by | United States of America | Search report |
| US10149110B2 | Cited by | United States of America | Applicant |
| US2005088291A1 | Cited by | United States of America | Pre-grant |
| US10152859B2 | Cited by | United States of America | Applicant |
| US7023333B2 | Cited by | United States of America | Applicant |
| US2006104616A1 | Cited by | United States of America | Pre-grant |
| US10668859B2 | Cited by | United States of America | Search report |
| US2007088488A1 | Cited by | United States of America | Pre-grant |
| CN110278414A | Cited by | China | Search report |
| US2005088521A1 | Cited by | United States of America | Pre-grant |
| US2004201765A1 | Cites | United States of America | Pre-grant |
| US4789904A | Cites | United States of America | Pre-grant |
| US4873711A | Cites | United States of America | Pre-grant |
| US4949186A | Cites | United States of America | Pre-grant |
| US5012335A | Cites | United States of America | Pre-grant |
| US5111289A | Cites | United States of America | Pre-grant |
| US5491464A | Cites | United States of America | Pre-grant |
| US5515042A | Cites | United States of America | Pre-grant |
| US5568510A | Cites | United States of America | Pre-grant |
| US5617086A | Cites | United States of America | Pre-grant |
| US5677979A | Cites | United States of America | Pre-grant |
| US5689442A | Cites | United States of America | Pre-grant |
| US5764685A | Cites | United States of America | Pre-grant |
| US5794125A | Cites | United States of America | Pre-grant |
| US5794164A | Cites | United States of America | Pre-grant |
| US5812056A | Cites | United States of America | Pre-grant |
| US5938717A | Cites | United States of America | Pre-grant |
| US5982418A | Cites | United States of America | Pre-grant |
| US6002326A | Cites | United States of America | Pre-grant |
| US6037977A | Cites | United States of America | Pre-grant |
| US6163338A | Cites | United States of America | Pre-grant |
| US6181373B1 | Cites | United States of America | Pre-grant |
| US6211907B1 | Cites | United States of America | Pre-grant |
| US6262764B1 | Cites | United States of America | Pre-grant |
| US6275773B1 | Cites | United States of America | Pre-grant |
| US6346890B1 | Cites | United States of America | Pre-grant |
| US6389340B1 | Cites | United States of America | Pre-grant |
| US6469735B2 | Cites | United States of America | Pre-grant |
| US6487500B2 | Cites | United States of America | Pre-grant |
| US6518881B2 | Cites | United States of America | Pre-grant |
1 member in 1 office
Priority claims2
| Document | Office | Kind | Date |
|---|---|---|---|
| 5562902 | United States of America | A | |
| US20020055629 | – | – | – |
Members1
| Document | Office | Kind | |
|---|---|---|---|
| US2003151663A1 | United States of America | A1 |
3 legal events, as the office reported them to INPADOC
Over the term
Point at a mark for the eventEvents
| Event | Code | |
|---|---|---|
| Information on status: application discontinuationABANDONED -- FAILURE TO RESPOND TO AN OFFICE ACTIONSTCB | STCB | |
| AssignmentAS | AS | |
| AssignmentAS | AS |
Numbers
- Publication, DOCDB
- 2003151663
- Publication, EPODOC
- US2003151663
- Application
- 10055629
- Application, DOCDB
- 5562902
- Application, EPODOC
- US20020055629
Titles
- English
- Video storage and delay device for use with an in-car video system
Classification
- CPC, 1
- H04N7/18
- IPC, 2
- H04N7 18
- H04N9 47
- USPC, 3
- 348148000
- 340937000
- 348E07085