Viewing system
Claim Score by NHIP
Abstract
A surveillance system comprising a middleware server (10) connected via a SMPP link to an SMSC (12). The surveillance system enables two-way connection to a plurality of image capture devices, such as video cameras or webcams (14). Image data captured by the cameras (14) is transmitted via GPRS and a private data communication network (16) to the middleware server (10). Data included with the image data indicative of the IP addresses of the respective image capture devices (14) from which the captured images originate is identified and the mobile communication devices, e.g. mobile telephones, registered as authorised to receive the captured images, or data relating thereto, are determined. Automatically, or upon request, the streamed image data received in the middleware server (10) from the image capture devices (14) is transmitted to the respective authorised client (18).

Term
Term ended
Projected expiry passed 28 October 2025, 0.9 years ago.
- Priority
- Filed
- Published
- Projected expiry
- Today
18 claims: 2 independent, 16 dependent
- 1Broadest claimClaim Score 55, average(NHIP)A viewing system, comprising means for storing address data representative of a plurality of remote image capture devices and corresponding address data representative of one or more remote communications devices authorised to receive images captured each of said remote image capture devices, means for receiving image data captured by one of said image capture devices across a data communications network, means for identifying address data representative of said image capture device and identifying the corresponding address data of one or more remote communications devices authorised to receive images therefrom, and means for transmitting said image data to an authorised remote communications device across a data communications network.
- 11A method of providing a viewing system, comprising storing address data representative of a plurality of remote image capture devices and corresponding address data representative of one or more remote communications devices authorised to receive images captured each of said remote image capture devices, providing means for receiving image data captured by one of said image capture devices across a data communications network, providing means for identifying address data representative of said image capture device and providing lookup means for identifying the corresponding address data of one or more remote communications devices authorised to receive image data therefrom, and providing transmission means for transmitting said image data to an authorised remote communications device across a data communications network.
Independent claims2
61 paragraphs, as filed
p-0002This invention relates generally to a viewing system and, more specifically, to a wireless viewing system and method of providing same.
p-0003There are many circumstances in which a user in a first location may wish to see images captured in respect of a second location, remote from the first location, for example, for surveillance, monitoring or entertainment purposes. For example, a user may wish to receive images and/or monitor activity occurring at their home or business premises whilst they are elsewhere.
p-0004It is therefore an object of the present invention to provide a system which enables a user to receive images on a local communications device, such as a personal computer, PDA or mobile telephone, captured by an image-capture device at a remote location.
p-0005In accordance with a first aspect of the present invention, there is provided a viewing system, comprising means for storing address data representative of a plurality of remote image capture devices and corresponding address data representative of one or more remote communications devices authorised to receive images captured each of said remote image capture devices, means for receiving image data captured by one of said image capture devices across a data communications network, means for identifying address data representative of said image capture device and identifying the corresponding address data of one or more remote communications devices authorised to receive images therefrom, and means for transmitting said image data to an authorised remote communications device across a data communications network.
p-0006Also in accordance with the first aspect of the present invention, there is provided a method of providing a viewing system, comprising storing address data representative of a plurality of remote image capture devices and corresponding address data representative of one or more remote communications devices authorised to receive images captured each of said remote image capture devices, providing means for receiving image data captured by one of said image capture devices across a data communications network, providing means for identifying address data representative of said image capture device and providing lookup means for identifying the corresponding address data of one or more remote communications devices authorised to receive image data therefrom, and providing transmission means for transmitting said image data to an authorised remote communications device across a data communications network.
p-0007In a preferred embodiment, the surveillance system comprises a server having a client interface for enabling communication thereof with said remote communications devices and a camera interface for enabling communication thereof with said remote image capture devices. The image data is preferably transmitted from said remote image capture devices to said surveillance system via a private data communications network, having a unique access point name (APN). Beneficially, said image data is transmitted by said viewing system to one or more authorised remote communications devices via a public data communications network.
p-0008The viewing system beneficially comprises an image database for receiving and storing image data received from said remote image capture devices. In a preferred embodiment, a user database is provided for storing said address data representative of a plurality of remote image capture devices and corresponding address data representative of one or more remote communications devices authorised to receive images captured each of said remote image capture devices. In one exemplary embodiment, means may be provided for receiving a signal from a remote image capture device indicating that activity has been identified in a respective field of view therein, and in response to receipt of such a signal, said viewing system may be arranged and configured to transmit a request signal to said remote image capture device to commence transmission of image data captured in respect of said field of view in which activity has been identified from said remote image capture device to said viewing system. In another exemplary embodiment, the surveillance system may be arranged and configured to monitor image data received from said remote image capture devices and identify activity occurring therein. In either case, means are preferably provided for transmitting a signal to a remote communications device indicating that activity has been identified in the field of view of a remote image capture device in respect of which said remote communications device is authorised to receive image data.
p-0009In accordance with a second aspect of the present invention, there is provided an image capture device for use with a viewing system as defined above, the image capture device comprising means for capturing image data in respect of a field of view thereof, means for compressing said image data, means for identifying activity within said field of view, means for establishing a connection across a data communications network with said viewing system and transmitting data via said connection to said viewing system indicative that activity has been identified within said field of view and means for causing image data captured in respect of said field of view to be stored in response to activity being identified therein.
p-0010In a preferred embodiment, the means for identifying activity in said field of view may comprise a motion sensor provided in or on said image capture device. The motion sensor may, for example, comprise a passive infra-red (PIR) sensor or the like. Image processing means may additionally or alternatively be provided for identifying activity within image data captured by the image capture device. A communications module, such as a GPRS module, and antenna are beneficially provided in or on said image capture device for establishing said connection across said data communications network and transmitting data across said data communications network.
p-0011Storage means, such as RAM memory or similar volatile memory means, may be provided in or on said image capture device for storing said image data captured in respect of said field of view in which activity has been identified. Additionally or alternatively, the image capture device is arranged and configured to transmit image data captured in respect of said field of view in which activity has been identified across said data communications network to said viewing system for storage. In this regard, the image capture device may comprise means for receiving a signal from said viewing system to commence transmission of image data thereto.
p-0012These and other aspects of the present invention will be apparent from, and elucidated with reference to, the embodiments described herein.
p-0013Embodiments of the present invention will now be described by way of examples only and with reference to the accompanying drawings, in which:
p-0014<figref idrefs="DRAWINGS">FIG. 1</figref> is a schematic block diagram illustrating the principal components of a surveillance system according to an exemplary embodiment of the present invention;
p-0015<figref idrefs="DRAWINGS">FIG. 2</figref> is a schematic block diagram illustrating the principal components of an image capture device according to an exemplary embodiment of the present invention; and
p-0016<figref idrefs="DRAWINGS">FIG. 3</figref> is a schematic block diagram of the principal components of the server middleware of the system of <figref idrefs="DRAWINGS">FIG. 1</figref>.
p-0017Referring to <figref idrefs="DRAWINGS">FIG. 1</figref> of the drawings, a surveillance system according to an exemplary embodiment of the present invention comprises a middleware server <b>10</b> connected via a SMPP link to an SMSC <b>12</b>. SMSC is an abbreviation for the words Short Message Service Centre. An SMSC provides a number of services, in particular the regulation of the transfer of text messages between mobile telephones. When a user sends a text message (or SMS message) to a recipient, the telephone actually sends the message to an SMSC which stores the message and then delivers it to the destination recipient when they are available. Additionally, the message centre will generally take care of any charging that needs to take place. Generally speaking, there is at least one SMSC per network. For bulk transmission and reception of SMS messages, SMSC's have conventional, fixed network interfaces as well as mobile network interfaces. A number of protocols have been defined to support this sort of wire-line access, and SMPP is the most commonly used of these protocols.
p-0018The Short Message Peer to Peer (SMPP) protocol is an open industry standard messaging protocol designed to simplify integration of data applications with wireless mobile networks such as GSM, TDMA, CDMA and PDC. This protocol is widely deployed in the telecommunications industry, as will be known to a person skilled in the art, and will not be discussed in any further detail herein.
p-0019Referring back to <figref idrefs="DRAWINGS">FIG. 1</figref> of the drawings, the surveillance system enables two-way connection to a plurality of image capture devices, such as video cameras or webcams <b>14</b>. This connection is preferably via a private data communications network <b>16</b> (such as a wireless local area network) having a unique Access Point Name (APN) which can be used by the image capture devices <b>14</b> to establish a connection to the middleware server <b>10</b>, and vice versa.
p-0020A highly suitable communication service for communication between the image capture devices <b>14</b> and the data communications network <b>16</b> is GPRS. General Packet radio Service (GPRS) is a non-voice service that allows information to be sent and received across a data communications network <b>16</b>. Theoretical minimum speeds of up to 171.2 kilobits per second (kbps) are achievable with GPRS using all eight timeslots at the same time. This is about three times as fast as the data transmission speeds possible over today's fixed telecommunications networks and ten times as fast as current Circuit Switched Data services on GSM (Global System for Mobile Communications) networks. GPRS has the advantage of facilitating instant connections whereby information can be sent or received immediately as the need arises, subject to radio coverage. No dial-up modem is necessary. However, it will be appreciated that the present invention is not intended to be limited to GPRS, other digital networks may be equally applicable, including (but not limited to) <b>3</b>G TETRA, CDMA, PCS, etc.
p-0021Several image capture devices could be networked via, for example, Bluetooth® which is an industrial specification for wireless personal area networks (PANs) and provides a way to connect and exchange information between devices such as digital cameras via a secure, low-cost globally available short range radio frequency. Bluetooth® allows such devices to “talk” to each other when they come into range, even if they are not in the same room, as long as they are within 10 metres (32 feet) of each other. The Bluetooth® protocol operates in the license-free ISM band at 2.45 GHz and reaches speeds of 723.1 kbps.
p-0022Referring back to <figref idrefs="DRAWINGS">FIG. 1</figref> once again, image data captured by the cameras <b>14</b> is transmitted via GPRS and a private data communications network <b>16</b> to the middleware server <b>10</b>. Data included with the image data indicative of the IP addresses of the respective image capture devices <b>14</b> from which the captured images originate is identified, and the mobile communications devices, e.g. mobile telephones, registered as authorised to receive the captured images, or data relating thereto, are determined. Automatically, or upon request, the streamed image data received in the middleware server <b>10</b> from the image capture devices <b>14</b>, and preferably stored therein, is transmitted to the respective authorised (client) mobile telephones <b>18</b>, preferably by GPRS via a public data communications network <b>20</b>, e.g. the Internet, again having a unique Access Point Name (APN) which can be used by the middleware server <b>10</b> to establish a connection to the mobile telephones <b>18</b>, and vice versa.
p-0023The above-described server architecture is desirable because of the way current mobile telecommunications networks are implemented. In general, GPRS network operators use a combination of Dynamic Host Configuration Protocol (DHCP) together with Network Address Translation (NAT) and/or Port Address Translation (PAT) to allow mobile equipment to be dynamically assigned a private-range IP address for the duration of a data session. The absence of bi-directional address resolution at their servers, together with restrictions on their billing mechanisms, results in direct transfer of data from one node (e.g. mobile telephone) to another being effectively prevented. Thus, in the current environment, in order to allow data to be transferred from an image capture device <b>14</b> to a mobile telephone <b>18</b>, it is necessary for both nodes to establish a connection to a server <b>10</b> which is ‘visible’ to them both on a public, static IP address.
p-0024It is for this reason, among others that, in the illustrated configuration it is envisaged, that the image capture devices <b>14</b> will be equipped with SIMs from a network provider, and that a private APN will be set up with that provider to allow the image capture devices access to the internet and, thereby, to the server <b>10</b>. However, this is not essential, and will tend to be dependent upon the evolution of the manner of operation of network providers into the future.
p-0025On the other hand, the client devices <b>18</b> (which may comprise mobile telephones, but are not restricted to this platform, and it will be appreciated that a client application <b>18</b> may be created for any internet-connected device capable of supporting basic user interface features and displaying the images, including but not limited to a personal computer (PC), a laptop computer, a PDA, a palmtop computer, etc.) can establish a connection from any network provider, as long as they can connect to the Internet and “see” the server <b>10</b>, and as long as there is no firewall or port restrictions in place on the client's APN <b>16</b> which block the surveillance system's TCP/IP traffic.
p-0026A camera <b>14</b> suitable for use in the surveillance system described above is illustrated schematically in <figref idrefs="DRAWINGS">FIG. 2</figref> of the drawings. Generally, the camera <b>14</b> consists of hardware and embedded software which together perform video capture, video compression, video motion detection, video storage and GPRS transmission to a server (<b>10</b>). The basic functional requirements of the camera <b>14</b> are, in this exemplary embodiment, to capture images from a colour CMOS camera module, compress captured images using JPEG compression, transfer compressed images over a GPRS connection to a remote server on request, motion detection, and local storage and upload of pre/post-event images.
p-0027Accordingly, the camera <b>14</b> illustrated in <figref idrefs="DRAWINGS">FIG. 2</figref> of the drawings, comprises a camera module <b>200</b> and a processor <b>202</b> to which the camera module <b>200</b> is connected via a camera interface module <b>204</b>. The processor <b>202</b>, which includes software to effect image data compression, is connected to a passive infra-red motion sensor <b>206</b>, status indicators <b>208</b>, a flash memory module <b>210</b> and a RAM memory module <b>212</b>. The processor <b>202</b> is also connected to a GPRS module <b>214</b> having a SIM <b>216</b> and an antenna <b>218</b>. Also illustrated, but of less significance, are an external power supply unit <b>220</b>, a power management module <b>222</b>, a Lithium-ion battery <b>224</b> and ancillary support devices (denoted generally as <b>226</b>). Of course, it will be appreciated that the power supply may comprise any suitable means, including solar, battery, mains, etc.
p-0028The camera module <b>200</b> may be a colour CMOS camera module having an 8-bit YUV 4:2:2 output format, I<sup>2</sup>C control interface and fixed focus lens. The camera interface <b>204</b> would then also be required to support I<sup>2</sup>C control and the JPEG compression means in the processor <b>202</b> should be capable of accepting 8-bit YUV 4:2:2 image data and performing JPEG compression with user-definable quantisation and huffmann tables. The processor <b>202</b>, more generally, should ideally be capable of interfacing to all other system components with a minimum of additional components,
p-0029The flash memory <b>210</b> provides non-volatile storage of application software and configuration settings (preferably minimum 256 KB) and the RAM memory <b>212</b> provides volatile storage for application data and compressed images (again, preferably 256 KB).
p-0030The SIM <b>216</b> may be a 3V GPRS data-enabled SIM, and a SIM holder may be required (if this is not integrated in the GPRS module <b>214</b>). Network specific APN login details can be stored in the flash memory <b>210</b>. The SIM <b>216</b> will not be readily removable, and some degree of tamper-proofing will ideally be provided by the camera enclosure.
p-0031The antenna <b>218</b> may be internal or external and dual-band, tri-band or quad-band, depending on the choice of GPRS module <b>214</b>. The passive infra-red (PIR) motion detector <b>206</b>, beneficially has an opto-insulated input and current-limited PIR power output. It will be appreciated that, in addition to PIR motion detection, video motion detection is preferably also provided in respect of the captured imaged data, so as to minimise the occurrence of false alarms.
p-0032The status indicators <b>208</b> may comprise at least one LED to indicate power and operational status, a second LED to indicate whether motion detection is activated and a third LED may indicate whether a mobile network connection has been made. A lead in respect of the power supply unit <b>220</b> (e.g. input: 100-240V AC 50-60 Hz; output: 5V DC at min. 2.4 A) may emerge from a grommet from the camera body and terminate in a suitable DC connector.
p-0033The power management module <b>222</b> will generate all of the voltages required for operation of the various system components and smart battery charging may also be supported. The ancillary support devices <b>226</b> may include power-on reset circuitry, timing generators (crystals/clocks) and interface circuitry between the various components. It is envisaged that other functions, such as wireless hubs, PTZ (pan, tilt, zoom), temperature sensors, meter reading etc. may also be incorporated in, or otherwise supported by, the camera module <b>14</b>, and the present invention is not intended to be limited in this regard.
p-0034Finally, the camera enclosure may comprise an injection moulded plastic enclosure incorporating a Fresnel lens for the PIR and incorporating the camera module <b>200</b> and lens. An external switch is beneficially provided to soft switch power on/off, so as to allow the camera to attach/detach the GPRS connection cleanly. A waterproof recessed reset switch may be provided which can be used to force a complete power down and reset the device completely, if required.
p-0035An overview of the main camera functions is as follows: <ul><li id="ul0001-0001" num="0000"><ul><li id="ul0002-0001" num="0035">establish and maintain authenticated connection to server</li><li id="ul0002-0002" num="0036">send and receive keepalive messages</li><li id="ul0002-0003" num="0037">send images in response to server request</li><li id="ul0002-0004" num="0038">adapt transmission rate in response to server responses</li><li id="ul0002-0005" num="0039">set image quality hi/med/lo in response to server request</li><li id="ul0002-0006" num="0040">set motion detection sensitivity hi/med/lo/off in response to server request</li><li id="ul0002-0007" num="0041">set motion detection on/off in response to external switch</li><li id="ul0002-0008" num="0042">store images in short-term (˜10 second) circular buffer</li><li id="ul0002-0009" num="0043">apply motion detection algorithm—alert server on event</li></ul></li></ul>
p-0036The main functions of a surveillance system, according to an exemplary embodiment of the invention will now be described in more detail. When the unit is turned on, the camera firmware establishes a connection to the middleware server via the chosen private APN authentication settings are hard-coded in the firmware. The firmware uses the unique hardware ID from the GPRS module to identify itself to the server. The server verifies that the ID belongs to a valid account. This relationship will have been established when the device is first registered by the purchaser. The camera and server then intermittently exchange short keep-alive messages to ensure that the connection between them is maintained as ‘always on’. If the camera does not receive a message from the server within the timeout period, the firmware automatically forces a reconnection attempt.
p-0037In response to the client activity the server may send a message to the camera requesting that it begin to capture and send images. The user can set the camera to three levels of image quality, and the camera will capture and send images at the current quality setting. Image request messages from the server inform the camera about the most recent throughput rate, and the camera adapts its rate of transmission to match the available bandwidth. This avoids a build up of latency during the session. Forward error correction is built in to the communications protocol, to avoid corrupted data being passed on to the client device.
p-0038An external switch enables or disables video motion detection (VMD). The user can also enable/disable and set three levels of sensitivity for VMD via the client application. When VMD monitoring is enabled, in response to activation of the sensor, the camera may send an alert message to the server, and optionally may also capture and send images to the server for a pre-determined period. The camera is configured to store ˜10 seconds worth of images in a circular buffer when VMD monitoring is enabled, and can therefore automatically send a sequence of ‘before and after’ images to the server for later review by the client.
p-0039The server (<b>10</b>) consists of software components (the middleware) hosted on a Windows server with a static public IP address. The software components communicate with both camera and client devices. The server is responsible for the authentication of cameras and clients, and for receiving images from cameras, and delivering them to clients. Additional server components record data throughout on a per camera and per client basis for billing purposes.
p-0040An overview of the main server functions is as follows: <ul><li id="ul0003-0001" num="0000"><ul><li id="ul0004-0001" num="0049">accept camera connections</li><li id="ul0004-0002" num="0050">accept client connections</li><li id="ul0004-0003" num="0051">authenticate cameras and clients against database of registration details</li><li id="ul0004-0004" num="0052">exchange keepalive messages with cameras</li><li id="ul0004-0005" num="0053">send list of available cameras to client on connection</li><li id="ul0004-0006" num="0054">start/stop image streaming from camera</li><li id="ul0004-0007" num="0055">route images through to client</li><li id="ul0004-0008" num="0056">route image quality and VMD mode/sensitivity commands to camera</li><li id="ul0004-0009" num="0057">send SMS in response to camera alert</li><li id="ul0004-0010" num="0058">log connections and data throughput</li><li id="ul0004-0011" num="0059">handle billing records</li><li id="ul0004-0012" num="0060">send reverse-billed SMS</li><li id="ul0004-0013" num="0061">provide MIS information</li></ul></li></ul>
p-0041Referring to <figref idrefs="DRAWINGS">FIG. 3</figref> of the drawings, the server middleware components have access to a database (<b>104</b>) of registered users which contains authentication details for clients, cameras, and the relationships between them.
p-0042One client may be permitted access to multiple cameras. One camera may be accessible to multiple clients. Some cameras will be ‘public’ accessible to anyone. The middleware server components access this database in read-write mode and real-time, so as to establish the validity of connection requests from cameras and clients. Current status flags in the records for cameras and clients are also updated in response to communications between the middleware and remote devices.
p-0043The same database is accessed in read-write mode, but with lower time priority by other, more generic components which support service provision functions e.g. the registration and activation of a newly-purchased camera. These modules require standard CRM type functionality, and will do little that is specific to the system architecture. The server will expose a web interface (<b>106</b>) to allow customer to change certain features of their accounts themselves, as well as a more powerful admin interface (<b>110</b>) which will only be accessible to e.g. call centre operators or administrators.
p-0044The middleware server consists of two types of interface thread, one (<b>100</b>) for cameras and one (<b>102</b>) for clients. The threads are independent and multi-instance, allowing for a high degree of scalability, but both types of thread require read-write access to the user database (<b>104</b>). Each interface module is responsible for handling the authentication of camera or client, and for all the communication taking place between the remote device and the server. Direct communication between threads is not required, image data is written to and read from an image database (<b>108</b>) which supports multi-threaded read-write access.
p-0045The interface components log their activity, and the volume of data transferred is recorded for each transaction. This data is used to support the billing function and manage the costs of the operation, as well as providing management information.
p-0046In response to a request, images are sent from the camera to the server, and then on to the client in blocks or units equivalent to 15 second's worth of video. Each time a unit of video is successfully sent to the user, the server increments the billing record. For PAYT clients, the middleware is responsible for sending a reverse-billed premium rate SMS ‘receipt’ to the connected client when video images are successfully sent. For contract clients, the billing is managed differently, but still based on the volume of data transferred.
p-0047In response to an alert message from a camera (e.g. following video motion detection activation) the server can send an SMS message, via an SMPP link, to one or more registered client phones selected by the user.
p-0048The client consists of a software application which can be installed and run on a Java enabled colour mobile phone (<b>18</b>). The application can establish an authenticated connection to the server (<b>10</b>), and then receive and display the images sent to it by the server. The functions of the client can similarly be implemented on a laptop or palmtop computer, PDA or Windows PC platform, for example.
p-0049An overview of the main client functions is as follows: <ul><li id="ul0005-0001" num="0000"><ul><li id="ul0006-0001" num="0071">establish and maintain authenticated connection to server</li><li id="ul0006-0002" num="0072">PIN protect access to application</li><li id="ul0006-0003" num="0073">allow user to select desired camera</li><li id="ul0006-0004" num="0074">allow user to set image quality</li><li id="ul0006-0005" num="0075">allow user to enable/disable VMD monitoring and set sensitivity</li><li id="ul0006-0006" num="0076">display images received from camera</li><li id="ul0006-0007" num="0077">display current camera settings</li></ul></li></ul>
p-0050Running the client application software in a surveillance system according to an exemplary embodiment of the invention, requires the entry of a PIN number, which is selected by the user at the time the software is registered. Once running, the client application establishes a connection to the middleware server via the internet APN of the user's chosen network provider. The client sends authentication information which includes the PIN used to activate the software, and a unique identifier for the phone. These Ids will have been notified to the service provider at the time of software registration. This method prevents a stolen phone or pirated client application being used to obtain unauthorised access to the camera.
p-0051Once authenticated, the client receives a list of camera devices which are registered to it, and which the server knows to be currently active. The user can select the camera from which they wish to receive images, and this selection is sent to the server. The server sends a message to activate the selected camera, along with a configuration block which specifies the required capture resolution. When images are received by the server they are routed through to the relevant client. Once the images are received, the client software displays them.
p-0052The client software also allows the user to configure options such as image quality, VMD on/off/sensitivity etc. The client can optionally display additional information such as duration of session and cost incurred.
p-0053The communications protocol proposed in respect of the system described above supports the following messages.
p-0054<tables id="TABLE-US-00001" num="00001"><table frame="none" colsep="0" rowsep="0"><tgroup align="left" colsep="0" rowsep="0" cols="3"><colspec colname="1" colwidth="147pt" align="left" /><colspec colname="2" colwidth="35pt" align="left" /><colspec colname="3" colwidth="35pt" align="left" /><thead><row><entry namest="1" nameend="3" align="center" rowsep="1" /></row><row><entry>Message</entry><entry>From</entry><entry>To</entry></row><row><entry namest="1" nameend="3" align="center" rowsep="1" /></row></thead><tbody valign="top"><row><entry>Camera logon request</entry><entry>Camera</entry><entry>Server</entry></row><row><entry>Camera logon confirmation</entry><entry>Server</entry><entry>Camera</entry></row><row><entry>Camera configuration read request</entry><entry>Server</entry><entry>Camera</entry></row><row><entry>Camera configuration read response</entry><entry>Camera</entry><entry>Server</entry></row><row><entry>Camera configuration write request</entry><entry>Server</entry><entry>Camera</entry></row><row><entry>Camera configuration write response</entry><entry>Camera</entry><entry>Server</entry></row><row><entry>Camera image start/stop/throughput request</entry><entry>Server</entry><entry>Camera</entry></row><row><entry>Camera image response</entry><entry>Camera</entry><entry>Server</entry></row><row><entry>Camera event notification</entry><entry>Camera</entry><entry>Server</entry></row><row><entry>Keepalive message</entry><entry>Server</entry><entry>Camera</entry></row><row><entry>Keepalive message</entry><entry>Camera</entry><entry>Server</entry></row><row><entry>Client logon request</entry><entry>Client</entry><entry>Server</entry></row><row><entry>Client logon confirmation</entry><entry>Server</entry><entry>Client</entry></row><row><entry>Client camera list request</entry><entry>Client</entry><entry>Server</entry></row><row><entry>Camera list response</entry><entry>Server</entry><entry>Client</entry></row><row><entry>Client camera live image request</entry><entry>Client</entry><entry>Server</entry></row><row><entry>Client camera stored image request</entry><entry>Client</entry><entry>Server</entry></row><row><entry>Client image response</entry><entry>Server</entry><entry>Client</entry></row><row><entry>Client camera configuration read request</entry><entry>Client</entry><entry>Server</entry></row><row><entry>Client camera configuration read response</entry><entry>Server</entry><entry>Client</entry></row><row><entry>Client camera configuration write request</entry><entry>Client</entry><entry>Server</entry></row><row><entry>Client camera configuration write response</entry><entry>Server</entry><entry>Client</entry></row><row><entry namest="1" nameend="3" align="center" rowsep="1" /></row></tbody></tgroup></table></tables>
p-0055The image request and response messages include fields which provide information on data throughput, allowing the client firmware and server middleware to dynamically adapt their rates of transmission to the bandwidth available.
p-0056System security may be provided as follows (although the present invention is not intended to be limited this regard):
p-0057When a camera <b>14</b> initiates communication with the server <b>10</b>, it sends a logon message containing the unique IMEI number of the GPRS module <b>214</b> and the unique IMSI number of the SIM card <b>216</b>. This unique combination is checked by the middleware server <b>10</b> against records of registered users held in the server database <b>104</b>. If the unique combination of IMEI and IMSI is not found in the database <b>104</b>, or is found to be associated with an invalid device (e.g. stolen equipment), the session is immediately terminated. If the IMEI/IMSI combination belongs to a legitimate user, the session is initiated, and the camera status held in the database <b>104</b> is updated to “active”.
p-0058When a client application initiates communication with the server <b>10</b>, it sends a logon message containing the unique serial number associated with the copy of the software on the client phone <b>14</b>, and a four digit PIN number which must be entered by the user every time the application is launched. This unique combination is checked by the middleware server <b>10</b> against records of registered users held in the database <b>104</b>. If a matching record is not found (e.g. incorrect PIN), or is found to be associated with an invalid client (e.g. customer has closed their account) then the session is immediately terminated. If the unique serial number/PIN combination is found to be associated with a valid client, then the session is initiated.
p-0059The client can request a list of cameras <b>14</b> to which he has access rights. The middleware server <b>10</b> checks the database <b>104</b> and builds a list of currently active cameras <b>14</b> to which the specified client has access rights, and this is sent to the client. The list of displayed to the user, who can then select their preferred camera, and opt to view either live images or recorded incidents from it.
p-0060Compressed images sent from the camera <b>14</b> to the server <b>10</b>, either during a “live” monitoring session, or as the result of alarm activation, are time-stamped automatically as they arrive at the server <b>10</b>. A 32 bit cyclic redundancy checksum is also calculated for each image, and the timestamp and CRC are stored as a metadata record in the image database <b>108</b> alongside each image. This provides a means of identifying alterations or modifications to the image from its original state.
p-0061Although the present invention has been described above, by way of example only, as a surveillance system, it will be appreciated that a viewing system according to the invention would be equally applicable for remote viewing of, for example, sporting or entertainment events, monitoring remote machinery telematic information, etc. and the present invention is not intended to be limited in this regard.
p-0062It should be noted that the above-mentioned embodiments illustrate rather than limit the invention, and that those skilled in the art will be capable of designing many alternative embodiments without departing from the scope of the invention as defined by the appended claims. In the claims, any reference signs placed in parentheses shall not be construed as limiting the claims. The word “comprising” and “comprises”, and the like, does not exclude the presence of elements or steps other than those listed in any claim or the specification as a whole. The singular reference of an element does not exclude the plural reference of such elements and vice-versa. The invention may be implemented by means of hardware comprising several distinct elements, and by means of a suitably programmed computer. In a device claim enumerating several means, several of these means may be embodied by one and the same item of hardware. The mere fact that certain measures are recited in mutually different dependent claims does not indicate that a combination of these measures cannot be used to advantage.
4 sheets
Sheet 1 Sheet 2 Sheet 3 Sheet 4
Every citation, both ways
| Document | Relation | Office | Cited during |
|---|---|---|---|
| US10516703B2 | Cited by | United States of America | Search report |
| US9706001B2 | Cited by | United States of America | Applicant |
| US9369749B2 | Cited by | United States of America | Applicant |
| US9491132B2 | Cited by | United States of America | Search report |
| US2015229825A1 | Cited by | United States of America | Pre-grant |
| WO2017045068A1 | Cited by | World Intellectual Property Organization (WIPO) | International search |
| US2019385427A1 | Cited by | United States of America | Search report |
| US8259816B2 | Cited by | United States of America | Search report |
| US2017257400A1 | Cited by | United States of America | Search report |
| US2010064029A1 | Cited by | United States of America | Pre-grant |
| EP2760180A1 | Cited by | European Patent Office (EPO) | Examiner |
| US2016142376A1 | Cited by | United States of America | Pre-grant |
| US8706843B2 | Cited by | United States of America | Search report |
| US11927487B2 | Cited by | United States of America | Applicant |
| US11202107B2 | Cited by | United States of America | Applicant |
| US9131257B2 | Cited by | United States of America | Applicant |
| US2012284665A1 | Cited by | United States of America | Pre-grant |
| US9246915B2 | Cited by | United States of America | Search report |
| US9692724B2 | Cited by | United States of America | Search report |
| US2017257400A1 | Cited by | United States of America | Search report |
| FR3073653A1 | Cited by | France | Search report |
| US9813857B2 | Cited by | United States of America | Applicant |
| US9788152B1 | Cited by | United States of America | Applicant |
| US9813091B2 | Cited by | United States of America | Applicant |
| US2011231903A1 | Cited by | United States of America | Pre-grant |
| TWI511573B | Cited by | Taiwan Province of China | Examiner |
| US9661373B2 | Cited by | United States of America | Applicant |
| US8918527B2 | Cited by | United States of America | Search report |
| US2013091272A1 | Cited by | United States of America | Pre-grant |
| US10251017B2 | Cited by | United States of America | Applicant |
| US2012212609A1 | Cited by | United States of America | Pre-grant |
| US2014120887A1 | Cited by | United States of America | Pre-grant |
| US2009128628A1 | Cited by | United States of America | Pre-grant |
| EP2774043A4 | Cited by | European Patent Office (EPO) | Search report |
| US10914635B2 | Cited by | United States of America | Applicant |
| US9722649B2 | Cited by | United States of America | Applicant |
| US9497373B2 | Cited by | United States of America | Search report |
| US2017257400A1 | Cited by | United States of America | Pre-grant |
| WO2015009350A1 | Cited by | World Intellectual Property Organization (WIPO) | International search |
| US2010232518A1 | Cited by | United States of America | Pre-grant |
| US10243597B2 | Cited by | United States of America | Applicant |
| US10823592B2 | Cited by | United States of America | Applicant |
| US10832539B2 | Cited by | United States of America | Search report |
| WO2019096871A1 | Cited by | World Intellectual Property Organization (WIPO) | International search |
| US11076113B2 | Cited by | United States of America | Applicant |
| US10638093B2 | Cited by | United States of America | Applicant |
| EP2774043A1 | Cited by | European Patent Office (EPO) | Search report |
| US9019372B2 | Cited by | United States of America | Search report |
| US2014040380A1 | Cited by | United States of America | Pre-grant |
| US9661209B2 | Cited by | United States of America | Search report |
| US2003025599A1 | Cites | United States of America | Pre-grant |
| US2003038878A1 | Cites | United States of America | Pre-grant |
| US2003112337A1 | Cites | United States of America | Pre-grant |
| US5473368A | Cites | United States of America | Pre-grant |
21 members in 17 offices; this record represents the family
Priority claims2
| Document | Office | Kind | Date |
|---|---|---|---|
| 0424337 | United Kingdom | A | |
| 2005004168 | United Kingdom | W |
Members21
| Document | Office | Kind | |
|---|---|---|---|
| GB0424337D0 | United Kingdom | D0 | |
| GB2420044A | United Kingdom | A | |
| AU2005300389A1 | Australia | A1 | |
| CA2585201A1 | Canada | A1 | |
| WO2006048613A1 | World Intellectual Property Organization (WIPO) | A1 | |
| TW200620902A | Taiwan Province of China | A | |
| AP2007003988A0 | African Regional Intellectual Property Organization (ARIPO) | A0 | |
| NO20072716L | Norway | L | |
| EP1815669A1 | European Patent Office (EPO) | A1 | |
| MX2007005188A | Mexico | A | |
| MX2007005188A | Mexico | A | |
| IL182858A0 | Israel | A0 | |
| KR20070099555A | Republic of Korea | A | |
| EA200701002A1 | Eurasian Patent Organization (EAPO) | A1 | |
| CN101084669A | China | A | |
| ZA200703407B | South Africa | B | |
| JP2008526052A | Japan | A | |
| BRPI0517960A | Brazil | A | |
| BRPI0517960A | Brazil | A | |
| GB2420044B | United Kingdom | B | |
| US2010013918A1 | United States of America | A1 |
41 transactions on the USPTO file
Abandoned after 1 non-final rejection.
- Non-final rejections
- 1
- Final rejections
- 0
- RCEs
- 0
- Appeals
- 0
Over time
Point at a mark for the transactionTransactions
| Event | Code | |
|---|---|---|
| Email NotificationEML_NTR | EML_NTR | |
| Mail Abandonment for Failure to Respond to Office ActionAbandonedMABN2 | MABN2 | |
| Aband. for Failure to Respond to O. A.AbandonedABN2 | ABN2 | |
| Electronic ReviewELC_RVW | ELC_RVW | |
| Email NotificationEML_NTF | EML_NTF | |
| Mail Non-Final RejectionNon-final rejectionMCTNF | MCTNF | |
| Non-Final RejectionNon-final rejectionCTNF | CTNF | |
| Case Docketed to Examiner in GAUDOCK | DOCK | |
| Case Docketed to Examiner in GAUDOCK | DOCK | |
| Case Docketed to Examiner in GAUDOCK | DOCK | |
| Case Docketed to Examiner in GAUDOCK | DOCK | |
| Case Docketed to Examiner in GAUDOCK | DOCK | |
| Case Docketed to Examiner in GAUDOCK | DOCK | |
| Preliminary AmendmentA.PE | A.PE | |
| Email NotificationEML_NTR | EML_NTR | |
| Mail Non-Compliant Preliminary AmendmentMNPRL | MNPRL | |
| Non-Compliant Preliminary AmendmentNPRL | NPRL | |
| Email NotificationEML_NTR | EML_NTR | |
| PG-Pub Issue NotificationPG-ISSUE | PG-ISSUE | |
| Application Dispatched from OIPEOIPE | OIPE | |
| Email NotificationEML_NTR | EML_NTR | |
| Email NotificationEML_NTR | EML_NTR | |
| Filing ReceiptFLRCPT.O | FLRCPT.O | |
| Notice of DO/EO Acceptance MailedM903 | M903 | |
| Sent to Classification ContractorPGPC | PGPC | |
| 371 Completion Date371COMP | 371COMP | |
| Additional Application Filing FeesADDFLFEE | ADDFLFEE | |
| A statement by one or more inventors satisfying the requirement under 35 USC 115, Oath of the ApplicOATHDECL | OATHDECL | |
| Electronic ReviewELC_RVW | ELC_RVW | |
| Email NotificationEML_NTF | EML_NTF | |
| Notice of DO/EO Missing Requirements MailedM905 | M905 | |
| Request for Foreign Priority (Priority Papers May Be Included)RQPR | RQPR | |
| Cleared by L&R (LARS)L128 | L128 | |
| Referred to Level 2 (LARS) by OIPE CSRL198 | L198 | |
| IFW Scan & PACR Auto Security ReviewSCAN | SCAN | |
| Information Disclosure Statement consideredIDSC | IDSC | |
| Information Disclosure Statement (IDS) FiledWIDS | WIDS | |
| Reference capture on IDSRCAP | RCAP | |
| Information Disclosure Statement (IDS) FiledM844 | M844 | |
| Preliminary AmendmentA.PE | A.PE | |
| Initial Exam Team nnIEXX | IEXX |
2 legal events, as the office reported them to INPADOC
Over the term
Point at a mark for the eventEvents
| Event | Code | |
|---|---|---|
| Information on status: application discontinuationABANDONED -- FAILURE TO RESPOND TO AN OFFICE ACTIONSTCB | STCB | |
| AssignmentAS | AS |
Numbers
- Application
- 71835405
Titles
- English
- VIEWING SYSTEM
Classification
- CPC, 8
- H04N1/00106
- H04N7/18
- H04N1/00108
- H04N1/00323
- H04N2101/00
- H04N2201/0075
- H04N2201/0089
- H04N1/00
- IPC, 4
- H04N5 222
- G06F21 44
- H04N1 00
- H04N7 18