Apparatus and method of ubiquitous context-aware agent based on sensor networks
Summary by NHIP
Ubiquitous Context-Aware Agent Apparatus
The apparatus collects real-world data via a sensor platform and uses a context-aware agent to interpret and integrate that data for managing user intentions. Distinctive components include a space manager detecting user movement relative to static objects and a home map manager displaying current real-world states to the user.
Claim Score by NHIP
Abstract
An apparatus and method for context awareness by detecting intentions of a user in the ubiquitous environment using context information which is created by analyzing real world data collected from sensors are provided. The apparatus is configured of a sensor platform, a context-aware agent and a service provider. The sensor platform collects data of real world and transmits the collected data to the context-aware agent. The context-aware agent integrates the data of real world from the sensor platform, and stores and manages context information according to the integrated data. The service provider automatically controls objects to perform necessary operations to provide a predetermined intelligent services according to the context information received from the context-aware agent.

Term
Projected expiry 24 October 2027.
- Priority
- Filed
- Granted
- Today
- Projected expiry
17 claims: 3 independent, 14 dependent
- 1An apparatus of an ubiquitous context-aware agent based on a sensor network, the apparatus comprising:a sensor platform for collecting data of real world and transmitting the collected data to a context-aware agent;the context-aware agent for interpreting and integrating the data of real world from the sensor platform, and storing and managing context information according to the interpreted and integrated data;and a service provider for receiving the context information from the context-aware agent, and automatically performing operations according to the received context information, wherein the context-aware agent includes a context interpreter for receiving the collected data from the sensor platform and interpreting the received data to be viewable to a human and a computer;an integrator for receiving an interpreted context information from the context interpreter and integrating the received context information in a predetermined format;a space manager for receiving the interpreted context information from the context interpreter and detecting users' intention with reference to a relation between a users' movement and static objects in a predetermined space;a home map manager for receiving the interpreted context information from the context interpreter, and displaying current states of a real world to the user using the interpreted context information;a context storage for storing information transferred from the context integrator, the space manager and the home map manager, and outputting the stored information in response to a request;and a context manager for receiving the predetermined format of the integrated context information from the context integrator and managing the context information stored in the context storage.
- 7A method of context-awareness using an ubiquitous context-aware agent based on a sensor network comprising:detecting sensing-data related to a real world collected through a sensor platform, and transforming the sensing-data to context information by analyzing a meaning of the sensing-data;determining whether a value of the transformed context information is in a normal range or not if a type of the transformed context information is an environmental context;setting an urgent flag, storing corresponding context information and transferring the context information to a service provider if the value of the transformed context information is not in the normal range;integrating context information, storing corresponding context information, filtering the stored context information and transmitting the filtered context information to the service provider if the value of the transformed context information is in the normal range;analyzing a relation between a moving object and a static object if the type of the transformed context information is a position context, detecting an intentions of a user according to a position, and determining whether it's value is in a normal range or not;and integrating context information, storing corresponding context information, filtering the stored context information and providing the filtered context information to the service provider if the value is in the normal range.
- 12Broadest claimClaim Score 46, average(NHIP)A method of inferring a position context in a context-aware method using an ubiquitous context-aware agent based on a sensor network, the method comprising:determining a type of an object through monitoring context information in real time, and creating an object model and an object area model if the type of the object is a static object;detecting a qualitative state if the type of the object is a moving object in the operation of the determining and creating or if the object model and the object area model are created in the operation of the determining and creating;generating a qualitative state message based on the detected qualitative state and storing the generated qualitative state message;generating an object relation message by inferring an object relation using the qualitative state message and storing the generated object relation message;and generating a semantic model using a stored object relation model, generating a semantic model message according to the generated semantic model and storing the semantic model message.
Independent claims3
104 paragraphs in 6 sections, as filed
CROSS REFERENCE TO RELATED APPLICATIONS
This application claims the benefit under 35 U.S.C. Section 371, of PCT International Application Number PCT/KR2006/004186, filed Oct. 16, 2006 and Korean Application No. 10-2005-0118422 filed Dec. 6, 2005 in Korea, the contents of all of which are incorporated herein by reference.
TECHNICAL FIELD
The present invention relates to a sensor network in a ubiquitous environment, and more particularly, to an apparatus and method for context awareness by detecting intentions of a user in the ubiquitous environment using context information which is created by analyzing real world data collected from sensors.
BACKGROUND ART
In a ubiquitous environment, all objects (e.g., homes, offices, buildings, telematics and artificial intelligent robots) are connected together through a communication network, and each of the objects performs dedicated functions by exchanging information about a target object to provide a context-aware service for the target object. Generally, a ubiquitous service denotes all of services provided in the ubiquitous environment.
In the information technology (IT) generation, a human learns a computing technology to use available objects such as computers, electric appliances and communication devices. That is, the computing technology is a simple tool that improves productivity. Moreover, a computing technology in the ubiquitous generation learns a human to intelligently provide the related services according to context of the users.
Such a ubiquitous service must be provided based on context of a user, which is analyzed and detected by a high intelligent level of context-aware technology. If not, the ubiquitous service becomes a harmful technology giving inconvenience to the human although a user is in the ubiquitous environment that is configured of objects having a superior computing power and allows the user to access the computer anytime and anywhere. That is, the ubiquitous environment must provide high intelligent aware-service by understanding users' intentions and detecting users' context. Such an environment providing high intelligent aware-service is called as a ubiquitous intelligence.
There are three essential technologies required to embody the ubiquitous intelligence.
The first essential technology is a sensing information based context aware/decision technology. The sensing information based context aware/decision technology analyzes sensed information about objects around a user, determines whether the sensed information is related to the users' intention based on the analysis result and generates event signals in response to a service request.
The second technology is an autonomic computing technology. The automatic computing technology enables computers to automatically manage themselves in order to minimize participants of user.
The third technology is a self-growing engine that enables the ubiquitous environment to be automatically evolved by self-learning and growing.
Among the essential technologies, the context aware/decision technology was spotlighted as the most important technology for the ubiquitous intelligence environment.
Conventionally, the context aware/decision technology was mostly developed to provide a simple service based on limited context processing, for example, a positioning based service to a cellular phone user in a wireless environment or a user in vehicle in a mobile environment. That is, a context aware/decision technology was not developed for the ubiquitous intelligence environment.
Since a proper context aware/decision technology is not applied to the ubiquitous environment, a ubiquitous service may be provided based on insufficient, incorrect and inaccurate users' environment, context and intention. Therefore, the ubiquitous service may become a harmful service giving inconvenience to the user.
DISCLOSURE OF INVENTION
Technical Problem
Accordingly, the present invention is directed to an apparatus and method of a ubiquitous context-aware agent based on sensor networks that substantially obviates one or more problems due to limitations and disadvantages of the related art.
An object of the present invention is to provide an apparatus of a ubiquitous context-aware agent based on sensor networks and a method thereof for automatically providing a service according to users' context and intention through creating context data by analyzing and integrating real world data collected from sensors, storing and managing the created context data in a context storage, inferring users' intentions based on the context data and providing the service according to the context data and the intention of the user.
Additional advantages, objects, and features of the invention will be set forth in part in the description which follows and in part will become apparent to those having ordinary skill in the art upon examination of the following or may be learned from practice of the invention. The objectives and other advantages of the invention may be realized and attained by the structure particularly pointed out in the written description and claims hereof as well as the appended drawings.
Technical Solution
To achieve these objects and other advantages and in accordance with the purpose of the invention, as embodied and broadly described herein, an apparatus of a ubiquitous context-aware agent based on a sensor network, the apparatus includes: <ul><li id="ul0001-0001" num="0000"><ul><li id="ul0002-0001" num="0017">a sensor platform for collecting data of real world and transmitting the collected data to a context-aware agent;</li><li id="ul0002-0002" num="0018">the context-aware agent for interpreting and integrating the data of real world from the sensor platform, and storing and managing context information according to the interpreted and integrated data; and</li><li id="ul0002-0003" num="0019">a service provider for receiving the context information from the context-aware agent, and automatically performing operations according to the received context information,</li><li id="ul0002-0004" num="0020">wherein the context-aware agent includes a context interpreter for receiving the collected data from the sensor platform and interpreting the received data to be viewable to a human and a computer; an integrator for receiving the interpreted context information from the context interpreter and integrating the received context information in a predetermined format; a space manager for receiving the interpreted context information from the context interpreter and detecting users' intention with reference to a relation between the users' movement and static objects in a predetermined space; a home map manager for receiving the interpreted context information from the context interpreter, and displaying current states of a real world to the user using the interpreted context information; a context storage for storing information transferred from the context integrator, the space manager and the home map manager, and outputting the stored information in response to the request; and a context manager for receiving the predetermined format of the integrated context information from the context integrator and managing the context information stored in the context storage.</li></ul></li></ul>
According to an aspect of the present invention, there is provided a method of context-awareness using a ubiquitous context-aware agent based on a sensor network including: a) detecting sensing-data related to a real world collected through a sensor platform, and transforming the sensing-data to context information by analyzing a meaning of the sensing-data; b) determining whether a value of the transformed context information is in a normal range or not if the type of the transformed context information is an environmental context; c) setting an urgent flag, storing corresponding context information and transferring the context information to a service provider if the value of the transformed context information is not in the normal range; d) integrating context information, storing corresponding context information, filtering the stored context information and transmitting the filtered context information to a service provider if the value of the transformed context information is in the normal range; e) analyzing a relation between a moving object and a static object if the type of the transformed context information is a position context, detecting an intentions of a user according to a position, and determining whether it's value is in a normal range or not; and f) integrating context information, storing corresponding context information, filtering the stored context information and providing the filtered context information to a service provider if the value is in the normal range.
According to another aspect of the present invention, there is provided a method of inferring a position context in a context-aware method using a ubiquitous context-aware agent based on a sensor network, including: a) determining a type of an object through monitoring context information in real time, and creating an object model and an object area model if the type of the object is a static object; b) detecting a qualitative state if the type of the object is a moving object in the operation a) or if the object model and the object area model are created in the operation a); c) generating a qualitative state message based on the detected qualitative state and storing the generated qualitative state message; d) generating an object relation message by inferring an object relation using the qualitative state message and storing the generated object relation message; and e) generating a semantic model using the stored object relation model, generating a semantic model message according to the generated semantic model and storing the semantic model message.
The present invention relates to a method of context-awareness by creating context data through analyzing various data such as voltage, temperature, humidity, noise, acceleration, electromagnetic field and computing power which are collected from sensors, integrating the created context data in a predetermined format, and detecting users' contexts and inferring users' intentions based on the position in the ubiquitous environment using the context data.
It is to be understood that both the foregoing general description and the following detailed description of the present invention are exemplary and explanatory and are intended to provide further explanation of the invention as claimed.
Advantageous Effects
The apparatus and method for ubiquitous context-aware based on a sensor network allows the real-time service according to the object and the context thereof by analyzing and integrating real world data collected from the sensors.
Furthermore, the apparatus and method for ubiquitous context-awareness based on the sensor network allows a computer program to provide a context-aware service according to the users' intention and context by expressing the position and the direction information collected from the sensor in real time as the semantic context in a terminological logic format through hierarchical inference.
It will be apparent to those skilled in the art that various modifications and variations can be made in the present invention. Thus, it is intended that the present invention covers the modifications and variations of this invention provided they come within the scope of the appended claims and their equivalents.
BRIEF DESCRIPTION OF THE DRAWINGS
The accompanying drawings, which are included to provide a further understanding of the invention and are incorporated in and constitute a part of this application, illustrate embodiment of the invention and together with the description serve to explain the principle of the invention. In the drawings:
<figref idrefs="DRAWINGS">FIG. 1</figref> is a block diagram illustrating an apparatus of a ubiquitous context-aware agent based on a sensor network according to an embodiment of the present invention;
<figref idrefs="DRAWINGS">FIG. 2</figref> is a block diagram showing a software configuration of a ubiquitous context-aware agent based on a sensor network according to an embodiment of the present invention;
<figref idrefs="DRAWINGS">FIG. 3</figref> is a flowchart showing a method of context awareness based on a sensor network in ubiquitous environment according to an embodiment of the present invention;
<figref idrefs="DRAWINGS">FIG. 4</figref> is a flowchart of inferring an intention related to a position context performed in a space managing process in a method of context awareness using a ubiquitous context-aware agent based on as sensor network according to an embodiment of the present invention;
<figref idrefs="DRAWINGS">FIG. 5</figref> shows a storage space for storing environment context data in an apparatus of a ubiquitous context-aware agent based on a sensor network according to an embodiment of the present invention;
<figref idrefs="DRAWINGS">FIG. 6</figref> shows a storage space for storing an object context in an apparatus of a ubiquitous context agent based on a sensor network according to an embodiment of the present invention;
<figref idrefs="DRAWINGS">FIG. 7</figref> shows a transmitting message in a qualitative state context-aware layer in a ubiquitous context agent based on a sensor network according to an embodiment of the present invention; and
<figref idrefs="DRAWINGS">FIG. 8</figref> shows a transmitting message in a layer of recognizing an object relation in a ubiquitous context agent based on a sensor network according to an embodiment of the present invention.
BEST MODE FOR CARRYING OUT THE INVENTION
Reference will now be made in detail to the preferred embodiments of the present invention, examples of which are illustrated in the accompanying drawings.
<figref idrefs="DRAWINGS">FIG. 1</figref> is a block diagram illustrating an apparatus of a ubiquitous context-aware agent based on a sensor network according to an embodiment of the present invention.
Referring to <figref idrefs="DRAWINGS">FIG. 1</figref>, the apparatus of ubiquitous context-aware agent includes: a sensor platform <b>101</b> for collecting data of real world and transmitting the collected data to a context-aware agent <b>104</b>; a context-aware agent <b>104</b> for analyzing and integrating the collected data from the sensor platform <b>101</b>, storing context data according to the analyzed and integrated data and managing the stored context data; and a service provider <b>111</b> for receiving the service context information from the context-aware agent <b>104</b> and controlling objects to perform necessary operations to provide a predetermine service according to the received service context information.
The sensor platform <b>101</b> includes a sensor node <b>102</b> for collecting real world data, and a sensor coordinator <b>103</b> for transmitting the collected data to the context-aware agent <b>104</b>. Herein, the sensor node <b>102</b> may be configured in various forms to collect the real world data.
The context-aware agent <b>104</b> includes: a context interpreter <b>105</b> for receiving real world data from the sensor coordinator <b>103</b> and interpreting the received data to be recognizable by a human and a computer; a context integrator <b>106</b> for receiving the interpreted context data and integrating the received data to a predetermined format; a space manager <b>107</b> for receiving the interpreted context data from the context interpreter and inferring an intention of a user by analyzing a relationship of the movement of the user and static objects in a predetermined space; a home mapping manager <b>108</b> for receiving the analyzed context data from the context interpreter <b>105</b> and displaying states of real world for a user using the analyzed context data; a context storage <b>110</b> for storing information from the context integrator <b>106</b>, the space manager <b>107</b> and the home map manager <b>108</b> and outputting information in response to a request; and a context manager <b>109</b> for receiving the integrated context data in a predetermined format from the context integrator <b>106</b> and managing the stored information in the context storage <b>110</b>.
The context integrator <b>106</b> also transfers information about a service state to a service provider <b>111</b>. That is, the context integrator <b>106</b> transfers a context requiring a predetermined service among the integrated contexts to the service provider <b>111</b> in order to automatically provide a predetermined service.
As described above, the space manager <b>107</b> infers the users' intention based on the analyzed relationship between the users' movement and the static objects in the predetermined space. For example, if a user walks to a switch of light in a dark room, the space manager <b>107</b> recognizes the users' intention to turn the light based on the analyzing the relationship between the users' movement and the static object which is the switch of light.
The home map manager <b>108</b> displays the ubiquitous space such as a digital home, an office, a building or a telemetric, and adds, deletes or updates objects in the ubiquitous space according to the context, dynamically.
The service provider <b>111</b> receives information about a context requiring the predetermined service from the context integrator <b>106</b>, understands the intention of the user through analyzing the relationship between the received and analyzed context about users' movement and the static object, and automatically provides the predetermined service based on the inferred users' intention.
<figref idrefs="DRAWINGS">FIG. 2</figref> is a block diagram showing a software configuration for a ubiquitous context-aware agent based on a sensor network according to an embodiment of the present invention.
Herein, blocks of the software configuration for the ubiquitous context-aware agent shown in <figref idrefs="DRAWINGS">FIG. 2</figref> may be embodied as hardware blocks of a ubiquitous context-aware agent.
Referring to <figref idrefs="DRAWINGS">FIG. 2</figref>, the software configuration of the ubiquitous context-aware agent is correspondent to the context-aware agent shown in <figref idrefs="DRAWINGS">FIG. 1</figref>. That is, the software configuration of the ubiquitous context-aware agent according to the present invention includes a context interpreting process <b>203</b> as the context interpreter <b>105</b>, a space managing process <b>204</b> as the space manager <b>107</b>, a home map managing process <b>206</b> as the home map manager <b>108</b>, a context managing process <b>207</b> for the context manager <b>109</b> and a context integrating process <b>205</b> for the context integrator <b>106</b>. The software configuration of the ubiquitous context-aware agent further includes a context-aware connection managing process <b>202</b> for storing information about connections to external devices and an agent control process <b>201</b> for generally controlling the entire software configuration.
The context-aware agent control process <b>201</b> observes messages received from a sensor platform <b>101</b> and a service providing unit <b>111</b> connected through the context-aware connection managing process <b>202</b> performs operations based on the observing result.
The messages from the sensor platform <b>101</b> to the context-aware agent control process <b>201</b> include environment data and position data. The context interpreting process <b>203</b> interprets the environment data to be viewable to a human and a computer, creates context data based on the interpreting result and transmits the created context data with an urgent flag to the service provider <b>111</b> through the connection managing process <b>202</b> if the interpreted data exceeds a normal range. As a result, a predetermined service is automatically provided to a user.
If the context-aware agent controlling process <b>201</b> receives the position data from the sensor platform <b>101</b>, the context-aware agent controlling process <b>201</b> extracts three-dimensional coordinates (X, Y, Z) of an moving object by analyzing the meaning of the position data, analyzing a relationship between the moving object and previously-stored information of static objects, and transmits the analyzed relationship to the space managing process <b>204</b> to infer the intention of the moving object based on the analyzed relationship.
The space managing process <b>204</b> detects a comparative state of the static object and the moving object based on the position data and the direction data transferred from the context-aware agent controlling process <b>201</b>, defines a position relation between the static object and the moving object based on a time, and infers the intention of the moving object's movement using rules made based on the characteristics of the static object.
The context integrating process <b>205</b> integrates the interpreted contexts from the context-aware agent controlling process <b>201</b> to the predetermined format data. The integrated data is transmitted to the home map managing process <b>206</b> to display the integrated data through the context-aware agent controlling process <b>201</b>. Also, the integrated data is transferred to the context managing process <b>207</b> to store the integrated data in the context storage <b>110</b> through the context-aware controlling process <b>201</b>.
The message transmitted from the service provider <b>111</b> to the context-aware agent controlling process <b>201</b> is a response to the urgent message transmitted by the context-aware agent <b>104</b> or messages requiring a predetermined service. If the response message is not normal, a previously-transmitted message is retransmitted to retry performing of automated service.
In the software configuration according to the present embodiment shown in <figref idrefs="DRAWINGS">FIG. 2</figref>, each of the processes denotes a logical software unit, and an inter-process communication or a call-function is used to communicate between the processes.
<figref idrefs="DRAWINGS">FIG. 3</figref> is a flowchart showing a method of context awareness based on a sensor network in ubiquitous environment according to an embodiment of the present invention.
Referring to <figref idrefs="DRAWINGS">FIG. 3</figref>, data transmitted from the sensor platform <b>101</b> is observed in operation S<b>301</b>. Then, the meaning of the data is analyzed in operation S<b>302</b>, and the analyzed meaning is interpreted to context data which is a format of information to be viewable by a human and a computer. Herein, the data observed through the sensor platform <b>101</b> is a sensing data and the sensing data expresses contexts as temperature, voltage and coordinate. Such sensing data are only numerical values. The numerical values of the sensing data are transformed to the context data to be recognized by the human and the computer.
After transforming, a type of the context data is verified in operation S<b>303</b>. If the type of the context data is an environment context, it determines whether a value of corresponding context is in a normal range or not in operation S<b>304</b>.
If the value of corresponding context is out of the normal range in operation S<b>304</b>, an urgent flag is set in operation S<b>305</b>, the corresponding context data is transformed to a predetermined format in operation S<b>306</b> and transmitted to the context manager <b>109</b> and the service provider <b>111</b> to store the context data in operation S<b>307</b> and S<b>308</b>. The service provider provides a proper context-aware service in real time.
The predetermined format may be a message format exchanged between the context-aware agent and the context manager or between the context-aware agent and the computer program providing a service. Such a format may be modified or changed in various forms according to types of context transmitted from the sensors.
If the value of corresponding context data is in the normal range in operation S<b>304</b>, context data form various sensors are integrated in operation S<b>309</b> and the integrated context is transmitted to the home map manager in operation S<b>310</b> and the home map manager displays the integrated context data in a form of a graphic user interface (GUI).
After transforming to the predetermined format data in operation S<b>311</b>, it is transmitted to the context manager <b>109</b> in operation S<b>312</b> and stored in the context storage <b>110</b>.
The integrated context data is filtered in operation S<b>313</b>. If the integrated context data requires a predetermined service, the integrated context data is transmitted to the service provider <b>111</b> in operation S<b>308</b> to automatically provide a corresponding service in real time.
If the type of the transformed context data is a position context in operation S<b>303</b>, the relationship between the static object and the moving object is analyzed in operation S<b>314</b>, the analyzing result is transmitted to the space manage process <b>204</b> in operation S<b>315</b> to infer the intention of the moving object. In order to infer, three steps of inferring operation are performed as follows. The comparative states between the static object and the moving object are analyzed based on the analyzed position information and direction information. Then, a position relation between the moving object and the static object is defined based on a time. Finally, the intention of the moving object's movement is inferred based on rules made based on characteristics of the static object. Then, the inferred intention is transmitted to the service provider <b>111</b> in operation S<b>308</b> to use the inferred intention for providing the related service.
The analyzed position context may require a service having a value out of the normal range, for example, a user enters a room and requires a service to turn on the light of the room. Then, an urgent flag is set in operation S<b>305</b> and the context is transformed to a predetermined format in operation S<b>306</b> and transmitted to the context manager and the service provider <b>111</b> in operation S<b>307</b> and S<b>308</b> to stored the corresponding context and the provide a corresponding service in real time.
The predetermined format may be a message format exchanged between the context-aware agent and the context manager or between the context-aware agent and the computer program providing a service. Such a format may be modified or changed in various forms according to types of context transmitted from the sensors.
If the three-dimension position context is in the normal range in operation S<b>304</b>, the contexts collected from the various sensors are integrated in operation S<b>309</b>, transmitted to the home map manager in operation S<b>310</b> and displayed in a forma of graphic user interface (GUI) through the home map.
After transforming to the predetermined format in operation S<b>311</b>, it is transmitted to the context manager <b>109</b> to store it in the context storage <b>110</b>.
The integrated context is filtered in operation S<b>313</b>. If the filtered context is a context requiring a predetermined service, it is transmitted to the service provider <b>111</b> in operation S<b>308</b> to perform necessary operations to automatically provide a predetermined service in real time.
<figref idrefs="DRAWINGS">FIG. 4</figref> is a flowchart of inferring an intention related to a position context performed in a space managing process in a method of context awareness using a ubiquitous context-aware agent based on as sensor network according to an embodiment of the present invention.
Referring to <figref idrefs="DRAWINGS">FIG. 4</figref>, contexts of the context analyzing process <b>203</b> is observed in real time in operation S<b>401</b> and a type of the context is analyzed in operation S<b>402</b>.
If the type of the context is a static object in operation S<b>402</b>, the context is transmitted to an object model generator in operation S<b>403</b> and the object model generator creates an object model and an object space model in operation S<b>404</b>. Herein, the object model generator creates the object model and the object area model with reference to information related to types and sizes of a real static object and a functional area of the static object which are previously stored. The object model expresses a position and a size of the sensed static object and the object space model expresses a position and a size of the functional area of the sensed static object.
The created object model and object space model are transmitted to a qualitative state detector in operation S<b>405</b> and a qualitative state of the models are detected in operation S<b>407</b>.
If the type of the object is the moving object in operation S<b>402</b>, the context is transmitted to the qualitative state detector in operation S<b>406</b> and the qualitative state of the context is detected in operation S<b>407</b>.
The qualitative state is detected by comparing the position information of a moving object transmitted in real time with reference to the object model and the object area model of the static object.
If the qualitative state between the moving object and the static object is changed, a predetermined format of the qualitative state message is created and the qualitative state message is stored in the context storage <b>110</b> in operation S<b>408</b>.
The created qualitative state message is transmitted to an object relation inferring unit for inferring the object relation in real time in operation S<b>409</b>. The object relation is inferred based on the qualitative states such as approach, reside and leave in operation S<b>410</b>. Then, the predetermined format of the relation message is created using position information such as on, front, rear, left and right, and the created relation message is stored in the storage in operation S<b>411</b>.
The object relation message is transmitted to a semantic model inferring unit in operation S<b>412</b>. The semantic model inferring unit infers a semantic model with reference to a semantic model knowledge base including rules previously defined based on the characteristics of the static object in operation S<b>413</b>. Accordingly, the service provider <b>111</b> generates the context data to provide meaningful context-aware services. Such a context is created as a predetermined format of a semantic model message and the created semantic model message is stored in the context storage <b>110</b> in operation S<b>414</b>.
The semantic model message is transmitted to the service provider <b>111</b> in operation S<b>415</b>. Therefore, the proper context-aware service may be provided to the user in real time. After providing the service, the semantic model message may be used as a data for self-learning.
<figref idrefs="DRAWINGS">FIG. 5</figref> shows a storage space for storing environment context data in an apparatus of a ubiquitous context-aware agent based on a sensor network according to an embodiment of the present invention.
Referring to <figref idrefs="DRAWINGS">FIG. 5</figref>, the storage space for storing environment context data according to the present embodiment includes an environmental context storage space and an object context storage space. Such a context storage stores and manages context data according to a type of a context which is analyzed and integrated after received from the sensor platform.
The environmental context storage space stores items of the context such as a message identification <b>501</b>, a message type <b>502</b>, an object identification <b>503</b>, a voltage <b>504</b>, a temperature <b>505</b>, a luminance <b>506</b>, a sound <b>507</b>, an acceleration X <b>508</b>, an acceleration Y <b>509</b>, an electromagnetic field X <b>510</b>, an electromagnetic field Y <b>511</b> and a time <b>512</b>. Other items may be added to the environment context storage space according to additional sensors.
Herein, the message identification <b>501</b> is a value identifying the messages itself by the class.
The message type <b>502</b> is used to classify the message into a response message or a request message. If it is the response message, the message type <b>502</b> denotes one of a normal message and an abnormal message. Therefore, the message type <b>502</b> makes the message to perform its dedicated function with the message identification <b>501</b>.
The object identification <b>503</b> is a item for classifying the objects by it's type. The type of the object may be a human and an object, the human may be classified into a grandfather, a grandmother, a father, a mother, a son and a daughter. The object may be classified into furniture such as a drawer, a table or a sofa, and electronic appliance such as a TV, a refrigerator and a washer.
The environmental context data may be a voltage <b>504</b>, a temperature <b>505</b>, a luminance <b>506</b>, a noise <b>507</b>, an acceleration X <b>508</b>, an acceleration Y <b>509</b>, an electromagnetic field X <b>510</b> and an electromagnetic field Y <b>512</b>. If additional sensors are added, more items for the environmental context will be added. Each of the environmental context data is transformed to a predetermined format of message to be viewable to a computer and a human, and stored and managed with the message identification <b>501</b>, the message type <b>502</b> and the object identification <b>503</b>. The stored and managed environmental context data is used to provide the context-aware service in real time.
<figref idrefs="DRAWINGS">FIG. 6</figref> shows a storage space for storing an object context in an apparatus of a ubiquitous context agent based on a sensor network according to an embodiment of the present invention.
Referring to <figref idrefs="DRAWINGS">FIG. 6</figref>, the storage space for storing the object context is configured of a message identification <b>601</b>, a message type <b>602</b>, an object identification <b>603</b>, a X coordinate <b>604</b>, a Y coordinate <b>605</b>, a Z coordinate <b>606</b>, a viewable angle <b>607</b> and a time <b>608</b>.
Herein, the message identification <b>601</b>, the message type <b>602</b>, the object identification <b>603</b> and the time <b>608</b> denote same information compared to those items for the environmental context storage space. The X coordinate <b>604</b>, the Y coordinate <b>605</b> and the Z coordinate <b>606</b> denote a three-dimensional position coordinate generated by converting the position related data collected from the sensors. The viewable angle <b>607</b> denotes a direction to the object and is obtained from the position related data collected from the sensors.
The object context storage space stores and manages the position information of the object which is created according to the object identification.
<figref idrefs="DRAWINGS">FIG. 7</figref> shows a transmitting message in a qualitative state context-aware layer in a ubiquitous context agent based on a sensor network according to an embodiment of the present invention.
Referring to <figref idrefs="DRAWINGS">FIG. 7</figref>, the transmitting message includes information such as a message identification <b>701</b>, a message type <b>702</b>, a qualitative operator <b>703</b>, a moving object identification <b>704</b>, a static object identification <b>705</b> and a viewable angel <b>706</b>.
Herein, the message identification <b>701</b> is a value for identifying a type of message transmitted, and the message type <b>702</b> is a value denoting the format of the message.
The qualitative operator <b>703</b> has one of values approach, reside and leave to express the qualitative relation between the objects.
The moving object identification <b>704</b> is a value identifying the moving object that is a target object of the detected qualitative state, and the static object identification <b>705</b> is a value for identifying the static object which is a target object of the detected qualitative state.
The time <b>706</b> denotes a time detecting the qualitative state of the moving object and the static object.
<figref idrefs="DRAWINGS">FIG. 8</figref> shows a transmitting message in a layer of recognizing an object relation in a ubiquitous context agent based on a sensor network according to an embodiment of the present invention.
Referring to <figref idrefs="DRAWINGS">FIG. 8</figref>, the transmitting message includes a message identification <b>801</b>, a message type <b>802</b>, a relation operator <b>803</b>, a moving object identification <b>804</b>, a static object identification <b>805</b>, a start time <b>806</b> and an end time <b>807</b>.
The message identification <b>801</b> is a value for identifying the message to be transmitted, and the message type <b>802</b> is a value denoting the type of the message. The relation operator <b>803</b> is a value denoting a relation between the moving object and the static object for a predetermined time such as on, front, rear, left, and right.
The moving object identification <b>804</b> is a value to identify a moving object that is a target object of the detected object relation, and the static object identification <b>805</b> is a value to identify a static object that is a target object of the detected object relation.
The start time <b>806</b> includes time information denoting a time establishing a relation between the moving object and the static object, and the end time <b>807</b> includes time information denoting a time terminating the relation between the moving object and the static object.
The above described methods for ubiquitous context-aware based on the sensor network and for inferring a position context thereof according to the present invention can be embodied as a program and stored on a computer readable recording medium. The computer readable recording medium is any data storage device that can store data which can be thereafter read by the computer system. The computer readable recording medium includes a read-only memory (ROM), a random-access memory (RAM), a CD-ROM, a floppy disk, a hard disk, an optical magnetic disk, and carrier waves such as data transmission through the Internet The computer-readable recording medium can also be distributed over network-coupled computer systems so that the computer-readable code is stored and executed in a distributed fashion. Also, functional programs, codes, and code segments for accomplishing the present invention can be easily construed by programmers skilled in the art to which the present invention pertains.
As described above, the apparatus and method for ubiquitous context-aware based on a sensor network allows the real-time service according to the object and the context thereof by analyzing and integrating real world data collected from the sensors.
Furthermore, the apparatus and method for ubiquitous context-awareness based on the sensor network allows a computer program to provide a context-aware service according to the users' intention and context by expressing the position and the direction information collected from the sensor in real time as the semantic context in a terminological logic format through hierarchical inference.
It will be apparent to those skilled in the art that various modifications and variations can be made in the present invention. Thus, it is intended that the present invention covers the modifications and variations of this invention provided they come within the scope of the appended claims and their equivalents.
Contents6
9 sheets
Sheet 1 Sheet 2 Sheet 3 Sheet 4 Sheet 5 Sheet 6 Sheet 7 Sheet 8 Sheet 9
Every citation, both waysCites: the store holds 6 of 7
| Document | Relation | Office | Cited during |
|---|---|---|---|
| US9671468B2 | Cited by | United States of America | Applicant |
| US11392636B2 | Cited by | United States of America | Applicant |
| US10664518B2 | Cited by | United States of America | Applicant |
| US10726632B2 | Cited by | United States of America | Applicant |
| US9569726B2 | Cited by | United States of America | Applicant |
| US9035970B2 | Cited by | United States of America | Applicant |
| US9483518B2 | Cited by | United States of America | Applicant |
| US9396589B2 | Cited by | United States of America | Applicant |
| US12118581B2 | Cited by | United States of America | Applicant |
| US11869160B2 | Cited by | United States of America | Applicant |
| US9977835B2 | Cited by | United States of America | Applicant |
| US10140317B2 | Cited by | United States of America | Applicant |
| US9723062B2 | Cited by | United States of America | Applicant |
| US12406441B2 | Cited by | United States of America | Applicant |
| WO2012138784A3 | Cited by | World Intellectual Property Organization (WIPO) | International search |
| US9325792B2 | Cited by | United States of America | Applicant |
| US10419540B2 | Cited by | United States of America | Applicant |
| US9317834B2 | Cited by | United States of America | Applicant |
| US12008719B2 | Cited by | United States of America | Applicant |
| US9035955B2 | Cited by | United States of America | Applicant |
| CN105493067A | Cited by | China | Search report |
| US2009224867A1 | Cited by | United States of America | Pre-grant |
| WO2012138784A2 | Cited by | World Intellectual Property Organization (WIPO) | International search |
| US10643389B2 | Cited by | United States of America | Applicant |
| US10127733B2 | Cited by | United States of America | Applicant |
| WO2015047659A1 | Cited by | World Intellectual Property Organization (WIPO) | International search |
| US8810598B2 | Cited by | United States of America | Applicant |
| US11514652B2 | Cited by | United States of America | Applicant |
| US8587402B2 | Cited by | United States of America | Search report |
| US9105210B2 | Cited by | United States of America | Applicant |
| US10403051B2 | Cited by | United States of America | Applicant |
| US9524081B2 | Cited by | United States of America | Applicant |
| WO2013003079A2 | Cited by | World Intellectual Property Organization (WIPO) | International search |
| US9824501B2 | Cited by | United States of America | Applicant |
| US9317971B2 | Cited by | United States of America | Applicant |
| US11107289B2 | Cited by | United States of America | Applicant |
| US2013198128A1 | Cited by | United States of America | Pre-grant |
| US11967034B2 | Cited by | United States of America | Applicant |
| WO2013003079A3 | Cited by | World Intellectual Property Organization (WIPO) | International search |
| US12182953B2 | Cited by | United States of America | Applicant |
| US9384737B2 | Cited by | United States of America | Applicant |
| KR20020050780A | Cites | Republic of Korea | Applicant |
| US2006020633A1 | Cites | United States of America | Applicant |
| US5555376A | Cites | United States of America | Applicant |
| US7725532B2 | Cites | United States of America | Search report |
| US7734780B2 | Cites | United States of America | Search report |
| US7739607B2 | Cites | United States of America | Search report |
| International Search Report mailed Jan. 23, 2007 in connection with the International application PCT/KR2006/004186. | Non-patent | – | Applicant |
6 members in 4 offices
Priority claims8
| Document | Office | Kind | Date |
|---|---|---|---|
| 20050118422 | Republic of Korea | A | |
| 20050118422 | Republic of Korea | A | |
| 2006004186 | Republic of Korea | W | |
| 2006004186 | Republic of Korea | W | |
| 1020050118422 | – | – | – |
| KR20050118422 | – | – | – |
| PCTKR2006004186 | – | – | – |
| WO2006KR04186 | – | – | – |
Members6
| Document | Office | Kind | |
|---|---|---|---|
| KR100715681B1 | Republic of Korea | B1 | |
| WO2007066887A1 | World Intellectual Property Organization (WIPO) | A1 | |
| EP1958380A1 | European Patent Office (EPO) | A1 | |
| US2009261978A1 | United States of America | A1 | |
| US7847699B2This record | United States of America | B2 | |
| EP1958380A4 | European Patent Office (EPO) | A4 |
31 transactions on the USPTO file
Allowed without a rejection on record.
- Non-final rejections
- 0
- Final rejections
- 0
- RCEs
- 0
- Appeals
- 0
Over time
Point at a mark for the transactionTransactions
| Event | Code | |
|---|---|---|
| Payment of Maintenance Fee, 12th Yr, Small EntityM2553 | M2553 | |
| Payment of Maintenance Fee, 8th Yr, Small EntityM2552 | M2552 | |
| Recordation of Patent Grant MailedPGM/ | PGM/ | |
| Patent Issue Date Used in PTA CalculationAllowedPTAC | PTAC | |
| Issue Notification MailedAllowedWPIR | WPIR | |
| Dispatch to FDCD1935 | D1935 | |
| Application Is Considered Ready for IssuePILS | PILS | |
| Issue Fee Payment VerifiedN084 | N084 | |
| Issue Fee Payment ReceivedIFEE | IFEE | |
| Mail Examiner's AmendmentMEX.A | MEX.A | |
| Mail Notice of AllowanceAllowedMN/=. | MN/=. | |
| Notice of Allowance Data Verification CompletedAllowedN/=. | N/=. | |
| Examiner's Amendment CommunicationEX.A | EX.A | |
| Examiner Interview Summary Record (PTOL - 413)EXIN | EXIN | |
| Case Docketed to Examiner in GAUDOCK | DOCK | |
| Case Docketed to Examiner in GAUDOCK | DOCK | |
| PG-Pub Issue NotificationPG-ISSUE | PG-ISSUE | |
| Application Dispatched from OIPEOIPE | OIPE | |
| Sent to Classification ContractorPGPC | PGPC | |
| Filing ReceiptFLRCPT.O | FLRCPT.O | |
| Notice of DO/EO Acceptance MailedM903 | M903 | |
| Cleared by OIPE CSRL194 | L194 | |
| IFW Scan & PACR Auto Security ReviewSCAN | SCAN | |
| Reference capture on IDSRCAP | RCAP | |
| Information Disclosure Statement (IDS) FiledM844 | M844 | |
| Preliminary AmendmentA.PE | A.PE | |
| Request for Foreign Priority (Priority Papers May Be Included)RQPR | RQPR | |
| Information Disclosure Statement consideredIDSC | IDSC | |
| 371 Completion Date371COMP | 371COMP | |
| Information Disclosure Statement (IDS) FiledWIDS | WIDS | |
| Initial Exam Team nnIEXX | IEXX |
7 legal events, as the office reported them to INPADOC
Over the term
Point at a mark for the eventEvents
| Event | Code | |
|---|---|---|
| Maintenance fee paymentMAFP | MAFP | |
| Maintenance fee paymentMAFP | MAFP | |
| Fee paymentFPAY | FPAY | |
| Fee payment procedurePAYOR NUMBER ASSIGNED (ORIGINAL EVENT CODE: ASPN); ENTITY STATUS OF PATENT OWNER: SMALL ENTITYFEPP | FEPP | |
| Information on status: patent grantGrantedPATENTED CASESTCF | STCF | |
| AssignmentAS | AS | |
| AssignmentAS | AS |
Numbers
- Publication
- 07847699
- Publication, DOCDB
- 7847699
- Publication, EPODOC
- US7847699
- Application
- 12085315
- Application, DOCDB
- 8531506
- Application, EPODOC
- US20060085315
Titles
- English
- Apparatus and method of ubiquitous context-aware agent based on sensor networks
Patent term adjustment
- A delay
- +373 daysthe office missed an examination deadline
- Net adjustment
- 373 days
Classification
- CPC, 7
- H04L12/2803
- H04L12/2829
- H04W4/027
- H04L67/12
- H04W4/38
- H04W24/00
- H04W84/18
- IPC, 2
- G08B23 00
- H04W4 38
- USPC, 4
- 340573100
- 340286020
- 340505000
- 706046000