Flexible user interface device and method

Description: TECHNICAL FIELD [Detailed description of the invention]

【0001】

(Background of invention) (Technical field of invention) The present invention relates to interface devices for computer systems, such as personal computers, designed for human user wear, and more specifically, visible displays with easily wearable shape elements and excellent input / output capabilities. Regarding the device. [0002]

(Disclosure of prior art) Many different types of wearable computing devices are used in commercial, industrial and consumer environments. The best wearable computers are lightweight, flexible, ergonomic, and usable during all normal activities. According to one example, a flexible circuit configuration or equivalent flexible transmission device is connected to a physically independent computer module, facilitating the distribution of computers to the body to accommodate major changes in body morphology. Standard intermediate connection input / output devices allow for easy user upgrades and modular relocations. Broadband wireless local area networks allow communication between other users and / or host computer systems. Until recently, only easy, easy-to-use, convenient and flexible wearable computing devices, or powerful brick-like machines, have been selected in the marketplace. [0003]

All referenced and collaborated US patent numbers 5,285,398, 5,491,651, 5,581492, 5,798,907 recently acquired by Janik and US patent numbers 5,555,490, 5,572,401 acquired by Carroll are possessed by conventional block-like wearable computers. It discloses a large number of effective designs that are expected. [0004]

Typical portable displays are rigid, difficult to carry and / or unsuitable for wearing. The display is small and thin enough to be pocket-sized, and / or has a rigid element to accommodate it, which is somewhat awkward over a long period of time. Moreover, even "seats" are approximately rigid in computer prototypes, such as Sharp's Conceptual System-on-Panel (SOP) computers (having a thickness of only a few millimeters), thus eliminating this problem. Head-mounted displays are also known to be used in a variety of situations, but are typically bulky, heavy, hot, rather awkward and aesthetically unpleasant. [0005]

(Gist of the invention) Embodiments of the present invention combine flexible and rigid structural properties and / or display with significant effects compared to conventional body-worn and portable display systems capable of varying size and shape. I will provide a. Embodiments of the present invention combine the advantages of a large display, such as visibility and ease of use, with the ease of carrying a small display. [0006]

In the first embodiment, the display of the present invention is removably wrapped around the body and worn, and generally has a semi-rigid or fixed configuration. The display is preferably a flexible sheet having at least a portion that acts as a display and / or a cross-visible interface. The user flexibly unwinds the display from the body as needed and then flexibly operates in a second semi-rigid form to flexibly secure the display to one or another part of the body. Of course, the display can have some flexible / semi-rigid properties when placed away from the user's body, such as a desktop. In another example, the display of the present invention includes a plurality of seat portions movably connected so that they can rotate, fold and / or slide in relation to each other. The display and / or the cross-visible interface is visible at least on the seat, but may not be optically visible on all or part of the seat. The seats move in tandem with each other, changing the size and size of the display. Of course, it can be made easier to see by making it possible to attach a plurality of seat portions. [0007]

Both of these flexible / semi-rigid characteristics and changes in size / shape characteristics can be used in combination or individually, and the display of the present invention is easily mounted with high portability and ease of use. It is a portable display. Together, these properties provide a display that can be selectively used for that environment in fashion such as the variable chameleon. [0008]

Embodiments of the present invention are described by reference to the drawings, where reference numerals indicate elements. [0009]

(Detailed description of preferred embodiments) Embodiments of the present invention are widely applied to different computing techniques and environments. Flexible and wearable computers are rapidly gaining acceptance in the market as well as in different computing environments such as military, maintenance, law enforcement, medicine and other environments. Higher visibility and portable display devices are important in virtually all graphic or text input / output computing environments, but not only in wearable computing environments. Thus, although specific embodiments of the present invention will be described in the context of wearable computers and particularly flexible and wearable computers, the present invention is not limited to these embodiments. Rather, embodiments can be used effectively and / or in a desktop environment, among other possibilities. [0010]

The flex-to-fix interface device 10 of the present invention is generally shown in FIG. Device 10 comprises a sheet having first and second edges 14,16 and third and fourth edges 18,20. Further, the device 20 includes a display, that is, an interface screen 22, similar to the optical bracket 24. The sheet 12 of the device 10 preferably forms a flexible layer with an elastic shape fixed. As shown, the elasticity of the seat 12 generally retains the tubular shape as shown, but is not wrapped, the elasticity moves the edges 14 and 16 away from each other, in the direction of arrow A. They are pulled back along. Conversely, the sheet 12 can be made into a more closed tubular shape by pushing the edges 14 and 16 against each other along the direction of arrow B. Fasteners or brackets 24 (or other suitable fixing devices) secure edges 14 and 16 to aid in the shape-retaining properties of the seat 12 and to maintain a fixed position as in the tubular shape shown in FIG. May be used to [0011]

Sheet 12 generally forms a touch screen type interface, such as a computer monitor, capable of providing a visible display and contact activity input. As shown in FIG. 1, the interface screen 22 is represented in the active region on the sheet 12 supporting touch screen type technology including a visible display, input / output functions, and optical key reduction algorithms. Of course, device 10 can be turned on and off. [0012]

On the other hand, although the interface screen 22 is shown to occupy only a part of the sheet, the interface screen 22 may be sized to cover the entire surface of the sheet 12 or only a part of the sheet 12. May be good. Further, the interface screen 22 can be placed at any part of the sheet and is not limited to the position shown in FIG. Similarly, the interface screen 22 can be changed in shape, and the screen 22 is not limited to the square shape shown in FIG. The size, position, and shape of the screen 22 on the sheet 12 are controlled by appropriate software, drivers, known or identifiable from these prior arts, and the device 10 and wired or wireless RF, body LAN, and It works with a CPU-based computing system 23 that communicates through other well-known communication technologies. [0013]

As shown in FIG. 2, the device 10 is particularly applied to be worn on the forearm or other body parts of the user (eg, thighs, hips, etc.). In this arrangement, the device 10 is in a wrapped shape that fits the shape of the forearm 25 and is easily portable. The opposite edges 14 and 16 of the device 10 are adjusted to contact each other or to be adjacent to each other according to the take-up strength desired by the wearer. Further, the device 10 may be provided with a suitable fixing device such as a bracket / fastener 24 so that the device 10 can be firmly fixed and wrapped around the arm 25. In this form, the device 10 is generally flexible in the longitudinal direction that is not covered / coated (ie, approximately perpendicular to the longitudinal axis of the forearm 25) and is generally lateral (ie, the longitudinal of the forearm 25). It is fixed (or semi-rigid) in the direction (almost parallel to the axis). [0014]

In use in this form, the reciprocal screen 22 occupies only a portion of the surface of the sheet 12 in the area shown to be readily visible from above the device 10, especially when worn on the user's forearm 25. However, for large display areas, when input surfaces and / or additional functionality is desired, or when device 10 is used for extended periods of time, the user does not wrap the device 10 and creates new shapes that are more suitable for these purposes. It can be operated to have. As the device 10 is removed from the forearm 25, it is driven by software depending on the degree of winding / unwinding of the device 10 to increase the size and automatically (or manually) reduce the active screen 22 of the display sheet 12. You may. [0015]

FIG. 3 shows the device 10 in a flexible form in the middle, i.e. after unwinding from the forearm 25 (FIG. 2). The device 10 has the form shown in FIG. 3 and is just before being wound around the forearm 25. As shown in FIG. 3, the device 10 further includes a band 26, side supports 28, slots 30, and fasteners 32, 34. The band 26 is secured to the seat 12 with the fastener 34 and detachably secures the device 10 around the arm 25 or other preferred body part. Lateral support 28 extends along arm 25 from band 26 to additional support seats. Of course, other configurations are also used to detachably secure the device 10 around the arm 25. [0016]

In the configuration shown in FIG. 3, the device 10 is flexible in at least two directions: longitudinal winding / unwinding directions (directions indicated by arrows A and B) and lateral release / fixing directions (arrows C and D). The indicated direction) will be further described. Thus, all forms of the device 10 described above are flexible in one direction and generally fixed (or semi-rigid) in the lateral direction. In contrast, in the form shown in FIG. 3, the device 10 is generally flexible both longitudinally and vertically. Both of these flexibilitys make device 10 more difficult for input / output operations, especially touch input operations. However, whether wound or unwound, the device 10 has input and output capabilities and the display displays text and / or graphics. Ultimately, as shown in Figure 4 below, device 10 is generally rigid (or semi-rigid) in the longitudinal direction (AB) and laterally (unless fixed by a suitable anchoring device). ) Is flexible. [0017]

In order to achieve maximum input / output functionality and / or a larger display screen surface, the device 10 is further intermediate, i.e., the device 10 is generally fixed (from both flexible shapes in FIG. 3 as shown in FIG. 4). Or it is operated to a substantially fixed shape that is semi-rigid in the longitudinal direction and substantially flexible in the vertical direction). To do so, the user bends the device 10 laterally as shown in FIG. 4 to form an arch 33 that faces laterally downward, thereby making the mutual screen 22 of the device 10 convex. The sheet 12 has an arch 33 with a radius of curvature 36. The arch 33 is substantially rigid along the longitudinal direction of the device 10 and can provide a structure that is significantly stable for touch screen functions, including input / output operations. In addition, in the arrangement of the slot 30 and fastener 34 combination shown in FIGS. 3 and 4, mechanical stops, bands, pins, hooks and loops, fasteners and other equivalent devices to support the device 10 in an arch shape. Can be used for. [0018]

As shown in FIG. 5, as a variant of the downward arch 33, the concave shape of the collaborative device 10, the seat 12, is fixed to the upward facing arch 35 for the mutual screen 22 and seat of the device 10. It has a concave shape. This upward facing arch makes device 10 nearly rigid and different from the placement associated with the forearm 25. [0019]

According to another embodiment shown in FIG. 6, the interactive device 40 has a sheet 42 with edges 42, 44 and sides 46 and a mutual screen 48. The device 40 has substantially the same characteristics as the device 10 described above in connection with FIG. 1-5. However, as shown in FIG. 6, the device 40 is always tubular or arranged in a tubular shape by the edges 14 and 16 of the device 10 facing in all directions. Such a tubular display is suitable for mounting in a gap and can also stand alone or with other support on a desk 41 in a kiosk style. [0020]

Therefore, at first, in the same interface device, the examples are combined (1) to make it a flexible form so that it can be carried and made into a small shape so that it can be attached. (2) Enlarge as necessary to make it a substantially rigid shape. Roughly speaking, depending on the position of the edge of the device 10 in one or more arrangements, the edge of the sheet-type configuration forming the device 10 with a suitable mechanism or other device is substantially fixed or retained, morphologically or The format changes from a flexible interface device to a fixed (or semi-rigid) interface device. Of course, this form can also be transformed from a fixed interface device to a flexible interface device. That is, this form can vary between two (or more) fixed interface forms that differ due to the flexible operation of the interface device. [0021] [0021]

Embodiments of the present invention include a variety of software components for utilizing interface devices in different embodiments. In addition, it automatically adjusts the "touch match" characteristics described above for size characteristics to arrange the touch screen layers differently so that the device 10 is fixed in different ways. In particular, as shown in FIG. 7, the touch screen interface device 50 of the present invention has at least two contacts, such as the outer layer 52 and the inner layer 54 (which have similar properties to the device 10 in FIG. 1-5). It has a sensitive layer. The outer layer 52 is configured to be in contact with a finger or other pointing device, often equipped with a visibility 56, and works directly with the appropriate processing electronics. If the touchscreen device is in a planar configuration (most of the time not all typical touchscreens), the visibility 56 of the outer layer 52 is generally a suitable contact element 58 in the lower layer 54. Arrange directly with. [0022]

However, when the device 10 is bent, the inner layer 54 and the outer layer 52 slide in relation to each other, changing the arrangement between them. When the device 50 is bent sideways or vertically, the center of the tentative curve is formed as described above. For example, FIG. 4 shows a tentative center of curvature 37 when the device 10 is bent laterally for rigidity. In the vertically bent form of FIG. 2, the center of curvature (not shown) is located inside the forearm 23. In either case, the outer layer 52 of the suitable touch screen has a larger radius from the center of curvature than the inner layer 54, and the visibility 56 between the outer layer 52 and the contact element 58 of the lower layer 54. Causes sequence disorder. Software characteristics can easily identify one of the usual techniques that can be performed to automatically correct this sequence disorder. [0023]

Correction or improvement of array disturbances according to the present invention has been described in the context of touch screen embodiments, but similar findings can also be used with other layer elements in the mutual device 10 such as display elements. it can. [0024]

The butterfly shape shown in Figure 8-9 is used for better application with minimal misalignment in the frequently used areas of the mutual screen 22 of device 10 (Figure 1-4). The device 60, which has substantially the same properties as the device 10, has a screen or other layers 62,64 along the rib 66 and the edge fastener 68. As best seen in the cross section of FIG. 8, the rib 66 extends along the length of the device 60. The rib 66 can slide between layers 62, 64, but can be more controlled and in the expected form than a multi-layered touch screen device without the rib 66. The outer edges 67 of layers 62,64 can be connected to one or more fasteners 68 to prevent layers 62, 64 from "fluttering" in relation to each other, of layers 62, 64. It is possible to prevent parallel slides that are related to each other. Fastener 68 may also have rails and interconnected slide points or slide edges between them and other fasteners. [0025]

According to one embodiment of the invention shown in FIG. 10, the interface device 70 has a plurality of rectangular screen layer sections 72 (including other screen support layers). Sections 72 are preferably connected by one or more pivot points 74 at the corners of section 72, together forming a mutual (or receiving) display 76. Section 72 of the device 70 slides in association with each other to increase or decrease the size or shape of the visible display 76. As shown in FIG. 10, a plurality of screens or other layers 72 are housed or stacked to minimize the contour of the device 70. Alternatively, as shown in FIG. 11, the plurality of screen sections 72 extend in relation to each other to extend the display 76, i.e., as shown in FIG. 12, the screens 72 partially overlap to form the display 76. In morphology, they rotate uniaxially in relation to each other. When stowed as shown in FIG. 10, the device 70 is highly wearable, portable and intermittently usable, while when expanded as shown in FIG. 11, the device 70 is highly transmissive, i.e. stationary. Used for use or applications that require higher resolution. Each screen, i.e. a selected group of other layers 72 or multiple screens / layers 72, is supplied with its own device driver. The device driver describes changes in quantity, shape and / or number of screens used in the display 76, especially for the shape of device 70. [0026]

Similarly, the device 80 of the invention shown in Figure 13-14 is similar to the device 70 in Figure 10-12, except that a pie-shaped screen section 82 is used instead of the square / rectangular screen section 72. Has characteristics. The pie-shaped screen sections 82 are integrally fixed by a pivot mechanism 84 to form the display 86 individually or together. Similar to device 70, the pie-shaped screen sections 82 are visible as a whole (side by side) or in a stacked shape as shown in FIG. 13, especially as shown in FIG. Only the pie-shaped screen section 82 at the top is visible, with the remaining screen sections hidden below. [0027]

These embodiments (FIG. 10-14) are used in a plurality of screens or other layers 72, 82 and a plurality of shapes (eg, a mixture of pies and squares or other shapes) determined by the user. .. The device driver is the screen used for display, input or other functions based on the position of each screen exposed to the user (ie, the part of the screen that is not hidden behind the other, the screen that is overlaid). Select 72 or 82. The screen or screen portions 72, 82 are preferably selected based on the shape of the device 10 and / or the user's instructions. [0028]

Like devices 70, 80, device 10 can be shaped to be placed around other suitable locations such as the user's wrists, hips, hips, neck, thighs, etc. As an example, as shown in FIG. 15, device 80 arranges pie-shaped screen sections (or other layers) 82 side-by-side to provide a larger integrated pie-shaped display 86 with bands 88. Is placed around the user's neck 90. This large pie-shaped morphology is particularly suitable for hanging around the neck from the smallest area of the recent and hard-to-see display 86 to the largest area of the easy-to-see display 86. Of course, the pie-shaped section 82 is stacked and the hands are positioned for storage or for the purpose of minimizing space (as in Figure 12, only the top section is used for visibility). [0029]

Similarly, the inter-devices of the present invention can be worn around the body in other embodiments shown in FIG. 16, which means that the inter-devices 100 are approximately parallel to form the display 104 together. Includes screen section 102 with adjacent edges arranged side by side. The band 106 secures the device 100 around the user's neck 108 or elsewhere. The screen section 102 is arranged in a horse hoof shape around the neck 108 as shown in FIG. Prior to that, the software screen driver integrates into the touch screen, display and input / output functions on screen section 102. [0030]

In another embodiment, the mutual device 120 of the present invention is arranged in a spelled or folded shape. The device 120 comprises a plurality of screen sections 122 connected to each other and arranged side by side at the edge 124. Device 120 group Further, it is equipped with a first side 126 and a second side 128. The screen sections 122 together form the display 130 and are visible on the first side 126 and / or the back side 128. [0031]

According to another embodiment shown in FIG. 18, the mutual device 140 of the present invention functions as a mutual device in the shape of an umbrella or a similar shape. Device 140 faction Equipped with multiple pie-shaped screen sections 142, fixed in the center or fixed by a pivot 144 to form a canopy-shaped display 148. The stem 146 extends from the underside of the display 148 and can accommodate the rest of the hardware of the device 140. The stem 146 acts as a standing device, allowing the device 140 to be placed upright on a table, desk, or other suitable structure. The screen or other layer 142 can be spread out on a flat plate at one end of the stem (as shown) or bent to improve visibility. The device 140 can be used to emit or reflect musical means, for example when a plurality of devices are used together, and creates a surround sound effect or the like. The present invention could be used for large scale applications, such as advertising screens, as described above, as well as for small scale applications. [0032]

Flexible display devices and especially flexible touch screens can be used for commercial use, the first embodiment of the invention is the effect of flexibility (eg, portability and ease of use) and the effect of rigidity (stationary). Combining touch input and ease, visibility on a large scale), such embodiments are particularly suitable for use in wearable computing environments. The mutual device 10 in this modified embodiment can be easily seen by the user, and can be more easily seen by others when it is expanded and fixed. The touch interface is quickly adapted and the entire image is easily visible on the large size display. [0033]

As shown in FIG. 19, support components 150 for interface devices 10, 70, 80, etc., which are used for processing components and other peripheral communication with devices 10, etc., have a belt 153 on the body 152. It can be worn on and inside clothes by using it. The patents granted to Carroll and Janik mentioned above clearly illustrate the effects of flexible and wearable computers, especially for that purpose, and work with them by reference. RF or other wireless communication can be used to transfer data between the wearable computer or component on the belt 153 and the interface device 10 (or 70, 80, etc.). Similarly, wired communication is also possible. [0034]

Since the interface device 10 is flexible, it is mounted on or mounted on a flexible battery with memory built into it. For example, devices 50,60 shown in Figure 7-8 include layers 54,64 and 62,64, respectively. One of these layers, namely layers 54 or 64, or additional layers, can be configured with a flexible battery with memory. [0035]

As shown in FIG. 20, another embodiment of the interactive device 10 further illustrates a wearable use case with a two-way language communication system with a microphone 1644 foldable earbud or plug 166. When the device 10 is attached to a body part such as the forearm 23 as shown in FIG. 2, the microphone 164 of the device 10 is located near the user's wrist and as needed (ie, depending on the capacity of the μphone). ) The microphone can be made by the user with the microphone lifted near the user's mouth. When the earbud 166 is stowed from device 10 and attached to the user's ear, the microphone / earbud component will be able to facilitate two-way language communication. [0036]

In embodiments of the invention, such as device 10 shown in FIG. 20, a CMOS camera 162 is provided as needed, preferably in collaboration with a microphone 164 and a retractable earbud 166 for bidirectional video conferencing. Make communication easier. [0037]

Finally, flexible motherboards and other flexible devices that work with device 10 do not have an unlimited flexible lifespan. The degree of bending sharpness of device 10 is determined by its flexible life. Thus, as shown in FIGS. 21 and 22, embodiments of the invention can include package limiting members such as cables and relatively stiff sheets arranged within or between the disclosed layers or motherboards. For example, FIG. 21 shows a reciprocal device 170 having screen layers (or other layers) 172, 174 with cables 176 extending in between. Similarly, FIG. 22 shows a mutual device 170 with a sheet 178 of a relatively hard material that is harder than the screen layer (or other PC support layer) of device 10 with different durometer values. These package limiting members, such as cable 176 or rigid sheet 178, prevent sharp bending and movement caused by unacceptably high bending stresses or wrinkles on the operating screen layer or other layers of device 10. [0038]

Although the present invention has been described with reference to specific embodiments, the description is an example and is not construed as a limitation of the scope of the invention. Not only is the device according to the invention wearable, it can also be used as another type of computing device. Wireless or wired infrared, optical and other means of communication can also be used. Flexible circuit configurations, ribbons, or other and / or additional signal relay components can be used in all embodiments of the invention. Signals refer to power signals, data signals and other electro-optical IR, RF or other signals and are used for electrical layers and / or communications. Other modifications and modifications that have changed exist within the scope of these techniques without leaving the spirit and scope of the present invention.

[Simple explanation of drawings]

[Figure 1]

It is a perspective view of the mutual display device in the semi-rigid form according to the embodiment of this invention. [Figure 2]

It is a perspective view of the device of FIG. 1 in the semi-rigid form when it is attached to the arm of the user according to the embodiment of the present invention. [Fig. 3]

It is a perspective view of the device of FIG. 1 in a substantially flexible form according to the embodiment of the present invention. [Fig. 4]

It is a perspective view of the device of FIG. 1 in a semi-rigid convex form according to the embodiment of the present invention. [Fig. 5]

It is a perspective view of the device of FIG. 1 in a substantially semi-rigid concave form according to the embodiment of the present invention. [Fig. 6]

FIG. 5 is a perspective view of the device of FIG. 1 according to an embodiment of the present invention, which is in a substantially tubular shape when erected on an end. [Fig. 7]

It is sectional drawing of the display device in a substantially semi-rigid form according to the embodiment of this invention. [Fig. 8]

FIG. 5 is a cross-sectional view of a display device in a substantially semi-rigid form having additional support characteristics according to an embodiment of the present invention. [Fig. 9]

It is a perspective view of the device of FIG. 8 according to the embodiment of this invention. [Fig. 10]

It is a top view of the multi-screen display device provided with the quadrangular part in the storage form according to the embodiment of this invention. [Fig. 11]

It is a top view of the device of FIG. 10 in the expanded state according to the embodiment of the present invention. [Fig. 12]

It is a top view of the device of FIG. 10 in a partially expanded state according to the embodiment of the present invention. [Fig. 13]

It is a top view of the multi-screen display device provided with the pie-shaped part in the storage form according to the embodiment of this invention. [Fig. 14]

It is a top view of the device of FIG. 13 in a partially expanded state according to the embodiment of the present invention. [Fig. 15]

FIG. 6 is a schematic view of the device of FIG. 13-14 in a fully expanded form worn around the user's neck according to an embodiment of the present invention. [Fig. 16]

It is the schematic of the multi-screen display device worn around the neck of the user according to the embodiment of the present invention. [Fig. 17]

FIG. 3 is a perspective view of a foldable multi-screen display device according to an embodiment of the present invention. [Fig. 18]

It is a perspective view of the multi-screen display in the umbrella form according to the embodiment of this invention. [Fig. 19]

FIG. 5 is a cross-sectional view of a wearable PC support component used with a display device according to an embodiment of the present invention. [Fig. 20]

FIG. 5 is a perspective view of the device of FIG. 1 having additional transmission characteristics according to an embodiment of the present invention. [Fig. 21]

It is sectional drawing of the display device provided with the internal support structure according to the embodiment of this invention. [Fig. 22]

It is sectional drawing of the display device provided with the sheet-like internal support structure according to the embodiment of this invention.