| Coordinating haptics with visual images in a human-computer interface -> Monitor Keywords |
|
|
  Coordinating haptics with visual images in a human-computer interfaceUSPTO Application #: 20070296692Title: Coordinating haptics with visual images in a human-computer interface Abstract: The present invention provides a method of generating haptic interface experiences that is capable of generating haptic companions to existing two-dimensional images. The method exploits the dominance of visual over haptic in humans: human tactile, proprioceptive, and kinesthetic senses do not supply as much fine detail as human vision, and consequently haptic representations do not have to be as detailed as the corresponding visual images to be believable to a human user. An existing two-dimensional image can be used as the visual component of a human-computer interface. A three-dimensional haptic model that is topologically similar to the image can be selected, where topological similarity means that the haptic model provides an acceptable approximation to important characteristics of the haptic experience desired to accompany the two-dimensional image. A relationship can then be established between the image in the visual component of the interface and the haptic model in the haptic component of the interface such that interaction with the image in the visual component is linked with interaction with the haptic model in the haptic component. As an example, a two-dimensional image of a ball can have a haptic model of a sphere associated therewith, and the center and radius established as a relationship such that visual cursor motion at the boundary of the image of the two-dimensional image of the ball is linked with haptic force feedback as the cursor encounters the surface of the haptic model. (end of abstract) Agent: V. Gerald Grafe, Esq. - Corrales, NM, US Inventor: Jake S. Jones USPTO Applicaton #: 20070296692 - Class: 345156000 (USPTO) The Patent Description & Claims data below is from USPTO Patent Application 20070296692. Brief Patent Description - Full Patent Description - Patent Application Claims
CROSS REFERENCE TO RELATED APPLICATIONS [0001] This application claims priority as a continuation of U.S. patent application Ser. No. 09/971,379, "Coordinating Haptics With Visual Images In A Human-Computer Interface", filed Oct. 4, 2001, now U.S. Pat. No. 7,225,215. BACKGROUND OF THE INVENTION [0002] This invention relates to the field of haptic human-computer interfaces, specifically to the incorporation of haptic experience with visual information. [0003] Haptic interface experiences are conventionally created using one of two basic methods. In some cases, a graphic or visual interface experience is created from three-dimensional models of objects. A haptic companion to the visual display can be created from the same three-dimensional models. This method produces a haptic interface experience that directly corresponds with the visual display (since it was created from the same models). However, creating three-dimensional models that approach the quality of real world visuals can be prohibitively expensive and time consuming. Also, models that approach real world detail can be too complex to render (either visually or haptically) in real time, making it difficult to provide an effective haptics experience. [0004] In other cases, a visual interface experience is created first, for example by two-dimensional photographs or movies of real objects. A haptic companion to the visual display is then added. This method can provide very realistic visual displays, and current technology can accommodate real time display of such realistic images. Creating the haptic experience from the initial visual images, however, can be quite difficult. Creating it manually is analogous to creating a sculpture from a single two-dimensional photograph. The task is possible, but requires significant time and skill to produce a believable haptic experience. Current research into automatic production of three-dimensional models from two-dimensional images offers hope, but the current state of the art is not capable of generating believable haptic representations from most two-dimensional images. [0005] The addition of a haptic interface component can increase the realism and efficiency of a user's experience with a visual display. Also, many two-dimensional images and image sequences exist (e.g., photographs, digital images, movies); haptic companions to the existing images could enhance the user experience. Accordingly, there is a need for a method of generating haptic interface experiences that is capable of generating haptic companions to existing two-dimensional images. SUMMARY OF THE INVENTION [0006] The present invention provides a method of generating haptic interface experiences that is capable of generating haptic companions to existing two-dimensional images. The method exploits the dominance of visual over haptic in humans: human tactile, proprioceptive, and kinesthetic senses do not supply as much fine detail as human vision, and consequently haptic representations do not have to be as detailed as the corresponding visual images to be believable to a human user. An existing two-dimensional image can be used as the visual component of a human-computer interface. A three-dimensional haptic model that is topologically similar to the image can be selected, where topological similarity means that the haptic model provides an acceptable approximation to important characteristics of the haptic experience desired to accompany the two-dimensional image. A relationship can then be established between the image in the visual component of the interface and the haptic model in the haptic component of the interface such that interaction with the image in the visual component is linked with interaction with the haptic model in the haptic component. As an example, a two-dimensional image of a ball can have a haptic model of a sphere associated therewith, and the center and radius established as a relationship such that visual cursor motion at the boundary of the image of the two-dimensional image of the ball is linked with haptic force feedback as the cursor encounters the surface of the haptic model. [0007] The method comprises selecting an initial haptic model that approximates haptic characteristics desired for the associated visual image or object within the visual image. For convenience, the description will refer to an object and its corresponding display or visual image, realizing that the object can represent all or just part of the total image. A correspondence can then be established between the initial haptic model and the object's visual image. A haptic model to accompany the visual image of the object can be generated by modifying the initial haptic model so that the generated model in haptic space corresponds to the image of the object in the visual display. Unlike many contemporary haptic modeling methods, the present method does not require a detailed three-dimensional model as input; details from the two-dimensional image combine with the generated haptic model to provide a believable haptic and visual combination. [0008] Haptic experiences produced by the present method can be significantly less complex than those produced from detailed three-dimensional models, easing the demands for real-time haptic and graphic rendering. Also, the present method obviates the time-consuming, and currently largely unsuccessful, process of creation of three-dimensional models from two-dimensional images. Consequently, the present method can economically add believable haptic experiences to the high realism visual images common with contemporary technology. [0009] Advantages and novel features will become apparent to those skilled in the art upon examination of the following description or may be learned by practice of the invention. The objects and advantages of the invention may be realized and attained by means of the instrumentalities and combinations particularly pointed out in the appended claims. Certain embodiments of the invention can be understood by examination of the computer software set forth in the table headed "Computer Program Listing". DESCRIPTION OF THE FIGURES [0010] The accompanying drawings, which are incorporated into and form part of the specification, illustrate embodiments of the invention and, together with the description, serve to explain the principles of the invention. [0011] FIGS. 1(a,b,c,d) is a schematic representation of a haptic model, a visual image, and correspondence therebetween. [0012] FIGS. 2(a,b,c,d) is a schematic representation of the present invention applied to an object in a sequence of images. [0013] FIG. 3 is a flow diagram of one implementation of the present invention. [0014] FIG. 4 presents a sequence of images comprising a table and a chair, viewed from different viewpoints. [0015] FIG. 5 is an illustration of a simplistic library of haptic models. [0016] FIG. 6 depicts haptic models selected to be topologically similar to the objects in FIG. 4. [0017] FIG. 7 is an illustration of the correspondence established between points on an object in an image and points on a selected haptic model. [0018] FIG. 8 presents a sequence of images of a haptic model of a table that has been automatically transformed to correspond to the images in FIG. 4. [0019] FIG. 9 presents of an image of a visual/haptic cursor about to touch the bottom of the table in the image, and then actually touching the bottom of the table in the image, and being occluded in the process. DETAILED DESCRIPTION OF THE INVENTION Continue reading... Full patent description for Coordinating haptics with visual images in a human-computer interface Brief Patent Description - Full Patent Description - Patent Application Claims Click on the above for other options relating to this Coordinating haptics with visual images in a human-computer interface patent application. ###  How KEYWORD MONITOR works... a FREE service from FreshPatents1. Sign up (takes 30 seconds). 2. Fill in the keywords to be monitored. 3. Each week you receive an email with patent applications related to your keywords. Start now! - Receive info on patent apps like Coordinating haptics with visual images in a human-computer interface or other areas of interest. ### Previous Patent Application: Automatic orientation-based user interface for an ambiguous handheld device Next Patent Application: Document processing system, document processing method, computer readable medium and data signal Industry Class: Computer graphics processing, operator interface processing, and selective visual display systems ### FreshPatents.com Support Thank you for viewing the Coordinating haptics with visual images in a human-computer interface patent info. IP-related news and info Results in 0.07233 seconds Other interesting Feshpatents.com categories: Electronics: Semiconductor , Audio , Illumination , Connectors , Crypto , |
||
