Follow us on Twitter
twitter icon@FreshPatents

Browse patents:
Next
Prev

Adjusting dimensioning results using augmented reality / Hand Held Products, Inc.




Adjusting dimensioning results using augmented reality


A system and method for using an augmented reality interface to adjust the results from a dimensioning system are disclosed. The augmented reality interface allows users to easily correct dimensioning errors, improve dimensioning results, and guide dimensioning analysis. In one embodiment, the user may adjust/select the results via hand gesturing/positioning within the system's field of view. In another embodiment, the user may use virtual tools, enabled by hand gesturing/positioning,...



Browse recent Hand Held Products, Inc. patents


USPTO Applicaton #: #20170017301
Inventors: Tyler Doornenbal, Jeffrey Mark Hunt, Sanjaya Bandaragoda


The Patent Description & Claims data below is from USPTO Patent Application 20170017301, Adjusting dimensioning results using augmented reality.


FIELD OF THE INVENTION

- Top of Page


The present invention relates to dimensioning systems and more specifically, to a means for adjusting the results from dimensioning systems using augmented reality.

BACKGROUND

- Top of Page


Many applications require non-contact, three-dimensional (3D) scanning of objects. An object may be scanned remotely without the need to touch the object. Active 3D scanners project radiation (e.g., light, ultrasound, X-ray, etc.) into a field of view and detect the radiation reflected from an object. A time-of-flight 3D scanner, for example, projects pulse of light onto an object and measures the time taken for the pulse of light to reflect from the object and return to the range finder. In another example, a structured light 3D scanner projects a light pattern (e.g., a dot pattern of light) onto an object, while a camera, offset from the projector, captures an image of the reflected pattern. The projector and camera may use triangulation to determine a range for each of the dots in the reflected dot pattern of light.

Dimensioning systems (i.e., dimensioners) may use 3D scanners (i.e., 3D sensors) to determine the dimensions (e.g., surface length, surface area, and object volume) of an object. These systems have found use in the transport and logistics industries. For example, dimensioning systems may facilitate the calculation of shipping cost based on package volume. In another example, dimensioning systems may help form packing strategies for transportation and/or storage.

During the dimensioning process, feedback may provide a user a way of verifying that the 3D scanner has scanned an object correctly. This feedback may include an image of the object overlaid with graphics showing the results of the 3D scan. For example, a package may have its edges highlighted by an overlaid wireframe graphic.

Dimensioning systems may return errors. For example, shading and/or glare could cause the dimensioning system to determine an edge of an object erroneously. In this case, the feedback would include a wireframe that did not align with the object's true edge. A human might easily see this misalignment in the feedback image and could help adjust the wireframe to fit the edges, thereby improving the results from the dimensioner.

Wireframe manipulation maybe difficult using traditional touch displays because using a 2D display to manipulate an object in three dimensions can easily result in errors. For example, an intended adjustment along one axis could cause an unwanted adjustment in another axis because it is difficult for a user to decouple height/width from depth using a 2D display.

Therefore, a need exists for an augmented reality interface to allow a user to (i) correct dimensioning errors, (ii) improve dimensioning results, and (iii) guide dimensioning analysis. The augmented reality interface embraced by the present invention provides the user with an easier, more-intuitive means for interacting with a dimensioning system.

SUMMARY

- Top of Page


Accordingly, in one aspect, the present invention embraces a dimensioning system. The dimensioning system includes a three-dimensional (3D) sensor for measuring the dimensions of objects (i.e., dimensioning) in a field of view. The dimensioning system also includes a camera for capturing real-time images of the objects. The dimensioning system further includes a processor that is communicatively coupled to the 3D Sensor, the camera, and a display. The processor is configured to create augmented-reality feedback that is displayed, in real-time, to a user via the display. The augmented-reality feedback includes the real-time images captured by the camera and graphic elements that are overlaid on the real-time images. Gestures in the real-time images are recognized by the processor and the graphic elements are adjusted in response.

In an exemplary embodiment of the dimensioning system, the gestures include a hand gesture.

In another exemplary embodiment of the dimensioning system, the gestures include the position and/or motion of a point of light projected into the field of view and reflected from the objects in the field of view.

In another exemplary embodiment of the dimensioning system, the graphic elements include wireframes that correspond to the edges of the objects in the field of view.

In another exemplary embodiment of the dimensioning system, the graphic elements include wireframes and virtual tools for adjusting and/or selecting the wireframes.

In another exemplary embodiment of the dimensioning system, the graphic elements include wireframes and virtual tools. The virtual tools include a tweezer for grabbing an edge of the wireframes, a pointer for selecting a face of the wireframes, and/or a virtual hand for grabbing the wireframes.

In another exemplary embodiment of the dimensioning system, the graphic elements include wireframes and the adjustment of the graphic elements includes selecting a portion of the wireframes for dimensioning.

In another exemplary embodiment of the dimensioning system, the graphic elements include wireframes and the adjustment of the graphic elements includes rotating and/or translating the wireframes.

In another aspect, the present invention embraces an augmented reality interface for a dimensioning system. The interface includes a camera for capturing images of a field of view that is aligned with the dimensioning system\'s field of view. The interface also includes a display for displaying images and graphical information to a user. A processor is communicatively coupled to the camera, the display, and the dimensioning system. The processor is configured by software to receive images from the camera and to receive dimensioning information, corresponding to an object in the dimensioning system\'s field of view, from the dimensioner. Using the dimensioning information, the processor is configured to create wireframe graphics that correspond to the edges of the object. The images and the wireframe graphics are presented on the display, wherein the wireframe graphics overlay and are aligned with the object. The processor is further configured to recognize adjustment cues in the images and to adjust the wireframe graphics in response to the adjustment cues.

In an exemplary embodiment of the augmented reality interface, the processor is further configured to update the dimensioning information in response to the adjustment of the wireframe graphics. The processor is also configured to communicate this updated wireframe information to the dimensioning system.

In another exemplary embodiment of the augmented reality interface, the adjustment cues include a user\'s hand reaching into the field of view and virtually manipulating the wireframe graphics presented on the display.

In another exemplary embodiment of the augmented reality interface, the adjustment cures include a light spot projected into the field of view to select a surface indicated by the wireframe graphics presented on the display.

In another exemplary embodiment of the augmented reality interface, the adjustment to the wireframe graphics includes resizing the wireframe graphics.

In another exemplary embodiment of the augmented reality interface, the adjustment to the wireframe graphics includes rotating and/or translating the wireframe graphics.

In another exemplary embodiment of the augmented reality interface, the adjustment to the wireframe graphics includes deleting a portion of the wireframe graphics.

In another exemplary embodiment of the augmented reality interface, the adjustment to the wireframe graphics includes combining wireframe graphics.

In another aspect, the present invention embraces a method for correcting dimensioning errors using an augmented reality interface. The method begins with the step of observing the results from a dimensioning system, wherein the results are displayed as virtual wireframes overlaid on real-time images of objects in a field of view. The virtual wireframes correspond to the edges of one or more surfaces on one or more objects in the dimensioning system\'s field of view. Errors in the virtual wireframes are identified. A hand is then reached into the dimensioning system\'s field of view so that it is displayed with the objects and the virtual wireframes. One of the virtual wireframes is selected using a virtual tool enabled by the hand or by using the hand itself. The selected virtual wireframe is then adjusted by moving the hand or the virtual tool. The steps of (i) identifying errors in the virtual wireframes, (ii) reaching into the field of view, (iii) selecting one of the virtual wireframes, and (iv) adjusting the selected virtual wireframe is repeated until all of the errors in the virtual wireframes have been corrected.

In an exemplary method for correcting dimensioning errors using an augmented reality interface, the errors in the virtual wireframes include (i) virtual wireframes that overlap, (ii) virtual wireframes that cover more than one object, and/or (iii) virtual wireframes that do not cover an object completely.

In another exemplary method for correcting dimensioning errors using an augmented reality interface, the augmented reality interface is an optical head-mounted display worn by a user.

The foregoing illustrative summary, as well as other exemplary objectives and/or advantages of the invention, and the manner in which the same are accomplished, are further explained within the following detailed description and its accompanying drawings.

BRIEF DESCRIPTION OF THE DRAWINGS

- Top of Page


FIG. 1 graphically depicts a perspective view of a user adjusting the output of a dimensioning system using an augmented reality interface according to an exemplary embodiment of the present invention.

FIG. 2 graphically depicts an image from an augmented reality interface showing a user manipulating a virtual tool to interact with the results from a dimensioning system according to an exemplary embodiment of the present invention.

FIG. 3 graphically depicts an image from an augmented reality interface showing a user manipulating a projected laser beam to interact with the results from a dimensioning system according to an exemplary embodiment of the present invention.

FIG. 4 schematically depicts a block diagram of a dimensioning system according to an embodiment of the present invention.




← Previous       Next →

Download full PDF for full patent description, claims and images

Advertise on FreshPatents.com - Rates & Info


You can also Monitor Keywords and Search for tracking patents relating to this Adjusting dimensioning results using augmented reality patent application.

###


Browse recent Hand Held Products, Inc. patents

Keyword Monitor How KEYWORD MONITOR works... a FREE service from FreshPatents
1. Sign up (takes 30 seconds). 2. Fill in the keywords to be monitored.
3. Each week you receive an email with patent applications related to your keywords.  
Start now! - Receive info on patent apps like Adjusting dimensioning results using augmented reality or other areas of interest.
###


Previous Patent Application:
Adjustable wheelchair handrim with movable friction band
Next Patent Application:
Adjustment mechanisms for adjustable bent housings
Industry Class:

Thank you for viewing the Adjusting dimensioning results using augmented reality patent info.
- - -

Results in 0.09795 seconds


Other interesting Freshpatents.com categories:
Computers:  Graphics I/O Processors Dyn. Storage Static Storage Printers

###

Data source: patent applications published in the public domain by the United States Patent and Trademark Office (USPTO). Information published here is for research/educational purposes only. FreshPatents is not affiliated with the USPTO, assignee companies, inventors, law firms or other assignees. Patent applications, documents and images may contain trademarks of the respective companies/authors. FreshPatents is not responsible for the accuracy, validity or otherwise contents of these public document patent application filings. When possible a complete PDF is provided, however, in some cases the presented document/images is an abstract or sampling of the full patent application for display purposes. FreshPatents.com Terms/Support
-g2-0.2737

66.232.115.224
Browse patents:
Next
Prev

stats Patent Info
Application #
US 20170017301 A1
Publish Date
01/19/2017
Document #
14801023
File Date
07/16/2015
USPTO Class
Other USPTO Classes
International Class
/
Drawings
7


Augmented Reality By Hand

Follow us on Twitter
twitter icon@FreshPatents

Hand Held Products, Inc.


Browse recent Hand Held Products, Inc. patents





Browse patents:
Next
Prev
20170119|20170017301|adjusting dimensioning results using augmented reality|A system and method for using an augmented reality interface to adjust the results from a dimensioning system are disclosed. The augmented reality interface allows users to easily correct dimensioning errors, improve dimensioning results, and guide dimensioning analysis. In one embodiment, the user may adjust/select the results via hand gesturing/positioning |Hand-Held-Products-Inc
';