| Temporal error concealment for video communications -> Monitor Keywords |
|
|
 
Temporal error concealment for video communicationsRelated Patent Categories: Pulse Or Digital Communications, Bandwidth Reduction Or Expansion, Television Or Motion Video Signal, Predictive, Motion VectorTemporal error concealment for video communications description/claimsThe Patent Description & Claims data below is from USPTO Patent Application 20060133495, Temporal error concealment for video communications. Brief Patent Description - Full Patent Description - Patent Application Claims
FIELD [0001] Embodiments of the present invention pertain to the processing of multimedia data, and in particular to the decoding (decompressing) of video data. BACKGROUND [0002] Media systems transmit media data, such as video data, over wired and/or wireless channels. Data transmitted over such channels may be lost or corrupted or may experience delays along the way, perhaps arriving late at its destination. Late or lost data can be particularly troublesome for video data that are predictively encoded (compressed) using techniques such as but not limited to MPEG (Moving Pictures Experts Group) encoding. Predictive encoding introduces dependencies in the encoded data, so that the decoding of some data depends on the decoding of other data. While predictive encoding generally improves the amount of compression, it can also result in error propagation should data relied on for the decoding of other data be lost or arrive late. Any late or lost data can impact the quality of the reconstructed (decoded or decompressed) video data. However, the impact can be aggravated if the lost or late data is part of a reference frame used for motion compensated prediction because errors will propagate to other frames that are dependent on the reference frame. [0003] For instance, consider a moving object that appears in different positions in successive frames of video data. Using predictive encoding techniques, the object is described by data in the first frame, but in the second frame the object is described using a motion vector that describes how the object moved from the first frame to the second frame. Thus, only the data for the motion vector needs to be transmitted in the second frame, improving the amount of compression because the data describing the object does not need to be retransmitted. However, if the motion vector is not received, then the object cannot be properly rendered when the second frame is reconstructed into a video image, thus reducing the quality of the reconstructed video. Subsequent frames in which the object appears may also be affected, because they may depend on proper placement of the object in the second frame. [0004] To alleviate the impact of absent (e.g., missing, lost, late or incorrectly received) data on the quality of the reconstructed video, a video decoder can apply an error recovery (e.g., error concealment) process to the received data. Studies have shown that the quality of the reconstructed video can be significantly improved if motion vectors can be recovered (e.g., estimated). Temporal error concealment improves the quality of the reconstructed video by estimating missing or incorrectly received motion vectors in a current frame using properly received information from the current frame and/or preceding frames. In other words, a goal of temporal error concealment is to estimate motion vectors using their spatial as well as temporal associates. [0005] Conventional temporal error concealment techniques are based in the pixel domain. Consider a frame (the current frame) in which a motion vector associated with an area (e.g., a macroblock of interest) in the frame is missing. A set of motion vectors is formed by selecting motion vectors associated with macroblocks that surround the macroblock of interest in the current frame and motion vectors associated with macroblocks that surround the co-located macroblock in the reference frame (the co-located macroblock is the macroblock that is at the same position in the reference frame as the macroblock of interest is in the current frame). With a pixel-domain approach, a measure of distortion is calculated for each of the motion vectors in the set. To evaluate the distortion, pixel values are taken from the reconstructed frame buffer. In a motion select technique, the motion vector that minimizes the distortion measure is chosen as the replacement for the absent motion vector. In a motion search technique, a search for a motion vector that minimizes the distortion measure is performed within, for example, a 3.times.3 window of macroblocks. [0006] Pixel-domain error concealment is problematic because it is computationally complex and time-consuming. Evaluating the distortion for each potential motion vector can require a large number of computations, consuming computational resources and causing delays in the decoding process. Pixel-domain error concealment is most effective when performed after the decoder has finished decoding a frame; hence, the delay introduced by error concealment in the pixel domain may be equivalent to one frame duration. Furthermore, accessing the reconstructed frame buffer to retrieve pixel values for the distortion evaluation takes time, which adds to the delays. [0007] Accordingly, a method and/or system that can reduce computational complexity and decoding delays would be desirable. SUMMARY [0008] Methods and systems for processing video data are described. In one embodiment, a set of candidate motion vectors is selected from motion vectors associated with macroblocks in a first frame of video data and from motion vectors associated with macroblocks in a second frame of the video data. In one embodiment, the first frame precedes the second frame in order of display. A statistical measure of the set is determined. For example, the average or the median of the candidate motion vectors can be determined. The statistical measure defines a motion vector for a macroblock of interest in the second frame. [0009] Various methods can be used to select the candidate motion vectors. The selection of the candidate motion vectors and the determination of a replacement motion vector are performed in the motion vector domain instead of the pixel domain. Consequently, computational complexity and latency are reduced. As an additional benefit, hardware modifications are not required. BRIEF DESCRIPTION OF THE DRAWINGS [0010] FIG. 1 is a block diagram of one example of a system for decoding video data. [0011] FIG. 2 illustrates an example of two frames of image data organized as macroblocks. [0012] FIG. 3 illustrates an example of two image frames showing the motion of an object from one frame to the next. [0013] FIG. 4 is a data flow diagram showing the flow of data from a data encoding process to a data decoding process. [0014] FIG. 5 is a flowchart of a motion vector domain-based temporal error concealment method. [0015] FIG. 6 illustrates the flow of information according to the method of FIG. 5. [0016] FIG. 7 is a flowchart of a method for selecting candidate motion vectors used in a motion vector domain-based temporal error concealment process. [0017] FIG. 8 illustrates the flow of information according to the method of FIG. 7. [0018] FIG. 9 is a flowchart of a method for detecting frame-to-frame motion change and used for selecting candidate motion vectors used in a motion vector domain-based temporal error concealment process. [0019] FIG. 10 is a flowchart of another method for detecting frame-to-frame motion change and used for selecting candidate motion vectors used in a motion vector domain-based temporal error concealment process. [0020] FIG. 11 is a flowchart of a method for locating a motion boundary within a frame and used for selecting candidate motion vectors used in a motion vector domain-based temporal error concealment process. Continue reading about Temporal error concealment for video communications... Full patent description for Temporal error concealment for video communications Brief Patent Description - Full Patent Description - Patent Application Claims Click on the above for other options relating to this Temporal error concealment for video communications patent application. ###  How KEYWORD MONITOR works... a FREE service from FreshPatents1. Sign up (takes 30 seconds). 2. Fill in the keywords to be monitored. 3. Each week you receive an email with patent applications related to your keywords. Start now! - Receive info on patent apps like Temporal error concealment for video communications or other areas of interest. ### Previous Patent Application: Moving-picture compression encoding method, apparatus and program Next Patent Application: Method and system for fast implementation of subpixel interpolation Industry Class: Pulse or digital communications ### FreshPatents.com Support Thank you for viewing the Temporal error concealment for video communications patent info. IP-related news and info Results in 0.39874 seconds Other interesting Feshpatents.com categories: Novartis , Pfizer , Philips , Polaroid , Procter & Gamble , 174 |
 * Protect your Inventions * US Patent Office filing 
PATENT INFO |
|
