Video processing system and method with dynamic tag architecture

US 7,738,740 B2
Filed: 07/15/2005
Issued: 06/15/2010
Est. Priority Date: 01/13/2005
Status: Active Grant

First Claim

Patent Images

1. A method for operating an image processing system, comprising:

processing a pixel or pixels of interest with the image processing system using a selected implementation of an image processing operation, the selected implementation being one of a set of available implementations for the image processing operation;

obtaining calibration data;

modifying the set of available implementations based on the calibration data so that the set of available implementations includes at least one previously unavailable implementation; and

processing a subsequent pixel or subsequent pixels of interest with the image processing system after modifying the set of available implementations.

View all claims

3 Assignments

Timeline View

Assignment View

0 Petitions

Accused Products

Abstract

An image processing system and method, in which an image processing operation is performed on a pixel or pixels by selecting and applying one of a plurality of implementations of the image processing operation. The plurality of implementations is varied from time to time, such that one or more of the implementations is replaced with a different implementation or implementations.

81 Citations

View as Search Results

38 Claims

1. A method for operating an image processing system, comprising:
- processing a pixel or pixels of interest with the image processing system using a selected implementation of an image processing operation, the selected implementation being one of a set of available implementations for the image processing operation;
  
  obtaining calibration data;
  
  modifying the set of available implementations based on the calibration data so that the set of available implementations includes at least one previously unavailable implementation; and
  
  processing a subsequent pixel or subsequent pixels of interest with the image processing system after modifying the set of available implementations.
- View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9)
- - 2. The method of claim 1, further comprising reading the set of available implementations from a first memory medium and writing the set of available implementations into a second memory medium.
  - 3. The method of claim 2, where the second memory medium has a faster access time than the first memory medium.
  - 4. The method of claim 3, where modifying the set of available implementations includes replacing one or more of the implementations with a different implementation or implementations, the different implementations being loaded from the first memory medium into the second memory medium.
  - 5. The method of claim 1, where the calibration data includes tag data associated with pixels being processed using said method.
  - 6. The method of claim 5, where the tag data includes classification information associated with pixels being processed using said method.
  - 7. The method of claim 5, where the tag data includes processing information associated with pixels being processed using said method.
  - 8. The method of claim 1, where the calibration data includes usage information pertaining to past usage of the set of available implementations.
  - 9. The method of claim 8, where the usage information includes frequency-of-use data for the set of available implementations, and where modifying the set of available implementations includes replacing a lesser-used implementation in the set of available implementations.

10. A method for operating an image processing system, comprising:
- for an image analysis or processing operation, providing a plurality of implementations of such image analysis or processing operation;
  
  analyzing or processing a first group of pixels with the image processing system using one or more of the plurality of implementations; and
  
  modifying the plurality of implementations, and then analyzing or processing a second group of pixels with the image processing system using one or more of the plurality of implementations of the image analysis or processing operation,where modifying the plurality of implementations includes retrieving one or more different implementations from a first memory medium and loading them into a second memory medium containing the plurality of implementations.
- View Dependent Claims (11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27)
- - 11. The method of claim 10, where the given image analysis or processing operation is a deinterlacing operation.
  - 12. The method of claim 11, where the plurality of implementations is modified based on motion detected in the first group of pixels.
  - 13. The method of claim 10, where the image analysis or processing operation is an image interpolation operation.
  - 14. The method of claim 10, where the image analysis or processing operation is a color processing operation.
  - 15. The method of claim 10, where the image analysis or processing operation is a motion estimation operation.
  - 16. The method of claim 10, further comprising dynamically varying the plurality of different implementations during processing of a video stream, where such dynamic variation is based on characteristics of the video stream.
  - 17. The method of claim 10, further comprising dynamically varying the plurality of different implementations during processing of a video stream, where such dynamic variation is based on prior usage of the plurality of implementations.
  - 18. The method of claim 17, where such dynamic variation is based on frequency of usage of one or more of the plurality of different implementations.
  - 19. The method of claim 10, where providing the plurality of implementations is initially performed based on source identification information associated with an incoming video signal.
  - 20. The method of claim 19, where the source identification information is analyzed to determine a broadcast method for the incoming video signal.
  - 21. The method of claim 19, where the source identification information is analyzed to determine a device type for the incoming video signal.
  - 22. The method of claim 19, where the source identification information is analyzed to determine a format for the incoming video signal.
  - 23. The method of claim 19, where the source identification information is analyzed to determine a digital quality level for the incoming video signal.
  - 24. The method of claim 10, further comprising processing the first group of pixels using a plurality of image processing operations, each of the image processing operations being dynamically controlled based on changing tag data associated with the first group of pixels.
  - 25. The method of claim 24, where the tag data includes classification information pertaining to characteristics of one or more pixels contained in the first group of pixels.
  - 26. The method of claim 24, where the tag data includes processing information pertaining to processing operations applied to one or more pixels contained in the first group of pixels.
  - 27. The method of claim 24, where the tag data includes source identification information associated with one or more pixels contained in the first group of pixels.

28. An image processing system, comprising:
- a pixel processing subsystem configured to receive input pixels and process the input pixels so as to produce output pixels, where processing the input pixels includes selecting a selected implementation of an image processing operation, the selected implementation being selected from a plurality of loaded implementations of the image processing operation,where the image processing system is configured to calibrate the pixel processing subsystem from time to time by unloading one or more of the loaded implementations and loading a different implementation or implementations so that replacement of one or more of the loaded implementations is based on usage information for the loaded implementations.
- View Dependent Claims (29, 30, 31, 32, 33, 34, 35, 38)
- - 29. The system of claim 28, where the image processing system is configured so that replacement of one or more of the loaded implementations is based on tag data associated with the input pixels.
  - 30. The system of claim 29, where the tag data includes classification information pertaining to characteristics of the input pixels.
  - 31. The system of claim 29, where the tag data includes processing information pertaining to processing operations applied to the input pixels.
  - 32. The system of claim 29, where the tag data includes source identification information associated with the input pixels.
  - 33. The system of claim 28, where the image processing system is configured to replace, based on analysis of the usage information, a lesser-used one of the loaded implementations.
  - 34. The system of claim 28, where the pixel processing subsystem is configured to perform multiple different pixel processing operations on the input pixels, where each of the pixel processing operations is dynamically controllable based on tag data associated with the input pixels, and where the tag data dynamically and successively changes as the input pixels are successively processed by the multiple different pixel processing operations.
  - 35. The system of claim 28, further comprising a first memory medium and a second memory medium, the loaded implementations being read from the first memory medium and loaded into the second memory medium.
  - 38. The system of claim 35, where the second memory medium has a faster access time than the first memory medium.

36. An integrated circuit, comprising:
- image processing logic configured to process pixels of video data by selecting a selected implementation of an image processing operation from a plurality of loaded implementations; and
  
  controller and classifier logic configured to control operation of the image processing logic and calibrate the image processing logic from time to time by unloading one or more of the loaded implementations and loading a different implementation or implementations,where the controller and classifier logic is configured so that replacement of one or more of the loaded implementations is based on usage information for the loaded implementations.

37. A method for operating an image processing system, comprising:
- repeatedly performing an image processing operation on a pixel or pixels of digital video data by selecting and applying one of a plurality of implementations of the image processing operation; and
  
  varying the plurality of implementations from time to time while repeatedly performing the image processing operation, such that one or more of the implementations is replaced with a previously unavailable implementation or implementations.

Specification

Resources

Litigation Campaign Assessment

Current Assignee
NVIDIA Corporation
Original Assignee
NVIDIA Corporation
Inventors
Ruggiero, Carl J.
Primary Examiner(s)
TUCKER, WESLEY J

Application Number

US11/182,728
Publication Number

US 20060153474A1
Time in Patent Office

1,796 Days
Field of Search

382302-308
US Class Current

382/302
CPC Class Codes

G06T 1/20   Processor architectures; Pr...

H04N 21/42692   for reading from or writing...

H04N 21/44008   involving operations for an...

H04N 21/4402   involving reformatting oper...

H04N 21/4621   Controlling the complexity ...

H04N 5/144   Movement detection for vide...

H04N 5/145   Movement estimation for vid...

H04N 5/46   for receiving on more than ...

H04N 7/012   Conversion between an inter...

H04N 7/0135   involving interpolation pro...

H04N 7/0145   the interpolation being cla...

Video processing system and method with dynamic tag architecture

First Claim

3 Assignments

0 Petitions

Accused Products

Abstract

81 Citations

38 Claims

Specification

Solutions

Use Cases

Quick Links

Video processing system and method with dynamic tag architecture

First Claim

3 Assignments

Subscription Required

Subscription Required

0 Petitions

Subscription Required

Accused Products

Subscription Required

Abstract

81 Citations

38 Claims

Specification

Subscription Required

Solutions

Use Cases

Quick Links