Instantly indexed databases for multimedia content analysis and retrieval
DC
First Claim
Patent Images
1. A method for use in indexing, in a database, data associated with a domain-specific event, the method comprising the steps of:
- processing sensor data obtained in accordance with the event in real time, the sensor data comprising motion data of one or more objects or one or more people associated with the domain-specific event;
obtaining pre-existing data associated with the domain-specific event; and
indexing data associated with the domain-specific event in the database, contemporaneous with capture of the data associated with the domain-specific event being indexed, based on at least a portion of the processed real time sensor data and at least a portion of the obtained pre-existing data, wherein the indexing step further comprises generating an index usable to retrieve at least a portion of the data associated with the domain-specific event by creating one or more cross-indexes between at least a portion of the processed real time sensor data and at least a portion of the obtained pre-existing data.
10 Assignments
Litigations
0 Petitions
Accused Products
Abstract
Techniques for indexing multimedia data substantially concurrently or contemporaneously with its capture to convert a real world event into an accessible database in real time are provided. The present invention introduces a new paradigm of converting a real world event in real time into a rich multimedia database by processing data from multiple sensors observing the event. Real time analysis of the sensor data, coupled with domain knowledge, results in instant indexing of multimedia data at capture time itself. This yields the semantic information to answer complex queries about the content, and the ability to extract portions of data that correspond to complex actions performed in the real world.
100 Citations
25 Claims
-
1. A method for use in indexing, in a database, data associated with a domain-specific event, the method comprising the steps of:
-
processing sensor data obtained in accordance with the event in real time, the sensor data comprising motion data of one or more objects or one or more people associated with the domain-specific event; obtaining pre-existing data associated with the domain-specific event; and indexing data associated with the domain-specific event in the database, contemporaneous with capture of the data associated with the domain-specific event being indexed, based on at least a portion of the processed real time sensor data and at least a portion of the obtained pre-existing data, wherein the indexing step further comprises generating an index usable to retrieve at least a portion of the data associated with the domain-specific event by creating one or more cross-indexes between at least a portion of the processed real time sensor data and at least a portion of the obtained pre-existing data. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11)
-
-
12. Apparatus for use in indexing, in a database, data associated with a domain-specific event, the apparatus comprising:
at least one processor operative to;
(i) process sensor data obtained in accordance with the event in real time, the sensor data comprising motion data of one or more objects or one or more people associated with the domain-specific event;
(ii) obtain pre-existing data associated with the domain-specific event; and
(iii) index data associated with the domain-specific event in the database, contemporaneous with capture of the data associated with the domain-specific event being indexed, based on at least a portion of the processed real time sensor data and at least a portion of the obtained pre-existing data, wherein the indexing operation further comprises generating an index usable to retrieve at least a portion of the data associated with the domain-specific event by creating one or more cross-indexes between at least a portion of the processed real time sensor data and at least a portion of the obtained pre-existing data.- View Dependent Claims (13, 14, 15, 16, 17, 18, 19, 20, 21, 22)
-
23. A database system, comprising:
-
at least one processor operative to;
(i) process sensor data obtained in accordance with a domain-specific event in real time, the sensor data comprising motion data of one or more objects or one or more people associated with the domain-specific event;
(ii) obtain pre-existing data associated with the domain-specific event; and
(iii) index data associated with the domain-specific event, contemporaneous with capture of the data associated with the domain-specific event being indexed, based on at least a portion of the processed real time sensor data and at least a portion of the obtained pre-existing data, wherein the indexing operation further comprises generating an index usable to retrieve at least a portion of the data associated with the domain-specific event by creating one or more cross-indexes between at least a portion of the processed real time sensor data and at least a portion of the obtained pre-existing data; anda database structure, coupled to the at least one processor, for storing the data in accordance with the indexing operation.
-
-
24. An article of manufacture for use in indexing, in a database, data associated with a domain-specific event, the article comprising a machine readable medium containing one or more programs which when executed implement the steps of:
-
processing sensor data obtained in accordance with the event in real time, the sensor data comprising motion data of one or more objects or one or more people associated with the domain-specific event; obtaining pre-existing data associated with the domain-specific event; and indexing data associated with the domain-specific event in the database, contemporaneous with capture of the data associated with the domain-specific event being indexed, based on at least a portion of the processed real time sensor data and at least a portion of the obtained pre-existing data, wherein the indexing step further comprises generating an index usable to retrieve at least a portion of the data associated with the domain-specific event by creating one or more cross-indexes between at least a portion of the processed real time sensor data and at least a portion of the obtained pre-existing data. - View Dependent Claims (25)
-
Specification
-
- Resources
Litigation Campaign Assessment
Thank you for your request. You will receive a custom alert email when the Litigation Campaign Assessment is available.
×
Litigation Data
-
Current AssigneeIron Gate Security, Inc. (XpresSpa Group, Inc. (f/k/a FORM Holdings Corp.))
-
Original AssigneeLucent Technologies, Inc. (Nokia Corporation)
-
InventorsCarlbom, Ingrid Birgitta, Jean, Yves D., Opalach, Agata, Pingali, Gopal S.
-
Primary Examiner(s)Coby, Frantz
-
Application NumberUS10/167,534Publication NumberTime in Patent Office1,763 DaysField of Search707/102, 707/100, 707/101, 707/104.1, 707/1, 715/20US Class Current1/1CPC Class CodesG06F 16/784 the detected or recognised ...G06F 16/786 using motion, e.g. object m...G06F 2213/0038 System on ChipG06F 2216/01 Automatic library buildingY10S 707/99931 Database or file accessingY10S 707/99943 Generating database or data...
