4599692 : Probabilistic learning element employing context drive searching
INVENTORS: Tan; Chuan-Chieh, Orange, CT
Slack; Thomas B., Oxford, CT
Denenberg; Jeffrey N., Trumbull, CT
ASSIGNEES: ITT Corporation, New York, NY
ISSUED:July 8 , 1986 FILED: Jan. 16, 1984
SERIAL NUMBER: 571223 MAINT. STATUS:
INTL. CLASS (Ed. 4): G06K 9/62; G06F 1/00; G06F 15/00;
U.S. CLASS:364-513; 364-200; 364-900; 382-015;
FIELD OF SEARCH: 364-134,148,149,200,300,513,728,817,900 ; 382-015< ;
AGENTS: Van Der Sluys; Peter C.;

ABSTRACT:   A probabilistic learning element for performing task independent sequential pattern recognition employs context driven searching. The element receives sequences of objects and outputs sequences of recognized states composed of objects. The element includes a short term memory for storing received objects in sequential context and long term memories for storing in sequential context previously learned states and predetermined types of knowledge relating to the previously learned states. The element correlates the information stored in the short term memory with information stored in the long term memories for assigning probabilities to possible next states in the sequence of recognized states. The correlation is facilitated by using the context of the information stored in the short term memory as a pointer to the context of the information stored in the long term memories. Based upon the probabilities of the possible next states the most likely next state is determined and outputted as a recognized next state in the recognized state sequence when the element determines that a state has ended. The element additionally includes means for providing a rating of confidence in the recognized next state. The ratings of confidence for a sequence of recognized states are accumulated and if the accumulated value exceeds a predetermined threshold level the element will be caused to store the recognized state sequence as a learned state sequence.

U.S. REFERENCES:22 patents reference this one
Patent No. Inventor Issued Title
3103648 * Hartmanis9 /1963  
3196399 * Kamentsky7 /1965  
3267431 * Greenberg8 /1966  
3414885 * Muller12 /1968  
3440617 * Lesti4 /1969  
3446950 * King, Jr.5 /1969  
3457552 * Asendorf7 /1969  
3562502 * Kautz8 /1967 CELLULAR THRESHOLD ARRAY FOR PROVIDING OUTPUTS REPRESENTING A COMPLEX WEIGHTING FUNCTION OF INPUTS
3581281 Martin5 /1971 PATTERN RECOGNITION COMPUTER
3588823 Chow6 /1971  
3601811 Yoshino8 /1971 LEARNING MACHINE
3613084 Armstrong10 /1971 TRAINABLE DIGITAL APPARATUS
3623015 Schmitz et al.11 /1971 STATISTICAL PATTERN RECOGNITION SYSTEM WITH CONTINUAL UPDATE OF ACCEPTANCE ZONE LIMITS
3638196 Nishiyama et al.1 /1972 LEARNING MACHINE
3646329 Yoshino et al.2 /1972 ADAPTIVE LOGIC CIRCUIT
3678461 Choate et al.7 /1972 EXPANDED SEARCH FOR TREE ALLOCATED PROCESSORS
3700866 Taylor10 /1972 SYNTHESIZED CASCADED PROCESSOR SYSTEM
3701974 Rusell10 /1972 LEARNING CIRCUIT
3702986 Taylor et al.11 /1972 TRAINABLE ENTROPY SYSTEM
3715730 Smith et al.2 /1973 MULTI-CRITERIA SEARCH PROCEDURE FOR TRAINABLE PROCESSORS
3716840 Masten et al.2 /1973 MULTIMODAL SEARCH
3725875 Choate et al.4 /1973 PROBABILITY SORT IN A STORAGE MINIMIZED OPTIMUM PROCESSOR
3753243 Ricketts, Jr. et al.8 /1973 PROGRAMMABLE MACHINE CONTROLLER
3772658 Sarlo11 /1973 ELECTRONIC MEMORY HAVING A PAGE SWAPPING CAPABILITY
3934231 Armstrong1 /1976 Adaptive boolean logic element
3950733 Cooper et al.4 /1976 Information processing system
3988715 Mullan et al.10 /1976 Multi-channel recognition discriminator
3999161 van Bilzem et al.12 /1976 Method and device for the recognition of characters, preferably of figures
4066999 Spanjersberg1 /1978 Method for recognizing characters
4100370 Suzuki et al.7 /1978 Voice verification system based on word pronunciation
4189779 Brautingham2 /1980 Parameter interpolator for speech synthesis circuit
4286330 Isaacson8 /1981 Autonomic string-manipulation system
4318083 Argyle3 /1982 Apparatus for pattern recognition
4384273 Ackland et al.5 /1983 Time warp signal recognition processor for matching signal patterns
4450530 Llinas et al.5 /1984 Sensorimotor coordinator
4504970 Werth et al.3 /1985 Training controller for pattern processing system
4507760 Fraser3 /1985 First-in, first-out (FIFO) memory configuration for queue storage
  * some details unavailable

EXEMPLARY CLAIM(s): Show all 20 claims

    What is claimed is:
    • 1. A probabilistic learning element, that sequentially receives objects and outputs sequences of recognized states and includes context driven searching, said learning element comprising:
      • means for sequentially receiving objects;
      • long term memory means for storing in sequential context,
        • previously learned states,
        • objects contained in said previously learned states, and
        • predetermined types of knowledge relating to said stored previously learned states and said objects contained in said previously learned states, whereby from any stored information in
        • said long term memory means the stored information which occurs next in context is directly accessible;
      • short term memory means for storing in sequential context said received objects;
      • means for correlating said received objects stored in said short term memory means with information stored in said long term memory means, said correlation being facilitated by using the context of said objects stored in said short term memory means as a pointer to the context of said information stored in said long term memory means, said correlating means assigning probabilities to possible next states in a sequence of recognized states;
      • means, responsive to said probabilities of possible next states, for determining a most likely next state;
      • means, responsive to said objects stored in said short term memory means and said information stored in said long term memory means, for providing a signal corresponding to a probability that a state has ended; and
      • means, responsive to said end of state signal, for outputting said most likely next state as a recognized next state in a recognized state sequence.

    RELATED U.S. APPLICATIONS: none

    FOREIGN APPLICATION PRIORITY DATA: none
    FOREIGN REFERENCES: none

    OTHER REFERENCES:

    • Roberts, "Artificial Intelligence", Byte, Sep. 1981, 164-178.
    • Jackson, Jr., "Introduction to Artificial Intelligence", Petrocelli, New York, 1974.
    • Healy, Machine Intelligence and Communications in Future NASA Missions", IEEE Communications, vol. 19, No. 6, pp. 8-15.
    • Bennett, Jr., "How Artificial is Intelligence", American Scientist, vol. 65, pp. 694-702.
    PRIMARY/ASSISTANT EXAMINERS: Smith; Jerry; Grossman; Jon D.
    ADDED TO DATABASE: Aug. 22, 1996