Learning Technique and the Stochastic Approximation Method

One of the main aims of contemporary theory o f a d a p t i v e , l e a r n i n g and s e l f l e a r n i n g systems i s the u n i f i c a t i o n o f the p r o b lems of a d a p t a t i o n , l e a r n i n g and s e l f l e a r n i n g from one p o i n t o f v i e w , i . e . t h e de t e r m i n a t i o n o f the a p p r o p r i a t e mathemat i c a l t echn ique which would be ab le to s o l v e as l a r g e a c l a s s of problems as p o s s i b l e . T h e o r e t i c a l l y i t seems t h a t the t h e o r y o f s t o c h a s t i c a p p r o x i m a t i o n cou ld s o l v e t h i s p rob lem 9 1 4 . I n the l e a r n i n g problem o f d i v i d i n g i n p u t s i t u a t i o n s i n t o n c l a s s e s , i t i s poss i b l e in a d e t e r m i n i s t i c case to cons ide r the l e a r n i n g i s i s known 1 2 -as an a p p r o x i ma t i on o f the f u n c t i o n , w h i c h d i v i d e s two d i s j o i n t c l a s s e s . L e t t h i s d e c i s i o n f u n c t i o n b e w r i t t e n a s