Systematic N-tuple Networks for Position Evaluation: Exceeding 90% in the Othello League
نویسنده
چکیده
N-tuple networks have been successfully used as position evaluation functions for board games such as Othello or Connect Four. The effectiveness of such networks depends on their architecture, which is determined by the placement of constituent n-tuples, sequences of board locations, providing input to the network. The most popular method of placing ntuples consists in randomly generating a small number of long, snake-shaped board location sequences. In comparison, we show that learning n-tuple networks is significantly more effective if they involve a large number of systematically placed, short, straight n-tuples. Moreover, we demonstrate that in order to obtain the best performance and the steepest learning curve for Othello it is enough to use n-tuples of size just 2, yielding a network consisting of only 288 weights. The best such network evolved in this study has been evaluated in the online Othello League, obtaining the performance of nearly 96% — more than any other player to date.
منابع مشابه
Learning to Play Othello with N -Tuple Systems
This paper investigates the use of n-tuple systems as position value functions for the game of Othello. The architecture is described, and then evaluated for use with temporal difference learning. Performance is compared with previously developed weighted piece counters and multi-layer perceptrons. The n-tuple system is able to defeat the best performing of these after just five hundred games o...
متن کاملEffect of look-ahead search depth in learning position evaluation functions for Othello using epsilon-greedy exploration
This paper studies the effect of varying the depth of look-ahead for heuristic search in temporal difference (TD) learning and game playing. The acquisition position evaluation functions for the game of Othello is studied. The paper provides important insights into the strengths and weaknesses of using different search depths during learning when 2-greedy exploration is applied. The main findin...
متن کاملTranslation Strategies of Culture-Specific Items from English to Persian in Translation of "Othello"
This study investigated the translation strategies of culture-specific items in translation of 'Othello' by William Shakespeare into Persian by Abdolhossein Nooshin. First, the English culture-specific items and their corresponding translations were identified. Then, the frequency of the strategies used by the translator according to Newmark's translation model and Venuti's domestication and fo...
متن کاملTeaching the HONEST Neural Network to Judge the Strength of Othello Positions
Bayesian learning, a statistical method, has been successfully applied to the feature combination stage of the evaluation function of the Othello program BILL, which won the 1989 North American Computer World Othello Championship. We have investigated the use of a novel neural network called HONEST in place of Bayesian learning in BILL. We implemented HONEST in six of BILL's twenty-six evaluati...
متن کاملFactors affecting brand loyalty sports apparel purchase decision makers in the Premier League football clubs
Today, the brand's customer loyalty is key to business success, Many companies try to increase loyalty among customers to expand their brand. The aim of this study was to identify factors influencing the loyalty of purchase decision makers of the clubs and football players to sports apparel brand in the eleventh round of the Premier football League. Methodology of this research was surveying an...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید
ثبت ناماگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید
ورودعنوان ژورنال:
- CoRR
دوره abs/1406.1509 شماره
صفحات -
تاریخ انتشار 2014