Bidding Strategy on Demand Side Using Eligibility Traces Algorithm

Restructuring in the power industry is followed by splitting different parts and creating a competition between purchasing and selling sections. As a consequence, through an active participation in the energy market, the service provider companies and large consumers create a context for overcoming the problems resulted from lack of demand side participation in the market. The most prominent challenge for customers on demand side, is bidding strategy selection manner for attending in the competitive market. In this regard, they attempt to pay the least expense for purchasing the energy, while tolerating the least risk. In this paper, bidding strategy of service provider companies and the large consumers in the power market is proposed under the eligibility traces algorithm. In this algorithm, the demand side customers are considered as agents of Reinforcement Learning (RL). These agents learn through interaction with environment to bid such that earn the highest benefit.