The original modified method of the direct delayed reaction has been used for the evaluation of food-obtaining strategy across spatial learning tasks in T-maze alternation. The optimal behavioral algorithms for each experimental day have been identified so that the animals obtain maximum possible food amount with minimal number of mistakes. Markov chain method has been used for the prognosis of rat’s behavioral strategy during the spatial learning task. The learning and decision-making represent the probabilistic transition process where the animal choice at each step (state) depends on the learning experience from previous step (state).
Macdonald, I.L. and Raubenheimer, D. (1995) Hidden Markov Models and Animal Behaviour. Biometrical Journal, 37, 701-712. http://dx.doi.org/10.1002/bimj.4710370606
Granovskiy, B. (2012) Modeling Collective Decision-Making in Animal Groups. Department of Mathematics, Uppsala Dissertations in Mathematics, Uppsala.
Houillon, A., Lorenz, R.C., Boehmer, W., Rapp, M.A., Heinz, A., Gallinat, J. and Obermayer, K. (2013) The Effect of Novelty on Reinforcement Learning. Progress in Brain Research, 202, 415-439. http://dx.doi.org/10.1016/B978-0-444-62604-2.00021-6
Mathew, B., Bauer, A.M, Koistinen, P., Reetz, T.C., Léon, J. and Sillanpaa, M.J. (2012) Bayesian Adaptive Markov Chain Monte Carlo Estimation of Genetic Parameters. Heredity, 109, 235-245. http://dx.doi.org/10.1038/hdy.2012.35
Smith, A.C., Wirth, S., Suzuki, W.A. and Brown, E.N. (2007) Bayesian Analysis of Interleaved Learning and Response Bias in Behavioral Experiments. Journal of Neurophysiology, 97, 2516-2524. http://dx.doi.org/10.1152/jn.00946.2006
Tejada, J., Bosco, G.G., Morato, S. and Roque, A.C. (2010) Characterization of the Rat Exploratory Behavior in the Elevated Plus-Maze with Markov Chains. Journal of Neuroscience Methods, 193, 288-295. http://dx.doi.org/10.1016/j.jneumeth.2010.09.008
Von Sydow, M., Hagmayer, Y. and Meder, B. (2015) Transitive Reasoning Distorts Induction in Causal Chains. Memory & Cognition, in press.
Zin, T.T., Tin, P., Toriu, T. and Hama, H. (2012) A Series of Stochastic Models for Human Behavior Analysis. IEEE International Conference on Systems, Man, and Cybernetics (SMC), Seoul, 14-17 October 2012, 3251-3256. http://dx.doi.org/10.1109/icsmc.2012.6378292
Solway, A. and Botvinick, M.M. (2012) Goal-Directed Decision Making as Probabilistic Inference: A Computational Framework and Potential Neural Correlates. Psychological Review, 119, 120-154. http://dx.doi.org/10.1037/a0026435
Blaettler, F., Kollmorgen, S., Herbst, J. and Hahnloser, R. (2011) Hidden Markov Models in the Neurosciences. In: Dymarski, P., Ed., Hidden Markov Models, Theory and Applications, InTech Publisher, Rijeka, 69-186. http://dx.doi.org/10.5772/601
Hanks, E.M., Hooten, M.B. and Alldredge, M.W. (2015) Continuous-Time Discrete-Space Models for Animal Movement. The Annals of Applied Statistics, 9, 145-165. http://dx.doi.org/10.1214/14-AOAS803
Arantes, R., Tejada, J., Bosco, G.G., Morato, S. and Roque, A.C. (2013) Mathematical Methods to Model Rodent Behavior in the Elevated Plus-Maze. Journal of Neuroscience Methods, 220, 141-148. http://dx.doi.org/10.1016/j.jneumeth.2013.04.022
Khodadadi, A., Fakhari, P. and Busemeyer, J.R. (2014) Learning to Maximize Reward Rate: A Model Based on Semi-Markov Decision Processes. Frontiers in Neuroscience, 8, 101. http://dx.doi.org/10.3389/fnins.2014.00101
Linderman, S.W., Johnson, M.J., Wilson, M.A. and Chen, Z. (2014) A Nonparametric Bayesian Approach to Uncovering Rat Hippocampal Population Codes during Spatial Navigation. CBMM Memo, 027. http://arxiv.org/abs/1411.7706
Stamateli, A. and Tsagareli, S. (2003) Evaluation of Optimum Algorithm by Testing on Modified Direct Delayed Reaction. Proceedings of the Georgian Academy of Sciences, 1, 70-73.
Ito, M. and Doya, K. (2011) Multiple Representations and Algorithms for Reinforcement Learning in the Cortico-Basal Ganglia Circuit. Current Opinion in Neurobiology, 3, 368-373. http://dx.doi.org/10.1016/j.conb.2011.04.001
Schliehe-Diecks, S., Kappeler, P.M. and Langrock, R. (2012) On the Application of Mixed Hidden Markov Models to Multiple Behavioural Time Series. Interface Focus, 2, 180-189. http://dx.doi.org/10.1098/rsfs.2011.0077
Zilli, E.A. and Hasselmo, M.E. (2008) The Influence of Markov Decision Process Structure on the Possible Strategic Use of Working Memory and Episodic Memory. PLoS ONE, 3, e2756. http://dx.doi.org/10.1371/journal.pone.0002756
Lloyd, K., Becker, N., Jones, M.W. and Bogacz, R. (2012) Learning to Use Working Memory: A Reinforcement Learning Gating Model of Rule Acquisition in Rats. Frontiers in Computational Neuroscience, 6, 87. http://dx.doi.org/10.3389/fncom.2012.00087
Huh, N., Jo, S., Kim, H., Jung, H.S. and Min, W.J. (2009) Model-Based Reinforcement Learning under Concurrent Schedules of Reinforcement in Rodents. Learning and Memory, 16, 315-323. http://dx.doi.org/10.1101/lm.1295509
Chen, Z., Kloosterman, F., Brown, E.N. and Wilson, M.A. (2012) Uncovering Spatial Topology Represented by Rat Hippocampal Population Neuronal Codes. Journal of Computational Neuroscience, 33, 227-255. http://dx.doi.org/10.1007/s10827-012-0384-x
Gomes, C.F., Brainerd, C.J., Nakamura, K. and Reyna, V.F. (2014) Markovian Interpretations of Dual Retrieval Processes. Journal of Mathematical Psychology, 59, 50-64. http://dx.doi.org/10.1016/j.jmp.2013.07.003
Huang, Y. and Rao, R.P.N. (2013) Reward Optimization in the Primate Brain: A Probabilistic Model of Decision Making under Uncertainty. PLoS ONE, 8, e53344. http://dx.doi.org/10.1371/journal.pone.0053344
Vevea, J.L. (2006) Recovering Stimuli from Memory: A Statistical Method for Linking Discrimination and Reproduction Responses. British Journal of Mathematical and Statistical Psychology, 59, 321-346. http://dx.doi.org/10.1348/000711005X73754
Whitehead, H. and Jonsen, I.D. (2013) Inferring Animal Densities from Tracking Data Using Markov Chains. PLoS ONE, 8, e60901. http://dx.doi.org/10.1371/journal.pone.0060901
Costa, A.A., Roque, A.C., Morato, S. and Tinós, R. (2012) A Model Based on Genetic Algorithm for Investigation of the Behavior of Rats in the Elevated Plus-Maze. Intelligent Data Engineering and Automated Learning—IDEAL, the Series Lecture Notes in Computer Science, 19, 151-158. http://dx.doi.org/10.1007/978-3-642-32639-4_19
McKellar, A.E., Roland, L.R., Walters, J.R. and Kesler, D.C. (2014) Using Mixed Hidden Markov Models to Examine Behavioral States in a Cooperatively Breeding Bird. Behavioral Ecology, 26, 148-157. http://dx.doi.org/10.1093/beheco/aru171
Rao, R.P.N. (2010) Decision Making under Uncertainty: A Neural Model Based on Partially Observable Markov Decision Processes. Frontiers in Computational Neuroscience, 4, 146. http://dx.doi.org/10.3389/fncom.2010.00146
Dileep, G. and Hawkins, G.D. (2009) Towards a Mathematical Theory of Cortical Micro-circuits. PLoS Computational Biology, 5, e1000532.
Zhang, J. (2009) Adaptive Learning via Selectionism and Bayesianism, Part II: The Sequential Case. Neural Networks, 22, 229-236. http://dx.doi.org/10.1016/j.neunet.2009.03.017