Aircraft Collision Avoidance Using Monte Carlo Real-Time Belief Space Search

Journal of Intelligent and Robotic Systems - 2011
Travis B. Wolf1, Mykel J. Kochenderfer
1[Lincoln Laboratory, Massachusetts Institute of Technology, Lexington, USA]

Tóm tắt

The aircraft collision avoidance problem can be formulated using a decision-theoretic planning framework where the optimal behavior requires balancing the competing objectives of avoiding collision and adhering to a flight plan. Due to noise in the sensor measurements and the stochasticity of intruder state trajectories, a natural representation of the problem is as a partially-observable Markov decision process (POMDP), where the underlying state of the system is Markovian and the observations depend probabilistically on the state. Many algorithms for finding approximate solutions to POMDPs exist in the literature, but they typically require discretization of the state and observation spaces. This paper investigates the introduction of a sample-based representation of state uncertainty to an existing algorithm called Real-Time Belief Space Search (RTBSS), which leverages branch-and-bound pruning to make searching the belief space for the optimal action more efficient. The resulting algorithm, called Monte Carlo Real-Time Belief Space Search (MC-RTBSS), is demonstrated on encounter scenarios in simulation using a beacon-based surveillance system and a probabilistic intruder model derived from recorded radar data.

Từ khóa


Tài liệu tham khảo

Espindle, L.P., Griffith, J.D., Kuchar, J.K.: Safety analysis of upgrading to TCAS version 7.1 using the 2008 U.S. correlated encounter model. Project Report ATC-349, Lincoln Laboratory, Lexington, Mass. (2009)

Frazzoli, E., Dahleh, M.A., Feron, E.: Real-time motion planning for agile autonomous vehicles. AIAA Journal of Aerospace Computing, Information, and Communication 25, 116–129 (2004)

Kaelbling, L.P., Littman, M.L., Cassandra, A.R.: Planning and acting in partially observable stochastic domains. Artif. Intell. 101, 99–134 (1998)

Kochenderfer, M., Kuchar, J., Espindle, L., Griffith, J.: Uncorrelated encounter model of the national airspace system version 1.0. Project Report ATC-345, Lincoln Laboratory, Lexington, Mass. (2008)

Kuchar, J.K., Drumm, A.C.: The traffic alert and collision avoidance system. Linc. Lab. J. 16(2), 277–296 (2007)

Kurniawati, H., Hsu, D., Lee, W.S.: SARSOP: efficient point-based POMDP planning by approximating optimally reachable belief spaces. In: Proceedings in Robotics: Science and Systems (2008)

Lawrence, D., Pisano, W.: Lyapunov vector fields for autonomous unmanned aircraft flight control. J. Guid. Control Dyn. 31(5), 1220–1229 (2008)

Neapolitan, R.: Learning Bayesian Networks. Pearson Prentice Hall, Upper Saddle River, NJ (2004)

Paquet, S., Tobin, L., Chaib-draa, B.: Real-time decision making for large POMDPs. In: Advances in Artificial Intelligence (LNAI 3501), pp. 450–455 (2005)

Pineau, J., Gordon, G., Thrun, S.: Point-based value iteration: An anytime algorithm for POMDPs. In: International Joint Conference on Artificial Intelligence (IJCAI), pp. 1025–1032. Acapulco, Mexico (2003)

Ross, S., Pineau, J., Paquet, S., Chaib-draa, B.: Online planning algorithms for POMDPs. J. Artif. Intell. Res. 32, 663–704 (2008)

RTCA: Minimum operational performance standards for traffic alert and collision avoidance system II (TCAS II) airborne equipment. Tech. rep., RTCA/DO-185A, Washington, D.C. (1997)

Schouwenaars, T., Mettler, B., Feron, E., How, J.: Hybrid model for trajectory planning of agile autonomous aerial vehicles. Journal of Aerospace Computing, Information, and Communication, Special Issue on Intelligent Systems 1, 629–651 (2004)

Smith, T., Simmons, R.G.: Heuristic search value iteration for POMDPs. In: Proc. Int. Conf. on Uncertainty in Artificial Intelligence (UAI) (2004)

Srinivasan, R.: Importance Sampling: Applications in Communications and Detection. Springer-Verlag, Berlin, Germany (2002)

Sundqvist, B.G.: Auto-ACAS—robust nuisance-free collision avoidance. In: Proceedings of the 44th IEEE Conference on Decision and Control and European Control Conference, pp. 3961–3963. IEEE (2005)

Thrun, S.: Monte Carlo POMDPs. In: Solla, S., Leen, T., Müller, K.R. (eds.) Advances in Neural Information Processing Systems 12, pp. 1064–1070. MIT Press (2000)

Winder, L.F.: Hazard avoidance alerting with Markov decision processes. Ph.D. thesis, MIT, Cambridge, Mass. (2004)

Thông tin
Thông tin xuất bản

Journal of Intelligent and Robotic Systems

Thông tin tác giả