An assigned responsibility system for robotic teleoperation control
Tóm tắt
This paper proposes an architecture that explores a gap in the spectrum of existing strategies for robot control mode switching in adjustable autonomy. In situations where the environment is reasonably known and/or predictable, pre-planning these control changes could relieve robot operators of the additional task of deciding when and how to switch. Such a strategy provides a clear division of labour between the automation and the human operator(s) before the job even begins, allowing for individual responsibilities to be known ahead of time, limiting confusion and allowing rest breaks to be planned. Assigned Responsibility is a new form of adjustable autonomy-based teleoperation that allows the selective inclusion of automated control elements at key stages of a robot operation plan’s execution. Progression through these stages is controlled by automatic goal accomplishment tracking. An implementation is evaluated through engineering tests and a usability study, demonstrating the viability of this approach and offering insight into its potential applications.
Tài liệu tham khảo
Argall, B.D., Chernova, S., Veloso, M., Browning, B.: A survey of robot learning from demonstration. Robot. Auton. Syst. 57(5), 469–483 (2009). https://doi.org/10.1016/j.robot.2008.10.024
Chao, C., Cakmak, M., Thomaz, A.L.: Towards grounding concepts for transfer in goal learning from demonstration. In: Development and learning (ICDL), 2011 IEEE International Conference, 2, 1–6. IEEE (2011)
Cote, N., Canu, A., Bouzid, M., Mouaddib, A.I.: Humans–robots sliding collaboration control in complex environments with adjustable autonomy. In: Web intelligence and intelligent agent technology (WI-IAT), 2012 IEEE/WIC/ACM International Conferences, 2, 146–153. IEEE (2012)
Crosby, M., Petrick, R.P.: Centralised high-level planning for a robot fleet. In: Workshop of the UK Planning and scheduling special interest group (PlanSIG 2014), UK (2014)
Dastani, M., Riemsdijk, M.B.V., Meyer, J.J.C.: Goal types in agent programming. In: Proceedings of the 17th European Conference on Artificial Intelligence (ECAI06, pp. 220–224 (2006)
de Jong, I.: Pyro - Python Remote Objects - 4.41 Pyro 4.41 documentation (2016). https://pythonhosted.org/Pyro4/
Deelman, E., Blythe, J., Gil, Y., Kesselman, C., Mehta, G., Patil, S., Su, M.H., Vahi, K., Livny, M.: Pegasus: mapping scientific workflows onto the grid. Grid Comput. 3165, 11–20 (2004)
Ding, J., Qin, Y., Jia, L., Zhu, S., Yu, B.: Soms: a subway operation and maintenance system based on planned maintenance model with train state. J. Intell. Learn. Syst. Appl. 5(4), 195 (2013)
Endsley, M.R.: Level of automation effects on performance, situation awareness and workload in a dynamic control task. Ergonomics 42(3), 462–492 (1999)
Endsley, M.R., Kiris, E.O.: The out-of-the-loop performance problem and level of control in automation. Hum. Fact. J. Hum. Fact. Ergon. Soc. 37(2), 381–394 (1995)
Fischer, P., Daniel, R., Siva, K.: Specification and design of input devices for teleoperation. In: Robotics and Automation, 1990. Proceedings., 1990 IEEE International Conference, pp. 540–545. IEEE (1990)
Foundation, P.S.: Welcome to Python.org. https://www.python.org/ (2017)
Ge, F., Moore, W., Antolovich, M.: Convergence problem in gmm related robot learning from demonstration. Mining intelligence and knowledge exploration, pp. 62–71. Springer, Berlin (2014)
Ghallab, M., Nau, D., Traverso, P.: Automated planning: theory & practice. Elsevier, Amsterdam (2004)
Goodrich, M., Olsen, D., Crandall, J., Palmer, T.: Experiments in adjustable autonomy. In: Proceedings of IJCAI Workshop on autonomy, delegation and control: interacting with intelligent agents, pp. 1624–1629 (2001)
Grier, R.A.: How high is high? A meta-analysis of NASA-TLX global workload scores. Human factors and ergonomics society annual meeting, vol. 59, pp. 1727–1731. SAGE Publications, New York (2015)
Hardin, B., Goodrich, M.A.: On using mixed-initiative control: a perspective for managing large-scale robotic teams. In: Proceedings of the 4th ACM/IEEE international conference on Human robot interaction, pp. 165–172. ACM (2009)
Hart, S.G., Staveland, L.E.: Development of NASA-TLX (Task Load Index): results of empirical and theoretical research. Adv. Psychol. 52, 139–183 (1988)
Hendrickson, C., Au, T.: Project management for construction: fundamental concepts for owners, engineers, architects, and builders. Chris Hendrickson (1989). Available at http://pmbook.ce.cmu.edu/
Kaber, D.B., Onal, E., Endsley, M.R.: Design of automation for telerobots and the effect on performance, operator situation awareness, and subjective workload. Hum. Fact. Ergon. Manuf. 10(4), 409–430 (2000)
Kephart, J.O., Chess, D.M.: The vision of autonomic computing. Computer 36(1), 41–50 (2003)
Kohlbrecher, S., Romay, A., Stumpf, A., Gupta, A., Von Stryk, O., Bacim, F., Bowman, D.A., Goins, A., Balasubramanian, R., Conner, D.C.: Human-robot teaming for rescue missions: Team ViGIR’s Approach to the 2013 DARPA robotics challenge trials. J. Field Robot. 32(3), 21558 (2015). https://doi.org/10.1002/rob.21558/full
Lee, K., Paton, N.W., Sakellariou, R., Deelman, E., Fernandes, A.A., Mehta, G.: Adaptive workflow processing and execution in pegasus. Concur. Comput. Pract. Exp. 21(16), 1965–1981 (2009)
Leymann, F., Roller, D., Thatte, S.: Goals of the BPEL4ws specification. http://www.oasis-open.org/committees/download.php/3249/ (2017)
Mann, G.A.: Quantitative evaluation of human-robot options for maintenance tasks during analogue surface operations. In: Proceedings of the 8th Australian Mars Exploration Conference, pp. 26–34 (2008)
Manschitz, S., Kober, J., Gienger, M., Peters, J.: Learning movement primitive attractor goals and sequential skills from kinesthetic demonstrations. Robot. Auton. Syst. 74, 97–107 (2015)
Martinez-Tenor, A., Fernandez-Madrigal, J.A.: Smoothly adjustable autonomy for the low-level remote control of mobile robots that is independent of the navigation algorithm. In: 2015 23th Mediterranean Conference on Control and Automation (MED), pp. 1071–1078 (2015). 10.1109/MED.2015.7158899
McCurdy, M.: Planning tools for mars surface operations: human–computer interaction lessons learned. In: Aerospace conference, 2009 IEEE, pp. 1–12 (2009)
McCurdy, M.: Planning tools for mars surface operations: human–computer interaction lessons learned. In: 2009 IEEE Aerospace conference, pp. 1–12. IEEE (2009)
Miller, C., Parasuraman, R.: Beyond levels of automation: an architecture for more flexible human-automation collaboration. Hum. Fact. Ergon. Soc. Annu. Meet. 47, 182–186 (2003)
Miller, C.A., Parasuraman, R.: Designing for flexible interaction between humans and automation: delegation interfaces for supervisory control. Hum Fact. J. Hum. Fact. Ergon. Soc. 49(1), 57–75 (2007)
Minguez, J., Montano, L.: Sensor-based robot motion generation in unknown, dynamic and troublesome scenarios. Robot. Auton. Syst. 52(4), 290–311 (2005)
Muszynski, S., Stuckler, J., Behnke, S.: Adjustable autonomy for mobile teleoperation of personal service robots. In: RO-MAN, 2012 IEEE, pp. 933–940. IEEE (2012)
Nas, S.W., Toralde, J.S., Wuest, C., et al.: Offshore managed pressure drilling experiences in asia pacific. In: SPE/IADC Drilling Conference and Exhibition. Society of petroleum engineers (2009)
Ohn-Bar, E., Trivedi, M.M.: Looking at humans in the age of self-driving and highly automated vehicles. IEEE Trans. Intell. Veh. 1(1), 90–104 (2016)
Parasuraman, R., Miller, C.: Delegation interfaces for human supervision of multiple unmanned vehicles: theory, experiments, and practical applications. Advances in human performance and cognitive engineering research, vol. 7, pp. 251–266. Elsevier, Amsterdam (2006)
Parasuraman, R., Riley, V.: Humans and automation: use, misuse, disuse, abuse. Hum. Fact. J. Hum. Fact. Ergon. Soc. 39(2), 230–253 (1997)
Pastor, P., Hoffmann, H., Asfour, T., Schaal, S.: Learning and generalization of motor skills by learning from demonstration. In: Robotics and Automation, 2009. ICRA’09. IEEE International Conference, pp. 763–768. IEEE (2009)
Prewett, M.S., Johnson, R.C., Saboe, K.N., Elliott, L.R., Coovert, M.D.: Managing workload in human-robot interaction: a review of empirical studies. Comput. Hum. Behav. 26(5), 840–856 (2010)
Sacerdoti, E.: A structure for plans and behavior. Elsevier Publishing Company, Amsterdam (1977)
Sellner, B., Heger, F.W., Hiatt, L.M., Simmons, R., Singh, S.: Coordinated multiagent teams and sliding autonomy for large-scale assembly. Proc. IEEE 94(7), 1425–1444 (2006)
Sheridan, T.B., Parasuraman, R.: Human–automation interaction. Rev. Hum. Fact. Ergon. 1(1), 89–129 (2005)
Sheridan, T.B., Verplanck, W.L.: Human computer control of undersea teleoperators. Technical report. MIT Man-Machine Systems Laboratory, Cambridge (1978)
Shneiderman, B., Plaisant, C., Cohen, M., Jacobs, S.: Designing the user interface: strategies for effective human–computer interaction, 5th edn. Addison Wesley, Boston (2009)
Small, N.J., Mann, G., Lee, K.: Goal Accomplishment Tracking for Automatic Supervision of Plan Execution. In: Proceedings of the 2013 Australasian Conference on Robotics and Automation. Sydney, Australia (2013). http://www.araa.asn.au/acra/acra2013/papers/pap158s1-file1.pdf
Small, N.J., Mann, G., Lee, K.: Assigned Responsibility for Remote Robot Operation. In: Proceedings of the 16th Australasian User Interface Conference (AUIC 2015). Sydney, Australia (2015). http://crpit.com/confpapers/CRPITV162Small.pdf
Sonntag, M., Karastoyanova, D., Deelman, E.: Bridging the Gap between Business and Scientific Workflows: Humans in the Loop of Scientific Workflows. In: e-Science (e-Science), 2010 IEEE Sixth International Conference on, pp. 206–213 (2010)
Stentz, A., Herman, H., Kelly, A., Meyhofer, E., Haynes, G.C., Stager, D., Zajac, B., Bagnell, J.A., Brindza, J., Dellin, C.: Others: Chimp, the cmu highly intelligent mobile platform. J. Field Robot. 32(2), 209–228 (2015)
Thrun, S.: Probabilistic algorithms in robotics. AI Mag. 21(4), 93 (2000)
Wang, J., Lewis, M.: Human control for cooperating robot teams. In: Human-Robot Interaction (HRI), 2007 2nd ACM/IEEE International Conference on, pp. 9–16. IEEE (2007)
Yi, S.J., McGill, S.G., Vadakedathu, L., He, Q., Ha, I., Han, J., Song, H., Rouleau, M., Zhang, B.T., Hong, D.: Others: team THOR’s entry in the DARPA robotics challenge trials 2013. J. Field Robot. 32(3), 315–335 (2015). https://doi.org/10.1002/rob.21555/full
Zion, B., Mann, M., Levin, D., Shilo, A., Rubinstein, D., Shmulevich, I.: Harvest-order planning for a multiarm robotic harvester. Comput. Electron. Agric. 103, 75–81 (2014)