Optimal shape morphing control of 4D printed shape memory polymer based on reinforcement learning

Lipson, 2013 Luo, 2020, A dynamic and static data based matching method for cloud 3D printing, Robot. Comput.-Integr. Manuf., 61, 10.1016/j.rcim.2019.101858 Zhang, 2019, Three-dimensional printed devices in droplet microfluidics, Micromachines, 10, 754, 10.3390/mi10110754 T.-C.T. Chen, Y.-C. Lin, Diverse three-dimensional printing capacity planning for manufacturers, Robot. Comput.-Integrated Manuf. 67 102052. Rashid, 2005, Simulation study on the improvements of machining accuracy by using smart materials, Robot. Comput.-Integr. Manuf., 21, 249, 10.1016/j.rcim.2004.09.002 Momeni, 2017, A review of 4D printing, Mater. Des., 122, 42, 10.1016/j.matdes.2017.02.068 Ding, 2017, Direct 4D printing via active composite materials, Sci. Adv., 3, 10.1126/sciadv.1602890 Q. Ji, C. Zhao, M. Chen, X.V. Wang, L. Feng, L. Wang, A flexible 4D printing service platform for smart manufacturing, in: 9th Swedish Production Symposium, 2020, pp. 575–585. Ge, 2013, Active materials by four-dimension printing, Appl. Phys. Lett., 103, 10.1063/1.4819837 Choong, 2017, 4D printing of high performance shape memory polymer using stereolithography, Mater. Des., 126, 219, 10.1016/j.matdes.2017.04.049 Ge, 2016, Multimaterial 4D printing with tailorable shape memory polymers, Sci. Rep., 6, 31110, 10.1038/srep31110 Mather, 2009, Shape memory polymer research, Annu. Rev. Mater. Res., 39, 445, 10.1146/annurev-matsci-082908-145419 Behl, 2009, One-step process for creating triple-shape capability of AB polymer networks, Adv. Funct. Mater., 19, 102, 10.1002/adfm.200800850 Xie, 2009, Revealing triple-shape memory effect by polymer bilayers, Macromol. Rapid Commun., 30, 1823, 10.1002/marc.200900409 Xie, 2010, Tunable polymer multi-shape memory effect, Nature, 464, 267, 10.1038/nature08863 Bodaghi, 2019, 4D printing self-morphing structures, Materials, 12, 1353, 10.3390/ma12081353 Wang, 2020, A phase evolution based constitutive model for shape memory polymer and its application in 4D printing, Smart Mater. Struct., 29, 10.1088/1361-665X/ab7ab0 Su, 2020, A machine learning workflow for 4D printing: understand and predict morphing behaviors of printed active structures, Smart Mater. Struct., 30, 10.1088/1361-665X/abc836 Hamel, 2019, Machine-learning based design of active composite structures for 4D printing, Smart Mater. Struct., 28, 10.1088/1361-665X/ab1439 Liu, 2021, Microstructural design of 4D printed angle-ply laminated strips with tunable shape memory properties, Mater. Lett., 285, 10.1016/j.matlet.2020.129197 Zolfagharian, 2019, Bending control of a 3D printed polyelectrolyte soft actuator with uncertain model, Sensors Actuators A, 288, 134, 10.1016/j.sna.2019.01.027 Ji, 2020, Feedback control for the precise shape morphing of 4D Printed Shape Memory Polymer, IEEE Trans. Ind. Electron., 1 Lewis, 2012, Reinforcement learning and feedback control: Using natural decision methods to design optimal adaptive controllers, IEEE Control Syst. Mag., 32, 76, 10.1109/MCS.2012.2214134 Buşoniu, 2018, Reinforcement learning for control: Performance, stability, and deep approximators, Annu. Rev. Control, 46, 8, 10.1016/j.arcontrol.2018.09.005 Li, 2020, Trajectory smoothing method using reinforcement learning for computer numerical control machine tools, Robot. Comput.-Integr. Manuf., 61, 10.1016/j.rcim.2019.101847 Khader, 2021, Adaptive optimal control of stencil printing process using reinforcement learning, Robot. Comput.-Integr. Manuf., 71, 10.1016/j.rcim.2021.102132 Chen, 2020, Active curved surface deforming of flexible conformal electronics by multi-fingered actuator, Robot. Comput.-Integr. Manuf., 64, 10.1016/j.rcim.2020.101942 Zolfagharian, 2020, Closed-loop 4D-printed soft robots, Mater. Des., 188, 10.1016/j.matdes.2019.108411 Q. Ji, X. Zhang, M. Chen, X.V. Wang, L. Wang, L. Feng, Design and closed loop control of a 3D printed soft actuator, in: 2020 IEEE 16th International Conference on Automation Science and Engineering, CASE, Hong Kong, 2020, pp. 842–848. M. Chen, Q. Ji, X. Zhang, L. Feng, X.V. Wang, L. Wang, Study on efficient fused deposition modelling of thermoplastic polyurethane inflatable wall features for airtightness, in: 9th Swedish Production Symposium, 2020, pp. 417–427. Sun, 2020, A soft gripper with variable stiffness inspired by pangolin scales, toothed pneumatic actuator and autonomous controller, Robot. Comput.-Integr. Manuf., 61, 10.1016/j.rcim.2019.101848 Bhagat, 2019, Deep reinforcement learning for soft, flexible robots: brief review with impending challenges, Robotics, 8, 4, 10.3390/robotics8010004 Yang, 2018, A soft artificial muscle driven robot with reinforcement learning, Sci. Rep., 8, 1 Kim, 2020, Learning to walk a tripod mobile robot using nonlinear soft vibration actuators with entropy adaptive reinforcement learning, IEEE Robot. Autom. Lett., 5, 2317, 10.1109/LRA.2020.2970945 Li, 2019, Deep reinforcement learning in soft viscoelastic actuator of dielectric elastomer, IEEE Robot. Autom. Lett., 4, 2094, 10.1109/LRA.2019.2898710 Thuruthel, 2018, Model-based reinforcement learning for closed-loop dynamic control of soft robotic manipulators, IEEE Trans. Robot., 35, 124, 10.1109/TRO.2018.2878318 Savitzky, 1964, Smoothing and differentiation of data by simplified least squares procedures., Anal. Chem., 36, 1627, 10.1021/ac60214a047 Kirk, 2004 Sundström, 2009, A generic dynamic programming matlab function, 1625 Wesemann, 2020, 3D printed protective equipment during covid-19 pandemic, Materials, 13, 1997, 10.3390/ma13081997 Manero, 2020, Leveraging 3D printing capacity in times of crisis: recommendations for COVID-19 distributed manufacturing for medical equipment rapid response, Int. J. Environ. Res. Public Health, 17, 4634, 10.3390/ijerph17134634