Development of prediction model with machine learning in continuous twin screw granulation

Seung-Dong Yoo1, Ji Yeon Kim2, Sung-Kyun Han1, Byung-Hoon Lee1, Du Hyung Choi2, Eun-Seok Park1
1School of Pharmacy, Sungkyunkwan University, Suwon, Republic of Korea
2College of Pharmacy, Daegu Catholic University, Gyeongsan-si, Republic of Korea

Tóm tắt

This study aimed to use machine learning to predict the quality of a drug product prepared through continuous manufacturing. A design of experiment (DoE) was employed to identify the relationship between process parameters in continuous twin screw granulation and intermediate and drug product quality. Subsequently, unsupervised and supervised machine learning were applied to develop a dissolution prediction model. Hierarchical clustering analysis (HCA) was conducted to evaluate the similarity between the datasets generated by the DoE. In addition, supervised learning, such as partial least squares (PLS) regression with variable importance in projection (VIP), was conducted, and a prediction model was developed using an artificial neural network (ANN) as a machine learning model. Moreover, principal component analysis (PCA), which is an unsupervised learning method, was used to preprocess the ANN model to reduce the number of features. HCA divided the data set obtained by DoE into three clusters, and it was confirmed that the L/S ratio significantly affected granule and tablet properties. The ANN, PLS-VIP(0.8)-ANN, PLS-VIP(1.0)-ANN, and PCA-ANN models were developed and statistically compared. The PLS-VIP(0.8)-ANN accurately predicted the dissolution profile with a high coefficient of determination and low mean absolute deviation, root mean square error, and sum of squared errors. This paper describes the application of various machine learning algorithms to predict drug product quality as a control strategy of continuous manufacturing.

Từ khóa


Tài liệu tham khảo

Abdi H, Williams LJ (2010) Principal component analysis. Wiley Interdiscip Rev Comput Stat 2:433–459

Agatonovic-Kustrin S, Beresford R (2000) Basic concepts of artificial neural network (ANN) modeling and its application in pharmaceutical research. J Pharm Biomed Anal 22:717–727

Arsham H, Lovric M (2011) Bartlett’s test. Int Encycl Stat Sci 1:87–88

Behzadi SS, Prakasvudhisarn C, Klocker J, Wolschann P, Viernstein H (2009) Comparison between two types of artificial neural networks used for validation of pharmaceutical processes. Powder Technol 195:150–157

Chauhan T, Rawat S, Malik S, Singh P (2021) Supervised and unsupervised machine learning based review on diabetes care. In: The 7th international conference on advanced computing and communication systems. pp 581−585

Chen Z, Zhang X, Lee J (2023) Combining PCA-AHP combination weighting to prioritize design elements of intelligent wearable masks. Sustainability 15:1888

Cronbach LJ (1951) Coefficient alpha and the internal structure of tests. Psychometrika 16:297–334

De Leersnyder F, Vanhoorne V, Bekaert H, Vercruysse J, Ghijs M et al (2018) Breakage and drying behaviour of granules in a continuous fluid bed dryer: influence of process parameters and wet granule transfer. Eur J Pharm Sci 115:223–232

El Hagrasy A, Hennenkamp J, Burke M, Cartwright J, Litster J (2013) Twin screw wet granulation: influence of formulation parameters on granule properties and growth behavior. Powder Technol 238:108–115

Escotet-Espinoza MS, Moghtadernejad S, Scicolone J, Wang Y, Pereira G et al (2018) Using a material property library to find surrogate materials for pharmaceutical process development. Powder Technol 339:659–676

Galindo-Prieto B, Eriksson L, Trygg J (2014) Variable influence on projection (VIP) for orthogonal projections to latent structures (OPLS). J Chemom 28:623–632

Geetha A, Santhakumar J, Sundaram KM, Usha S, Thentral TT et al (2022) Prediction of hourly solar radiation in Tamil Nadu using ANN model with different learning algorithms. Energy Rep 8:664–671

Granato D, Santos JS, Escher GB, Ferreira BL, Maggio RM (2018) Use of principal component analysis (PCA) and hierarchical cluster analysis (HCA) for multivariate association between bioactive compounds and functional properties in foods: a critical perspective. Trends Food Sci Technol 72:83–90

Kaiser HF, Rice J (1974) Little Jiffy, Mark IV. Educ Psychol Meas 34:111–117

Kaya A (2010) Artificial neural network study of observed pattern of scour depth around bridge piers. Comput Geotech 37:413–418

Lee SL, O’connor TF, Yang X, Cruz CN, Chatterjee S et al (2015) Modernizing pharmaceutical manufacturing: from batch to continuous production. J Pharm Innov 10:191–199

Liu H, Ricart B, Stanton C, Smith-Goettler B, Verdi L et al (2019) Design space determination and process optimization in at-scale continuous twin screw wet granulation. Comput Chem Eng 125:271–286

Mascia S, Heider PL, Zhang H, Lakerveld R, Benyahia B et al (2013) End-to-end continuous manufacturing of pharmaceuticals: integrated synthesis, purification, and final dosage formation. Angew Chem 125:12585–12589

Mendez KM, Broadhurst DI, Reinke SN (2020) Migrating from partial least squares discriminant analysis to artificial neural networks: a comparison of functionally equivalent visualisation and feature contribution tools using jupyter notebooks. Metabolomics 16:1–15

Meng W, Román-Ospino AD, Panikar SS, O’callaghan C, Gilliam SJ et al (2019) Advanced process design and understanding of continuous twin-screw granulation via implementation of in-line process analytical technologies. Adv Powder Technol 30:879–894

Milewski R, Jankowska D, Cwalina U, Milewska AJ, Citko D et al (2016) Application of artificial neural networks and principal component analysis to predict results of infertility treatment using the IVF method. Stud Log Gramm Rhetor 47:33–46

Morgan P, Cleave-Hogg D, Desousa S, Tarshis J (2004) High-fidelity patient simulation: validation of performance checklists. Br J Anaesth 92:388–392

Nandi U, Trivedi V, Ross SA, Douroumis D (2021) Advances in twin-screw granulation processing. Pharmaceutics 13(624):4

Partheniadis I, Toskas M, Stavras F-M, Menexes G, Nikolakakis I (2020) Impact of hot-melt-extrusion on solid-state properties of pharmaceutical polymers and classification using hierarchical cluster analysis. Processes 8:1208

Pishnamazi M, Ismail HY, Shirazian S, Iqbal J, Walker GM et al (2019) Application of lignin in controlled release: development of predictive model based on artificial neural network for API release. Cellulose 26:6165–6178

Portier C, De Vriendt C, Vigh T, Di Pretoro G, De Beer T et al (2020a) Continuous twin screw granulation: robustness of lactose/MCC-based formulations. I Int J Pharm 588:119756

Portier C, Pandelaere K, Delaet U, Vigh T, Di Pretoro G et al (2020b) Continuous twin screw granulation: a complex interplay between formulation properties, process settings and screw design. Int J Pharm 576:119004

Portier C, Pandelaere K, Delaet U, Vigh T, Kumar A et al (2020c) Continuous twin screw granulation: influence of process and formulation variables on granule quality attributes of model formulations. Int J Pharm 576:118981

Portier C, Vigh T, Di Pretoro G, De Beer T, Vervaet C et al (2020d) Continuous twin screw granulation: impact of binder addition method and surfactants on granulation of a high-dosed, poorly soluble API. Int J Pharm 577:119068

Portier C, Vigh T, Di Pretoro G, Leys J, Klingeleers D et al (2021) Continuous twin screw granulation: Impact of microcrystalline cellulose batch-to-batch variability during granulation and drying—a QbD approach. Int J Pharm X 3:100077

Quek SS, Lim CP, Peh KK (2001) Prediction of drug dissolution profiles using artificial neural networks. Int J Comput Intell Appl 1:187–202

Shalizi C (2009) Distances between clustering, hierarchical clustering. Lectures notes, Carnegie Mellon University

Simões MF, Silva G, Pinto AC, Fonseca M, Silva NE et al (2020) Artificial neural networks applied to quality-by-design: from formulation development to clinical outcome. Eur J Pharm Biopharm 152:282–295

Tahara K (2020) Pharmaceutical formulation and manufacturing using particle/powder technology for personalized medicines. Adv Powder Technol 31:387–392

Thompson M (2015) Twin screw granulation—review of current progress. Drug Dev Ind Pharm 41:1223–1231

Turner JV, Maddalena DJ, Cutler DJ (2004) Pharmacokinetic parameter prediction from drug structure using artificial neural networks. Int J Pharm 270:209–219

Vanhoorne V, Vervaet C (2020) Recent progress in continuous manufacturing of oral solid dosage forms. Int J Pharm 579:119194

Velez NL, Drennen JK, Anderson CA (2022) Challenges, opportunities and recent advances in near infrared spectroscopy applications for monitoring blend uniformity in the continuous manufacturing of solid oral dosage forms. Int J Pharm 615:121462

Verma KK, Singh BM, Dixit A (2019) A review of supervised and unsupervised machine learning techniques for suspicious behavior recognition in intelligent surveillance system. Int J Inf Technol. https://doi.org/10.1007/s41870-019-00364-0

Yin J, Clayton J (2014) The role of powder characterization in continuous manufacturing. Pharm Technol 38:44–49

Zhang Z, Beck MW, Winkler DA, Huang B, Sibanda W et al (2018) Opening the black box of neural networks: methods for interpreting neural network models in clinical applications. Ann Transl Med 6:216