Perturbation analysis for online control and optimization of stochastic fluid models

IEEE Transactions on Automatic Control - Tập 47 Số 8 - Trang 1234-1248 - 2002
C.G. Cassandras1, Y. Wardi2, B. Melamed3, Gang Sun1, C.G. Panayiotou1
1Department of Manufacturing Engineering, Boston University, Brookline, MA, USA
2School of Electrical Engineering, Georgia Institute of Technology, Atlanta, GA, USA
3Department of Management Science and Information Systems, University of Newark and New Brunswick, Piscataway, NJ, USA

Tóm tắt

Uses stochastic fluid models (SFMs) for control and optimization (rather than performance analysis) of communication networks, focusing on problems of buffer control. We derive gradient estimators for packet loss and workload related performance metrics with respect to threshold parameters. These estimators are shown to be unbiased and directly observable from a sample path without any knowledge of underlying stochastic characteristics, including traffic and processing rates (i.e., they are nonparametric). This renders them computable in online environments and easily implementable for network management and control. We further demonstrate their use in buffer control problems where our SFM-based estimators are evaluated based on data from an actual system.

Từ khóa

#Stochastic processes #Communication system control #Performance analysis #Communication networks #Measurement #Parameter estimation #Communication system traffic control #Computer networks #Computer network management #Environmental management

Tài liệu tham khảo

wardi, 2000, loss volume in continuous flow models: fast simulation and sensitivity analysis via ipa, Proc 8th IEEE Mediterranean Conf on Control and Automation (MED 2000) 10.1023/A:1011257222927 10.1007/BF00940712 10.1137/S0363012999362724 10.1007/978-1-4615-4024-3 10.1007/978-1-4757-4070-7 liu, 1999, perturbation analysis for stochastic fluid queueing systems, 27th IEEE Decision Control Conf, 4440 kushner, 1978, Stochastic Approximation for Constrained and Unconstrained Systems, 10.1007/978-1-4684-9352-8 10.1109/CDC.2001.981186 10.1109/CDC.1999.832743 wardi, 1994, ipa gradient estimation for the loss volume in continuous flow models, Proc Hong Kong Int Workshop on New Directions of Control and Manufacturing, 30 10.1109/18.61109 kumaran, 1998, performance and fluid simulations of a novel shared buffer management system, Proc IEEE InfoCom 10.1109/GLOCOM.1996.591988 liu, 1999, fluid simulation of large scale networks: issues and tradeoffs, Proc Int Conf on Parallel and Distributed Processing Techniques and Applications miyoshi, 1998, sensitivity estimation of the cell-delay in the leaky bucket traffic filter with stationary gradual input, Proc Int Workshop on Discrete Event Systems WoDES 98, 190 kobayashi, 1992, a mathematical theory for transient analysis of communications networks, IEICE Trans Commun, e75 b, 1266 10.1002/j.1538-7305.1982.tb03089.x 10.1109/18.771162 rubinstein, 1993, Discrete Event Systems Sensitivity Analysis and Stochastic Optimization via the Score Function Method 10.1137/S0363012999362724