Partial Diffusion Markov Model of Heterogeneous TCP Link: Optimization with Incomplete Information

Partial Diffusion Markov Model of Heterogeneous TCP Link: Optimization with Incomplete Information

The paper presents a new mathematical model of TCP (Transmission Control Protocol) link functioning in a heterogeneous (wired/wireless) channel. It represents a controllable, partially observable stochastic dynamic system. The system state describes the status of the modeled TCP link and expresses i...

Full description

Bibliographic Details
Main Authors:	Andrey Borisov, Alexey Bosov, Gregory Miller, Igor Sokolov
Format:	Article
Language:	English
Published:	MDPI AG 2021-07-01
Series:	Mathematics
Subjects:	controllable Markov jump processes compound Poisson processes diffusion limits stochastic control problem with incomplete information novel queuing models in applications
Online Access:	https://www.mdpi.com/2227-7390/9/14/1632

Similar Items

Approximation of a class of Markov-modulated Poisson processes with a large state-space.
by: Sitaraman, Hariharakrishnan.
Published: (1989)

Countable Markov chains with an application to queueing theory
by: Owens, Ray Collins
Published: (2009)

Spatial queueing systems and reversible markov processes
by: Huang, Wenzong
Published: (2008)

Vacation queues with Markov schedules
by: Wortman, M. A.
Published: (2015)

Discrete-time partially observed Markov decision processes: ergodic, adaptive, and safety control
by: Hsu, Shun-pin
Published: (2008)

Switched Markov Jump Linear Systems: Analysis and Control Synthesis
by: Lutz, Collin C.
Published: (2014)

Asymptotic behaviour of an overloading queueing network with resource pooling
by: Brown, Louise Eleanor
Published: (2008)

Controlled Semi-Markov Processes With Partial Observation
by: Goswami, Anindya
Published: (2011)

Response of dynamic systems to a class of renewal impulse process excitations : non-diffusive Markov approach
by: Tellier, Matilde
Published: (2008)

Reciprocal class of jump processes
by: Conforti, Giovanni, et al.
Published: (2014)

Analysis And Optimization Of Queueing Models With Markov Modulated Poisson Input
by: Hemachandra, Nandyala
Published: (2012)

Modeling Precious Metal Returns through Fractional Jump-Diffusion Processes Combined with Markov Regime-Switching Stochastic Volatility
by: Martha Carpinteyro, et al.
Published: (2021-02-01)

Brownian approximations for queueing networks with finite buffers : modeling, heavy traffic analysis and numerical implementations
by: Dai, Wanyang
Published: (2009)

Performance of multi-state Markov modulated queuing in ATM networks
by: Yousef, Sufian Yacoub Salameh
Published: (1998)

Predictive control for stochastic systems based on multi-layer probabilistic sets
by: Huaqing LIANG, et al.
Published: (2016-04-01)

Importance Sampling for a Markov Modulated Queuing Network with Customer Impatience until the End of Service
by: Ebrahim MAHDIPOUR, et al.
Published: (2009-01-01)

Oil Price estimating Under Dynamic Economic Models Using Markov Chain Monte Carlo Simulation Approach
by: Kianoush Fathi Vajargah, et al.
Published: (2021-07-01)

Survey-based calibration of a parking entry as a single-server mathematical queuing model: A case study
by: Mounir Mahmoud Moghazy Abdel-Aal
Published: (2020-04-01)

Bounds for mixing times for finite semi-Markov processes with heavy-tail jump distribution
by: Georgiou, N., et al.
Published: (2022)

Single and Multi-player Stochastic Dynamic Optimization
by: Saha, Subhamay
Published: (2018)

An Optimal Medium Access Control with Partial Observations for Sensor Networks
by: Cristescu Răzvan, et al.
Published: (2005-01-01)

An Optimal Medium Access Control with Partial Observations for Sensor Networks
by: Servetto Sergio D, et al.
Published: (2005-01-01)

Modelling of the process of controlling technical systems with the help of diffusion Markov random processes
by: Tatyana A. Shornikova, et al.
Published: (2011-05-01)

Queues with a Markov renewal service process
by: Magalhaes, Marcos N.
Published: (2015)

The multiple-server queue with heterogeneous service times
by: Baxley, Robert Van Namee
Published: (2008)

Static Output Constrained Control for Discrete-Time Hidden Markov Jump Linear Systems
by: Yeison A. Zabala, et al.
Published: (2020-01-01)

Markov and Semi-markov Chains, Processes, Systems and Emerging Related Fields
Published: (2021)

SISTEMUL DE AŞTEPTARE [SM / M /∞] CU FLUX SEMI-MARKOV. CRITERIUL DE MEDIERE
by: Iulia DAMIAN
Published: (2015-12-01)

Kalman Based Finite State Controller for Partially Observable Domains
by: H. Levent Akin, et al.
Published: (2008-11-01)

Control of Markov Jump Linear Systems with uncertain detections.
by: Stadtmann, Frederik
Published: (2019)

Simulation Based Algorithms For Markov Decision Process And Stochastic Optimization
by: Abdulla, Mohammed Shahid
Published: (2010)

Estimation and control of jump stochastic systems
by: Wong, Wee Chin
Published: (2010)

Customer allocation policies in a two server network: stability and exact asymptotics
by: Coombs-Reyes, Jerome D.
Published: (2005)

Convergence of hitting times for jump-diffusion processes
by: Georgiy Shevchenko
Published: (2015-09-01)

On a new Markov model for the pitting corrosion process and its application to reliability
by: Rodriguez, Elindoro Suarez.
Published: (1986)

Resource allocation in parallel processing systems
by: Menich, Ronald Paul
Published: (2009)

Process Discovery untuk Streaming Event Log menggunakan Model Markov Tersembunyi
by: Kelly Rossa Sungkono, et al.
Published: (2017-01-01)

Prediction of earthquake hazard by hidden Markov model (around Bilecik, NW Turkey)
by: Can Ceren, et al.
Published: (2014-09-01)

Boundary value methods for transient solutions of Markovian queueing networks.
Published: (2004)

Stochastic stability of linear time-delay system with Markovian jumping parameters
by: Benjelloun K., et al.
Published: (1997-01-01)