Healthc Inform Res Search


Healthc Inform Res > Volume 23(3); 2017 > Article
Belderrar and Hazzab: Hierarchical Genetic Algorithm and Fuzzy Radial Basis Function Networks for Factors Influencing Hospital Length of Stay Outliers



Controlling hospital high length of stay outliers can provide significant benefits to hospital management resources and lead to cost reduction. The strongest predictive factors influencing high length of stay outliers should be identified to build a high-performance prediction model for hospital outliers.


We highlight the application of the hierarchical genetic algorithm to provide the main predictive factors and to define the optimal structure of the prediction model fuzzy radial basis function neural network. To establish the prediction model, we used a data set of 26,897 admissions from five different intensive care units with discharges between 2001 and 2012. We selected and analyzed the high length of stay outliers using the trimming method geometric mean plus two standard deviations. A total of 28 predictive factors were extracted from the collected data set and investigated.


High length of stay outliers comprised 5.07% of the collected data set. The results indicate that the prediction model can provide effective forecasting. We found 10 common predictive factors within the studied intensive care units. The obtained main predictive factors include patient demographic characteristics, hospital characteristics, medical events, and comorbidities.


The main initial predictive factors available at the time of admission are useful in evaluating high length of stay outliers. The proposed approach can provide a practical tool for healthcare providers, and its application can be extended to other hospital predictions, such as readmissions and cost.

I. Introduction

Nowadays, critical intensive care units (CICU) are often dangerously overcrowded, and the acceptance of patients is becoming an increasingly significant public health system problem [1]. Waiting time [2,3], limited resources [1,4], and hospital costs [5,6,7,8], are difficulties facing hospital policymakers and healthcare authorities. Addressing hospital high length of stay outliers (HHSOs) is a major task that continues to preoccupy healthcare providers while maintaining and improving the quality of healthcare. One solution is to have a better allocation of resources by reducing [9] hospital stays and expanding patient acceptance rates. More specifically, reducing HHSOs can have a significant impact on improving flow and reducing in-patient services. However, finding a way to predict HHSOs earlier could be advantageous for managers in that it could help control hospital costs, could support optimal admissions scheduling, staff planning, and management of resources [10].
To this end, both statistical analysis methods and machine learning have been investigated. Typically, HHSO analysis methods follow a statistical, deviation-based, and distancebased approach [11]. Machine learning techniques, have been proposed to build prediction models for length of stay, and they are applied in some care services. These techniques include logistic regression [12], artificial neural network [12,13,14,15], decision tree [12,15], ensemble model [12], and support vector machines [15].
Various predictive factors have been considered in statistics and data mining. These factors include age [5,12,16,17,18], gender [5,16,17,19], marital status [19], ethnicity [19], ambulance use [16], admission type [5,19], admission status [16], department type [5], discharging reason [5], length of stay [16], comorbidity [16,19], in-hospital mortality [16], diagnosis [19], and costs [19].
Up to now, there is no universal agreement about the predictive factors. To this end, we propose a novel approach to identify the main predictive factors influencing HHSOs using data collected from various types of CICUs. We also designed a high-performance hybrid prediction model (HPM).

II. Case Description

1. Data Collection

Data was extracted from MMIC III [20,21]. The following five types of CICUs were investigated: neonatal intensive care units (NICUs), medical intensive care units (MICUs), coronary care units (CCUs), cardiac surgery recovery units (CSRUs), and surgical intensive care units (SICUs). We excluded admissions with missing predictive factors and patients older than 89 years because their ages are replaced by 300 years. We obtained HHSO data using the geometric mean plus two standard deviations [22,23]. The extracted predictive factors studied in this work are summarized in Table 1.
We encoded the input binary data following a –1/+1 scheme, and for the input categorical data, we followed 1-of-C dummy-coding. We rescaled the input data using both zscore standardization, in which inputs have a mean of 0 and a standard deviation of 1, and min-max normalization, in which inputs are in the range of [-1,1]. We did not encode or rescale the HHSOs. We split the data into two sets: 80% of admissions for the training phase and 20% for the testing phase.

2. HPM Design

The proposed HPM is based on the hierarchical genetic algorithm (HGA) and fuzzy radial basis function networks (FRBFN). The purpose of the HGA is to provide the main predictive factors and the structure of the FRBFN. The purpose of the FRBFN is to accurately predict HHSOs of new admissions.

1) HGA chromosome representation

Our chromosome is composed of two parametric genes and two control genes. The first parametric gene is a vector of seven bits defining the optimal structure of the FRBFN. The second parametric gene is a vector of 28 bits identifying the main predictive factors. When a bit 1 is indicated in the control gene, the corresponding parametric gene is activated. A chromosome is defined by {f, V, k, C, Σ, W}, where F is the fitness function of the HGA, V is the set of predictive factors, and the set {k, C, Σ, W} defines the parameters of the FRBFN, where k is the number of hidden neurons, C and Σ are respectively the set of centers and widths of the transfer Gaussian functions, and W is the set of weights.

2) HPM algorithm

Our algorithm takes as input the training set and its HHSOs, and it returns an optimal solution (chromosome). First, a population of many chromosomes is generated, where V and k are generated randomly. Next, in each evolutionary cycle, a new population of potential solutions is generated based on the application of the genetic operations. In each cycle, the parameters of each produced chromosome are defined as follows: V and k are defined by the application of crossover and mutation on the two control genes separately. The set C is determined using the fuzzy C-means algorithm [24]. The set Σ is defined using the fuzzy K-nearest neighbors algorithm. The set W is defined by the singular value decomposition algorithm. Next, f is evaluated in terms of the mean absolute error (MAE) as shown in Equation (1). The cycle stops when an optimal solution is good enough or the maximum number of generations is expected.
A predicted HHSO is calculated by Equations (2) and (3), where ωkW, β0 is the bias, ckC, σk ∈ Σ, and φk is the kth Gaussian function:

3. Performance Evaluation

We evaluated the performance of the FRBFN in terms of the mean magnitude relative error MMRE and Pred(q) [25] prediction at level q as shown by Equations (4) and (5). Conte et al. [26] maintained that a good estimation model should have MMRE≤0.25 and Pred(q)≥0.75. The parameter m denotes the number of computed HHSOs for which the MRE is less than or equal q:

4. Results

Among the 26,897 admissions considered in this study (Table 2), we found 1,365 (5.07%) patients with HHSO; 44.69% of them were hospitalized in an MICU. The mean age of the patients was 59.96 ± 0.43 years (range, 0–89 years) with most subjects between 40–64 years, while 57.58% of them were men and 42.42% were women. Most of the discharges (62.93%) required other healthcare facilities. Also, 62.86% of the patients were covered by Medicare or Medicaid. In addition, a notable 88.27% of patients showed multiple comorbidities. Table 3 summarizes the statistical results of common factors and some other important factors.
The population was composed of 150 chromosomes, and the number of iterations was 15,000. The predicted outputs were rounded to the zero decimal place because an HHSO is calculated based on the number of days. We used the technique in which the closest respected output is selected as the predicted output. The results shown in Table 4 indicate that the FRBFN performed better for all CICUs. The outcomes obtained by the z-score standardization were more effective and efficient in terms of MRME and Pred(0.25) than those obtained by min-max normalization.
Table 5 summarizes the numbers of predictive factors and the numbers of neurons. There are three key observations to be made. First, the structure of the prediction model differed according to the studied CICUs. Second, the results suggest that each CICU has its own main predictive factors. Third, the obtained optimal configurations depend on the scaling data. The predictive factors found in the two scaling techniques were almost the same. We note that we could not verify any relationship between the FRBFN structure and the main predictive factors.
Table 6 summarizes the common main predictive factors between the studied CICUs. Medical comorbidities were not identified in HHSO prediction of NICUs.

III. Discussion

HHSOs are closely related to hospital costs and should be controlled and justified. We examined the predictive factors associated with HHSOs using both the HGA and FRBFN. We have presented the necessary steps to implement the HPM and have illustrated its applicability using data collected from various CICUs. We obtained the main factors of the prediction model FRBFN and its optimal structure using the HGA.
A comprehensive and accurate determination of the underlying factors associated with HHSOs is a critical requirement as this can help to obtain a lighter and more efficient prediction model. The optimal configurations obtained for HPM are related to the studied data; therefore, the scalability of our approach to other hospital predictions, such as re-admissions or costs may be problematic, and it would require the adoption of pruning heuristics, determination of the effective optimal parameters of FRBFN, or merging with a statistical analysis. Therefore, we cannot claim that similar results can be obtained with other hospital predictions, but it would be an interesting area for future research.
The HHSO distribution is highly skewed as shown in Table 2. This has inspired us to delve deeper into investigating for which fraction of the admissions, our hybrid model can predict HHSOs with error margins that are reasonably bounded.
Regarding the race factor in MICUs, the admissions rate of White and Asian races represents 69.67% (average of 44.67 days) and 3.44% (average of 47.1 days) respectively. The hospital stays of most Asian patients were longer than those of White patients. This information cannot be interpreted by our approach; therefore, other potential analysis should be investigated.
To improve the performance of HPM, the following suggestions should be considered: (1) Is there a relationship between the factors and the HPM structure? (2) Explore the sample to identify other factors. (3) The performance of HGA depends on the genetic operators that should be carefully selected. (4) To speed up the HPM, the first control genes can be used without corresponding parametric genes.


We wish to thank the group of general practitioners GGP U.M. for their contributions to discussions about the predictive factors used in this study.


Conflict of Interest: No potential conflict of interest relevant to this article was reported.


1. Di Somma S, Paladino L, Vaughan L, Lalle I, Magrini L, Magnanti M. Overcrowding in emergency department: an international issue. Intern Emerg Med 2015;10(2):171-175. PMID: 25446540.
2. Siciliani L, Moran V, Borowitz M. Measuring and comparing health care waiting times in OECD countries. Health Policy 2014;118(3):292-303. PMID: 25217838.
3. Barua B, Esmail N, Jackson T. The effect of wait times on mortality in Canada. Vancouver: Fraser Institute; 2014.

4. Richards JR, van der Linden MC, Derlet RW. Providing care in emergency department hallways: demands, dangers, and deaths. Adv Emerg Med 2014;2014:495219.
5. Cyganska M. The impact factors on the hospital high length of stay outliers. Procedia Econ Financ 2016;39:251-255.
6. Ithman MH, Goplarkrishna G, Beck NC, Das J, Petroski G. Predictors of length of stay in an acute psychiatric hospital. J Biosaf Health Educ 2014;2(2):1000119.
7. Pakzad H, Thevendran G, Penner MJ, Qian H, Younger A. Factors associated with longer length of hospital stay after primary elective ankle surgery for end-stage ankle arthritis. J Bone Joint Surg Am 2014;96(1):32-39. PMID: 24382722.
8. Gruenberg DA, Shelton W, Rose SL, Rutter AE, Socaris S, McGee G. Factors influencing length of stay in the intensive care unit. Am J Crit Care 2006;15(5):502-509. PMID: 16926372.
9. Clarke A, Rosen R. Length of stay. How short should hospital care be. Eur J Public Health 2001;11(2):166-170. PMID: 11420803.
10. Mak G, Grant WD, McKenzie JC, McCabe JB. Physicians, ability to predict hospital length of stay for patients admitted to the hospital from the emergency department. Emerg Med Int 2012;2012:824674PMID: 22319649.
11. Han J, Pei J, Kamber M. Data mining: concepts and techniques. Amsterdam: Morgan Kaufmann; 2012.

12. Jiang X, Qu X, Davis L. Using data mining to analyze patient discharge data for an urban hospital Proceedings of the 2010 International Conference on Data Mining; 2010 Jul 12-15. Las Vegas, NV: p. 139-144.

13. Rowan M, Ryan T, Hegarty F, O'Hare N. The use of artificial neural networks to stratify the length of stay of cardiac patients based on preoperative and initial postoperative factors. Artif Intell Med 2007;40(3):211-221. PMID: 17580112.
14. Tu JV, Guerriere MR. Use of a neural network as a predictive instrument for length of stay in the intensive care unit following cardiac surgery. Comput Biomed Res 1993;26(3):220-229. PMID: 8325002.
15. Hachesu PR, Ahmadi M, Alizadeh S, Sadoughi F. Use of data mining techniques to determine and predict length of stay of cardiac patients. Healthc Inform Res 2013;19(2):121-129. PMID: 23882417.
16. Miyata H, Hashimoto H, Horiguchi H, Matsuda S, Motomura N, Takamoto S. Performance of in-hospital mortality prediction models for acute hospitalization: hospital standardized mortality ratio in Japan. BMC Health Serv Res 2008;8:229PMID: 18990251.
17. Son YJ, Kim HG, Kim EH, Choi S, Lee SK. Application of support vector machine for prediction of medication adherence in heart failure patients. Healthc Inform Res 2010;16(4):253-259. PMID: 21818444.
18. Ahn M, Choi M, Kim Y. Factors associated with the timeliness of electronic nursing documentation. Healthc Inform Res 2016;22(4):270-276. PMID: 27895958.
19. Sushmita S, Khulbe G, asan A, Newman S, Ravindra P, Basu Roy S, et al. Predicting 30-day risk and cost of “All-Cause” hospital readmissions The Workshops at the 30th AAAI Conference on Artificial Intelligence: Expanding the Boundaries of Health Informatics Using AI; 2016 Feb 12-17. Phoenix, AZ.

20. Johnson AE, Pollard TJ, Shen L, Lehman LW, Feng M, Ghassemi M, et al. MIMIC-III, a freely accessible critical care database. Sci Data 2016;3:160035PMID: 27219127.
21. Goldberger AL, Amaral LA, Glass L, Hausdorff JM, Ivanov PC, Mark RG, et al. PhysioBank, PhysioToolkit, and PhysioNet: components of a new research resource for complex physiologic signals. Circulation 2000;101(23):E215-E220. PMID: 10851218.
22. Cots F, Elvira D, Castells X, Saez M. Relevance of outlier cases in case mix systems and evaluation of trimming methods. Health Care Manag Sci 2003;6(1):27-35. PMID: 12638924.
23. Freitas A, Silva-Costa T, Lopes F, Garcia-Lema I, Teixeira-Pinto A, Brazdil P, et al. Factors influencing hospital high length of stay outliers. BMC Health Serv Res 2012;12:265PMID: 22906386.
24. Jain AK, Murty MN, Flynn PJ. Data clustering: a review. ACM Comput Surv 1999;31(3):264-323.
25. Briand LC, Wieczorek I. Resource estimation in software engineering. In: Marciniak JJ, editors. Encyclopedia of software engineering. New York (NY): John Wiley & Sons Inc; 2002.

26. Conte SD, Dunsmore HE, Shen VY. Software engineering metrics and models. Redwood City (CA): Benjamin/Cummings Publishing; 1986.

Table 1

Overview of the predictive factors used to predict hospital high length of stay outliers


CICU: critical intensive care units.

Table 2

Distribution of hospital high length of stay outliers


CICU: critical intensive care units, NICU: neonatal intensive care units, MICU: medical intensive care units, CCU: coronary care units, CSRU: cardiac surgery recovery units, SICU: surgical intensive care units.

Table 3

Statistical result (in % except mean) of common factors and some other important factors


NICU: neonatal intensive care units, MICU: medical intensive care units, CCU: coronary care units, CSRU: cardiac surgery recovery units, SICU: surgical intensive care units.

aExcept NICU (day).

Table 4

Performance of the hybrid prediction model in terms of MMRE and Pred(q)


CICU: critical intensive care units, NICU: neonatal intensive care units, MICU: medical intensive care units, CCU: coronary care units, CSRU: cardiac surgery recovery units, SICU: surgical intensive care units.

Table 5

Configuration of the proposed hybrid prediction model


CICU: critical intensive care units, NICU: neonatal intensive care units, MICU: medical intensive care units, CCU: coronary care units, CSRU: cardiac surgery recovery units, SICU: surgical intensive care units.

Table 6

Overview of the common main predictive factors

Share :
Facebook Twitter Linked In Google+ Line it
METRICS Graph View
  • 2 Crossref
  • 3   Scopus
  • 157 View
  • 1 Download
Related articles in Healthc Inform Res


Browse all articles >

Editorial Office
1618 Kyungheegung Achim Bldg 3, 34, Sajik-ro 8-gil, Jongno-gu, Seoul 03174, Korea
Tel: +82-2-733-7637, +82-2-734-7637    E-mail:                

Copyright © 2020 by Korean Society of Medical Informatics. All rights reserved.

Developed in M2community

Close layer
prev next