HERC: Analyzing Cost Data
Locator
Contact
Search

Analyzing Cost Data

Overview

Multivariate regression is a statistical method that can be used to evaluate health care costs.  Cost is the dependent variable. In the simplest case, the cost of two groups of patients can be compared by using an indicator variable for group membership as the explanatory variable.  For example, for an indicator "experimental group," individuals in the experimental group are assigned the value of one and those in control group are assigned a value of zero.  The coefficient for this independent variable represents the difference in cost associated with being a member of the experimental group compared to the control group.  When group assignment is not random, additional independent variables can allow the analyst to control for the effect of of age, gender, chronic illness, or other factors.

Because health care costs are so variable, cost regressions require special methods.  These methods are discussed below.  This discussion is followed by descriptions of applications to VA cost issues--determining inpatient cost, and estimating the effect of chronic illness on health care cost.

Health Care Costs Require Special Methods

The most common method of multivariate regression is Ordinarly Least Squares (OLS).  This method assumes that the dependent variable is normally distributed and that the errors in the regression be independent and not explained by any of the independent variables. Health care costs are highly skewed and thus as are not normally distributed.  The error terms in cost regressions often violated the assumptions of OLS.

This problem can be overcome by transforming the dependent variable, making it more normally distributed. One common method is to take the natural log of cost-adjusted charges. This approach has limitations, but is almost always results in less bias than an OLS regression of raw costs.  Among the limitations are the impossibility of including observations in which no cost was incurred, as it is not possible to take the log of zero.  Substituting a small positive number (e.g., one dollar) for zero costs can result in biased parameters and is not recommended.  Simulating costs from a function that uses a transformed dependent variable (such as the log of costs) requires correction for retransformation bias.

General Linear Models (GLM) allow more flexible modeling of costs that is superior to OLS regression of log cost.  GLM models allow inclusion of observations with zero cost.  GLM models correct for heteroscedastic errors and do not need to be adjusted for retransformation bias. There are specific tests to choose the best link function and most appropriate distribution.  A common form of GLM regression uses a log link function and a gamma distribution, and for this reason, is often referred to a gamma regression.  Special care must be exercised in running gamma regressions in the SAS statistical program, as the default is to exclude observations that have zero cost as the dependent variable.

Alternatively, a two-part model can be used to handle cost data where there are a large number of observations with zero healthcare expenditures (Deb and Norton, 2017). In a two-part model, the first part of the model estimates whether the subject had any non-zero healthcare expenditure. This can be achieved using either a logit or probit model. The second part of the model is conditional on the first part being positive and can be a GLM, which can give the researcher flexibility to model cost data. Standard errors and 95% Confidence Intervals (CI) can be estimated using "recycled predictions" a method that bootstraps the data as described by Kleinman and Norton (2009). An early application of the two-part model method was conducted by Manning and colleagues (1987) to address the high proportion of their subjects that did not incur expenditures.

For more information on widely used choices and how to choose among them, the analyst will want to consult the papers by Manning and Mullahy cited below.  Two lectures on cost regressions are given in the HERC econometrics course, and archived on the training section of this web site.

Retransformation Bias

Economists frequently wish to estimate regression models using healthcare cost as the dependent variable. Health data are often strongly skewed to the right, however, making ordinary least squares unattractive. For example, the length of inpatient stays and the cost of inpatient care are often highly skewed (and kurtotic).

A common approach is to use the natural log of cost in place of raw cost. The logarithmic transformation often removes enough skewness to allow least squares models to produce unbiased results. The resulting coefficients from such a regression are not directly interpretable in raw dollars.  The fitted value of a log-cost regression cannot be exponeniated to estimate cost, as there is a retransformation bias (Manning 1998).

Retransformation bias does not occur when simulating costs from parameters estimated from GLM regressions; this is one of several advantages to the GLM approach.

The case of homoskedastic errors: the smearing estimator

If the errors from the regression are homoskedastic, one can determine an appropriate retransformation through the smearing estimator (Duan 1983). Consider a regression model of the form: A simulation of the retransformed fitted value (cost) when X=X0 is not simply: Although the expected value of the residual is zero, it is subject to a non-linear retransformation. The expected value of cost when X=X0 is thus: The smearing estimator for models with log-transformed dependent variables is the right hand factor. It is the mean of the anti-log of the residuals: Most regression packages allow the analyst to save the residual. To find the smearing estimator, we find the anti-log of the residuals, and then find its mean. This often yields a value between 1 and 2. The smearing estimator is then multiplied by the fitted value to correct it for retransformation bias.

The method in Duan (1983) also applies to other non-linear models, such as a square-root transformation of the dependent variable.

The case of heteroscedastic errors

Quite often the error for a particular observation in the cost regression will depend on the level of one or more regressors. This situation, known as heteroscedasticity, precludes the use of Duan's smearing estimator unless the heteroscedasticity can be modeled accurately. For example, if heteroscedasticity occurred only based on gender, then one could estimate separate smearing estimators for men and for women. The sources of heteroscedasticity may be more complicated in other situations, however, and in some cases it may be impossible to control for it sufficiently.

There are several alternative approaches to this problem. A technical explanation is beyond the scope of this FAQ response; interested readers are encouraged to read the journal articles in the References section below. Mullahy (1998) lays out the econometric problem in detail and derives the bias of the smearing estimator when heteroscedasticity is present. Manning and Mullahy (2001) and Basu et al. (2004) describe several alternatives: ordinary least squares on the natural log of y; GLM variants (such as gamma regression with log link and Weibull regression with log link); and the Cox proportional hazards model. They conclude that no single model is best under all circumstances.

Applications of Cost Regression Methods to VA Data

HERC has used cost regressions to estimate the cost of VA hospital stays and to determine the incremental effect of chronic disease on VA health care costs.

Estimating VA Inpatient Costs

HERC uses cost regressions to estimate the cost of VA hospital stays.  A cost regression is estimated using non-VA data, the Medicare stays of veterans. Cost-adjusted charges are the dependent variable and characteristics of the patient, the hospital, and the hospital stay, are the independent variables.  The resulting coefficients are used to create predict costs (fitted values of the dependent variable) for VA hospital stays with particular attributes (levels of the independent variables).

This method is more precise than assuming that every day of hospital stay has the same cost, or that cost is proportionate to Diagnosis Related Group (DRG) weight. It takes advantage of additional information available to explain the costs variations, such as days of stay that are longer than the average for that DRG.

See the page describing the HERC average cost estimates for more information on this regression analysis.

Studies that rely on this costing method are listed in the HERC bibliography of journal articles and reports that use VA data.

One limitation of the HERC cost regressions is the lack of information on the cost of physician services.   HERC use the cost-adjusted charge from the hospital as the dependent variable, excluding the cost of physicians services.  Physician bill separately from the hospital, and it is difficult to determine which part of the physician reimbursements are attributable to services provided during a hospital stay.   VA costs include all physician services, however, and so the predicted cost-adjusted charges based on a non-VA hospital regression understates the true cost of care.  HERC adjusts its estimates so that they sum to the total of VA inpatient costs.  This assumes that the cost of physician services is proportional to the cost of the hospital component.  There are few alternatives to making this assumption.  Analysts who need a more specific cost of physician services provided to hospitalized patients would need to merge physician billing data with hospital billing data. Two studies have estimate the physician cost associated with each DRG.  Mitchell et al. (1995) and Miller and Welch (1993) examined the average Medicare reimbursement for physician services provided to hospitalized patients for each DRG (Diagnosis Related Group). Unfortunately, this work became obsolete with the revision of the DRG classification system in 2007. A chronological history of DRG changes can be found on the DRG Wikipedia site.

Regression Studies of the Cost of Chronic Diseases

Researchers at HERC have use cost regression to estimate the incremental effect of common chronic conditions on VA cost.  These studies used diagnosis codes from VA encounter records to classify different conditions and obtained estimates of the costs of VA health care from HERC Average Cost estimates.  The most recent study estimated the costs and prevalence of 16 conditions in 2000 and 2008 based on two instances of a specific diagnosis in encounter records. An earlier study, based on 1999 data, estimated the costs and prevalence of 40 different conditions and used a less restrictive definition of only a single diagnosis. Both studies used the same multivariate methods to estimate the marginal costs associated with each chronic condition after adjusting for all other conditions and demographic characteristics such as age and gender. For general estimates of the total VA patient population, researchers can contact HERC.

HERC researchers create an annual person-level file each year that contains the total costs of VA inpatient, outpatient, pharmacy, and fee basis care. This file was formerly only available to VA researchers at the Austin Information Technology Center (AITC). However, this is no longer the case. The Managerial Cost Accounting System (MCA), formally known as Decision Support Services (DSS) is now in the CDW as SQL tables. Researchers can use this file to link annual patient costs to diagnosis information in other VA data tables to estimate the costs incurred by patients with specific conditions and other cohorts of interest. Please refer to the VHA Data Portal for access to these files.

For further reference, see HERC Guidebooks.

References

Barnett PG. Determination of VA health care costs. Medical Care Research and Review 2003;60(3 Suppl):124S-141S.

Basu A, Manning WG, Mullahy J. Comparing alternative models: log vs Cox proportional hazard? Health Economics 2004;13(8):749-765

Deb P, Norton EC. Modeling Health Care Expenditures and Use. Annu Rev Public Health. 2018 Apr 1;39:489-505.

Duan N. Smearing estimate: a nonparametric retransformation method. Journal of the American Statistical Association 1983;78:605-610.

Kleinman LC, Norton EC. What's the Risk? A simple approach for estimating adjusted risk measures from nonlinear models including logistic regression. Health Serv Res. 2009 Feb;44(1):288-302.

Manning WG. The logged dependent variable, heteroscedasticity, and the retransformation problem, J Health Econ, 1998;7:283-95.

Manning WG, Mullahy J. Estimating log models: to transform or not to transform?, J Health Econ, 2001;20:461-94.

Manning WG, Basu A, Mullahy J. Generalized modeling approaches to risk adjustment of skewed outcomes data, J Health Econ, 2005;24:465-88.

Manning WG. Dealing with skewed data on costs and expenditures, in: Jones, A. (Ed.) The Elgar Companion to Health Economics, 2006; pp. 439-446 (Cheltenham, UK, Edward Elgar).

Manning WG, Newhouse JP, Duan N, Keeler EB, Leibowitz A, Marquis MS. Health insurance and the demand for medical care: evidence from a randomized experiment. Am Econ Rev. 1987 Jun;77(3):251-77.

Manning WG, Mullahy J. Estimating log models: to transform or not to transform. Journal of Health Economics 2001;20:461-494.

Miller ME, Welch WP. Analysis of Hospital Medical Staff Volume Performance Standards: Technical Report. Washington, DC: Urban Institute, 1993.

Mitchell JB, McCall NT, Burge RT, Boyce S, Dittus R. Heck D, Parchman M, Iezzoni L. Per Case Prospective Payment for Episodes of Hospital Care. NTIS report PB95226023. Waltham, MA: Health Economics Research, 1995.

Mullahy J. Much ado about two: reconsidering retransformation and the two-part model in health econometrics. Journal of Health Economics 1998;17:247-281.