Next Article in Journal
Self-Rated Health: Inequalities and Potential Determinants
Next Article in Special Issue
Vitamin D and Calcium Insufficiency-Related Chronic Diseases: an Emerging World-Wide Public Health Problem
Previous Article in Journal
Alcohol Consumption and Development of Acute Respiratory Distress Syndrome: A Population-Based Study
Previous Article in Special Issue
Life Years at Risk: A Population Health Measure from a Prevention Perspective
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

The Effect of Uncertainty in Exposure Estimation on the Exposure-Response Relation between 1,3-Butadiene and Leukemia

1
Wayne State University School of Medicine, Karmanos Cancer Institute, Detroit, MI 48201, USA
2
University of Alabama at Birmingham School of Public Health, Department of Epidemiology, Birmingham, AL 35294, USA
3
Centers for Disease Control and Prevention, Division of Reproductive Health, Atlanta, GA 30341, USA
4
University of Minnesota School of Public Health, Division of Environmental Health Sciences, Minneapolis, MN 55455, USA
*
Author to whom correspondence should be addressed.
Int. J. Environ. Res. Public Health 2009, 6(9), 2436-2455; https://doi.org/10.3390/ijerph6092436
Submission received: 16 July 2009 / Accepted: 8 September 2009 / Published: 11 September 2009
(This article belongs to the Special Issue Advances in Epidemiology)

Abstract

:
In a follow-up study of mortality among North American synthetic rubber industry workers, cumulative exposure to 1,3-butadiene was positively associated with leukemia. Problems with historical exposure estimation, however, may have distorted the association. To evaluate the impact of potential inaccuracies in exposure estimation, we conducted uncertainty analyses of the relation between cumulative exposure to butadiene and leukemia. We created the 1,000 sets of butadiene estimates using job-exposure matrices consisting of exposure values that corresponded to randomly selected percentiles of the approximate probability distribution of plant-, work area/job group-, and year specific butadiene ppm. We then analyzed the relation between cumulative exposure to butadiene and leukemia for each of the 1,000 sets of butadiene estimates. In the uncertainty analysis, the point estimate of the RR for the first non zero exposure category (>0–<37.5 ppm-years) was most likely to be about 1.5. The rate ratio for the second exposure category (37.5–<184.7 ppm-years) was most likely to range from 1.5 to 1.8. The RR for category 3 of exposure (184.7–<425.0 ppm-years) was most likely between 2.1 and 3.0. The RR for the highest exposure category (425.0+ ppm-years) was likely to be between 2.9 and 3.7. This range off RR point estimates can best be interpreted as a probability distribution that describes our uncertainty in RR point estimates due to uncertainty in exposure estimation. After considering the complete probability distributions of butadiene exposure estimates, the exposure-response association of butadiene and leukemia was maintained. This exercise was a unique example of how uncertainty analyses can be used to investigate and support an observed measure of effect when occupational exposure estimates are employed in the absence of direct exposure measurements.

1. Introduction

Assessment of exposure in epidemiologic studies is especially difficult for historical periods when worker or workplace monitoring data were scarce. Exposure typically must be estimated using information on subjects’ history of employment by production area, job title, task, duration of employment or a combination of these [1,2]. In these situations misclassification of subjects by exposure is inevitable, error in study results is likely and the direction of the error may be unpredictable [310]. Uncertainty analysis of exposure estimates can be used to evaluate quantitatively the impact of exposure measurement error on study results and can improve the interpretation of study results [1113]. Uncertainty analysis is an approach in which the statistical analysis is systematically repeated, using different assumptions each time. This technique may be used to measure how sensitive results are to changes in assumptions about selection bias, information bias and confounding. In an uncertainty analysis, one may repeat the analysis using different corrections for possible unintentional omissions from the eligible study group for misclassification of subjects by exposure or outcome or for uncontrolled confounding [1417].
In a retrospective follow-up study of mortality among North American synthetic rubber industry workers, cumulative exposure to 1,3-butadiene (butadiene), a carcinogen [18] of substantial industrial importance [19], was positively associated with leukemia. Evidence of exposure-response persisted after controlling for potential confounding by other agents [20]. Problems with historical exposure estimation, however, may have distorted the observed association between butadiene and leukemia.
Here we report the results of an uncertainty analysis that examines quantitatively the impact of potential inaccuracies in exposure estimation on the observed results of an investigation of the relation between cumulative exposure to butadiene and leukemia.

2. Methods

2.1. Overview of Exposure Estimation

The approach used to estimate exposure in our study of synthetic rubber workers has been described previously [21,22]. Development of exposure estimates did not use industrial hygiene data for several reasons. There have been extensive changes in production processes and engineering controls in the synthetic rubber industry since it began in the 1940s, historical exposure measurements were sparse before 1975, and exposure measurements taken since 1975 did not cover all work area/job groups at all plants and may have underestimated butadiene concentrations.
Estimation procedures, explained in detail elsewhere [21,22], included: 1) identifying at each plant a series of work area/job groups that had similar job tasks and exposure potential, 2) identifying for each work area/job group its component tasks that entailed exposure, documenting historical changes in those tasks, and estimating exposure time and intensity (parts per million, ppm) associated with each task; 3) calculating calendar time period-specific eight-hour time-weighted average (TWA) exposure intensities for each work area/job group and compiling these into job-exposure matrices (JEMs), and 4) linking the exposure estimates in the JEMs with each subject’s work history to obtain cumulative exposure estimates. To better illustrate the exposure estimation process used in our main analyses and the approximate probability distributions associated with the butadiene exposure estimates, we have included an Appendix that outlines one subject’s work history, with its calendar year and work area/job group combinations and the corresponding calculated butadiene estimates.
To develop information on exposure and on historical changes in exposure potential for each of the work area/job groups, we conducted in-depth walk-through surveys at each of the six plants, met with knowledgeable plant staff, obtained engineering and construction records, and interviewed workers who had a history of long-term employment in specific work area/job title groups. The interviews provided information on process layout, equipment and material flow, process operations, job titles of workers employed in routine operations or maintenance/cleanup, potential exposure sources and exposure control systems.
We developed an integrated system of computer programs to assist with documenting and calculating exposure estimates. This system consisted of an interactive Statistical Analysis System-AF [23] interface that integrated text descriptions of each task and information on the exposure scenario, on the exposure estimation assumptions and on calculations documenting the exposure estimates for each task and time period. The menu driven interface enabled investigators to review and modify estimation assumptions (i.e., probability of an operator standing in the emission plume, wind speed, frequency and duration of task, and distance of operator from point source of emission), to recalculate task and/or work area/job group-specific estimates and to obtain the approximate probability distribution of butadiene intensity (ppm) for each combination of plant, work area/job group and calendar year. The end result was a JEM, each cell of which contains a distribution of butadiene ppm estimates. The Appendix (Illustration of Exposure Estimation) further summarizes exposure estimation procedures by illustrating the derivation of the approximate probability distribution of butadiene ppm estimates for one plant/task/year combination and the use of these estimates in obtaining the corresponding distribution for a plant/work area/job group/year combination.

2.2. Task-Specific Exposure Estimates

We used information obtained from interviews with plant hourly and salaried staff and direct observation of the work place to compute a distribution of exposure estimates for each task in each time period during which exposure determinants could be considered constant. We then compiled task-specific exposure estimates into a task-exposure matrix and identified the tasks comprising each work area/job group.
In brief, we derived each time period -specific distribution of estimates for each task by specifying a lower and upper boundary for the parameters in an exposure model with the following parameters: emission rate, ventilation rate/air speed, and, when appropriate, the distance of the worker from a point source of emissions for each task entailing exposure other than background (see Appendix, section II). We assumed that each parameter in the exposure model followed a triangular distribution with the mode at the midpoint between the boundaries. We then used simulation to compute an approximate probability distribution of the butadiene exposure intensity for a task. We further computed the approximate distribution of the sum over one shift of butadiene ppm-minutes associated with a particular task by assuming that the task’s duration and frequency followed a triangular distribution. We evaluated the resulting empirical distributions to find the approximate 1st, …, 99th percentile of each task- and time period-specific exposure intensity estimate.

2.3. Work Area/Job Group Exposure Estimates

To obtain eight-hour TWA estimates for each work area/job group, we developed algorithms to combine task-specific estimates with background estimates (Appendix, Section III). These algorithms first multiplied the intensity for each task by the task-specific minutes of exposure occurring during a work shift to obtain the task-specific number of ppm-minutes; next, multiplied the remaining part of the time period of the shift by the estimated area background intensity to obtain the number of ppm-minutes of background exposure; and last, divided the sum of ppm-minutes of exposure by 480 to obtain the eight-hour TWA in ppm. Thus, the algorithms considered for each task comprising the work area/job group, the frequency and duration of the task during an eight-hour work shift.

2.4. Subject-Specific Cumulative Exposure Estimates

We linked exposure estimates for each work area/job group with the work histories of individual workers and computed final lifetime cumulative exposure indices. The latter computation involved multiplying the calendar year-specific amount of time a worker spent in each work area/job group by the concentration (ppm) or annual number of peaks estimated for that work area/job group and calendar year category, and summing over all work area/job title groups and years covered by a subject’s employment history.

2.5. Vital Status and Cause of Death Information

We used linkages with several national databases, including the National Death Index (NDI), Social Security Administration (SSA) and Canadian Mortality Database (CMDB), to update vital status of the study group. Cause of death information came from a combination of death certificate information (for subjects who died before 1979, the beginning of the NDI) and linkages to NDI Plus and the CMDB. We attempted to obtain medical records for all subjects whose death certificate mentioned leukemia. For analyses, we included as leukemia decedents those subjects whose medical records confirmed a diagnosis of leukemia and subjects whose death certificate indicated an underlying or contributing cause of death from leukemia.

2.6. Association of Butadiene Exposure to Leukemia Mortality in the Main Analysis

Poisson regression analyses of the relation between cumulative exposure to butadiene and leukemia mortality among the study group included 500,174 person-years of observation and 81 decedents with leukemia. Evidence of exposure-response persisted, after controlling for age, years since hire and potential confounding by other agents [20].

2.7. Uncertainty Analyses

Uncertainty analyses evaluated the impact of potential inaccuracies in butadiene exposure estimation on relative rates (RRs) for leukemia. In these analyses we examined subjects’ leukemia mortality rates in relation to each of 1,000 sets of butadiene cumulative exposure (ppm-years) estimates.
To obtain the ith (i, 1–1000) set of exposure estimates for a particular plant, for each work area/job group at that plant we: 1) randomly selected a percentile (1–99%) and used the exposure estimate corresponding to this percentile for each work area/job group, 2) obtained, from each year-specific approximate probability distribution of exposure estimates for that work area/job group, the butadiene ppm value corresponding to the selected percentile, 3) repeated percentile selection for each work area/job group 1000 times, and 4) compiled the complete work area/job group-year butadiene ppm JEM for the ith iteration. After we combined the butadiene ppm values selected for each plant during the ith iteration of the procedure to obtain JEM (i), we linked JEM (i) to work history data to obtain the ith set of butadiene ppm-years for each subject. We then analyzed the relation between cumulative exposure to butadiene and leukemia for the data derived from each of the 1,000 JEMs (Figure 1).
Poisson regression analyses used the Statistical Analysis System GENMOD procedure [23] to obtain maximum likelihood estimates of leukemia RRs for categories of butadiene ppm-years (>0–<33.7, 33.7–<184.7, 184.7–<425.0, and 425.0+ ppm-years), controlling for age and years since hire. We specified exposure categories based on the distribution of cumulative butadiene exposure among leukemia decedents, using quartiles of cumulative exposure among those decedents with nonzero exposure.

2.8. Exposure-Response Simulation

To assess any observed exposure-response association of butadiene ppm-years and leukemia, we performed a simulation that determined how often we would see a monotonic increase in RRs in the four exposure categories, due to chance alone. Using data from the main analysis [20], we determined the proportional distribution of leukemia cases that would yield all RRs = 1.0 after adjusting for covariates. Briefly, we took the observed value for each exposure category and divided it by the adjusted RR to compute the theoretical number of cases that would yield RR = 1.0. Next, we summed all expected values and recalculated the proportion of the total accounted for by each expected value. We, then used the set of values calculated above as the parameters of a multinomial distribution with N = 81 (the total number of leukemia cases observed), and generated first 10, then 1,000, then 10,000 and finally 1,000,000 samples of size 81, which represented a control population for the 1,000 alternative cohorts in the uncertainty analyses. For each sample, we counted the number of contrasts between adjacent RRs that were consistent with a positive or negative exposure-response.

3. Results

As expected, percentiles chosen for each primary work area/job group in the six plants ranged from a minimum value of 1 to a maximum of 99. Median values for the selected percentiles ranged from 43.5 for one work area/job group in plant seven to 54.0 for three work area/job groups in plant seven and one work area/job group in plant one. Among the 1,000 datasets, minimum and maximum selected percentiles ranged from 1 to 20 and from 83 to 99, respectively. Median percentiles ranged 27.5–73.0, and the arithmetic mean of selected percentiles ranged from 35.0 to 67.2 (data not displayed).
Leukemia RRs for the lowest nonzero category of butadiene ppm-years (category 1) ranged from a minimum of 1.2 to a maximum of 1.8 (Table 1). In categories 2, 3, and 4 of butadiene ppm-years, the ranges of RRs were 1.1–2.2, 1.2–3.8, and 2.4–4.3, respectively. The RR median values indicated a positive association between butadiene ppm-years and leukemia with RRs of 1.0, 1.5, 1.6, 2.6, and 3.3, respectively, for exposures of 0, >0–<33.7, 33.7–<184.7, 184.7–<425.0, and 425.0 + ppm-years.
Among the 1,000 uncertainty analysis datasets, 473 indicated a regular exposure-response relation between butadiene ppm-years and leukemia (data not presented), in that the RR from each nonzero category of butadiene ppm-years was greater than the RR for the next lower category. Among the 473 datasets that indicated a regular exposure-response pattern, the median change in RR between adjacent exposure categories was 20% for categories 1 and 2, 41% for categories 2 and 3, and 35% for categories 3 and 4. In the absence of a control distribution reflecting the null hypothesis of no association, we undertook an exercise to determine how often we would see a monotonic increase in RRs due to chance alone. Under the null hypothesis, only five or six of the 1,000 uncertainty analyses should have resulted in a monotonically increasing risk level within the four exposure categories, while we observed 473, even after perturbing the exposure estimates throughout the ranges of uncertainty that we designed.
In exposure category 1 of butadiene ppm-years, 25% of the RRs had a value of 1.4, the same value as in the main analysis (Figure 2). Eight percent of the RRs in category 1 were less than 1.4, and 67% of the RRs were greater than 1.4. In exposure category 2, only 1% of the RRs had the same value as in the main analysis (RR = 1.2). Almost all (99%) of the RRs in exposure category 2 were greater than 1.2, whereas less than 1% had a value lower than 1.2. In both categories 3 and 4, the majority of RRs were less than the corresponding RR from the main analysis.
In 166 (31%) of the 527 datasets that did not display a monotonic exposure-response pattern, the lack of montonicity was due to the fact that two or more adjacent exposure categories had the same RR (Table 2). In 79 the RR from exposure category 4 was less than the RR from category 3. In 44 the RR from category 3 was less than the RR from category 2. In 199 the RR from category 2 was less than the RR from category 1. In 38 the RR from category 4 was less than the RR from category 3, and the RR from category 2 was less than the RR from category 1.
Figure 2 can be interpreted as a probability distribution that describes our uncertainty in RR point estimates due to uncertainty in exposure estimation. Figure 2 shows that, under our assumptions in the uncertainty analysis about the exposure estimation parameters and under our analysis assumptions, the point estimate of the RR for category 1 of butadiene ppm-years is most likely to be about 1.5; it is unlikely to be less than 1.2 or greater than 1.9. The RR for category 2 is most likely to be about 1.5–1.8; it is unlikely to be less than 1.1 or greater than 2.0. The RR for category 3 is most likely to be about 2.1–3.0; it is unlikely to be less than 1.5 or greater than 3.4. The RR for category 4 is likely to be about 2.9–3.7; it is unlikely to be less than 2.5 or greater than 4.2.

4. Discussion

In most epidemiologic research, the amount of error in a measure of effect is presented in a confidence interval, which is simply an indication of random error or the effect measure’s precision. However, the amount of error due to the effect measure’s validity, the systematic error, rarely is presented. A quantitative assessment of the systematic error for an effect estimate can be made by conducting uncertainty analysis [1417,2429].
In our study of mortality among North American synthetic rubber industry workers, we assessed the impact of potential systematic error due to problems with historical exposure estimation on the observed association between butadiene and leukemia. When comparing the distribution of RRs from the uncertainty analyses to those in our main analysis, in which the exposure estimates were derived from a JEM containing butadiene intensities corresponding to the mean of the approximate probability distribution of estimates for each plant/work area/job group/calendar year combination, the main analysis RRs in the first two exposure categories fell at the low end of the distribution of RRs from the uncertainty analyses and were at the high end of the distribution in the third and fourth exposure categories. Nonetheless, after considering the complete probability distributions of butadiene exposure estimates, the exposure-response association of butadiene and leukemia is maintained.
There are alternatives to the procedures we used to assess uncertainty stemming from exposure estimation. One possible approach could include the arbitrary variation of assumptions made about TWA estimated exposure for particular work area/job groups. The amount of misclassification of exposure most likely varies among work area/job group estimates. Misclassification may be greatest for work area/job groups that are “nonspecific” (i.e., Production Operator, Production Laborer, Maintenance Laborer or Laboratory worker in unspecified work areas). It is reasonable to assume that a relatively large amount of error occurred in assigning exposure estimates to subjects’ person-time in these groups. Uncertainty analyses could assess how important the lack of job title specificity is in adding to the uncertainty of exposure estimation.
In a preliminary set of uncertainty analyses (data not presented), we created a series of alternative exposure profiles, focusing on work area/job groups that were poorly specified, to evaluate the effect of changes in exposure estimation criteria on the association of butadiene ppm-years and leukemia. We assigned each work area/job group to one of four major categories: unskilled labor in maintenance, skilled trades/field assignment, laboratory technicians and other jobs. We then assigned one of three values of the probability distribution of butadiene estimates (5th percentile, mean or 95th percentile) to each of the four work area/job group categories. The analysis included 10 different exposure profiles and indicated that assumptions made in exposure estimation had little impact on the relation between cumulative butadiene exposure and leukemia. The exposure-response association of butadiene with leukemia persisted in analyses of all 10 exposure profiles. However, this crude analysis had a potential problem in that bias due to exposure estimation error is a complicated function of several parameters, and therefore, examining these few scenarios did not capture the true range of possible estimation error bias.
Using our automated exposure estimation system, we were able to create a much broader range of exposure profiles by creating 1,000 JEMs and subsequently preparing 1,000 datasets for the analysis of the association between butadiene ppm-years and leukemia. The resulting set of RRs portrayed a probability distribution of the estimated RR of the butadiene-leukemia association. These uncertainty analyses assessed the global impact of uncertainty due to exposure estimation on the butadieneleukemia association. The approach entailed manipulation of estimated exposure by using JEMs consisting of exposure values that corresponded to randomly selected percentiles of the approximate probability distribution of plant-, work area/job group- and year-specific butadiene ppm.
This approach was limited in that we were not able to identify particular assumptions (i.e., wind speed, distance of operator from point source of emission, probability of operator standing directly in the emission plume, exposure frequency and duration) that contributed the greatest amount of uncertainty to butadiene exposure estimation. We were also limited to selecting percentile values of butadiene ppm from year-specific approximate probability distributions of exposure estimates for well-defined primary work area/job groups. Butadiene estimates for the less well-defined secondary job groups were, in turn, computed after the percentile estimates were selected for primary work area/job groups. Therefore, this analysis directly quantifies only the variability in the butadiene-leukemia association due to uncertainty in the estimation of butadiene in primary work area/job groups.
This uncertainty analysis was designed to provide insight into the impact of limitations due to exposure estimation procedures, but was carried out only for butadiene ppm-years and leukemia. We estimated exposure for two additional agents in our synthetic rubber workers study, styrene and sodium dimethyldithiocarbamate (DMDTC). Additional analyses could use the same techniques outlined above to investigate the effect on leukemia mortality of uncertainty in styrene and DMDTC exposure estimation.
While additional investigations of the effect of uncertainty in our exposure estimation procedures could be performed, this exercise was a unique approach that displayed the possible distortion of the association observed in our main analysis between cumulative exposure to butadiene and leukemia.
Few occupational and environmental epidemiologic studies have made an effort to quantify the amount of systematic error introduced when using quantitative exposure estimates. This exercise is an example of how uncertainty analyses can be used to investigate and support an observed measure of effect when occupational exposure estimates are employed in the absence of direct exposure measurements.

Appendix

Illustration of Exposure Estimation

Introduction

To illustrate exposure estimation, we selected one subject’s work history, with its calendar year and work area/job group combinations and the corresponding butadiene estimates used in our main analyses. We then selected one combination of work area/job group/calendar year combination from the subject’s work history, described the derivation of butadiene estimates for one of the tasks comprising that work area/job group/year, and calculated the butadiene estimates for the selected work area/job group/year using data from all of its component tasks. Finally, we summarized the derivation of the subject’s butadiene cumulative exposure estimates for one of the uncertainty analysis datasets.

I. Overview of One Subject’s Work History and Butadiene Cumulative Exposure Estimates

The subject whom we selected worked at plant four for 28 years, and his work history consisted of 38 segments, each generated at the end of a calendar year or at the point when the subject changed work area/job group during a calendar year (Table 1A). Each segment of the work history included data on the start and end dates of the segment, the work area/job group, the number of days in the segment, the estimated eight-hour time weighted average (TWA) butadiene exposure intensity in parts per million (ppm), and the estimated cumulative butadiene exposure (ppm-years) as of the end of that segment. The butadiene ppm estimates displayed in Table 1A came from the JEM used in the main analysis. That is, each corresponded to the mean of the approximate probability distribution of butadiene intensity (ppm) estimates for the plant/work area/job group/year combination. The subject’s cumulative butadiene exposure was ppm-years.
Table 1A. Work history of one subject with butadiene (BD) ppm used in main analyses.
Table 1A. Work history of one subject with butadiene (BD) ppm used in main analyses.
SegmentWork area/job groupStart dateEnd dateDaysBD ppm 8-hour TWABD ppm-years
181208/27/194309/24/19432836.00662.76
281209/24/194312/31/19439836.006612.42
381212/31/194301/23/19442336.272514.71
481201/23/194410/01/194425236.272539.73
581710/01/194412/31/19449143.124250.48
681612/31/194412/12/194534642.967491.18
781612/12/194512/31/19451942.967493.41
881612/31/194501/06/1946642.581594.11
981601/06/194612/31/194635942.5815135.97
1081612/31/194612/31/194736542.7788178.72
1181612/31/194710/31/194830537.3081209.87
1281710/31/194812/31/19486143.1242217.07
1381712/31/194812/31/194936543.1242260.17
1481712/31/194910/22/195029543.1242295.00
1581710/22/195012/31/19507043.1242303.26
1681712/31/195012/31/195136543.1242346.36
1781712/31/195112/31/195236643.1242389.57
1881712/31/195212/31/195336543.1242432.66
1981712/31/195312/31/195436543.1242475.76
2081712/31/195412/31/195536543.1242518.85
2181712/31/195512/31/195636643.1242562.06
2281712/31/195612/31/195736543.1242605.16
2381712/31/195712/31/195836543.1242648.25
2481712/31/195812/31/195936543.1242691.35
2581712/31/195912/31/196036640.4189731.85
2681712/31/196012/31/196136540.4189772.24
2781712/31/196112/31/196236540.4189812.63
2881712/31/196203/14/19637440.4189820.82
2981704/30/196312/31/196324540.4189847.93
3081712/31/196312/31/196436640.4189888.44
3181712/31/196412/31/196536540.4189928.83
3281712/31/196512/31/196636540.4189969.22
3381712/31/196612/31/196736540.41891009.61
3481712/31/196712/31/196836640.41891050.11
3581712/31/196810/31/196930440.41891083.75
3681710/31/196912/31/19696140.41891090.50
3781712/31/196912/31/197036540.41891130.89
3881712/31/197004/29/197112040.41891144.17
*Work area/job group 812 = polymerization operative, unspecified; 816 = Polymerization reactor recovery; 817 = recovery in SBR polymerization.

II. Derivation of Butadiene Estimate for One of the Tasks Comprising One Work Area/Job Group

Work area/job group 817 (recovery in SBR polymerization, including compressor house and high solids recovery operations), in which the subject worked from 1948 through 1971, consisted of five tasks that entailed exposure to butadiene (Table 2A). We selected task 305 (minor maintenance, recovery compressor house) to illustrate the estimation of task-specific butadiene exposure intensities.
Table 2A. Component tasks entailing butadiene exposure, work area/job group 817 (recovery in SBR polymerization, including compressor house and high solids recovery operations), plant 4.
Table 2A. Component tasks entailing butadiene exposure, work area/job group 817 (recovery in SBR polymerization, including compressor house and high solids recovery operations), plant 4.
Task numberTask name

301Recovery area background
303Water draw-off from vacuum pumps
305Minor maintenance of recovery compressor house
312Drain water from butadiene decanter (recycle tanks)
315Minor maintenance of butadiene pumps
Table 3A describes task 305 and indicates the exposure scenario and the parameters used to calculate the distribution of butadiene intensity estimates for the task for the time period 1943–1983. There was no butadiene exposure in task 305 after 1983 at plant four.
Table 3A. Description of task 305, exposure scenario, and parameters used to estimate exposure to butadiene.
Table 3A. Description of task 305, exposure scenario, and parameters used to estimate exposure to butadiene.
Description
The inspection and maintenance of the recovery compressors involved inspecting the area for compressor leaks and preparing the compressor for repair by a mechanic or pipefitter. Exposure is a function of the compressor leak rate. The leak rate for compressors was determined to be 20–30 lbs per day. The compressors leaked liquid that was approximately 90% butadiene. The average wind speed values (lower and upper limit) for this task across all plants was used. We assumed that, during the inspection, the operator maintained an average distance of 1 meter from any one of the four compressor seals. The upper and lower limits were calculated based on the theory that the probability that the operator stood directly in the plume was 0.125 (lower limit) to 0.25 (upper limit) of standing directly in the plume.

Exposure scenario
Point source emission of butadiene. During the time period 1943–1983, compressors leaked a water/butadiene mixture at a rate of 20–30 lbs/day; 90% of this mixture was butadiene; thus 18–27 lbs of butadiene were lost from each seal per compressor per day.
Parameters
• Butadiene emission rate, Q
  • – Lower limit = 18 lb/day * 454 grams/1lb * 1day/24 hours * 1 hour/3600 seconds = 0.09458 g/sec
  • – Upper limit = 27 lb/day * 454 grams/1lb * 1day/24 hours * 1 hour/3600 seconds = 0.141875 g/sec
• Duration of task (minutes)
  • – Lower limit = 10
  • – Upper limit = 20
• Duration of exposure
  • – Lower limit = 10
  • – Upper limit = 20
• Frequency of task = 4 times/shift
• Distance of the operator = 1 meter
• Wind speed (meters/second)*
  • – Upper limit = 0.42
  • – Lower limit = 1.44
• Probability of operator standing directly in the plume
  • – Lower limit = 0.125
  • – Upper limit = 0.25
*Upper limit is lower than lower limit because the lower the wind speed, the higher the exposure.
Butadiene exposure in task 305 occurred if an operator stood in the plume generated by leaking compressors (exposure scenario, point source of emissions). The probability of nonzero exposure for an operator in task 305 (i.e., the probability that an operator stood in the emission plume) ranged from 0.125 to 0.25. Because the maximum probability of exposure was low, many of the probability distribution’s exposure estimates had a value of zero (Figure 1A). The task had seven other exposure parameters, relevant to calculating estimates under nonzero exposure conditions. Six of these could vary in value, and one (distance of the operator from the emission source) had only one value. We used the point source emissions exposure scenario and the parameter estimates listed in Table 3A to estimate the distribution of nonzero values of the butadiene partial TWA for task 305, as shown in Table 4A, and obtained a lower limit of 18.1886 ppm and an upper limit of 187.0889 ppm. The full dataset of estimates consisted of 3,000 observations. From the complete approximate probability distribution, we selected 99 percentile values of the butadiene exposure intensity estimates for task 305 (Table 5A). The first 80 percentiles had a butadiene exposure intensity of zero because of the high probability of zero exposure in task 305.
Figure 1A. Distribution of butadiene ppm-minutes task 305, plant 4, 1943–1983.
Figure 1A. Distribution of butadiene ppm-minutes task 305, plant 4, 1943–1983.
Ijerph 06 02436f3
Table 4A. Exposure estimation model and calculation of lower and upper limits of nonzero butadiene partial TWA, task 305.
Table 4A. Exposure estimation model and calculation of lower and upper limits of nonzero butadiene partial TWA, task 305.
Description
Intensity of exposure originating from a point source was calculated using a near-field air dispersion model that estimates worker exposure to gases and vapors leaking from pumps and valves:
E ppm = 1000 * 24.45 * Q / ( MW * 0.136 * D 1.84 * u )
where Eppm was the estimated air concentration in ppm of butadiene in the plume originating from the emission source, Q was the butadiene emission rate (lower limit = 0.09458; upper limit = 0.141875 grams/second), MW was the molecular weight of butadiene (54.1), D was the distance of the operator from the emission source (1 meter), and u was the air speed across the dispersion field (lower limit = 1.44, upper limit = 0.42 meters/second). The constants in the denominator of the model are dispersion coefficients from the Gaussian model for predicting downwind concentrations due to dispersion of a gas or vapor.
Information from interviews indicated that duration of task 305 ranged from a lower limit of 10 minutes to an upper limit of 20 minutes, with an exposure frequency of four times per shift. The partial eight-hour time weighted average was calculated as the point source exposure (Eppm) multiplied by the duration and frequency of the task, divided by 480 (the number of minutes in an eight-hour shift).

The probability of an operator standing directly in the plume and having an exposure greater than zero ranged from a lower limit of 0.125 to an upper limit of 0.25. If the operator was not directly in the plume, exposure would have been equal to zero. Therefore, the majority of exposure estimates for task 305 had a value of zero (see Figure B1).
Calculation of nonzero exposure values
Lower limit (LL):
Point source exposure, if operator was in the emission plume:Eppm = [1000 * 24.45 * 0.09458/(54.1 * 0.136 * 11.84 * 1.44)] = 218.2627
Partial time-weighted average (ppm) if in the plume:TWA (task 305) = [Eppm(LL) * duration (LL) * frequency (LL)]/480 = [218.2627 * 10 * 4]/480 = 18.1886 ppm
Upper limit (UL):
Point source exposure if operator was in the emission plume:Eppm = [1000 * 24.45 * 0.141875 /(54.1 * 0.136 * 11.84 * 0.42)] = 1122.5334
Partial time-weighted average (ppm) if in the plume:TWA (task 305) = [Eppm(UL) * duration (UL) * frequency (UL)]/480 = [1122.5334 * 20 * 4]/480 = 187.0889 ppm
Table 5A. Distribution of butadiene (BD) ppm-minutes, 1943–1983, task 305, plant four.
Table 5A. Distribution of butadiene (BD) ppm-minutes, 1943–1983, task 305, plant four.
Description
We computed an approximate probability distribution of the butadiene exposure intensity for task 305 by assuming that each parameter in the exposure model followed a triangular distribution with a mode at the midpoint between the lower and upper boundaries, by identifying the 1st, 2nd, …, 99th percentile of this distribution, and by computing the exposure intensity for all possible combinations of parameter quantiles (i.e., for the approximate joint distribution of the exposure parameters). We evaluated the resulting empirical distribution of exposure estimates to find the approximate 1st, 2nd, …, 99th percentile of each task-and time period-specific exposure intensity estimate.
Results

Percentile of probability distributionBD ppm-minutesPercentile of probability distributionBD ppm-minutesPercentile of probability distributionBD ppm-minutes

1–8008721850.479428984.96
815866.338822790.279530450.26
8212203.218923681.709632126.42
8317268.859024669.889734454.32
8418717.139125609.699837932.57
8519896.179226594.459945111.79
8620910.669327721.00

III. Derivation of Butadiene PPM Estimates for Work Area/Job Group 817 from Component Tasks

We combined the approximate probability distributions of the five component tasks to obtain the final approximate probability distribution of the eight-hour time weighted average exposure intensity for work area/job group 817 (Table 6A). To do this, we: 1) selected 100 points from each of the approximate probability distributions of exposure intensity of the first two component tasks, each corresponding to the mid-point of the range of ppm-minutes of exposure comprised by each percentile category; 2) created a new distribution of every possible combination of these exposure intensities (100 × 100 = 10,000 possible combinations); 3) computed the sum of ppm-minutes of exposure for each combination; and 4) sorted the 10,000 resulting sums from the lowest to the highest. From that distribution we selected 100 new points of the approximate probability distribution of ppm-minutes of exposure attributable to the first two component tasks. We then combined those values with 100 selected points of the approximate probability distribution of the third component task, created a distribution of all possible combinations of exposure intensities, and selected 100 new percentile points of the exposure intensity attributed to the first three tasks. We repeated this process for each of the remaining two component tasks of work area/job group 817. This procedure, at its completion yielded a dataset with 10,000 observations corresponding to the approximate probability distribution of the ppm-minutes of butadiene exposure for work area/job group 817 during a specified calendar year. The arithmetic mean of this distribution, divided by 480 minutes in a work shift, is the butadiene ppm value that we used as the eight-hour TWA of butadiene exposure in the main analysis.
We used the entire percentile distribution of butadiene TWAs created for work area/job groups, to create the 1,000 uncertainty analysis datasets. To obtain each dataset, we randomly selected a percentile for each work area/job group in a particular plant and chose for that work area/job group the set of butadiene ppm values corresponding to that percentile (i.e., for a given work area/job group in a given plant, we used the same percentile for all years to select butadiene ppm values). We compiled 1,000 JEMs containing butadiene ppm values selected according to each set of randomly selected percentiles, linked the 1,000 JEMs to subjects’ work histories, and recalculated all subjects’ cumulative exposure to butadiene for each iteration. Table 7A displays the work history and exposure estimates of our sample subject from the 70th of 1,000 uncertainty analysis datasets. In dataset 70 of the uncertainty analysis, the butadiene ppm eight-hour TWA for work area/job group 817 in 1950 was based on the 25th percentile of the approximate probability distribution of exposure intensities for work area/job group 817.
Table 6A. Combination of task-specific butadiene exposure estimates to obtain the distribution of eight-hour time-weighted average estimates (BD ppm) for work area/job group 817, plant four, 1950.
Table 6A. Combination of task-specific butadiene exposure estimates to obtain the distribution of eight-hour time-weighted average estimates (BD ppm) for work area/job group 817, plant four, 1950.
Procedure
Using the five component tasks for work area/job group 817 that entailed butadiene exposure, we computed the approximate probability distribution of the eight-hour time weighted average exposure intensity. We selected 100 points from each of the approximate probability distributions of exposure intensity of the first two component tasks, and created a new distribution of every possible combination of these exposure intensities (100 * 100 = 10,000 possible combinations). From that distribution we selected 100 new points of the approximate probability distribution of exposure intensity attributable to the first two component tasks. We then combined those values with 100 selected points of the approximate probability distribution of exposure intensity of the third component task, created a distribution of all possible combinations of exposure intensities, and selected 100 new percentile points of the exposure intensity attributed to the first three tasks. We repeated this process for each of the other two component tasks of work area/job group 817.

Distribution of estimates for work area/job group 817
Below are selected values of the approximate probability distribution of BD ppm-minutes for work area/job group 817 in plant four in 1950.
Percentile of probability distributionBD ppm-minutesPercentile of probability distributionBD ppm-minutesPercentile of probability distributionBD ppm-minutes

59213.704514415.398533112.75
1010208.705015007.269038563.94
1510920.085515666.869545231.64
2011557.116016382.51
2512149.746517295.72min5435.93
3012718.857018323.38mean20699.60
3513283.747519912.71max130474.33
4013788.178023472.45

Calculation of BD ppm 8-hour TWA for work area/job group 817, plant four, 1950 (main analysis)

BD ppm 8-hour TWA = mean of approximate probability distribution/ 480 minutes
= 20699.60/480 = 43.1242
Calculation of BD ppm 8-hour TWA for work area/job group 817, plant four, 1950 (dataset 70 of uncertainty analysis)

In the 70th of the 1,000 datasets created for the uncertainty analysis, we randomly selected the 25th percentile of approximate probability distribution of butadiene exposure intensity for work area/job group 817 in plant four.

BD ppm 8-hour TWA = 25th percentile value of approximate probability distribution/ 480 minutes
= 12149.74/480 = 25.3120
Table 7A. Work history of one subject with butadiene (BD) ppm used in dataset 70 of uncertainty analysis.
Table 7A. Work history of one subject with butadiene (BD) ppm used in dataset 70 of uncertainty analysis.
SegmentWork area/job groupStart dateEnd dateDaysBD ppm 8-hour TWABD ppm-years
181208/27/194309/24/19432818.55701.42
281209/24/194312/31/19439818.55706.40
381212/31/194301/23/19442318.56227.57
481201/23/194410/01/194425218.562220.38
581710/01/194412/31/19449125.311426.68
681612/31/194412/12/194534616.420542.24
781612/12/194512/31/19451916.420543.09
881612/31/194501/06/1946616.434743.36
981601/06/194612/31/194635916.434759.52
1081612/31/194612/31/194736516.449975.96
1181612/31/194710/31/194830516.630789.84
1281710/31/194812/31/19486125.312694.07
1381712/31/194812/31/194936525.3045119.36
1481712/31/194910/22/195029525.3120139.80
1581710/22/195012/31/19507025.3120144.65
1681712/31/195012/31/195136525.3614169.20
1781712/31/195112/31/195236625.3120195.36
1881712/31/195212/31/195336525.3366220.68
1981712/31/195312/31/195436525.3100245.97
2081712/31/195412/31/195536525.3139271.27
2181712/31/195512/31/195636625.3084296.63
2281712/31/195612/31/195736525.3092321.92
2381712/31/195712/31/195836525.3137347.22
2481712/31/195812/31/195936525.3126372.51
2581712/31/195912/31/196036623.7432396.30
2681712/31/196012/31/196136523.7102415.00
2781712/31/196112/31/196236523.7005443.68
2881712/31/196203/14/19637423.6767448.41
2981704/30/196312/31/196324523.6767464.30
3081712/31/196312/31/196436623.7113488.06
3181712/31/196412/31/196536523.6885511.73
3281712/31/196512/31/196636523.6767535.39
3381712/31/196612/31/196736523.6888559.06
3481712/31/196712/31/196836623.6718582.78
3581712/31/196810/31/196930423.7432602.54
3681710/31/196912/31/19696123.7432606.51
3781712/31/196912/31/197036523.6718630.16
3881712/31/197004/29/197112023.7115637.89
*Work area/job group 812 = polymerization operative, unspecified; 816 = polymerization reactor recovery; 817 = recovery in SBR polymerization.

References

  1. Checkoway, H; Pearce, N; Crawford-Brown, DJ. Research methods in occupational epidemiology; Oxford University Press: New York, NY, USA, 1989; p. 344. [Google Scholar]
  2. Mannetje, A; Kromhout, H. The use of occupation and industry classifications in general population studies. Int. J. Epidemiol 2003, 32, 419–428. [Google Scholar]
  3. Chavance, M; Dellatolas, G; Lellouch, J. Correlated nondifferential misclassifications of disease and exposure: application to a cross-sectional study of the relation between handedness and immune disorders. Int. J. Epidemiol 1992, 21, 537–546. [Google Scholar]
  4. Flegal, KM; Keyl, PM; Nieto, FJ. Differential misclassification arising from nondifferential errors in exposure measurement. Am. J. Epidemiol 1991, 134, 1233–1244. [Google Scholar]
  5. Wacholder, S; Dosemeci, M; Lubin, JH. Blind assignment of exposure does not always prevent differential misclassification. Am. J. Epidemiol 1991, 134, 433–437. [Google Scholar]
  6. Weinberg, CR; Umbach, DM; Greenland, S. When will nondifferential misclassification of an exposure preserve the direction of a trend? Am. J. Epidemiol 1994, 140, 565–571. [Google Scholar]
  7. Dosemeci, M; Wacholder, S; Lubin, JH. Does nondifferential misclassification of exposure always bias a true effect toward the null value? Am. J. Epidemiol 1990, 132, 746–748. [Google Scholar]
  8. Jurek, AM; Greenland, S; Maldonado, G; Church, TR. Proper interpretation of non-differential misclassification effects: expectations vs observations. Int. J. Epidemiol 2005, 34, 680–687. [Google Scholar]
  9. Kristensen, P. Bias from nondifferential but dependent misclassification of exposure and outcome. Epidemiology 1992, 3, 210–215. [Google Scholar]
  10. Gustafson, P. Measurement error and misclassification in statistics and epidemiology: impacts and Bayesian adjustments; CRC Press/Chapman and Hall: Boca Raton, FL, USA, 2003; p. 200. [Google Scholar]
  11. Kromhout, H; Loomis, DP; Mihlan, GJ; Peipins, LA; Kleckner, RC; Iriye, R; Savitz, DA. Assessment and grouping of occupational magnetic field exposure in five electric utility companies. Scand. J. Work Environ. Health 1995, 21, 43–50. [Google Scholar]
  12. Kromhout, H; Loomis, DP; Kleckner, RC. Uncertainty in the relation between exposure to magnetic fields and brain cancer due to assessment and assignment of exposure and analytical methods in dose-response modeling. Ann. N Y Acad. Sci 1999, 895, 141–155. [Google Scholar]
  13. Phillips, CV; Maldonado, G. Using Monte Carlo methods to quantify the multiple sources of error in studies. Am. J. Epidemiol 1999, 149, S17. [Google Scholar]
  14. Greenland, S. Basic methods for sensitivity analysis and external adjustment. In Modern Epidemiology, 2nd ed; Lippincott-Raven: Philadelphia, PA, USA, 1998; pp. 343–358. [Google Scholar]
  15. Greenland, S; Lash, TL. Bias analysis. In Modern Epidemiology, 3rd ed; Rothman, KJ, Greenland, S, Lash, TL, Eds.; Lippincott Williams & Wilkins: Philadelphia, PA, USA, 2008; p. 758. [Google Scholar]
  16. Fox, MP; Lash, TL; Greenland, S. A method to automate probabilistic sensitivity analyses of misclassified binary variables. Int. J. Epidemiol 2005, 34, 1370–1377. [Google Scholar]
  17. Gustafson, P. Measurement Error and Misclassification in Statistics and Epidemiology: Impacts and Bayesian Adjustments; Chapman and Hall/CRC Press: Boca Raton, FL, USA, 2003. [Google Scholar]
  18. IARC. 1,3-Butadiene. In IARC Monogr 1,3-Butadiene, Ethylene Oxide and Vinyl Halides (Vinyl Fluoride, Vinyl Chloride and Vinyl Bromide); International Agency for Research on Cancer: Lyon, France, 2008; pp. 45–184. [Google Scholar]
  19. Lynch, J. Occupational exposure to butadiene, isoprene and chloroprene. Chem Biol Interact 2001, 135–136, 207–214. [Google Scholar]
  20. Graff, JJ; Sathiakumar, N; Macaluso, M; Maldonado, G; Matthews, R; Delzell, E. Chemical exposures in the synthetic rubber industry and lymphohematopoietic cancer mortality. J. Occup. Environ. Med 2005, 47, 916–932. [Google Scholar]
  21. Macaluso, M; Larson, R; Delzell, E; Sathiakumar, N; Hovinga, M; Julian, J; Muir, D; Cole, P. Leukemia and cumulative exposure to butadiene, styrene and benzene among workers in the synthetic rubber industry. Toxicology 1996, 113, 190–202. [Google Scholar]
  22. Macaluso, M; Larson, R; Lynch, J; Lipton, S; Delzell, E. Historical estimation of exposure to 1,3-butadiene, styrene, and dimethyldithiocarbamate among synthetic rubber workers. J. Occup. Environ. Hyg 2004, 1, 371–390. [Google Scholar]
  23. SAS. SAS Institute Inc., SAS7 Technical Report P-243. SAS/STAT7 Software: The GENMOD Procedure, Release 6.09; SAS Institute: Cary, NC, USA, 1993. [Google Scholar]
  24. Lash, TL; Fink, AK. Semi-automated sensitivity analysis to assess systematic errors in observational data. Epidemiology 2003, 14, 451–458. [Google Scholar]
  25. Orsini, N; Bellocco, R; Bottai, M; Wolk, A; Greenland, S. A tool for deterministic and probabilistic sensitivity analysis of epidemiologic studies. Stata J 2008, 8, 29–48. [Google Scholar]
  26. Robins, JM; Rotnitzky, A; Scharfstein, DO. Sensitivity analysis for selection bias and unmeasured confounding in missing data and causal inference models. In Statistical Models in Epidemiology, the Environment and Clinical Trials; Halloran, ME, Berry, D, Eds.; Springer: New York, NY, USA, 2000; p. 274. [Google Scholar]
  27. Scharfstein, DO; Daniels, MJ; Robins, JM. Incorporating prior beliefs about selection bias into the analysis of randomized trials with missing outcomes. Biostatistics 2003, 4, 495–512. [Google Scholar]
  28. Turner, RM; Spiegelhalter, DJ; Smith, GCS; Thompson, SG. Bias modeling in evidence synthesis. J. Royal. Stat. Soc 2009, 172, 21–47. [Google Scholar]
  29. Vansteelandt, S; Goetghebeur, E; Kenward, MG; Molenberghs, G. Ignorance and uncertainty regions as inferential tools in a sensitivity analysis. Stat. Sinica 2006, 16, 953–980. [Google Scholar]
Figure 1. Creation of 1,000 datasets for uncertainty analyses.
Figure 1. Creation of 1,000 datasets for uncertainty analyses.
Ijerph 06 02436f1
Figure 2. Distribution of leukemia relative rate by category of butadiene ppm-years*, 1,000 uncertainty analysis Poisson regression models.* Categories were quartiles of BD ppm-years among exposed leukemia decedents, used in main analyses, in which exposure estimates were derived from a job-exposure matrix containing eight-hour time weighted average butadiene intensities corresponding to the mean of the approximate probability distribution of estimates for each plant/work area/job group/calendar year combination. Leukemia relative rate and 95% CI for BD ppm-years in the main analysis.
Figure 2. Distribution of leukemia relative rate by category of butadiene ppm-years*, 1,000 uncertainty analysis Poisson regression models.* Categories were quartiles of BD ppm-years among exposed leukemia decedents, used in main analyses, in which exposure estimates were derived from a job-exposure matrix containing eight-hour time weighted average butadiene intensities corresponding to the mean of the approximate probability distribution of estimates for each plant/work area/job group/calendar year combination. Leukemia relative rate and 95% CI for BD ppm-years in the main analysis.
Ijerph 06 02436f2
Table 1. Summary of relative rates for butadiene ppm-years and leukemia from uncertainty analyses of 1,000 alternative datasets of exposure estimates.
Table 1. Summary of relative rates for butadiene ppm-years and leukemia from uncertainty analyses of 1,000 alternative datasets of exposure estimates.
Butadiene ppm-years*Relative rate
MinimumMaximumMeanMedian

01.01.01.01.0
>0–<33.71.21.81.51.5
33.7–<184.71.12.21.61.6
184.7–<425.01.23.82.62.6
425.0+2.44.33.33.3
*Categories based on quartiles of exposed leukemia decedents, used in main analyses, in which exposure estimates derived from a job-exposure matrix containing eight-hour time-weighted average butadiene intensities that corresponded to the mean of the approximate probability distribution of estimates for each plant/work area/job group/calendar year combination.
Table 2. Number of datasets displaying an nonmonotonic dose-response pattern by type of pattern.
Table 2. Number of datasets displaying an nonmonotonic dose-response pattern by type of pattern.
Nonmonotonic pattern*N

RR2 = RR1116
RR3 = RR219
RR3 = RR2 = RR11
RR4 = RR320
RR4 = RR3 & RR2 = RR110
RR4 < RR359
RR4 < RR3 & RR2 = RR120
RR3 < RR243
RR3 < RR2 = RR11
RR2 < RR1182
RR4 = RR3 & RR2 < RR117
RR4 < RR3 & RR2 < RR138
RR3 < RR2 < RR11
*RR1, relative rate for >0–<33.7 butadiene ppm-years; RR2, relative rate for 33.7–<184.7 butadiene ppm-years; RR3, relative rate for 184.7–<425.1 butadiene ppm-years; RR4, relative rate for 425+ butadiene ppm-years.

Share and Cite

MDPI and ACS Style

Graff, J.J.; Sathiakumar, N.; Macaluso, M.; Maldonado, G.; Matthews, R.; Delzell, E. The Effect of Uncertainty in Exposure Estimation on the Exposure-Response Relation between 1,3-Butadiene and Leukemia. Int. J. Environ. Res. Public Health 2009, 6, 2436-2455. https://doi.org/10.3390/ijerph6092436

AMA Style

Graff JJ, Sathiakumar N, Macaluso M, Maldonado G, Matthews R, Delzell E. The Effect of Uncertainty in Exposure Estimation on the Exposure-Response Relation between 1,3-Butadiene and Leukemia. International Journal of Environmental Research and Public Health. 2009; 6(9):2436-2455. https://doi.org/10.3390/ijerph6092436

Chicago/Turabian Style

Graff, John J., Nalini Sathiakumar, Maurizio Macaluso, George Maldonado, Robert Matthews, and Elizabeth Delzell. 2009. "The Effect of Uncertainty in Exposure Estimation on the Exposure-Response Relation between 1,3-Butadiene and Leukemia" International Journal of Environmental Research and Public Health 6, no. 9: 2436-2455. https://doi.org/10.3390/ijerph6092436

APA Style

Graff, J. J., Sathiakumar, N., Macaluso, M., Maldonado, G., Matthews, R., & Delzell, E. (2009). The Effect of Uncertainty in Exposure Estimation on the Exposure-Response Relation between 1,3-Butadiene and Leukemia. International Journal of Environmental Research and Public Health, 6(9), 2436-2455. https://doi.org/10.3390/ijerph6092436

Article Metrics

Back to TopTop