Next Article in Journal / Special Issue
Harnessing Data to Assess Equity of Care by Race, Ethnicity and Language
Previous Article in Journal / Special Issue
DNA Damage, Cell Cycle Arrest, and Apoptosis Induction Caused by Lead in Human Leukemia Cells
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Application of Citizen Science Risk Communication Tools in a Vulnerable Urban Community

1
Division of Environmental Health Sciences, College of Public Health, The Ohio State University, Columbus, OH 43210, USA
2
Division of Epidemiology, College of Public Health, The Ohio State University, Columbus, OH 43210, USA
3
VERTICES, LLC 303 George Street Suite 406, New Brunswick, NJ 08901, USA
4
Environmental Science Graduate Program, School of Environment and Natural Resources, The Ohio State University, Columbus, OH 43210, USA
5
Universities Space Research Association at NASA Marshall Space Flight Center, Huntsville, AL 35805, USA
6
Stambaugh-Elwood Citizens for the Environment, LLC Columbus, OH 43207, USA
*
Author to whom correspondence should be addressed.
Int. J. Environ. Res. Public Health 2016, 13(1), 11; https://doi.org/10.3390/ijerph13010011
Submission received: 11 August 2015 / Revised: 2 October 2015 / Accepted: 9 October 2015 / Published: 22 December 2015

Abstract

:
A public participatory geographical information systems (PPGIS) demographic, environmental, socioeconomic, health status portal was developed for the Stambaugh-Elwood (SE) community in Columbus, OH. We hypothesized that soil at SE residences would have metal concentrations above natural background levels. Three aims were developed that allowed testing of this hypothesis. Aim 1 focused on establishing partnerships between academia, state agencies and communities to assist in the development of a community voice. Aim 2 was to design and conduct soil sampling for residents of the SE community. Aim 3 was to utilize our interactive, customized portal as a risk communication tool by allowing residents to educate themselves as to the potential risks from industrial sources in close proximity to their community. Multiple comparisons of means were used to determine differences in soil element concentration by sampling location at p < 0.05. The results demonstrated that eight metals (As, Cd, Cu, Pb, Mo, Se, Tl, Zn) occurred at statistically-significantly greater levels than natural background levels, but most were below risk-based residential soil screening levels. Results were conveyed to residents via an educational, risk-communication informational card. This study demonstrates that community-led coalitions in collaboration with academic teams and state agencies can effectively address environmental concerns.

1. Introduction

Within government, as well as the academic and scientific community, the focus has shifted towards more of an exposome framework approach when addressing current public health and environmental health issues. The public health exposome is a population-based, exposure science approach to health disparities research. This framework is an integrated model for examining exogenous and endogenous source-exposure-disease relationships across the life cycle and the influence of those relationships on health disparities at a population level [1].
The Healthy People 2020 campaign has identified five social determinants of health: economic stability; education; health and healthcare; neighborhood and built environment; and the social and community context. From an environmental health perspective, the neighborhood and built environment determinant has proven to contribute significantly toward assessing health outcomes that are believed to result from exposure to environmental contaminants. The assessment of environmental conditions is an important consideration in determining potential exposure of humans to hazardous or toxic substances that negatively impact our health [2].
The Kirwan Institute for the Study of Race and Ethnicity at Ohio State University similarly categorizes social determinants of health, but describes them from three perspectives: domains, levels and pathways. Akin to the Healthy People 2020 approach to evaluating health outcomes, the Kirwan Institute also recommends a broader focus that recognizes the relevance of specific areas, geographic scale and the actual mechanisms by which individuals or populations are affected by specific hazards or experiences. In order to address such important public health issues, recognition of structural barriers, as well as the identification of population susceptibility factors must occur when evaluating disparity issues [3].

Environmental Health Disparities

There are numerous communities throughout the United States that bare a disproportionate burden of environmental hazards within close proximity to their living space [4]. This occurrence with respect to vulnerable communities is consistent with an “environmental injustice” theme.
To this end and historically, participatory GIS (P-GIS) has been proven to have robust potential as a tool for analyzing and mapping indicators of “poverty”, “exclusion” or “discrimination” within rural and urban communities. The disenfranchised populations of our society can be mapped as distinct spatial sites or as zones of disparities. Applications from public participatory geographical information systems (PPGIS) practice and research include: mapping “environmental racism”, i.e., the spatial correlation between environmental degradation and the distribution of ethnic or socio-economic groups in urban areas (e.g., Stuart [5]; Kellogg [6]); social equity mapping, i.e., the identification of socio-economic groups that are relatively disadvantaged by ethnicity, employment status, caste, economic class, age, language location or by gender. As reviewed by Hall [7] and Kwan [8], PPGIS utilization has been employed for analyzing differential mobility and people’s access to services according to social categories. Burke and Sawicki [9] and Poole [10] noted in seminal reports that a significant component of P-GIS empowers marginalized groups. Additionally, making such geo-information available serves to promote transparency in decision-making processes [11].
The Environmental Protection Agency (EPA) defines environmental justice (EJ) as, “the fair treatment and meaningful involvement of all people regardless of race, color, national origin, or income with respect to the development, implementation, and enforcement of environmental laws, regulations, and policies” [12]. Often, communities that are disproportionally exposed to an excess of environmental hazards may also be lacking in the other social determinants of health: economic stability, education, healthcare and the social context [13,14]. Low-income communities and specific minority groups are more frequently burdened by the cumulative effects of additional stressors and more frequent exposure pathways [15].
Although environmental justice is something to strive for in all communities, the visibility of the environmental justice movement did not begin until the late 1960s following the American Civil Rights movement. There were several landmark cases in the 1970s and 1980s that were indicative of environmental injustice in communities with certain demographics. For example, in 1979, Bean v. Southwestern Waste Management Inc. was one of the first lawsuits to challenge waste facility siting within a community. Three years later, the placement of a polychlorinated biphenyl landfill placed in Warren County, North Carolina, led to a large number of community member protests. This particular incident steered research studies that assessed predictive factors, such as race, socioeconomic status, land values and the relationship with facility siting and proximity to emissions from industrial facilities. In 1990, Robert Bullard, coined the “father of environmental justice”, fused the concepts of social determinants, environmental movements and community-led resistance strategies in his book Dumping in Dixie: Race, Class and Environmental Quality. With the goals of environmental equity, Bullard planned the 1991 National People of Color Environmental Leadership Summit that highlighted a more comprehensive approach in viewing environmental health issues. The summit’s focus of “public health, worker safety, land use, transportation, housing, resource allocation, and community empowerment” (p.556) ultimately led to the core principles of environmental justice [16].
Despite the growth and visibility of environmental justice movements, millions of people today still experience the burden of excessive hazards within their communities. The EPA has identified seven factors that may contribute to environmental factors in vulnerable communities [17]: (in no particular order) (1) chronic psychosocial stress; (2) unique exposure; (3) multiple and cumulative environmental burdens; (4) physical infrastructure; (5) diminished capacity to participate in decision making; (6) vulnerability/susceptibility; and (7) proximity to sources of environmental hazards.
The Stambaugh-Elwood community is one community of seven within the Southern Gateway in Columbus, Ohio, that exhibits many of these characteristics that may contribute to the disparate health outcomes observed in this community. Our preliminary assessment of the heavy metal content of soils in this urban area that is located in close proximity to industrial complexes represents the first step in determining a hazard index for this area. Although heavy metals may be present naturally in soil in trace amounts, there may be potential health risks to humans if levels are in excess of Franklin County, OH, background levels. Anthropogenic and industrial processes have been sown to increase the potential for adverse exposure to human populations [18,19]. Cumulative and chronic exposures may be contributing factors to a variety of health ailments. Exposure to heavy metals can negatively impact normal functioning of the reproductive and central nervous systems, result in fetal and/or infant death, low birth rates and potential developmental issues [18,19,20,21]. In addition, arsenic, cadmium, chromium and lead are classified as known or probable human carcinogens by the International Agency for Research on Cancer [22].
A prior study assessed heavy metal concentrations in a community located approximately 8–10 miles from Stambaugh-Elwood [23]. Heavy metal concentrations (As, Cd, Cr, Pb and Zn) were compared to the USEPA regional soil screening levels. The study identified Pb and Zn as metals that exceeded Franklin County background concentrations. Similarly to Stambaugh-Elwood, Weinland Park is considered to be a post-industrial low-income urban neighborhood. Fifty percent of Weinland park residents identify as African American. The average annual income of the neighborhood was $17,000 in 2009. About 36% of residents are not employed, and for those that are employed, 18% of residents have full-time employment. The average for the City of Columbus is $41,370 [23,24].
The linkage between environmental domains and disparate health outcomes is gaining appreciation for its multi-dimensionality and defines the recent introduction of our public health exposome framework [1,25]. According to several studies, socioeconomic status may also be a contributing factor to adverse health outcomes [26,27]. Residents of Franklin County, OH, have an average household income of $67,000 annually, and the average Columbus residential home earns approximately $55,000. Southern Gateway residents have an average annual household income of approximately $33,000, which is significantly less than Franklin County and Columbus city averages. In the Southern Gateway community, the poverty rate is 43%, about two times higher than the Columbus city average (~22%) [28].
Like Weinland Park, the Stambaugh-Elwood community characteristics are also indicative of a post-industrial low-come urban neighborhood. In the 1970s, many of the factories and businesses that had thrived during the Industrial Era began to close. The long-term economic effects can be seen within the community as the economy has shifted. Residents have expressed concerns about air quality due to nearby Columbus Castings, one of the metal scrap plants that remain on the South Side. The Stambaugh-Elwood community consists of 46% residents that identify as African American, whereas the overall percentage of the African American population for Columbus, OH, is 28%. This community also has a significantly higher elderly population of 15% of the resident population. Annual income rates show that African Americans have an adjusted mean income of $14,273, whereas non-Hispanic white residents have more than double the income, with an adjusted mean income of $30,451. Overall, 72% percent of residents live below the poverty line. According to comments made by the Southern Gateway Collaborative committee, Stambaugh-Elwood (SE) is isolated from the rest of the Southern Gateway due to industrial use, and the community has been “neglected in terms of infrastructure improvements” [29]. Many residents live near industrial facilities that contain hazardous substances. Adverse health outcomes are much more prevalent in SE than other parts of the city [28]. Recent studies substantiate a growing concern related to potentially linking the spatiotemporal relationships of social vulnerability and exposure to environmental contaminants [30,31]. In a later study, Krieger and colleagues in an elegant study demonstrated that neighborhoods with higher concentrations of poverty and populations of color have higher exposure to traffic-related pollutants [31]. In fact, the study improves our understanding of the social determination of these patterns by analyzing exposure to one spatially-patterned traffic-related air pollutant, black carbon, in connection to the Index of Concentration at the Extremes (ICE) [32]. The focus on black carbon as an exposure with notable public health significance was informed by a plethora of evidence indicating that it is “causally involved in all-cause, lung cancer, and cardiovascular mortality, morbidity, and likely adverse birth outcomes and nervous system effects” [33]. Within the United States, the greatest single contributor to black carbon ambient levels is transportation (2010 estimate: 216 out of 321 Gg emitted) [33], rendering black carbon an important indicator of ambient traffic-related fine particulate matter, especially for urban air pollution [33,34]. This study represents the first phase in deploying our public health exposome framework to analyze potential exposure to spatially-patterned soil contaminant levels in connection to the ICE.
The ICE simultaneously measures the concentration of privilege and deprivation and can be computed at multiple levels and scales. The results of the Krieger et al. [31] study suggest that extreme concentrations of socioeconomic resources and racial/ethnic privilege, structured by social class and race relations, as manifested at the census tract level, are inversely associated with individuals’ residential exposure to black carbon, an important airborne pollutant, even after controlling for individual and household social characteristics.
Vulnerable communities often bear the burden of environmental injustice within their communities, due to political, economic and social factors [35,36,37]. Various population-based studies have shown the associations of environmental disparities being linked to socioeconomic status and race [38,39,40,41]. Studies have shown that communities exhibit various degrees of health outcomes that have previously been linked to environmental contaminants [29,42,43]. For example, preterm birth and infant mortality are adverse health outcomes that have links to environmental exposures. As reported in Ferguson et al., 2013 [44], there are suggestive associations of environmental contamination/exposures that may impact preterm birth outcomes. The heightened concern from environmental contamination and its effect on the fetus is reasonable because of the potential for long-term exposure and the ability of certain contaminants to cross the placental barrier [44].
SE residents live within close proximity to facilities that harbor harmful environmental contaminants. Franklin County, Ohio, has one of the highest infant mortality rates in the nation. Although the Franklin County infant mortality rate is already extraordinarily high in comparison to the rest of the nation, there is also a noticeable disparity between the SE neighborhood within the Southern Gateway and the rest of the county. Franklin County has a 9% low birth weight rate, whereas the South Side has a 12% low birth weight rate (Figure 1).
Figure 1. (a) Franklin County (Franklin CO.) infant birth outcomes [36]. (b) Comparison between South Side health statistics and Franklin County (birth and prenatal care numbers noted in percentages) [3,45,46,47,48].
Figure 1. (a) Franklin County (Franklin CO.) infant birth outcomes [36]. (b) Comparison between South Side health statistics and Franklin County (birth and prenatal care numbers noted in percentages) [3,45,46,47,48].
Ijerph 13 00011 g001

2. Materials and Methods

2.1. Community Mapping Decision Support Tools

Subsequent to the development and customization of a PPGIS portal, MapplerX [49] (Figure 2), by the Division of Environmental Health Sciences, College of Public Health in April 2014, the Environmental Protection Agency launched EJSCREEN in June 2015. Like MapplerX, EJSCREEN is an interactive mapping tool that enables residents of Southern Gateway communities in Columbus, OH, to access public and private databases that may assist in identifying communities that may have environmental concerns. The EPA tool EJSCREEN combines twelve environmental indicators and six demographic indicators that combine to create twelve environmental justice indices. The data include pollution exposure estimates and are able to show population proximity to industrial or facility locations. This comprehensive tool enables users to access a variety of data; however, it is important to note that EJSCREEN is not to be used as a risk assessment tool. Rather, it can highlight areas of interest that may be burdened by environmental disturbances and health disparities. Due to the fact that the EJSCREEN maps can provide data at the local level, they serve to provide the much-needed attention to vulnerable communities that may be in need of further scientific review, analysis or policy changes [50,51].
The SE community of Columbus, Ohio (n = 150) is located within the zip code 43207. Within EJSCREEN, there is approximately 90%–95% of this area within close proximity to a facility requiring a Risk Management Plant (RMP) by the USEPA (Figure 3). Under the Clean Air Act, facilities that use extremely hazardous substances are required to have an RMP on file. For community members that live within the vicinity of these facilities, it is possible that hazardous outputs might be contributing factors to disparate health outcomes within the region [52].
The present preliminary study sought to identify metalloid levels from an urban soil matrix in a community that is located in close proximity to industry, thereby providing baseline residential soil level data for residents and other stakeholders. An important aspect of evaluating relationships between the built environment and health outcomes is geographical information about structural points of interest within a neighborhood. A mapping database, such as geographic information systems (GIS), can provide insight for a variety of potential contributing factors, such as environmental management, social economic status and proximity to potential hazards. PPGIS is a community engagement form of GIS that can also assist with public health advocacy [53,54].
Figure 2. Spatiotemporal presentation of PM2.5 data from the 88 counties in Ohio from the NASA MODIS satellite available at MapplerX [49]. TRI, Toxic Release Inventory. OSU, The Ohio State University; DEHS, Division of Environmental Health Sciences.
Figure 2. Spatiotemporal presentation of PM2.5 data from the 88 counties in Ohio from the NASA MODIS satellite available at MapplerX [49]. TRI, Toxic Release Inventory. OSU, The Ohio State University; DEHS, Division of Environmental Health Sciences.
Ijerph 13 00011 g002
Figure 3. EPA-EJSCREEN portal. Stambaugh-Elwood (SE) population (n = 150) is in the 90–93 percentile for the proximity to a facility with a Risk Management Plan (RMP). The red rectangle denotes the SE neighborhood. EJ: environmental justice; The National-scale Air Toxics Assessment (NATA); Proximity National Priority List Sites (NPL); Proximity to Treatment Storage and Disposal Facilities (TSDF) [51].
Figure 3. EPA-EJSCREEN portal. Stambaugh-Elwood (SE) population (n = 150) is in the 90–93 percentile for the proximity to a facility with a Risk Management Plan (RMP). The red rectangle denotes the SE neighborhood. EJ: environmental justice; The National-scale Air Toxics Assessment (NATA); Proximity National Priority List Sites (NPL); Proximity to Treatment Storage and Disposal Facilities (TSDF) [51].
Ijerph 13 00011 g003
Information provided on the portal developed for the SE community is shown in Table 1 and includes: (1) Ohio health data from the Ohio Department of Health database; (2) sub-county-level gridded PM2.5 data from the Marshall Space Flight Center database in Huntsville, AL [55]; (3) USEPA (Unites States Environmental Protection Agency) Toxic Release Inventory (TRI) data and EPA air data from approximately twelve industrial sites within the boundaries of Southern Gateway communities comprising zip codes 43206 and 43207; (4) census track and zip code data; and (5) land use and cover. An added feature for stakeholders is the ability to permit the uploading of individual spatial data specific to an individual’s place of residence.
Table 1. Examples of mineable sources of environmental data (bold) that are presently included in the customized public participatory geographical information systems (PPGIS) portal for Stambaugh-Elwood.
Table 1. Examples of mineable sources of environmental data (bold) that are presently included in the customized public participatory geographical information systems (PPGIS) portal for Stambaugh-Elwood.
DatasetType of DataPartner Providing Access
(or Publically Available)
Medicaid; Ohio Medicaid Assessment SurveyClaims data; insurance, access to care, health behaviors and experiences of careNationwide Children’s Hospital (NCH), Government Resource Center (GRC), Medicare & Medicaid Services
Pregnancy Risk Assessment
Monitoring System (PRAMS)
Pre- and peri-natal risk and exposure dataPublicly available
USDA Food Environment AtlasAccess to affordable food, food securityPublicly available
U.S. CensusSocioeconomic dataPublicly available
NASA PM2.5 Air quality data for all 88 Ohio countiesMarshall Space Flight Center
Birth and death certificatesDetailed birth outcomes data; can be linkedOhio Department of Health
Tobacco retail outlet dataExposure to tobacco advertisingNielsen, County Auditors
Expression Genetics in Drug Therapy (XGEN)Genome-wide data on disease phenotypesOSU Center for Pharmacogenomics
Phenotypes and eXposures (PhenX)Phenotype databaseNIH
OH Longitudinal Data ArchiveP-20 education data; housing dataOSU Center Human Resource Research
Adolescent Health &
Development in Context
Socio-spatial study of child
Adolescent health in Franklin Co
OSU Department Sociology
Epic Systems Corporation (EPIC)Electronic health recordsWexner Medical Center, NCH
Toxics Release InventorySmokestack emissions into environmentPublicly available

2.2. Consent for Soil Sampling

The consent process for soil sampling at SE residences for this study was done in collaboration with the monthly meetings of the South Side Health Advisory Committee. The South Side Health Advisory Council (SSHAC) is a community health committee sanctioned by Columbus Public Health that seeks to bring the health concerns of a community to the forefront. This specific committee serves residents of the zip codes 43205, 43206 and 43207. Every third Thursday of the month, the Southside Health Advisory Councils hosts community engagement meetings at the Church for All People, located at 946 Parsons Ave, Columbus, OH 43206. Residents of the Southern Gateway community attended these meetings and were provided with project background information from The Ohio State University researchers. During these meetings, residents were given the opportunity to decide if they would like to consent for soil sampling at their residence. Residents were informed of the benefits of the research, potential risks and protection against risks. Although this project was determined to not include human subjects, all residents that elected to take part in the research did sign a consent form: Institutional Review Board, Protocol #2014B0445 (exempt). Consented participants were made aware that they: (1) could leave the study any time; (2) could decide to stop participating in the study and, if so, that there will be no penalty to them; and (3) their decisions would not affect their future relationship with the College of Public Health at The Ohio State University [56]. Forty-two residences consented to participate in the study. There are approximately 150 people in the Stambaugh-Elwood community. From month to month over a two-year period, 35–50 residents attended the monthly meeting of the South Side Health Advisory Committee, which is a sub-committee of Columbus Public Health. The demographic breakdown of the Stambaugh-Elwood community is (1) African American and (2) gender balanced, with the majority of the population over the age of 50. From the individuals that consented to participate in the soil sampling research, future appointments were made for a research team member to obtain soil samples at the residence.

2.3. Soil Sampling Strategy

Twenty-one resident locations within the SE neighborhood were selected from consenting residences by using a random number generator (Figure 4). The selected residences were split into east and west halves of the neighborhood. Ten–eleven residences from each half were selected for a total of 21 residential locations. All soil sampling occurred on 11 April 2015. During sampling, the researchers used their judgment as to shifting the sampling strategy to ensure the better overall balance of sampling coverage in the neighborhood. For example, the number generator selected two residences immediately adjacent to one another. A substitution occurred to sample from a residence farther away.
As referenced in Figure 5 (below), at each location, four types of soil samples were collected: house, road, Yard 1 and Yard 2. For the house samples: four subsamples were collected along the foundation and placed into the house sample bag. For the road samples, four subsamples were collected from the yard area along the road and placed in the road sample bag. For the Yard 1 sample, four subsamples were collected from the general yard area and placed in the Yard 1 sample bag. For the Yard 2 sample, four subsamples were collected from a different part of the yard and placed in the Yard 2 sample bag. Soils were collected using bulb planters, to a depth of 2 inches. There were 84 total samples collected from all of the SE residences. Acquisition of soil samples was performed for total metal content using EPA Method 3051A [57,58]. In totality, sampling resulted in 84 soil (4 × 21) samples. Each sample consisted of four subsamples. For example, walking along the foundation and placing the bulb planter into the soil at four different locations represented the house foundation sample. All of these four subsamples were placed and included in the house-sampling bag. Samples were transported to the laboratory of Nicholas Basta, Ph.D., at Ohio State University and allowed to dry under a fume hood for approximately 2 weeks. Samples were subsequently sieved to 2 mm, and a subsample was crushed using a mortar and pestle for a total acid digestion following EPA Method 3051A. Soil digests were subsequently analyzed for metals using an Agilent 700 ICP-OES (Agilent Technologies, Santa Clara, CA, USA).
Figure 4. A random generator algorithm selected SE residences for soil sampling (blue residences). See the text for details.
Figure 4. A random generator algorithm selected SE residences for soil sampling (blue residences). See the text for details.
Ijerph 13 00011 g004

2.4. Statistical Analysis of Data

The total mean metal content of soils was compared to upper prediction limit values, either as reported by The Ohio Environmental Protection Agency (OEPA) (2013) or calculated from the 95th percentile from U.S. Geological Survey (USGS) (2004, 2013). Soils were considered elevated if the element concentration + 2 standard deviations (SD) were above the 95th percentile natural background concentration reported by USGS (2004, 2013) or OEPA (2013). The minimum, maximum and percentage elevation effect size was calculated for soils with elevated of elements. Multiple comparisons of means were used to determine differences in soil element concentration by sampling location (i.e., house vs. road vs. yard) at p < 0.05. This was accomplished by analysis of variance (ANOVA) and subsequent analysis using Tukey’s honest significant difference (HSD) test at p < 0.05.
Figure 5. Schematic of the soil sampling strategy for selected residences in the Stambaugh-Elwood community.
Figure 5. Schematic of the soil sampling strategy for selected residences in the Stambaugh-Elwood community.
Ijerph 13 00011 g005

3. Results and Discussion

The citizen science GIS portal that was developed for Southern Gateway communities can be viewed in real time at MapplerX [49]. Presently, our tool allows for mapping, visualization and communicating spatial information from large public and private environmental datasets that are relevant to the health status of Southern Gateway community residents. This methodology is a promising approach for engaging community partners in educational risk communication and/or hazard identification assessments by providing an on-line, interactive mapping functionality. As can be seen in the active layer legend in the portal, this functionality allows stakeholders to map data from: (1) health and/or environmental surveys, (2) black/white infant mortality hot spots [59]; (3) Toxics Release Inventory (TRI) data [27]; (4) NASA (National Aeronautic Space Administration) MODIS satellite PM2.5 sub-county level gridded data; (5) zip codes; (6) Ohio census tracks; and (7) land use/land cover data. The methodology also allows stakeholders to map disparities, population and community characteristics and risk factors that are gathered during consolidation of a community principle [16]. In the case of the SE community, our citizen science approach to mapping this community within the context of the larger community presented an opportunity to propose that this population was vulnerable simply based on proximity to potential contaminant emissions from neighboring industry. This supposition was validated with the release of the USEPA EJSCREEN tool. Upon searching the zip code 43207 in EJSCREEN, this census track area scored over 80% in the overall (1) Environmental Justice Index, (2) demographic and (3) environmental profiles to be consistent with the characteristics of an environmental justice community.

3.1. Data Mining for Historical Industrial Emissions in Close Proximity to SE

The two graphs below are examples of how our PPGIS portal can assist vulnerable populations in communities located in close proximity to industrial facilities in educating themselves as it relates to historical contaminant emissions from neighboring industrial facilities. Figure 6a represents the total contaminant air releases from an industrial company in zip code 43207 in close proximity to the SE community for the period 1987–2012. Shown are the data plotted from the TRI database for this 26-year period.
Figure 6b represents the total contaminant emissions from a second industrial facility (Company B) in zip code 43207 for the same 25-year period from 1987 to 2012. From 1987 to 2002, releases of chromium, manganese and manganese containing compounds, molybdenum trioxide, nickel and zinc comprise the majority of releases for the eight-year period from 1996 to 2004, totaling more than a combined 30,000 total pounds released into the environment. Naphthalene (a polycyclic aromatic hydrocarbon whose neurodevelopmental and reproductive toxicity has been thoroughly investigated over the past 20 years) [60,61,62,63,64,65,66,67,68] releases into the environment also far exceed 20,000 pounds per year for this eight-year period.
Figure 6. USEPA Toxic Release Inventory data (1987–2012) of on-site releases for (a) Company A and (b) Company B located in close proximity to the Stambaugh-Elwood Community.
Figure 6. USEPA Toxic Release Inventory data (1987–2012) of on-site releases for (a) Company A and (b) Company B located in close proximity to the Stambaugh-Elwood Community.
Ijerph 13 00011 g006

3.2. Soil Sampling Results in the SE Community

The design of our study allowed us to ask two fundamental research questions with regard to urban soils. First, is there a systematic elevation of soil metals and metalloids in the study area relative to expected concentrations from previously released findings (Lindsay, 1979 [69]; OEPA, 2013; USGS, 2004; USGS 2013) Since metals have natural abundance in all soils, it is important to compare background levels with measured soil levels to determine if contamination as evidenced by elevated levels of metals is present. The results from the 84 soil samples were compared to published values for soil metals and metalloids in Ohio and within Franklin County, OH (Table 1) (Figure 7, Figure 8, Figure 9, Figure 10, Figure 11, Figure 12, Figure 13 and Figure 14). The published values for soil metals in Ohio and Franklin County, OH, were not collected from areas impacted by human activities, i.e., urban residential areas. The published values represent natural uncontaminated soil background levels of metals in soil. It is likely that human activities in urban areas will elevate metal levels. In the present study, seven metals and one non-metal (Cd, Cu, Pb, Mo, P, Se, Tl, Zn) occurred at levels greater than natural background levels (Table 2).
Table 2. Comparison between metal concentrations in Stambaugh-Elwood soil versus published values.
Table 2. Comparison between metal concentrations in Stambaugh-Elwood soil versus published values.
Element Mean ± 2 SE mg/kgUpper Prediction Limits, mg/kgPercent of Samples Exceeding Background 95th Percentile
All Samples (n = 84)Published Values Percent
Aluminum12,670 ± 53250,540 3
Arsenic16 ± 1.020.7 2
Barium143 ± 10443 3
Beryllium<0.11.5 3
Cadmium1.6 ± 0.60.789 286%
Chromium30 ± 241.8 3
Cobalt10 ± 0.412.2 3
Copper38 ± 420.7 349%
Iron22,070 ± 58039,098 1
Lead160 ± 4841.5 299%
Magnesium7120 ± 6409777 1
Manganese599 ± 28765 1
Molybdenum7 ± 0.42.7 350%
Nickel29 ± 236.4 2
Phosphorus1050 ± 188560 199%
Potassium4191 ± 19616,657 3
Selenium2.7 ± 0.21.07 299%
Thallium0.7 ± 0.040.743 252%
Vanadium35 ± 266 3
Zinc262 ± 36105 194%
References: 1 USGS, 2004; 2 OEPA, 2013; 3 USGS, 2013. Upper prediction limit values either as reported by OEPA (2013) or calculated from the 95th percentile from USGS (2004, 2013). Calculated as (minimum effect size/UPL or 95th percentile) times 100 and (maximum effect size/UPL or 95th percentile) times 100 [70,71,72].
The second question that our design allows us to answer is: are there differences in the concentrations of soil metals and metalloids between the sampling locations (house, yard and road). The results from the 84 soil samples were compared to one another based on sampling location (Table 3). This resulted in 21 house samples, 21 road samples and 42 yard samples (21 for Yard 1 and 21 for Yard 2 combined). Most of the elements had consistent concentrations amongst the three sample locations. Zinc was elevated in the house soil samples relative to the other soil sampling locations. Cadmium and lead in house samples tended to have increased soil concentration compared to the other locations, but the increased concentration was not significant at p < 0.05. One element elevated in the road samples was magnesium. The statistically-significantly designations within an element can be seen in Table 3 and are represented by p < 0.05.
Table 3. Elemental metal concentrations in Stambaugh-Elwood soil sampling locations.
Table 3. Elemental metal concentrations in Stambaugh-Elwood soil sampling locations.
Element Sample Location Mean (mg/kg) ± SE
HouseRoadYard 1Yard 2
Aluminum12513 ± 438 a,‡11400 ± 669 b13221± 523 a,b13530 ± 356 a,b
Arsenic17.2 ± 1.3 a13.8 ± 1.1 b15.7 ± 0.5 a,b15.9 ± 0.5 a,b
Barium160 ± 16.6 a136 ± 6.3 a139 ± 4.4 a138 ± 5.2 a
Beryllium<0.1 a<0.1 a<0.1 a<0.1 a
Cadmium2.9 ± 1.0 a1.1 ± 0.1 a1.2 ± 0.1 a1.3 ± 0.1 a
Chromium31.9 ± 3.3 a29.9 ± 2.5 a29.2 ± 1.6 a27.6 ± 0.8 a
Cobalt10.3 ± 0.3 a8.4 ± 0.4 b9.8 ± 0.3 a9.8 ± 0.3 a
Copper44.8 ± 4.2 a36.7 ± 3.8 a36.4 ± 1.6 a36.0 ± 1.9 a
Iron23,100 ± 504 a20,295 ± 638 b22,406 ± 540 a22,478 ± 473 a
Lead251 ± 88 a116 ± 15 a145 ± 21 a130 ± 19 a
Magnesium7672 ± 526 b9692 ± 648 a5493 ± 406 c5625 ± 494 c
Manganese629 ± 23.3 a549 ± 24.5 a619 ± 32 a599 ± 30 a
Molybdenum7.8 ± 0.4 a6.3 ± 0.3 b7.0 ± 0.3 a,b7.1 ± 0.2 a,b
Nickel30.4 ± 0.8 a28.6 ± 2.8 a28.2 ± 0.7 a28.4 ± 0.7 a
Phosphorus951 ± 92.0 a1216 ± 365.3 a1018 ± 40 a1014 ± 40 a
Potassium4088 ± 166 a4141 ± 237 a4161 ± 191 a4372 ± 191 a
Selenium2.8 ± 0.2 a2.6 ± 0.2 a2.9 ± 0.2 a2.7 ± 0.1 a
Thallium0.7 ± 0.0 a0.7 ± 0.04 a0.8 ± 0.1 a0.8 ± 0.0 a
Vanadium34.6 ± 1.0 a32.2 ± 1.5a36.0 ± 1.2 a36.4 ± 0.8 a
Zinc365 ± 57.0 a228 ± 27.7b230.4 ± 17.7 b225.4 ± 16.6 b
Different letter designations (a, b, c) within a row represents significant differences (p < 0.05) between mean values. For instance, for Arsenic, Yard 1 and Yard 2 with a,b represent no statiscal difference. However, with House and Road, House is significantly different that Road at p < 0.05.
Figure 7. Residential urban soil level of As in the Stambaugh-Elwood community versus Franklin County (background), common averages and residential screening levels (RSLs) (mg/kg soil). Soil samples were taken from 21 of 46 residences that consented for the study in compliance with OSU IRB Protocol 2014B0445-exempt. Each sample consisted of four subsamples. Analysis proceeded following EPA Method 3051A, and digests were subsequently analyzed for metals using an Agilent 700 ICP-OES.
Figure 7. Residential urban soil level of As in the Stambaugh-Elwood community versus Franklin County (background), common averages and residential screening levels (RSLs) (mg/kg soil). Soil samples were taken from 21 of 46 residences that consented for the study in compliance with OSU IRB Protocol 2014B0445-exempt. Each sample consisted of four subsamples. Analysis proceeded following EPA Method 3051A, and digests were subsequently analyzed for metals using an Agilent 700 ICP-OES.
Ijerph 13 00011 g007
Figure 8. Residential urban soil level of Cu in the Stambaugh-Elwood community versus Franklin County (background), common averages and residential screening levels (RSLs) (mg/kg soil). Soil samples were taken from 21 of 46 residences that consented for the study in compliance with OSU IRB Protocol 2014B0445-exempt. Each sample consisted of four subsamples. Analysis proceeded following EPA Method 3051A, and digests were subsequently analyzed for metals using an Agilent 700 ICP-OES.
Figure 8. Residential urban soil level of Cu in the Stambaugh-Elwood community versus Franklin County (background), common averages and residential screening levels (RSLs) (mg/kg soil). Soil samples were taken from 21 of 46 residences that consented for the study in compliance with OSU IRB Protocol 2014B0445-exempt. Each sample consisted of four subsamples. Analysis proceeded following EPA Method 3051A, and digests were subsequently analyzed for metals using an Agilent 700 ICP-OES.
Ijerph 13 00011 g008
Figure 9. Residential urban soil level of Pb in the Stambaugh-Elwood community versus Franklin County (background), common averages and residential screening levels (RSLs) (mg/kg soil). Soil samples were taken from 21 of 46 residences that consented for the study in compliance with OSU IRB Protocol 2014B0445-exempt. Each sample consisted of four subsamples. Analysis proceeded following EPA Method 3051A, and digests were subsequently analyzed for metals using an Agilent 700 ICP-OES.
Figure 9. Residential urban soil level of Pb in the Stambaugh-Elwood community versus Franklin County (background), common averages and residential screening levels (RSLs) (mg/kg soil). Soil samples were taken from 21 of 46 residences that consented for the study in compliance with OSU IRB Protocol 2014B0445-exempt. Each sample consisted of four subsamples. Analysis proceeded following EPA Method 3051A, and digests were subsequently analyzed for metals using an Agilent 700 ICP-OES.
Ijerph 13 00011 g009
Figure 10. Residential urban soil level of Mo in the Stambaugh-Elwood community versus Franklin County (background), common averages and residential screening levels (RSLs) (mg/kg soil). Soil samples were taken from 21 of 46 residences that consented for the study in compliance with OSU IRB Protocol 2014B0445-exempt. Each sample consisted of four subsamples. Analysis proceeded following EPA Method 3051A, and digests were subsequently analyzed for metals using an Agilent 700 ICP-OES.
Figure 10. Residential urban soil level of Mo in the Stambaugh-Elwood community versus Franklin County (background), common averages and residential screening levels (RSLs) (mg/kg soil). Soil samples were taken from 21 of 46 residences that consented for the study in compliance with OSU IRB Protocol 2014B0445-exempt. Each sample consisted of four subsamples. Analysis proceeded following EPA Method 3051A, and digests were subsequently analyzed for metals using an Agilent 700 ICP-OES.
Ijerph 13 00011 g010
Figure 11. Residential urban soil level of Se in the Stambaugh-Elwood community versus Franklin County (background), common averages and residential screening levels (RSLs) (mg/kg soil). Soil samples were taken from 21 of 46 residences that consented for the study in compliance with OSU IRB Protocol 2014B0445-exempt. Each sample consisted of four subsamples. Analysis proceeded following EPA Method 3051A, and digests were subsequently analyzed for metals using an Agilent 700 ICP-OES.
Figure 11. Residential urban soil level of Se in the Stambaugh-Elwood community versus Franklin County (background), common averages and residential screening levels (RSLs) (mg/kg soil). Soil samples were taken from 21 of 46 residences that consented for the study in compliance with OSU IRB Protocol 2014B0445-exempt. Each sample consisted of four subsamples. Analysis proceeded following EPA Method 3051A, and digests were subsequently analyzed for metals using an Agilent 700 ICP-OES.
Ijerph 13 00011 g011
Figure 12. Residential urban soil level of Cd in the Stambaugh-Elwood community versus Franklin County (background), common averages and residential screening levels (RSLs) (mg/kg soil). Soil samples were taken from 21 of 46 residences that consented for the study in compliance with OSU IRB Protocol 2014B0445-exempt. Each sample consisted of four subsamples. Analysis proceeded following EPA Method 3051A, and digests were subsequently analyzed for metals using an Agilent 700 ICP-OES.
Figure 12. Residential urban soil level of Cd in the Stambaugh-Elwood community versus Franklin County (background), common averages and residential screening levels (RSLs) (mg/kg soil). Soil samples were taken from 21 of 46 residences that consented for the study in compliance with OSU IRB Protocol 2014B0445-exempt. Each sample consisted of four subsamples. Analysis proceeded following EPA Method 3051A, and digests were subsequently analyzed for metals using an Agilent 700 ICP-OES.
Ijerph 13 00011 g012
Figure 13. Residential urban soil level of Ti in the Stambaugh-Elwood community versus Franklin County (background), common averages and residential screening levels (RSLs) (mg/kg soil). Soil samples were taken from 21 of 46 residences that consented for the study in compliance with OSU IRB Protocol 2014B0445-exempt. Each sample consisted of four subsamples. Analysis proceeded following EPA Method 3051A, and digests were subsequently analyzed for metals using an Agilent 700 ICP-OES.
Figure 13. Residential urban soil level of Ti in the Stambaugh-Elwood community versus Franklin County (background), common averages and residential screening levels (RSLs) (mg/kg soil). Soil samples were taken from 21 of 46 residences that consented for the study in compliance with OSU IRB Protocol 2014B0445-exempt. Each sample consisted of four subsamples. Analysis proceeded following EPA Method 3051A, and digests were subsequently analyzed for metals using an Agilent 700 ICP-OES.
Ijerph 13 00011 g013
Figure 14. Residential urban soil level of Zn in the Stambaugh-Elwood community versus Franklin County (background), common averages and residential screening levels (RSLs) (mg/kg soil). Soil samples were taken from 21 of 46 residences that consented for the study in compliance with OSU IRB Protocol 2014B0445-exempt. Each sample consisted of four subsamples. Analysis proceeded following EPA Method 3051A, and digests were subsequently analyzed for metals using an Agilent 700 ICP-OES.
Figure 14. Residential urban soil level of Zn in the Stambaugh-Elwood community versus Franklin County (background), common averages and residential screening levels (RSLs) (mg/kg soil). Soil samples were taken from 21 of 46 residences that consented for the study in compliance with OSU IRB Protocol 2014B0445-exempt. Each sample consisted of four subsamples. Analysis proceeded following EPA Method 3051A, and digests were subsequently analyzed for metals using an Agilent 700 ICP-OES.
Ijerph 13 00011 g014
As previously mentioned, metals are naturally present in trace amounts within soil matrices with variations depending on geographic area and soil type. Due to this fact, it was important to provide comparison numbers and reference levels for residents. In eighty-four soil samples for the twenty-one residences (four samples per residence), four of seven metals found to be present in SE soil at levels above the normal Franklin County background levels are often associated with the historical use of Pb-based paint and leaded gasoline. This in fact may be the most important finding of this work, and see Figure 4 for an appreciation of the spatial distribution of sampled residences that are in blue. Lead in urban soils comes from the historic use of Pb-based products, including Pb-based paint and Pb-based gasoline. Dried Pb paint often contained 30%–50% Pb by weight. As is shown in Table 1, cadmium (Cd), chromium (Cr), copper (Cu), lead (Pb), molybdenum (Mo), selenium (Se) and zinc (Zn). The metals were also ranked against one another based on soil sampling location. Magnesium was found to be present at above normal levels in the road samples, whereas cadmium, lead and zinc were above normal Franklin County background levels in the three house samples. Paint analyses from older urban homes show high concentrations of multiple metals in exterior paint samples (in mg/kg): Pb 35,000; Zn 31,000; Cd 439; Cu 2,000; and Cr 775 [73,74,75] We found elevated Pb, Cd and Zn, all paint components, at significantly higher levels along the dripline of the homes (i.e., house sample). Leaded gas emissions travel more than 100 m from roadways. Therefore, it is possible that the increased levels of soil Pb for the entire neighborhood were due to vehicle emissions from leaded gas. Selenium, thallium and molybdenum were slightly increased in the soils. These trace elements are not associated with Pb-based paint or Pb gas emissions. Atmospheric deposition of coal combustion or other high temperature combustion activities can lead to the elevation of all seven of the metals found in this study (including Mo, Se and Tl). Increased levels of Zn along the house dripline are consistent with the use of Pb-based paint. Although not significant at p < 0.05, many soils along the house dripline had enhanced levels of Pb, Cd and Cu, which are all consistent with Pb-based paint use. The enhanced Mg concentrations in the road samples were likely due to dolomitic limestone used for road resurfacing.
As part of our community-state agency-academic partnership, it was essential that the results be shared with the residents who elected to participate in the soil sampling study. Therefore, an educational, risk communication informational card was developed. This process is complex in nature, because there are different levels of how to report scientific information. If data are included, there must be additional information provided that can provide context and meaning to quantitative numbers. Scientific research is often complex; therefore, possible barriers to communication may arise. It is important to report the facts and the message at a level that can be easily understood by the recipient. It is essential to continue to encourage engagement and to develop trust within the Stambaugh-Elwood community. Materials that are distributed must provide information in an understandable way that will take into account variations in the health literacy of community members.
It is essential to create materials that will not consume the reader or potentially confuse the reader, causing him or her to misinterpret the results. In order to adequately reach an audience, one must consider the quantitative information that will be provided in conjunction with qualitative information that will address potential concerns, interests, vulnerabilities and values. Elliot R. Churchill of the Centers for Disease Control and Prevention suggests a method known as the “single over-riding communications objective.” This method was used in the development of communication materials within the Southern Gateway, because the goal is to educate and inform residents and stakeholders. This method differs from the traditional scientific report method that includes: an Introduction, Materials and Methods section, Results and Discussion. The scientific report method is most applicable in the present study to report preliminary results [76].

3.3. Citizen Science Risk Communication Activities

Once all soil samples had been analyzed, results were reported back to the participants in the form of an informational postcard (Figure 15) to answer questions such as: What is the level of lead in my soil? Can I consume vegetables grown in my soil? To do this, residents were invited to a South Side Health Advisory meeting where they were given an informal presentation on the: (1) methodologies used to prepare and analyze their residential soil samples; (2) exposure assessment and risk characterization calculations used to interpret their data (Figure 7, Figure 8, Figure 9, Figure 10, Figure 11, Figure 12, Figure 13 and Figure 14); and (3) an introduction to the format in which their results would be presented. Next, residents were given tailored personalized informational cards (Figure 15a,b) that contained the “raw” confidential data (i.e., milligrams of metal per kilogram of soil, as well as a table that outlined the reference concentrations of metal that their soil sample was analyzed against. The informational card included the following information: individual soil sampling specific to each resident, United States Geological Survey Ohio-specific averages for metals; Franklin County, OH, averages for metals; Ohio-EPA averages for metals; and Ohio-EPA residential soil screening levels (RSLs) of the eight metals. Individual informational postcards conveyed the levels of metals in comparison to these aforementioned reference levels.
Figure 15. (a,b) Informational postcard developed and customized for residents of the Stambaugh-Elwood community reporting soil sampling results. (a) The front side of the post card; (b) the individual residents’ soil sampling result presented consistent with the “single over-riding communications objective concept” developed by Elliot R. Churchill of the Centers for Disease Control and Prevention.
Figure 15. (a,b) Informational postcard developed and customized for residents of the Stambaugh-Elwood community reporting soil sampling results. (a) The front side of the post card; (b) the individual residents’ soil sampling result presented consistent with the “single over-riding communications objective concept” developed by Elliot R. Churchill of the Centers for Disease Control and Prevention.
Ijerph 13 00011 g015aIjerph 13 00011 g015b
One of the most important aspects of communication efforts at all levels is adequate framing of an issue. According to Taylor, “framing refers to the process by which individuals and groups, identify, interpret, and express social and political concerns.” [77]. Proper framing during communication may positively influence the influx of supporters and community stakeholders that identify with a particular issue. With the release of EJSCREEN by the USEPA, we observed an immediate effect on the individual behavior and collective action of the residents in this community [77]. This type of public participation in scientific research is in general a form of “citizen science”, broadly defined in this study as a partnership between scientists and non-scientists in which authentic data are collected, shared and analyzed [78,79,80]. The present citizen science project was designed to increase the overall health literacy of Stambaugh-Elwood residents; specifically, to increase the science literacy via analysis of residential urban soil samples and to better communicate the potential risk from exposure to environmental contaminants to public health officials via participation in local decision-making venues. Previous research in sociology and science education and has demonstrated the requirement to engage communities in scientific research and that this level of engagement can be successfully facilitated via community-academic partnerships. Members of the Stambaugh-Elwood community, which is located in the midst of industrial smoke-emitting facilities, were motivated to learn more about their potential modes of exposure. These residents were clearly motivated to engage in the process because of being in the proximity of emissions [81]. Just in the new millennium, popular epidemiology was proposed as a community-driven practice by populations experiencing disproportionate contamination and demanded the inclusion of investigations, the gathering of scientific knowledge and the recruiting of scientific professionals [82]. This approach in combination with that specified by “street science” addresses environmental health justice issues that serve to join local knowledge with professional techniques to re-value forms of knowledge that professional science has traditionally excluded [83].
The community engagement activity that occurred as a result of this preliminary study will continue to foster a community-state agency-academic partnership within Southern Gateway communities. It is essential that our current and future relationship with these communities be focused on beneficial reciprocal outcomes with a common goal. In addition to providing clear communication materials, it is important to continue to provide communities with assistance and access to informational resources that may enhance knowledge. Community Campus Partnerships for Health, a non-profit organization that promotes health equity and social justice, developed a framework for enhancing university partnerships that consist of nine principles [84].
Principles 5 and 7 framed the development of our informational postcard, which ensured that results were conveyed with relevant background information and accessible university and state agency contacts for the purpose of clarification and to provide community members with continued avenues to ask questions or express concerns.

4. Conclusions

Because the results from soil sampling demonstrated that eight metals (As, Cd, Cu, Pb, Mo, Se, Tl, Zn) occurred at statistically-significantly greater levels than natural Franklin County background levels, we will pursue a full hazard identification campaign for this community. Presently, we are in discussions with the Ohio-EPA to partner in the conduct of outdoor particulate air monitoring for the Stambaugh-Elwood community. Although most soil samples were below risk-based residential soil screening levels, the documented disparate health outcomes for Southern Gateway communities warrant such an approach going forward (Figure 1). In consideration of the fact that when using the risk-based methodology, soil metal levels tended to be typical of urban soils and unremarkable, this should not detract from the overall context of our citizen science-GIS findings using MapplerX and those from the USEPA (EJSCREEN). Those findings indicated that the EJ index for the SE community (43,207) is approaching the U.S. 80th percentile in five of seven categories that likely signal an “environmental vulnerability.”
From a national public health perspective, there are many other communities with characteristics similar to those in SE exhibiting concerns about a myriad of environmental justice issues. As a community becomes more aware of the relationships between potential environmental hazards and potential exposures, it is important to continue to work towards developing effective educational and environmental interventions that improve the health equity of a community. The Environmental Protection Agency’s most recent 2014 Environmental Justice Progress Report developed a framework for including environmental justice concerns in policy making, enforcement and community programming. In May 2015, the USEPA updated this framework to include three environmental justice priorities that the agency aims to focus on in the next five years. The USEPA has committed to reducing environmental health disparities, developing community relationships and identifying progress in burdened areas. In order to provide quality hazard identification activities leading to risk assessments, various factors should be taken into account, such as population susceptibility, socioeconomics and cumulative exposure [54,85,86]. It will be essential to continue to partner with community members in identifying resources towards the implementation of effective environmental-based interventions that better inform public health policy. Community-led coalitions that collaborate and partner with academic teams and state agencies have the potential to increase health literacy, reduce environmental health disparities and increase movement towards the goal of health equity.

Acknowledgments

We would like to thank all of the residents of the SE community that assisted us in this preliminary study. We would also like to collectively thank Columbus Public Health and, in particular, Gene W. Bailey, Director of the Healthy Neighborhoods Program, and co-chairs Gladys Murray and Kathleen Gmeiner of the South Side Health Advisory Committee. We also thank Russell E. Savage for critical review of the manuscript. This study was supported in part by start-up funds (Darryl B. Hood) from the College of Public Health, The Ohio State University. We also acknowledge Nicholas Basta for his support in conducting the sampling and analyzing the data. Nicholas Basta also provided valuable input to writing and editing sections of the manuscript.

Author Contributions

Darryl B. Hood conceived of and designed the project and supervised the citizen science community mapping projects assisted by Yuqin Jiao, John Obrycki, Allison Wilder, Claire Bollinger and Jerrie Hatten using MapplerX (Wansoo Im). Sub-county gridded PM2.5 data were provided by Mohammad Z. Al-Hamdan and were uploaded to the Mappler portal by Yuqin Jiao Stambaugh-Elwwod Citizens for the Environment members that provided input for the initial design of the study included Ludie Hatten, Jerrie Hatten, Darryl B. Hood, Julie K. Bower, Nicholas Basta and John Obrycki, who collected soil samples and analyzed the data. Tongwen Zhang and John Obrycki performed parametric and non-parametric analyses on the data and prepared all figures and graphs. Darryl B. Hood wrote the manuscript with substantial contributions from Nicholas Basta, Julie K. Bower, Yuqin Jiao, Allison Wilder and John Obrycki.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Juarez, P.D.; Matthews-Juarez, P.; Hood, D.B.; Im, W.; Levine, R.S.; Kilbourne, B.J.; Langston, M.A.; Al-Hamdan, M.Z.; Crosson, W.L.; Estes, M.G.; et al. The public health exposome: a population-based, exposure science approach to health disparities research. Int. J. Environ. Res. Public Health 2014, 11, 12866–12895. [Google Scholar] [PubMed]
  2. Office of Disease Prevention and Health Promotion. Healthy People 2020. Available online: http://www.healthypeople.gov/2020/topics-objectives/topic/environmental-health (accessed on 15 May 2015).
  3. Reece, J.; Norris, D. Place & Infant Health: “Hot Spot” and Asset Mapping for Infant and Maternal Health in Franklin County. Available online: http://gcinfantmortality.org/wp-content/uploads/2014/05/2014_05_20_GCIM_Reece_Norris_Presentation.pdf (accessed on 11 August 2015).
  4. Ramos, M.A.; Fox, A.; Simon, E.P.; Horowitz, C.R. A Community-academic partnership to address racial/ethnic health disparities through grant-making. Public Health Rep. 2013, 128, 61–67. [Google Scholar] [PubMed]
  5. Stuart, C.A. Public participation, technological discourses and the scale of gis. In Community Participation and Geographical Information Systems; CRC Press: New York, NY, USA, 2002. [Google Scholar]
  6. Kellogg, W.A. From the field: Observations on using gis to develop a neighborhood environmental information system for community-based organizations. Urisa J. 1999, 11, 15–32. [Google Scholar]
  7. GIS and Society: The Social Implications of How People, Space, and Environment Are Represented in GIS. Available online: http://eprints.cdlib.org/uc/item/9bw2d2rw (accessed on 11 August 2015).
  8. Kwan, M.-P. Gender differences in space-time constraints. Area 2000, 32, 145–156. [Google Scholar] [CrossRef]
  9. Burke, P.; Sawicki, D.S. The atlanta project: Reflections on ppgis practice. In Community Participation and Geographical Information Systems; Harris, T.M., Craig, W.J., Weiner, D., Eds.; CRC Press: New York, NY, USA, 2002; pp. 89–100. [Google Scholar]
  10. Poole, P. Indigenous Peoples, Mapping and Biodiversity Conservation: An Analysis of Current Activities and Opportunities for Applying Geomatics Technologies. Available online: http://rmportal.net/library/content/frame/indigenous-people.pdf/view (accessed on 11 August 2015).
  11. Drew, C.H. Transparency—Considerations for ppgis research and development. Urisa J. 2003, 15, 73–78. [Google Scholar]
  12. EPA. Environmental Justice. Draft EJ 2020 Action Agenda. Available online: http://www.epa.gov/environmentaljustice/ej2020/index.html (accessed on 15 June 2015).
  13. Collins, M.B. Risk-based targeting: Identifying disproportionalities in the sources and effects of industrial pollution. Am. J. Public Health 2011, 101, S231–S237. [Google Scholar] [CrossRef] [PubMed]
  14. Gochfeld, M.; Burger, J. Disproportionate exposures in environmental justice and other populations: The importance of outliers. Am. J. Public Health 2011, 101, S53–S63. [Google Scholar] [CrossRef] [PubMed]
  15. Morello-Frosch, R.; Zuk, M.; Jerrett, M.; Shamasunder, B.; Kyle, A.D. Understanding the cumulative impacts of inequalities in environmental health: Implications for policy. Health Affair. 2011, 30, 879–887. [Google Scholar] [CrossRef] [PubMed]
  16. Bullard, R.D.; Johnson, G.S. Environmentalism and public policy: Environmental justice: Grassroots activism and its impact on public policy decision making. J. Soc. Issues 2000, 56, 555–578. [Google Scholar] [CrossRef]
  17. Nweke, O.C.; Payne-Sturges, D.; Garcia, L.; Lee, C.; Zenick, H.; Grevatt, P.; Sanders, W.H.; Case, H.; Dankwa-Mullan, I. Symposium on integrating the science of environmental justice into decision-making at the environmental protection agency: An overview. Am. J. Public Health 2011, 101, S19–S26. [Google Scholar] [CrossRef] [PubMed]
  18. Tchounwou, P.; Yedjou, C.; Patlolla, A.; Sutton, D. Heavy Metal Toxicity and the Environment. In Molecular, Clinical and Environmental Toxicology; Luch, A., Ed.; Springer Basel: Berline, Germany, 2012; Volume 101, pp. 133–164. [Google Scholar]
  19. Greene, N.A.; White, J.D.; Morris, V.R.; Roberts, S.; Jones, K.L.; Warrick, C. Evidence for environmental contamination in residential neighborhoods surrounding the defense depot of memphis, tennessee. Int. J. Environ. Res. Public Health 2006, 3, 244–251. [Google Scholar] [CrossRef] [PubMed]
  20. Neeti, K.; Prakash, T. Effects of heavy metals during pregnancy. Int. Res. J. Environ. Sci. 2013, 2, 88–92. [Google Scholar]
  21. Jarup, L. Hazards of heavy metal contamination. Brit. Med. Bull. 2003, 68, 167–182. [Google Scholar] [CrossRef] [PubMed]
  22. EPA. Clean Air Act. Available online: http://www.epa.gov/air/caa/progress.html (accessed on 11 August 2015).
  23. Sharma, K. Assessment of Heavy Metal Contamination and Restoration of Soil Food Web Structural Complexity in Urban Vacant Lots in Two Post-Industrial Cities; The Ohio State University: Columbus, OH, USA, 2014. [Google Scholar]
  24. Sharma, K.; Basta, N.; Grewal, P. Soil heavy metal contamination in residential neighborhoods in post-industrial cities and its potential human exposure risk. Urban Ecosyst. 2015, 18, 115–132. [Google Scholar] [CrossRef]
  25. Langston, M.A.; Levine, R.S.; Kilbourne, B.J.; Rogers, G.L.; Kershenbaum, A.D.; Baktash, S.H.; Coughlin, S.S.; Saxton, A.M.; Agboto, V.K.; Hood, D.B.; et al. Scalable combinatorial tools for health disparities research. Int. J. Environ. Res. Public Health 2014, 11, 10419–10443. [Google Scholar] [CrossRef] [PubMed]
  26. Morales, L.S.; Lara, M.; Kington, R.S.; Valdez, R.O.; Escarce, J.J. Socioeconomic, cultural, and behavioral factors affecting hispanic health outcomes. J. Health Care Poor Underserved 2002, 13, 477–503. [Google Scholar] [CrossRef] [PubMed]
  27. Patricia, M.-J. Developing a cadre of transdisciplinary health disparities researchers for the 21st century. J. Health Care Poor Underserved 2013, 24, 121–128. [Google Scholar]
  28. Reece, J.; Olinger, J.; Holley, K. Social Capital and Equitable Neighborhood Revitalization on Columbus Southside. Available online: http://kirwaninstitute.osu.edu/wp-content/uploads/2014/10/201410-southside.pdf (accessed on 11 August 2015).
  29. Gray, S.C.; Edwards, S.E.; Schultz, B.D.; Miranda, M.L. Assessing the Impact of Race, Social Factors and Air Pollution on Birth Outcomes: A Population-Based Study. Available online: http://www.biomedcentral.com/content/pdf/1476-069X-13-4.pdf (accessed on 11 August 2015).
  30. Kruize, H.; Droomers, M.; van Kamp, I.; Ruijsbroek, A. What causes environmental inequalities and related health effects? An analysis of evolving concepts. Int. J. Environ. Res. Public Health 2014, 11, 5807–5827. [Google Scholar] [CrossRef] [PubMed]
  31. Krieger, N.; Waterman, P.D.; Gryparis, A.; Coull, B.A. Black carbon exposure, socioeconomic and racial/ethnic spatial polarization, and the Index of Concentration at the Extremes (ICE). Health Place 2015, 34, 215–228. [Google Scholar] [CrossRef] [PubMed]
  32. Massey, D.S. The prodigal paradigm returns: Ecology comes back to sociology. In Does It Take a Village? Community Effects on Children, Adolescents, and Families; Booth, A., Crouter, A.C., Eds.; Lawrence Erlbaum Associates: New Jersey, NJ, USA, 2001; p. 263. [Google Scholar]
  33. Grahame, T.J.; Klemm, R.; Schlesinger, R.B. Public health and components of particulate matter: The changing assessment of black carbon. J. Air Waste Manage. 2014, 64, 620–660. [Google Scholar] [CrossRef]
  34. Suglia, S.F.; Gryparis, A.; Wright, R.O.; Schwartz, J.; Wright, R.J. Association of black carbon with cognition among children in a prospective birth cohort study. Am. J. Epidemiol. 2008, 167, 280–286. [Google Scholar] [CrossRef] [PubMed]
  35. Juarez, P. Sequencing the public health genome. J. Health Care Poor Underserved 2013, 24, 114–120. [Google Scholar] [CrossRef] [PubMed]
  36. Pickett, K.; Pearl, M. Multilevel analyses of neighbourhood socioeconomic context and health outcomes: A critical review. J. Epidemiol. Community Health 2001, 55, 111–122. [Google Scholar] [CrossRef] [PubMed]
  37. Chen, C.-K.; Bruce, M.; Tyler, L.; Brown, C.; Garrett, A.; Goggins, S.; Lewis-Polite, B.; Weriwoh, M.L.; Juarez, P.D.; Hood, D.B.; et al. Analysis of an environmental exposure health questionnaire in a metropolitan minority population utilizing logistic regression and support vector machines. J. Health Care Poor Underserved 2013, 24, 153–171. [Google Scholar] [CrossRef] [PubMed]
  38. Stokes, S.C.; Hood, D.B.; Zokovitch, J.; Close, F.T. Blueprint for communicating risk and preventing environmental injustice. J. Health Care Poor Underserved 2010, 21, 35–52. [Google Scholar] [PubMed]
  39. Tyrrell, J.; Melzer, D.; Henley, W.; Galloway, T.S.; Osborne, N.J. Associations between socioeconomic status and environmental toxicant concentrations in adults in the USA: Nhanes 2001–2010. Environ. Int. 2013, 59, 328–335. [Google Scholar] [CrossRef] [PubMed]
  40. Evans, G.W.; Kim, P. Multiple risk exposure as a potential explanatory mechanism for the socioeconomic status—Health gradient. Ann. NY Acad. Sci. 2010, 1186, 174–189. [Google Scholar] [CrossRef] [PubMed]
  41. Mohai, P.; Lantz, P.M.; Morenoff, J.; House, J.S.; Mero, R.P. Racial and socioeconomic disparities in residential proximity to polluting industrial facilities: Evidence from the Americans’ Changing lives study. Am. J. Public Health 2009, 99, S649–S656. [Google Scholar] [CrossRef] [PubMed]
  42. Conley, D.; Strully, K.W. Birth weight, infant mortality, and race: Twin comparisons and genetic/environmental inputs. Soc. Sci. Med. 2012, 75, 2446–2454. [Google Scholar] [CrossRef] [PubMed]
  43. Brender, J.D.; Maantay, J.A.; Chakraborty, J. Residential proximity to environmental hazards and adverse health outcomes. Am. J. Public Health 2011, 10, S37–S52. [Google Scholar] [CrossRef] [PubMed]
  44. Ferguson, K.K.; O'Neill, M.S.; Meeker, J.D. Environmental contaminant exposures and preterm birth: A comprehensive review. J. Toxicol. Env. Heal. B 2013, 16, 69–113. [Google Scholar] [CrossRef] [PubMed]
  45. Greater Columbus Infant Mortality Task Force Final Report and Implementation Plan. Available online: http://gcinfantmortality.org/wp-content/uploads/2014/01/IMTF-2014-Final-Report-v10.pdf (accessed on 25 June 2014).
  46. Jiao, Y.; Darryl, B.H. Development of a Public Participatory Geographic Information Systems (PPGIS) Portal to Communicate Risk from Potential Exposure to Airborne Environmental Contaminants in a Vulnerable Columbus, OH Community. Master of Public Health Culminating Project Thesis, The Ohio State University, Ohio, OH, USA, May 2015. [Google Scholar]
  47. Roadmap to Revitalization: Southern Gateway Community Report. Available online: https://columbus.gov/uploadedFiles/Columbus/Departments/Development/Planning_Division/Document_Library/Library_Documents/PDFs/SG%20Community%20Report%202014.pdf (accessed on 25 June 2014).
  48. Community Health Advisory Committees. The City of Columbus Public Health Department. Available online: http://columbus.gov/publichealth/programs/health-advisory-committees/ (accessed on 11 August 2015).
  49. The Ohio State University, College of Public Health, Mappler: Interactive Map Stambaugh-Elwood Community. Available online: http://mappler.info/ohio/ (accessed on 11 August 2015).
  50. Community-Based Federal Environmental Justice Resource Guide. Available online: http://www3.epa.gov/environmentaljustice/resources/publications/interagency/resource-guide.pdf (accessed on 11 August 2015).
  51. EPA. EJSCREEN: Environmental Justice Screening and Mapping Tool. Available online: http://www2.epa.gov/ejscreen (accessed on 15 June 2015 ).
  52. EPA. Risk Management Plan (RMP) Rule. Available online: http://www2.epa.gov/rmp (accessed on 15 June 2015).
  53. Sieber, R. Public participation geographic information systems: A literature review and framework. Ann. Assoc. Am. Geogr. 2006, 96, 491–507. [Google Scholar] [CrossRef]
  54. Corburn, J. Environmental justice, local knowledge, and risk: the discourse of a community-based cumulative exposure assessment. Environ. Manage. 2002, 29, 451–466. [Google Scholar] [CrossRef] [PubMed]
  55. Al-Hamdan, M.Z.; Crosson, W.L.; Economou, S.A.; Estes, M.G., Jr.; Estes, S.M.; Hemmings, S.N.; Kent, S.T.; Puckett, M.; Quattrochi, D.A.; Rickman, D.L.; et al. Environmental public health applications using remotely sensed data. Geocarto Int. 2014, 29, 85–98. [Google Scholar] [CrossRef] [PubMed]
  56. Gonzalez, P.A.; Minkler, M.; Garcia, A.P.; Gordon, M.; Garzon, C.; Palaniappan, M.; Prakash, S.; Beveridge, B. Community-based participatory research and policy advocacy to reduce diesel exposure in West Oakland, California. Am. J. Public Health 2011, 101, S166–S175. [Google Scholar] [CrossRef] [PubMed]
  57. EPA. Method 3051a: Microwave Assisted Acid Digestion of Sediments, Sludges, Soils, and Oils. Available online: http://www.epa.gov/solidwaste/hazard/testmethods/sw846/pdfs/3051a.pdf (accessed on 11 August 2015).
  58. EPA. Method 1340: In Vitro Bioaccessibility Assay for Lead in Soil. Available online: http://www.epa.gov/solidwaste/hazard/testmethods/sw846/pdfs/1340.pdf (accessed on 20 May 2015).
  59. Ferenchik, M. Neighbors of South Side Factories Are Fed up with Toxic Waste. Available online: http://www.dispatch.com/content/stories/local/2015/05/11/neighbors-of-plant-are-fed-up.html (accessed on 11 August 2015).
  60. Hood, D.B.; Nayyar, T.; Ramesh, A.; Greenwood, M.; Inyang, F. Modulation in the developmental expression profile of sp1 subsequent to transplacental exposure of fetal rats to desorbed benzo[a]pyrene following maternal inhalation. Inhal. Toxicol. 2000, 12, 511–535. [Google Scholar] [PubMed]
  61. Hood, D.B.; Woods, L.; Brown, L.; Johnson, S.; Ebner, F.F. Gestational 2,3,7,8-tetrachlorodibenzo-p-dioxin exposure effects on sensory cortex function. Neurotoxicology 2006, 27, 1032–1042. [Google Scholar] [CrossRef] [PubMed]
  62. Wormley, D.D.; Chirwa, S.; Nayyar, T.; Wu, J.; Johnson, S.; Brown, L.A.; Harris, E.; Hood, D.B. Inhaled benzo[a]pyrene impairs long-term potentiation in the F1 generation rat dentate gyrus. Cell. Mol. Biol. 2004, 50, 715–721. [Google Scholar] [PubMed]
  63. Wormley, D.D.; Ramesh, A.; Hood, D.B. Environmental contaminant-mixture effects on CNS development, plasticity, and behavior. Toxicol. Appl. Pharmacol. 2004, 197, 49–65. [Google Scholar] [CrossRef] [PubMed]
  64. Wu, J.; Ramesh, A.; Nayyar, T.; Hood, D.B. Assessment of metabolites and Ahr and Cyp1a1 Mrna expression subsequent to prenatal exposure to inhaled benzo[a]pyrene. Int. J. Dev. Neurosci. 2003, 21, 333–346. [Google Scholar] [CrossRef]
  65. Li, Z.; Chadalapaka, G.; Ramesh, A.; Khoshbouei, H.; Maguire, M.; Safe, S.; Rhoades, R.E.; Clark, R.; Jules, G.; McCallister, M.; et al. Pah particles perturb prenatal processes and phenotypes: Protection from deficits in object discrimination afforded by dampening of brain oxidoreductase following in utero exposure to inhaled benzo[a]pyrene. Toxicol. Sci. 2012, 125, 233–247. [Google Scholar] [CrossRef] [PubMed]
  66. McCallister, M.M.; Maguire, M.; Ramesh, A.; Aimin, Q.; Liu, S.; Khoshbouei, H.; Aschner, M.; Ebner, F.F.; Hood, D.B. Prenatal exposure to benzo[a]pyrene impairs later-life cortical neuronal function. Neurotoxicology 2008, 29, 846–854. [Google Scholar] [CrossRef] [PubMed]
  67. Brown, L.A.; Khousbouei, H.; Goodwin, J.S.; Irvin-Wilson, C.V.; Ramesh, A.; Sheng, L.; McCallister, M.M.; Jiang, G.C.; Aschner, M.; Hood, D.B. Down-regulation of early ionotrophic glutamate receptor subunit developmental expression as a mechanism for observed plasticity deficits following gestational exposure to benzo[a]pyrene. Neurotoxicology 2007, 28, 965–978. [Google Scholar] [CrossRef] [PubMed]
  68. Sheng, L.; Ding, X.; Ferguson, M.; McCallister, M.; Rhoades, R.; Maguire, M.; Ramesh, A.; Aschner, M.; Campbell, D.; Levitt, P.; et al. Prenatal polycyclic aromatic hydrocarbon exposure leads to behavioral deficits and downregulation of receptor tyrosine kinase, MET. Toxicol. Sci. 2010, 118, 625–634. [Google Scholar] [CrossRef] [PubMed]
  69. Lindsay, W.L. Chemical Equilibria in Soils; John Wiley and Sons Ltd.: Chichester, UK, 1979. [Google Scholar]
  70. Kasich, J.; Taylor, M.; Nally, S.J. Evaluation of Background Metal Soil Concentrations in Franklin County—Columbus Area; OEPA: Columbus, OH, USA, 2013; p. 132. [Google Scholar]
  71. USGS. National Geochemical Survey. Mineral Resources on-Line Spatial Data. Available online: http://mrdata.usgs.gov/geochem/doc/averages/countydata.htm (accessed on 29 May 2015).
  72. USGS. Geochemical and Mineralogical Data for Soils of the Conterminous United States. Available online: http://pubs.usgs.gov/ds/801/ (accessed on 29 May 2015).
  73. Mielke, H.W.; Powell, E.T.; Shah, A.; Gonzales, C.R.; Mielke, P.W. Multiple metal contamination from house paints: Consequences of power sanding and paint scraping in New Orleans. Environ. Health Persp. 2001, 109, 973–978. [Google Scholar] [CrossRef]
  74. Minca, K.K.; Basta, N.T.; Scheckel, K.G. Using the mehlich-3 soil test as an inexpensive screening tool to estimate total and bioaccessible lead in urban soils. J. Environ. Qual. 2013, 42, 1518–1526. [Google Scholar] [CrossRef] [PubMed]
  75. Turner, A.; Sogo, Y.S. Concentrations and bioaccessibilities of metals in exterior urban paints. Chemosphere 2012, 86, 614–618. [Google Scholar] [CrossRef] [PubMed]
  76. Lee, L.M.; Teutsch, S.M.; Churchill, R.E. Principles and Practice of Public Health Surveillance; Oxford University Press: Oxford, UK, 2000. [Google Scholar]
  77. Taylor, D.E. The Rise of the environmental justice paradigm: Injustice framing and the social construction of environmental discourses. Am. Behav. Sci. 2000, 43, 508–580. [Google Scholar] [CrossRef]
  78. Bonney, R.; Ballard, H.; Jordan, R.; McCallie, E.; Phillips, T.; Shirk, J.; Wilderman, C.C. Public Participation in Scientific Research: Defining the Field and Assessing Its Potential for Informal Science Education. A Caise Inquiry Group Report. Available online: http://eric.ed.gov/?id=ED519688 (accessed on 11 August 2015).
  79. Brossard, D.; Lewenstein, B.; Bonney, R. Scientific knowledge and attitude change: The impact of a citizen science project. Int. J. Sc. Educ. 2005, 27, 1099–1121. [Google Scholar] [CrossRef]
  80. Evans, C.; Abrams, E.; Reitsma, R.; Roux, K.; Salmonsen, L.; Marra, P.P. The neighborhood nestwatch program: Participant outcomes of a citizen-science ecological research project. Conserva. Biol. 2005, 19, 589–594. [Google Scholar] [CrossRef]
  81. Falk, J.H.; Storksdieck, M.; Dierking, L.D. Investigating public science interest and understanding: Evidence for the importance of free-choice learning. Public Underst. Sci. 2007, 16, 455–469. [Google Scholar] [CrossRef]
  82. Brown, P. Popular epidemiology and toxic waste contamination: Lay and professional ways of knowing. J. Health Soc. Behav. 1992, 33, 267–281. [Google Scholar] [CrossRef] [PubMed]
  83. Corburn, J. Street Science: Community Knowledge and Environmental Health Justice; MIT Press: Cambridge, MA, USA, 2005. [Google Scholar]
  84. Wilson, S.; Campbell, D.; Dalemarre, L.; Fraser-Rahim, H.; Williams, E. A critical review of an authentic and transformative environmental justice and health community—University partnership. Int. J. Environ. Res. Public Health 2014, 11, 12817. [Google Scholar] [CrossRef] [PubMed]
  85. Schwartz, J.; Bellinger, D.; Glass, T. Expanding the scope of environmental risk assessment to better include differential vulnerability and susceptibility. Am. J. Public Health 2011, 101, S88–S93. [Google Scholar] [CrossRef] [PubMed]
  86. Sadana, R.; Blas, E. What can public health programs do to improve health equity? Public Health Rep. 2013, 128, 12–20. [Google Scholar] [PubMed]

Share and Cite

MDPI and ACS Style

Jiao, Y.; Bower, J.K.; Im, W.; Basta, N.; Obrycki, J.; Al-Hamdan, M.Z.; Wilder, A.; Bollinger, C.E.; Zhang, T.; Hatten, L.S.; et al. Application of Citizen Science Risk Communication Tools in a Vulnerable Urban Community. Int. J. Environ. Res. Public Health 2016, 13, 11. https://doi.org/10.3390/ijerph13010011

AMA Style

Jiao Y, Bower JK, Im W, Basta N, Obrycki J, Al-Hamdan MZ, Wilder A, Bollinger CE, Zhang T, Hatten LS, et al. Application of Citizen Science Risk Communication Tools in a Vulnerable Urban Community. International Journal of Environmental Research and Public Health. 2016; 13(1):11. https://doi.org/10.3390/ijerph13010011

Chicago/Turabian Style

Jiao, Yuqin, Julie K. Bower, Wansoo Im, Nicholas Basta, John Obrycki, Mohammad Z. Al-Hamdan, Allison Wilder, Claire E. Bollinger, Tongwen Zhang, Luddie Sr. Hatten, and et al. 2016. "Application of Citizen Science Risk Communication Tools in a Vulnerable Urban Community" International Journal of Environmental Research and Public Health 13, no. 1: 11. https://doi.org/10.3390/ijerph13010011

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop