In our first project, two senior undergraduate geography students at Middlebury College—Derrick Burt and Kufre Udoh—reproduced and replicated Kang et al’s 2020 paper on the spatial accessibility of COVID-19 healthcare resources in Illinois and published their work on GitHub.
Spatial Accessibility of COVID-19 Health Care Resources in Connecticut. Red circles represent hospitals and the blue gradient represents accessibility, with dark blue being more accessible. Map created by Derrick Burt.
Key Findings from the Student Reproduction and Replication
With some very minor code modifications, the Jupyter notebook can reproduce the analysis of spatial accessibility of two populations (COVID-19 cases or people over the age of 50) and two health care resources (ICU beds or Ventilators) for the city of Chicago, Illinois!
By searching for some additional data resources and making further minor modifications to the code, the Jupyter notebook can be used to replicate the analysis of spatial accessibility for another state, illustrated with Connecticut.
The code available on the CyberGISX platform clarifies methodological decisions that were uncertain based upon the published paper alone. Specifically, techniques for road network simplification and for enhanced two-step floating catchment method (E2SFCA) contain more detailed information in the Jupyter notebook than in the publication.
The data provided with the Jupyter notebook enabled the study to be reproduced, but some data-preprocessing described in the published paper occurred prior to the first lines of the notebook’s code. For instance, tabular COVID-19 data had been joined to zip code tabulation areas, American Community Survey data had been processed to calculate the total population over 50 years old, and hexagonal tessellations had been generated with an area attribute field, presumably using an algorithm like QGIS Create Grid. Kufre developed an R-script to automate much of the data gathering and processing.
The computing resources available on a typical desktop computer or CyberGISX virtual server are insufficient for calculating network-based accessibility for the entire state of Illinois. This is not surprising given that a main contribution of this research paper was a parallel processing strategy for the computationally expensive task of calculating E2SFCA accessibility. However, if independent researchers are interested in reproducing or replicating the analysis with regions requiring as much data as the state of Illinois, then they will need to develop or access cyber-infrastructure comparable to the authors’ system.
Ideally, this type of accessibility analysis would include a buffer of data outside the region of interest (Illinois), including services, populations, and road networks. However, this is not possible for most regions in the United States because COVID-19 cases are not consistently reported at the sub-county level, as illustrated by this map created by Dr. Clio Andris and students. Therefore, some caution should be used interpreting results within 30 minutes’ drive from the Illinois border. Data on intensive care unit beds and ventilators in hospitals also vary by state and jurisdiction.
The Python notebook is focused on reproducing the E2SFCA component of the research paper. It needs additional code to record processing times, analyze patterns of accessibility vis a vis the CDC Social Vulnerability Index, and create the histograms, scatter-plots, t-tests, and correlation analyses in the paper’s results.
The CyberGISX environment has installed version 0.11.4-py_1 of the OSMnx package for network analysis with OpenStreetMap, while the current version of the package is 1.0.1. The OSMnx package underwent a significant overhaul in the summer of 2020, as documented here and here, including changes to the functions for saving and loading graphs. One new feature of the library is an option to create a network based on OSM data at a particular date, which should aid in research reproductions using a data source undergoing daily revisions.
About Derrick and Kufre
Derrick Burt and Kufre Udoh are undergraduate geography students at Middlebury College. At the time of the reproduction and replication attempts, Both Derrick and Kufre had already completed their geography major requirements, including introductory courses GIS and an advanced course in Open Source GIScience in which we learned the QGIS graphic modeler, PostGIS spatial SQL, and some batch scripting and R. Both students had previously or concurrently studied introductory data science with R, and Kufre had studied introductory computer science with Python.
About the Original Study
Kang et al. (2020) applies an enhanced two-step floating catchment area (E2SFCA) method to calculating the spatial accessibility of health care services–ICU beds and ventilators–for treatment of severe COVID-19 cases, and geographic analysis of social vulnerability. The paper was published along with a public Jupyter Notebook and is the analytical basis for a Spatial Access web map application.
Kang, J. Y., A. Michels, F. Lyu, Shaohua Wang, N. Agbodo, V. L. Freeman, and Shaowen Wang. 2020. Rapidly measuring spatial accessibility of COVID-19 healthcare resources: a case study of Illinois, USA. International Journal of Health Geographics 19 (1):1–17. https://doi.org/10.1186/s12942-020-00229-x.
I am currently working on Reproducibility and Replicability in Human-Environment and Geographic Sciences with Dr. Peter Kedron. My research interests are in open geographic information science, vulnerability and adaptation to climate change and natural hazards, and teaching GIS.
Redirecting to CILogon in 10 seconds.
Please select your university or organization to sign in. You will be redirected back to CyberGISX automatically.
The purpose of this website, https://cybergisxhub.cigi.illinois.edu/
is to provide information to You related to “CyberGISX Project” (“Project”). This Project aims to enable open access and sharing of computation- and data-intensive geospatial analytics, under Apache 2.0 license agreement.
The initial version of the Project (“Original Project”), was developed by the CyberGIS Center for Advanced Digital and Spatial Studies (CyberGIS Center) and is solely owned by The Board of Trustees of the Illinois of Illinois.
The Site and its content is made available by the Board of Trustees of the Illinois of Illinois (“Illinois”, “we”, “our”, “us”), on behalf of the CyberGIS Center. The Site is owned by the Illinois.
or otherwise accessing the Site. Please read these Terms carefully. The Terms govern Your use of the Site and any incorporated content (such as Illinois or third party software, text, data, information, or graphics) made available through the Site.
By continuing to use this site, You accept these Terms. If You are not willing to be bound by these Terms, please stop using this Site.
1. Governing Terms:
The Terms are governed by Illinois’s web privacy notices and policy links presented here:
You hereby accept that all intellectual property, including copyrights, and other proprietary rights in or related to Original Project and Site are, and will remain, the exclusive property of Illinois, whether or not specifically recognized or perfected under applicable law. As End User, You will not take any action that jeopardizes Illinois’s proprietary rights.
3. Credit and Attribution.
You agree to credit and attribute the authors and creators of Project that You use with the copyright notice or statement of credit/attribution as customarily acceptable in industry.
In no event shall Illinois or its employees be liable for any damages (including, without limitation, damages for loss of data or profit, or due to business interruption) arising out of the use or inability to use the content on Site, even if Illinois or a Illinois authorized representative has been notified orally or in writing of the possibility of such damage. Because some jurisdictions do not allow limitations on implied warranties, or limitations of liability for consequential or incidental damages, these limitations may not apply to you.
5. Modification of Site and Terms.
Illinois reserves the right to modify the Site and may discontinue, temporarily or permanently, the Site for any reason, at its sole discretion, with or without notice to You. Illinois may likewise change the Terms from time to time with or without notice to you. You agree to review the Terms periodically to ensure that you are aware of any modifications. Your continued access to the Site after the modifications have become effective shall be deemed your conclusive acceptance of the modified Terms.
If you violate or fail to comply with any of these Terms or in Illinois’ sole discretion restrict or inhibit any other user from using or enjoying the Site, Illinois may terminate your access to the Site account without notice to You.
CyberGISX Project Contributor License Agreement
Version 1.0 February 9, 2021
Thank you for your interest in contributing to the CyberGISX Project. In order to contribute, you will need to provide your name and contact information and sign this CyberGISX Project Contributor License Agreement, which sets the terms and conditions of the intellectual property license granted with your contributions.
This CyberGISX Project Contributor License Agreement (“Agreement”) is by and between you, any person or entity (“You” or “Your”) and the Board of Trustees of the University of Illinois, a body corporate and politic of the State of Illinois (“Illinois”). Please read this document carefully before signing and keep a copy for your records. By signing this Agreement or making a “Contribution” to the “CyberGISX Project” as defined below (even if You do not sign), You agree to the following:
1. “CyberGISX Project” is an open-source software project that aims to enable open access and sharing of computation- and data-intensive geospatial analytics with computational reproducibility and transparency support available under Apache 2.0 license agreement: https://www.apache.org/licenses/LICENSE-2.0
2. “Contribution” means all of Your contributions of object code, source code, content, and documentation, and any modifications thereof, to the CyberGISX Project.
3. “Licensed Patents” mean patent claims licensable by You which are necessarily infringed by the making, using, selling, offering for sale, having made, import, or transfer of either Your Contribution alone or when combined with the CyberGISX Project.
4. “Representation.” You represent the following to the best of your knowledge:
a. You are at least 18 years of age and have full power and authority to enter into this Agreement and to grant the rights in and to the Contribution as set forth herein (individuals who are under 18 years of age and who wish to contribute to the CyberGISX project may not enter into this Agreement, but may contact CyberGISX at firstname.lastname@example.org to explore alternatives);
b. If your employer has rights to intellectual property that You create as part of the Contribution, You represent that You have obtained permission from Your employer to make the Contribution on behalf of that employer, or Your employer waived any rights in and to Your Contribution, or Your employer authorizes the Contribution and agrees to be bound by the terms herein by signing as an entity below;
c. That either:
1. all documentation and code in the Contribution is Your original work and includes complete details of any third-party license and any other restriction (including, but not limited to related patents and trademarks) of which You are personally aware and which are associated with any part of Your Contributions; or
2. any part of the Contribution that is not Your original creation is submitted to CyberGISX separately from any original Contribution, includes the complete details of its source and any corresponding license and any other restriction (including, but not limited to related patents, trademarks, and license agreements) of which You are personally aware, and is conspicuously marked as "Submitted on behalf of a third party: [named here]".
d. That Your Contribution does not include any viruses, worms, Trojan horses, malicious code or other harmful or destructive content;
e. The CyberGISX Project delivered under this Agreement may be subject to U.S. export control laws and may be subject to export or import regulations in other countries. You agree to comply strictly with all such laws and regulations and acknowledge that You have the responsibility, at Your own expense, to obtain such licenses to export, re-export, or import as may be required; and
f. Your Contribution does not include any encryption technology and no government license or permission is required for the export, import, transfer or use of the Contribution.
5. Notification. Your representations are accurate, and You agree to notify Illinois of any facts or circumstances of which You become aware that would make any of Your representations inaccurate in any respect.
6. License grant to Contributions. You grant to Illinois and to recipients of the CyberGISX software (collectively, “Recipients”), a perpetual, irrevocable, non-exclusive, worldwide, royalty-free unrestricted license to use, reproduce, prepare derivative works of, publicly display, publicly perform, distribute, and sublicense the Contribution, and such derivative works, in source code and object code forms.
7. License grant to Patents.
8. No support. Except for the rights granted to Recipients above, You reserve all right, title, and interest in and to Your Contribution. You are not expected to provide support for your Contributions.
9. No Warranties. Subject to Your representations above, Your Contributions are provided on an “AS-IS” basis WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND (express or implied), including, without limitation, any implied warranty of merchantability and fitness for a particular purpose, and any warranty of non-infringement.
10. No Liability. Illinois, its trustees, directors, officers, employees, students, and agents have no liability for any infringement of any copyright, patent, or other right of third parties in connection with any Contributions, the CyberGISX Project, or CyberGISX software, and are not liable for any direct, indirect, punitive, special, incidental, consequential, or exemplary damages arising in connection with any Contribution, the CyberGISX Project, or CyberGISX software.
11. Indemnity. You agree to indemnify, defend, and hold Illinois and its subsidiaries, affiliates, officers, agents, employees, partners, licensees, and licensors harmless from any claim or demand, including but not limited to reasonable attorneys’ fees, made by any third party due to or arising out of Contributions You submit, post, transmit or otherwise make available through the CyberGISX Project, as well as Your use of the CyberGISX software; connection to the CyberGISX Project; or violation of any rights of another.
12. You agree that Illinois may assign this Agreement and CyberGISX Project to any third party without notice or consent.
13. Illinois is under no obligation to accept or include Your Contribution to the CyberGISX Project.
14. This Agreement is governed by the laws of the State of Illinois, excluding its conflict of laws provisions.