Reproducibility and Replicability in the Studies about GIS and Spatial Analysis: The Case Study on the Journal of the Korean Geographical Society

Jeon-Young Kang; Chul Sue Hwang

doi:10.22776/kgs.2022.57.5.425

All Issue

2022 Vol.57, Issue 5 Next Page

Research Article

Reproducibility and Replicability in the Studies about GIS and Spatial Analysis: The Case Study on the Journal of the Korean Geographical Society GIS 및 공간 분석 연구의 재현성(Reproducibility) 및 반복가능성(Replicability) - 대한지리학회지를 사례로 -

31 October 2022. pp. 425-435

PDF XML

Abstract

Much attention has been paid to reproducibility and replicability (R&R) in studies of GIS and spatial analysis for ensuring the advancement of research transparency. Reproducibility refers to an ability of a researcher to get the same results of a prior study through the same data and method used by the original researcher. Replicability refers to an ability of a research to get the similar/same results of a prior study through the same method with the newly collected data. In this study, we defined the five steps for the R&R, and assess the previous studies published in Journal of the Korean Geographical Society. Also, we investigated the submission guidelines for the Korean journals indexed in the SCIE, SSCI, A&HCI, SCOPUS, regarding the data and code sharing policy. This study highlights an importance of establishing the guidelines for the R&R and educational efforts on the advancement of research transparency.

Keywords

Reproducibility

Replicability

GIS

Spatial Analysis

Journal of the Korean Geographical Society

연구의 투명성을 높이기 위해서는 연구의 재현성(Reproducibility)과 반복가능성(Replicability)이 중요하다. 재현성은 출판된 연구에서 수행한 분석을 다시 후속 연구자가 진행하였을 때 동일한 연구결과가 산출되는 것을 의미하며, 반복가능성은 새로운 데이터를 활용하여 동일한 분석 절차를 진행하였을 때, 기존의 연구와 유사한/동일한 연구 결과가 산출되는 것을 의미한다. 해외의 GIS 및 공간분석 분야에서 이러한 연구의 재현성과 반복가능성에 대한 노력 및 관심이 증대하고 있는 상황에서 본 연구는 연구의 재현성과 반복가능성을 위한 5단계를 정의하였다. 또한 기존의 대한지리학회지에서 출판된 GIS 및 공간분석 관련 연구에서의 데이터 및 코드 공유 상황을 판단하였으며, 국내의 학술지 중 SCIE, SSCI, A&HCI, SCOPUS에 등재된 학술지의 데이터 및 코드 공유 관련 규정을 확인하였다. 본 연구는 연구의 재현성과 반복가능성을 위해서는 학술지의 규정 신설 및 교육 등의 학계와 기관에서의 다양한 방법에서의 노력이 필요함을 밝히고 있다.

키워드

재현성

반복가능성

GIS

공간분석

대한지리학회지

References

강전영･박진우, 2021, “코로나-19 상설선별진료소 및 임시선별검사소의 공간적 접근성 분석-서울시를 사례로.” 대한지리학회지, 56(2), 231-244.

김지현, 2015, “데이터 관리와 공유에 대한 대학 연구자들의 인식에 관한 연구.” 한국문헌정보학회지, 49(3), 413-436. 10.4275/KSLIS.2015.49.3.413

정수영, 1984, “수도권에 있어서 사회적 인구증감의 공간적 패턴과 그 형성과정-공간적자기상관에 의한 분석.” 대한지리학회지, 19(2), 62-76.

최명석･이상환, 2020, “데이터 관리 계획의 국내 현황 및 과제.” 한국콘텐츠학회논문지, 20(6), 220-229.

Baker, M., 2016, Reproducibility crisis. Nature, 533(26), 353-66.

Cacioppo, J. T., Kaplan, R. M., Krosnick, J. A., Olds, J. L. and Dean, H., 2015, Social, Behavioral, and Economic Sciences Perspectives on Robust and Reliable Science. Report of the Subcommittee on Replicability in Science Advisory Committee to the National Science Foundation Directorate for Social, Behavioral, and Economic Sciences, 1.

Grimm, V., Berger, U., DeAngelis, D. L., Polhill, J. G., Giske, J. and Railsback, S. F., 2010, The ODD protocol: a review and first update. Ecological modelling, 221(23), 2760-2768. 10.1016/j.ecolmodel.2010.08.019

IJGIS, 2022, Instructions for authors, International Journal of Geographic Information Science. https://www.tandfonline.com/action/authorSubmission?show=instructions&journalCode=tgis20#dsp

Kang, J. Y., Aldstadt, J., Michels, A., Vandewalle, R. and Wang, S., 2019, CyberGIS-Jupyter for spatially explicit agent-based modeling: a case study on influenza transmission. In Proceedings of the 2nd ACM SIGSPATIAL International Workshop on Geospatial Simulation, 32-35. 10.1145/3356470.3365531

Kang, J. Y., Farkhad, B. F., Chan, M. P. S., Michels, A., Albarracin, D. and Wang, S., 2022, Spatial accessibility to HIV testing, treatment, and prevention services in Illinois and Chicago, USA. PloS One, 17(7), e0270404. 10.1371/journal.pone.027040435895722PMC9328561

Kang, J. Y., Michels, A., Lyu, F., Wang, S., Agbodo, N., Freeman, V. L. and Wang, S., 2020, Rapidly measuring spatial accessibility of COVID-19 healthcare resources: a case study of Illinois, USA. International Journal of Health Geographics, 19(1), 1-17. 10.1186/s12942-020-00229-x32928236PMC7487451

Kedron, P., Frazier, A. E., Trgovac, A. B., Nelson, T., and Fotheringham, A. S., 2021, Reproducibility and replicability in geographical analysis. Geographical Analysis, 53(1), 135-147. 10.1111/gean.12221

Lee, W., Qian, M. and Schwanen, T., 2021, The association between socioeconomic status and mobility reductions in the early stage of England’s COVID-19 epidemic. Health & place, 69, 102563. 10.1016/j.healthplace.2021.10256333799134

Park, J., Kang, J. Y., Goldberg, D. W. and Hammond, T. A., 2022, Leveraging temporal changes of spatial accessibility measurements for better policy implications: a case study of electric vehicle (EV) charging stations in Seoul, South Korea. International Journal of Geographical Information Science, 36(6), 1185-1204. 10.1080/13658816.2021.1978450

Wang, S., 2016, CyberGIS and spatial data science. GeoJournal, 81(6), 965-968. 10.1007/s10708-016-9740-0

Wilson, J. P., Butler, K., Gao, S., Hu, Y., Li, W. and Wright, D. J., 2021, A five-star guide for achieving replicability and reproducibility when working with GIS software and algorithms. Annals of the American Association of Geographers, 111(5), 1311-1317. 10.1080/24694452.2020.1806026

Yin, D., Liu, Y., Hu, H., Terstriep, J., Hong, X., Padmanabhan, A. and Wang, S., 2019, CyberGIS‐Jupyter for reproducible and scalable geospatial analytics. Concurrency and Computation: Practice and Experience, 31(11), e5040. 10.1002/cpe.5040

Information

Publisher :The Korean Geographical Society
Publisher(Ko) :대한지리학회
Journal Title :Journal of the Korean Geographical Society
Journal Title(Ko) :대한지리학회지
Volume : 57
No :5
Pages :425-435
Received Date : 2022-09-15
Revised Date : 2022-10-11
Accepted Date : 2022-10-13
DOI :https://doi.org/10.22776/kgs.2022.57.5.425

Journal of the Korean Geographical Society ISSN:1225-6633(Print) 대한지리학회지

All Issue