The goal of washopenresearch is to provide an overview of open research data related to Water Sanitation and Hygiene (WASH). The current version contains four datasets from the following sources:
washdev: Open access journal Journal of Water, Sanitation and Hygiene for Developmentuncnewsletter: Research section of the newsletter North Carolina Water Newsploswater: Open access journal PLOS Waterdatapapers: WASH-related data papers in seven dedicated data journals (Scientific Data, Data in Brief, Gates Open Research, F1000Research, GigaScience, GigaByte, and Data), harvested from Crossref and Europe PMC
You can install the development version of washopenresearch from GitHub with:
# install.packages("devtools")
devtools::install_github("openwashdata/washopenresearch")Alternatively, you can download the individual datasets as a CSV or XLSX file from the table below.
| dataset | CSV | XLSX |
|---|---|---|
| washdev | Download CSV | Download XLSX |
| uncnewsletter | Download CSV | Download XLSX |
| ploswater | Download CSV | Download XLSX |
| datapapers | Download CSV | Download XLSX |
The package provides access to four datasets washdev, uncnewsletter,
ploswater, and datapapers. Each dataset collects information on
scientific articles about (1) article metadata (e.g. title, first
author, correspondence author), (2) supplementary material information,
(3) data availability statement or linked data repository, and (4)
semantic information (e.g. keywords or abstract).
library(washopenresearch)The dataset washdev contains data on open access articles of the
Journal of Water, Sanitation & Hygiene for Development (Vol. 1 Issue 1
to Vol. 16 Issue 6). It has 1173 observations from March 2011 to 2026.
washdev |>
head(3) |>
gt::gt() |>
gt::as_raw_html()| paperid | volume | issue | paper_url | journal | title | published_year | is_supp | num_supp | supp_file_type | supp_url | num_authors | first_author_name | first_author_affiliation | first_author_affiliation_country | first_author_email | first_author_orcid | correspondence_author_name | correspondence_author_affiliation | correspondence_author_affiliation_country | correspondence_author_email | correspondence_author_orcid | has_das | das | das_type | das_repo_url | keywords | doi | url_source |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| 28742 | 1 | 1 | https://iwaponline.com/washdev/article/1/1/1/28742/Editorial | Journal of Water, Sanitation & Hygiene for Development | Editorial | 2011 | FALSE | 0 | NA | NA | 6 | Jamie Bartram | Journal of Water, Sanitation and Hygiene for Development | NA | NA | NA | NA | NA | NA | NA | NA | FALSE | NA | NA | NA | NA | 10.2166/washdev.2011.0001 | iwaponline.com |
| 28745 | 1 | 1 | https://iwaponline.com/washdev/article/1/1/3/28745/The-sanitation-ladder-a-need-for-a-revamp | Journal of Water, Sanitation & Hygiene for Development | The sanitation ladder – a need for a revamp? | 2011 | FALSE | 0 | NA | NA | 5 | E. Kvarnström | Stockholm Environment Institute, Kräftriket 2B, SE-10691 Stockholm, Sweden | Sweden | elisabeth.kvarnstrom@sei.se | NA | E. Kvarnström | Stockholm Environment Institute, Kräftriket 2B, SE-10691 Stockholm, Sweden | Sweden | elisabeth.kvarnstrom@sei.se | NA | FALSE | NA | NA | NA | function-based; sanitation technologies; sustainability; the sanitation ladder | 10.2166/washdev.2011.014 | iwaponline.com |
| 28743 | 1 | 1 | https://iwaponline.com/washdev/article/1/1/13/28743/Vertical-flow-constructed-wetlands-as-an-emerging | Journal of Water, Sanitation & Hygiene for Development | Vertical-flow constructed wetlands as an emerging solution for faecal sludge dewatering in developing countries | 2011 | FALSE | 0 | NA | NA | 6 | I. M. Kengne | Laboratory of Plant Biotechnology and Environment, Faculty of Science, University Yaoundé I, PO Box 812, Yaoundé, Cameroon | Cameroon | NA | NA | E. Soh Kengne | Laboratory of Plant Biotechnology and Environment, Faculty of Science, University Yaoundé I, PO Box 812, Yaoundé, Cameroon | Cameroon | ives_kengne@yahoo.fr | NA | FALSE | NA | NA | NA | biosolid accumulation; Cyperus papyrus; Echinochloa pyramidalis; faecal sludge dewatering; pollutant removal efficiencies; vertical-flow constructed wetlands | 10.2166/washdev.2011.001 | iwaponline.com |
For an overview of the variable names, see the following table.
|
variable_name |
variable_type |
description |
|---|---|---|
|
paperid |
integer |
ID number of the paper on the journal website |
|
volume |
integer |
Volume number of the journal |
|
issue |
integer |
Issue number of the journal |
|
paper_url |
character |
Official website url of the paper |
|
journal |
character |
Full name of the journal |
|
title |
character |
Title of the paper |
|
published_year |
integer |
Year of publication |
|
is_supp |
logical |
Whether the paper has supplementary materials |
|
num_supp |
integer |
Number of supplementary material files |
|
supp_file_type |
character |
File types of the supplementary materials separated by a semicolon when there are multiple |
|
supp_url |
character |
Website urls of the supplementary materials separated by a semicolon when there are multiple |
|
num_authors |
integer |
Number of the authors |
|
first_author_name |
character |
Name of the first author |
|
first_author_affiliation |
character |
Academic affiliation of the first author |
|
first_author_affiliation_country |
character |
Country of the first author parsed from first_author_affiliation variable encoded with United Nations names |
|
first_author_email |
character |
Email of the first author |
|
first_author_orcid |
character |
ORCID of the first author |
|
correspondence_author_name |
character |
Name of the correspondence author |
|
correspondence_author_affiliation |
character |
Academic affiliation of the correspondence author |
|
correspondence_author_affiliation_country |
character |
Country of the correspondence author parsed from correspondence_author_affiliation variable encoded with United Nations names |
|
correspondence_author_email |
character |
Email of the correspondence author |
|
correspondence_author_orcid |
character |
ORCID of the correspondence author |
|
has_das |
logical |
Whether the paper has a data availability statement |
|
das |
character |
Original data availability statement of the paper. NA if it does not have a data availability statement. |
|
das_type |
factor |
Type of the data availability statement including “in paper”(data in full paper scope like supplementary material or appendix or main content) “on request”(data available on request to the authors) “available in online repository”(data is shared in a public online repository) “not shareable”(data is not shareable). NA if it does not have a data availability statement. |
|
das_repo_url |
character |
Website urls of the data if the relevant data of the paper is shared on a public repository separated by a semicolon when there are multiple |
|
keywords |
character |
Keywords of the paper separated by a semicolon |
|
url_source |
character |
Publisher website of the paper |
|
doi |
character |
DOI of the paper. Collected by the R scraper for recent articles and backfilled via Crossref for legacy rows (issue #20); NA where no Crossref match was found (see data-raw/washdev-doi-review.csv) |
The dataset uncnewsletter contains data on a curated list of articles
published at the Research section of the newsletter North Carolina Water
News. It has 173 observations from 2020 to 2023. The newsletter ceased
publication in May 2024, so this dataset is a frozen source.
uncnewsletter |>
head(3) |>
gt::gt() |>
gt::as_raw_html()| paperid | issue_url | paper_url | url_source | journal | title | published_year | is_supp | num_supp | supp_file_type | supp_url | num_authors | first_author_name | first_author_affiliation | first_author_affiliation_country | first_author_email | first_author_orcid | correspondence_author_name | correspondence_author_affiliation | correspondence_author_affiliation_country | correspondence_author_email | correspondence_author_orcid | has_das | das | das_type | das_repo_url | citations | keywords | doi |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| 198 | http://eepurl.com/hWz3Yf | https://aiche.onlinelibrary.wiley.com/doi/abs/10.1002/ep.13800 | aiche.onlinelibrary.wiley.com | Environmental Progress & Sustainable Energy | Mitigation of PFAS in U.S. Public Water Systems: Future steps for ensuring safer drinking water | 2022 | TRUE | 1 | docx | https://aiche.onlinelibrary.wiley.com/action/downloadSupplement?doi=10.1002%2Fep.13800&file=ep13800-sup-0001-Supinfo.docx | 1 | Alexis Voulgaropoulos | North Carolina State University | United States of America | anvoulga@ncsu.edu | 0000-0002-5778-354X | NA | NA | NA | NA | NA | FALSE | NA | NA | NA | 2 | drinkingwater; environmentalpolicy; healthandsafety | 10.1002/ep.13800 |
| 89 | http://eepurl.com/ieh0rf | https://ajph.aphapublications.org/doi/abs/10.2105/AJPH.2022.307108 | ajph.aphapublications.org | American Journal of Public Health | Timing and Trends for Municipal Wastewater, Lab-Confirmed Case, and Syndromic Case Surveillance of COVID-19 in Raleigh, North Carolina | 2023 | TRUE | 1 | docx | https://ajph.aphapublications.org/doi/suppl/10.2105/AJPH.2022.307108/suppl_file/kotlarz_suppl-figures_tables.docx | 17 | Nadine Kotlarz | North Carolina State University | United States of America | nkotlar@ncsu.ede | NA | NA | NA | NA | NA | NA | FALSE | NA | NA | NA | 3 | NA | 10.2105/ajph.2022.307108 |
| 200 | http://eepurl.com/hWz3Yf | https://aslopubs.onlinelibrary.wiley.com/doi/abs/10.1002/lom3.10469 | aslopubs.onlinelibrary.wiley.com | Limnology and Oceanography: Methods | OpenOBS: Open-source, low-cost optical backscatter sensors for water quality and sediment-transport research | 2022 | TRUE | 1 | https://aslopubs.onlinelibrary.wiley.com/action/downloadSupplement?doi=10.1002%2Flom3.10469&file=lom310469-sup-0001-Supinfo.pdf | 4 | Emily F. Eidam | University of North Carolina | United States of America | efe@unc.edu | 0000-0002-1906-8692 | NA | NA | NA | NA | NA | TRUE | The code, wiring diagram, hardware bill of materials, and 3D-printed endcap design files are available at https://github.com/tedlanghorst/OpenOBS. | available in online repository | https://github.com/tedlanghorst/OpenOBS | 4 | NA | 10.1002/lom3.10469 |
For an overview of the variable descriptions, see the following table.
|
variable_name |
variable_type |
description |
|---|---|---|
|
paperid |
integer |
ID number of the paper on the journal website |
|
issue_url |
character |
URL of the newsletter issue that featured the paper |
|
paper_url |
character |
Official website url of the paper |
|
url_source |
character |
Publisher website of the paper |
|
journal |
character |
Full name of the journal |
|
title |
character |
Title of the paper |
|
published_year |
integer |
Year of publication |
|
is_supp |
logical |
Whether the paper has supplementary materials |
|
num_supp |
integer |
Number of supplementary material files |
|
supp_file_type |
character |
File types of the supplementary materials separated by a semicolon when there are multiple |
|
supp_url |
character |
Website urls of the supplementary materials separated by a semicolon when there are multiple |
|
num_authors |
integer |
Number of the authors |
|
first_author_name |
character |
Name of the first author |
|
first_author_affiliation |
character |
Academic affiliation of the first author |
|
first_author_affiliation_country |
character |
Country of the first author directly parsed from first_author_affiliation variable encoded with United Nation names |
|
first_author_email |
character |
Email of the first author |
|
first_author_orcid |
character |
ORCID of the first author |
|
correspondence_author_name |
character |
Name of the correspondence author |
|
correspondence_author_affiliation |
character |
Academic affiliation of the correspondence author |
|
correspondence_author_affiliation_country |
character |
Country or region of the correspondence author directly parsed from correspondence_author_affiliation variable encoded with United Nation names |
|
correspondence_author_email |
character |
Email of the correspondence author |
|
correspondence_author_orcid |
character |
ORCID of the correspondence author |
|
has_das |
logical |
Whether the paper has a data availability statement |
|
das |
character |
Original data availability statement of the paper. NA if it does not have a data availability statement. |
|
das_type |
factor |
Type of the data availability statement including “in paper”(data in full paper scope like supplementary material or appendix or main content) “on request”(data available on request to the authors) “available in online repository”(data is shared in a public online repository) “not shareable”(data is not shareable). NA if it does not have a data availability statement. |
|
das_repo_url |
character |
Website urls of the data if the relevant data of the paper is shared on a public repository separated by a semicolon when there are multiple |
|
keywords |
character |
Keywords of the paper separated by a semicolon |
|
doi |
character |
DOI of the paper backfilled via a Crossref title search (issue #20); NA where no match cleared the title-similarity threshold (see data-raw/uncnewsletter-doi-review.csv) |
The dataset ploswater contains data on all articles of the journal
PLOS Water from its first volume
(2022) onward, collected through the public PLOS API rather than web
scraping. It has 436 observations. Data availability statements are
mandatory at PLOS, so the interesting variation lies in das_type,
das_repo_url, and das_repo_name, which describe how and where the
data behind each article is stored. All article types are included; use
article_type to restrict to research articles.
ploswater |>
head(3) |>
gt::gt() |>
gt::as_raw_html()| paperid | volume | issue | paper_url | journal | title | published_year | is_supp | num_supp | supp_file_type | supp_url | num_authors | first_author_name | first_author_affiliation | first_author_affiliation_country | first_author_email | first_author_orcid | correspondence_author_name | correspondence_author_affiliation | correspondence_author_affiliation_country | correspondence_author_email | correspondence_author_orcid | has_das | das | das_type | das_repo_url | das_repo_name | keywords | url_source | doi | article_type | publication_date |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| 10.1371/journal.pwat.0000058 | 1 | 12 | https://journals.plos.org/water/article?id=10.1371/journal.pwat.0000058 | PLOS Water | Water remains a blind spot in climate change policies | 2022 | FALSE | 0 | NA | NA | 9 | Hervé Douville | Centre National de Recherches Météorologiques, Université de Toulouse, Météo-France, CNRS, Toulouse, France | France | herve.douville@meteo.fr | NA | Hervé Douville | Centre National de Recherches Météorologiques, Université de Toulouse, Météo-France, CNRS, Toulouse, France | France | herve.douville@meteo.fr | NA | FALSE | NA | NA | NA | NA | /Earth sciences/Atmospheric science/Climatology/Climate change; /Earth sciences/Atmospheric science/Climatology/Climate change/Anthropogenic climate change; /Earth sciences/Atmospheric science/Climatology/Climate change/Global warming; /Earth sciences/Atmospheric science/Climatology/Climate modeling; /Earth sciences/Atmospheric science/Meteorology/Rain; /Earth sciences/Hydrology/Water cycle; /Ecology and environmental sciences/Drought; /Ecology and environmental sciences/Natural resources/Water resources; /Research and analysis methods/Simulation and modeling/Climate modeling | journals.plos.org | 10.1371/journal.pwat.0000058 | Review | 2022-12-15 |
| 10.1371/journal.pwat.0000070 | 2 | 1 | https://journals.plos.org/water/article?id=10.1371/journal.pwat.0000070 | PLOS Water | Understanding household self-supply use and management using a mixed-methods approach in urban Indonesia | 2023 | TRUE | 2 | docx; docx | https://journals.plos.org/water/article/file?id=10.1371/journal.pwat.0000070.s001&type=supplementary; https://journals.plos.org/water/article/file?id=10.1371/journal.pwat.0000070.s002&type=supplementary | 7 | Franziska Genter | Institute for Sustainable Futures, University of Technology Sydney, Ultimo, NSW, Australia | Australia | franziska.g.genter@student.uts.edu.au | https://orcid.org/0000-0001-5867-4671 | Franziska Genter | Institute for Sustainable Futures, University of Technology Sydney, Ultimo, NSW, Australia | Australia | franziska.g.genter@student.uts.edu.au | https://orcid.org/0000-0001-5867-4671 | TRUE | Datasets for this research are available in this paper and its supplementary information files. | in paper | NA | NA | /Biology and life sciences/Neuroscience/Cognitive science/Cognition/Decision making; /Biology and life sciences/Neuroscience/Cognitive science/Cognitive psychology/Decision making; /Biology and life sciences/Neuroscience/Cognitive science/Cognitive psychology/Perception/Sensory perception/Taste; /Biology and life sciences/Neuroscience/Sensory perception/Taste; /Biology and life sciences/Psychology/Cognitive psychology/Decision making; /Biology and life sciences/Psychology/Cognitive psychology/Perception/Sensory perception/Taste; /Ecology and environmental sciences/Natural resources/Water resources; /Ecology and environmental sciences/Pollution/Water pollution; /Ecology and environmental sciences/Water quality; /Engineering and technology/Environmental engineering/Water management; /Physical sciences/Chemistry/Chemical elements/Chlorine; /Physical sciences/Physics/Condensed matter physics/Phase transitions/Vaporization/Boiling; /Social sciences/Psychology/Cognitive psychology/Decision making; /Social sciences/Psychology/Cognitive psychology/Perception/Sensory perception/Taste | journals.plos.org | 10.1371/journal.pwat.0000070 | Research Article | 2023-01-24 |
| 10.1371/journal.pwat.0000085 | 2 | 1 | https://journals.plos.org/water/article?id=10.1371/journal.pwat.0000085 | PLOS Water | Issues that should be addressed at the UN 2023 Water Conference | 2023 | FALSE | 0 | NA | NA | 1 | Jon Lane | World Water Week, Stockholm International Water Institute, WINZ–The Water Initiative for Net Zero, Stockholm, Sweden | Sweden | Jon.lane@siwi.org | NA | Jon Lane | World Water Week, Stockholm International Water Institute, WINZ–The Water Initiative for Net Zero, Stockholm, Sweden | Sweden | Jon.lane@siwi.org | NA | FALSE | NA | NA | NA | NA | /Earth sciences/Atmospheric science/Atmospheric chemistry/Greenhouse gases; /Earth sciences/Atmospheric science/Climatology/Climate change/Anthropogenic climate change; /Earth sciences/Geomorphology/Topography/Landforms/Wetlands; /Earth sciences/Hydrology/Surface water; /Earth sciences/Marine and aquatic sciences/Aquatic environments/Freshwater environments/Wetlands; /Ecology and environmental sciences/Aquatic environments/Freshwater environments/Wetlands; /Ecology and environmental sciences/Environmental chemistry/Atmospheric chemistry/Greenhouse gases; /Ecology and environmental sciences/Natural resources/Water resources; /Medicine and health sciences/Health care/Environmental health/Sanitation; /Medicine and health sciences/Public and occupational health/Environmental health/Sanitation; /Physical sciences/Chemistry/Chemical compounds/Methane; /Physical sciences/Chemistry/Environmental chemistry/Atmospheric chemistry/Greenhouse gases; /Social sciences/Political science/Governments | journals.plos.org | 10.1371/journal.pwat.0000085 | Opinion | 2023-01-24 |
For an overview of the variable descriptions, see the following table.
|
variable_name |
variable_type |
description |
|---|---|---|
|
paperid |
character |
DOI of the paper; identical to the doi variable |
|
volume |
integer |
Volume number of the journal; volume 1 is 2022 |
|
issue |
integer |
Issue number of the journal |
|
paper_url |
character |
Official website url of the paper |
|
journal |
character |
Full name of the journal |
|
title |
character |
Title of the paper |
|
published_year |
integer |
Year of publication |
|
is_supp |
logical |
Whether the paper has supplementary materials |
|
num_supp |
integer |
Number of supplementary material files |
|
supp_file_type |
character |
File types of the supplementary materials separated by a semicolon when there are multiple |
|
supp_url |
character |
Website urls of the supplementary materials separated by a semicolon when there are multiple. Stable download endpoints that do not expire |
|
num_authors |
integer |
Number of the authors |
|
first_author_name |
character |
Name of the first author |
|
first_author_affiliation |
character |
Academic affiliation of the first author |
|
first_author_affiliation_country |
character |
Country of the first author parsed from first_author_affiliation encoded with United Nations names |
|
first_author_email |
character |
Email of the first author. Only available when the first author is the correspondence author because PLOS publishes only the correspondence email |
|
first_author_orcid |
character |
ORCID of the first author |
|
correspondence_author_name |
character |
Name of the correspondence author |
|
correspondence_author_affiliation |
character |
Academic affiliation of the correspondence author |
|
correspondence_author_affiliation_country |
character |
Country of the correspondence author parsed from correspondence_author_affiliation encoded with United Nations names |
|
correspondence_author_email |
character |
Email of the correspondence author |
|
correspondence_author_orcid |
character |
ORCID of the correspondence author |
|
has_das |
logical |
Whether the paper has a data availability statement |
|
das |
character |
Original data availability statement of the paper. NA if it does not have a data availability statement |
|
das_type |
factor |
Type of the data availability statement including “available in online repository”(data is shared in a public online repository) “in paper”(data in full paper scope like supplementary material or appendix or main content) “on request”(data available on request to the authors) “not shareable”(data is not shareable) “no data generated”(the study produced no datasets). NA if it does not have a data availability statement or no classification rule matched |
|
das_repo_url |
character |
Website urls and dataset DOIs mentioned in the data availability statement separated by a semicolon when there are multiple |
|
das_repo_name |
character |
Recognized data repositories behind das_repo_url (e.g. zenodo dryad figshare osf github dataverse) separated by a semicolon when there are multiple |
|
keywords |
character |
Subject terms of the paper from the PLOS search API separated by a semicolon. PLOS Water articles carry no author keywords in their XML |
|
url_source |
character |
Publisher website of the paper |
|
doi |
character |
DOI of the paper |
|
article_type |
character |
Article type e.g. Research Article or Opinion or Review |
|
publication_date |
date |
Date of publication (ISO 8601) |
The dataset datapapers contains WASH-related data papers published in
seven dedicated data journals, identified from Crossref and Europe PMC
metadata and screened for relevance (see data-raw/README.md for the
pipeline). It has 8 observations. Because a data paper exists to
describe a shared dataset, data_repo_url and data_repo take the role
that the data availability statement variables play in the other two
datasets.
datapapers |>
head(3) |>
gt::gt() |>
gt::as_raw_html()| paperid | doi | paper_url | url_source | journal | title | published_year | num_authors | first_author_name | first_author_affiliation | first_author_affiliation_country | data_repo_url | data_repo | license | related_paper_doi | abstract | query_term | retrieval_date |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| 1 | 10.3390/data8060103 | https://doi.org/10.3390/data8060103 | mdpi.com | Data | Physico-Chemical Quality and Physiological Profiles of Microbial Communities in Freshwater Systems of Mega Manila, Philippines | 2023 | 6 | Marie Christine M. Obusan | Microbial Ecology of Terrestrial and Aquatic Systems Laboratory, Institute of Biology, College of Science, University of the Philippines Diliman, Quezon City 1101, Philippines | Philippines | NA | NA | https://creativecommons.org/licenses/by/4.0/ | NA | <jats:p>Studying the quality of freshwater systems and drinking water in highly urbanized megalopolises around the world remains a challenge. This article reports data on the quality of select freshwater systems in Mega Manila, Philippines. Water samples collected between 2020 and 2021 were analyzed for physico-chemical parameters and microbial community metabolic fingerprints, i.e., carbon substrate utilization patterns (CSUPs). The detection of arsenic, lead, cadmium, mercury, polyaromatic hydrocarbons (PAHs), and organochlorine pesticides (OCPs) was carried out using standard chromatography- and spectroscopy-based protocols. Physiological profiles were determined using the Biolog EcoPlate™ system. Eight samples were free of heavy metals, and none contained PAHs or OCPs. Fourteen samples had high microbial activity, as indicated by average well color development (AWCD) and community metabolic diversity (CMD) values. Community-level physiological profiling (CLPP) revealed that (1) samples clustered as groups according to shared CSUPs, and (2) microbial communities in non-drinking samples actively utilized all six substrate classes compared to drinking samples. The data reported here can provide a baseline or a comparator for prospective quality assessments of drinking water and freshwater sources in the region. Metabolic fingerprinting using CSUPs is a simple and cheap phenotypic analysis of microbial communities and their physiological activity in aquatic environments.</jats:p> | water quality | 2026-07-23 |
| 2 | 10.3390/data8090141 | https://doi.org/10.3390/data8090141 | mdpi.com | Data | Thailand Raw Water Quality Dataset Analysis and Evaluation | 2023 | 6 | Jaturapith Krohkaew | Department of Big Data Management and Analytics, Rajamangala University of Technology Thanyaburi, Pathum Thani 12110, Thailand | Thailand | NA | NA | https://creativecommons.org/licenses/by/4.0/ | NA | <jats:p>Sustainable water quality data are important for understanding historical variability and trends in river regimes, as well as the impact of industrial waste on the health of aquatic ecosystems. Sustainable water management practices heavily depend on reliable and comprehensive data, prompting the need for accurate monitoring and assessment of water quality parameters. This research describes a reconstructed daily water quality dataset that complements rare historical observations for six station points along the Chao Phraya River in Thailand. Internet of Things technology and a Eureka water probe sensor is used to collect and reconstruct the water quality dataset for the period from June 2022–February 2023, with Turbidity, Optical Dissolved Oxygen, Dissolved Oxygen Saturation, Spatial Conductivity, Acidity/Basicity, Total Dissolved Solids, Salinity, Temperature, Chlorophyll, and Depth as the recorded parameters from six different stations. The presented dataset comprises a total of 211,322 data points, which are separated into six CSV files. The dataset is then evaluated using the Long Short-Term Memory (LSTM) algorithm with a Mean Squared Error (MSE) of 0.0012256, and Root Mean Squared Error (RMSE) of 0.0350080. The proposed dataset provides valuable insights for researchers studying river ecosystems, supporting informed decision-making and sustainable water management practices.</jats:p> | drinking water; water quality; water sanitation | 2026-07-23 |
| 3 | 10.46471/gigabyte.167 | https://doi.org/10.46471/gigabyte.167 | gigabytejournal.com | GigaByte | Collection of entomological, demographic, water and sanitation, and climatic data of interest for arbovirus surveillance in Praia, Cabo Verde | 2025 | 7 | Lara Ferrero Gómez | Universidade Jean Piaget de Cabo Verde | Cabo Verde | NA | NA | https://creativecommons.org/licenses/by/4.0/ | NA | <jats:p>Vector-borne diseases, primarily those transmitted by mosquitoes, are a serious public health problem. Some, such as dengue, put half of the world’s population at risk. Combating these diseases requires multifaceted strategies, with vector surveillance and control playing key roles. Robust and predictive surveillance systems for vector-borne diseases, based on risk stratification, enable the implementation of appropriate interventions across time and space. Here, we present a collection of entomological, demographic, water and sanitation, and climatic data from Praia (Cabo Verde), a hotspot for mosquito-borne diseases. These data were collected from June to November 2022, at 40 sentinel points scattered across the urban area of Praia. They constitute a valuable source of information for developing predictive scenarios of arbovirus outbreak risk using statistical models applied to spatial and non-spatial indicators. These data demonstrate the utility of GBIF in transforming large volumes of occurrence data into valuable information for arbovirus surveillance and vector control.</jats:p> | drinking water; sanitation; water quality; water sanitation | 2026-07-23 |
For an overview of the variable descriptions, see the following table.
|
variable_name |
variable_type |
description |
|---|---|---|
|
paperid |
integer |
ID number of the paper within this dataset |
|
doi |
character |
DOI of the data paper |
|
paper_url |
character |
Official url of the paper (DOI resolver link) |
|
url_source |
character |
Publisher website of the paper |
|
journal |
character |
Full name of the journal |
|
title |
character |
Title of the paper |
|
published_year |
integer |
Year of publication |
|
num_authors |
integer |
Number of the authors |
|
first_author_name |
character |
Name of the first author |
|
first_author_affiliation |
character |
Academic affiliation of the first author |
|
first_author_affiliation_country |
character |
Country of the first author parsed from first_author_affiliation variable encoded with United Nations names |
|
data_repo_url |
character |
Website urls of the repository holding the dataset the paper describes separated by a semicolon when there are multiple |
|
data_repo |
character |
Name of the data repository (e.g. Zenodo Dryad Figshare OSF Dataverse) parsed from data_repo_url |
|
license |
character |
License url of the paper from Crossref metadata |
|
related_paper_doi |
character |
DOI of a linked research article if any separated by a semicolon when there are multiple |
|
abstract |
character |
Abstract of the paper as provided by the metadata source |
|
query_term |
character |
WASH search term(s) that retrieved the paper separated by a semicolon |
|
retrieval_date |
date |
Date the paper metadata was harvested from the API |
- What are the top 10 countries(or regions) the first authors from in the Journal of Water, Sanitation and Hygiene for Development?
library(washopenresearch)
washdev |>
filter(!is.na(first_author_affiliation_country)) |>
group_by(first_author_affiliation_country) |>
summarise(count=n()) |>
arrange(desc(count)) |>
head(10) |>
ggplot() +
geom_col(aes(x = reorder(first_author_affiliation_country, count),
y = count)) +
labs(title = "Top 10 countries of first author",
subtitle = "in the Journal of Water, Sanitation and Hygiene for Development",
x = "First Author Country", y = "Count") +
scale_x_discrete(labels = scales::label_wrap(15))+
coord_flip() +
theme_classic()
- What are the top choices of keywords in WASH Dev?
Each publication may provide a list of keywords, typically 5-7, to summarize the topics of the article. Here we compile all keywords and calculate their frequency to be used.
keywords_freq <- washdev$keywords |>
str_split("; ") |>
unlist() |>
str_to_lower() |>
table() |>
as.data.frame() |>
as_tibble() |>
arrange(desc(Freq))
# Top 20 keywords
ggplot(data = head(keywords_freq, 20)) +
geom_bar(aes(x = reorder(Var1, Freq), y=Freq), stat = "identity") +
coord_flip() +
labs(title = "Top 20 Keywords in WASH Dev Journal", x = "Keywords", y = "Count") +
theme_bw()
- What are the top 10 source websites of the publications selected by the newsletter?
uncnewsletter |>
group_by(url_source) |>
summarise(count=n()) |>
arrange(desc(count)) |>
head(10) |>
ggplot() +
geom_col(aes(x = reorder(url_source, count),
y = count)) +
labs(title = "Top 10 publication websites",
subtitle = "in the selection of North Carolina Water News",
x = "Website URL", y = "Count") +
scale_x_discrete(labels = scales::label_wrap(15))+
coord_flip() +
theme_classic()
- How many papers per journal, and how many resolve to a data repository?
datapapers |>
group_by(journal) |>
summarise(papers = n(),
with_repository_link = sum(!is.na(data_repo_url))) |>
arrange(desc(papers)) |>
knitr::kable()| journal | papers | with_repository_link |
|---|---|---|
| Scientific Data | 5 | 0 |
| Data | 2 | 0 |
| GigaByte | 1 | 0 |
We describe the raw data collection procedure of each dataset in this section. To reproduce the collection, you need to have python3 installed and install python libraries
pip install requirements.txt
The collection of washdev is via web scraping using Python. The script
can be found in inst/python/washdev_scraping.py. First, each
publication link is scraped from iterating the table of contents of all
volumes. This step delivers a table containing the variables paper ID,
volume number, issue number, publication url, journal title, publication
title, and published year. This table will be merged to get the final
dataset.
Then, for each publication, we retrieve the needed variables from the publication’s html file using the publication url. The retrieval is rule-based to find the relevant fields (e.g. supplementary materials) and extract the value.
The collection of datapapers is fully scripted in R. Crossref is
queried by journal ISSN and Europe PMC by journal name (for the
F1000-platform journals) with a fixed list of WASH search terms; the
harvest is committed as a raw snapshot with the retrieval date and
matching query terms recorded per row. Relevance screening and country
corrections are captured in committed CSV decision sheets keyed on DOI,
so the pipeline runs end-to-end non-interactively. See
data-raw/README.md for the run order.
The collection of uncnewsletter is a combination of web scraping and
manual annotation. We first use the newsletter archive to scrape all
publication website links. The code can be found at
inst/python/uncnewsletter_scraping.py. Two annotators worked on the
manual extraction of the needed variables on these publications. For
each publication, an annotator follows the guide to fill in the value on
an collaborative spreadsheet. The guide is converted into the data
dictionary for this dataset.
Data are available as CC-BY.
Please cite this package using:
citation("washopenresearch")
#> To cite package 'washopenresearch' in publications use:
#>
#> Zhong M, Luz L, Schöbitz L (2026). "washopenresearch: Dataset about
#> open research data information in Water, Sanitation, and Hygiene."
#> doi:10.5281/zenodo.11185699
#> <https://doi.org/10.5281/zenodo.11185699>.
#> <https://github.com/openwashdata/washopenresearch>.
#>
#> A BibTeX entry for LaTeX users is
#>
#> @Misc{zhong_etall:2026,
#> title = {washopenresearch: Dataset about open research data information in Water, Sanitation, and Hygiene},
#> author = {Mian Zhong and Ludwig Luz and Lars Schöbitz},
#> year = {2026},
#> doi = {10.5281/zenodo.11185699},
#> url = {https://github.com/openwashdata/washopenresearch},
#> abstract = {The goal of washopenresearch is to provide an overview of open research data related to Water Sanitation and Hygiene (WASH). The package provides access to two datasets `washdev` and `uncnewsletter`. Each dataset collects information on scientific articles about (1) article metadata (e.g. title, first author, correspondence author), (2) supplementary material information, (3) data availability statement, and (4) semantic information (e.g. keywords).},
#> keywords = {open-data,open-research-data,open-science,openwashdata,sanitation,wash},
#> version = {0.1.0},
#> }