Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
79 commits
Select commit Hold shift + click to select a range
030edf4
First steps in switching to httr2
ldecicco-USGS Oct 23, 2024
84cb3cc
Getting there!
ldecicco-USGS Oct 24, 2024
ffbfaa3
udpates from main
ldecicco-USGS Oct 24, 2024
a8f236e
update ua
ldecicco-USGS Oct 24, 2024
ea8170a
start
ldecicco-USGS Oct 24, 2024
d829f26
Merge branch 'main' of https://code.usgs.gov/water/dataRetrieval into…
ldecicco-USGS Nov 1, 2024
6062607
cleaning up WQP calls
ldecicco-USGS Nov 1, 2024
af0b523
style
ldecicco-USGS Nov 1, 2024
f1bbab0
getting the lists correct
ldecicco-USGS Nov 2, 2024
993a2a4
More NWIS and WQP httr2 updates
ldecicco-USGS Nov 3, 2024
9fca4e2
a few httr2 updates
ldecicco-USGS Nov 4, 2024
313fdda
Fixing some tests. Mostly arguments in the URLs are shuffled around.
ldecicco-USGS Nov 4, 2024
f09bb35
wrong argument
ldecicco-USGS Nov 4, 2024
90cb26c
More tests to fix and update findNLDI
ldecicco-USGS Nov 4, 2024
746d32c
local file tests
ldecicco-USGS Nov 4, 2024
47e35a7
getting water use URLs to work
ldecicco-USGS Nov 5, 2024
790f924
more test url updates
ldecicco-USGS Nov 5, 2024
82318a9
everything except NGWMN working
ldecicco-USGS Nov 5, 2024
9792060
NGWMN
ldecicco-USGS Nov 5, 2024
111feb5
Dropping problimatic example (data source keeps changing)
ldecicco-USGS Nov 5, 2024
6bfc32a
Upstream pull
ldecicco-USGS Nov 5, 2024
d289745
adding count=no to legacy
ldecicco-USGS Nov 5, 2024
7ad1ed5
updating docker file
ldecicco-USGS Nov 5, 2024
20fa9e7
run check on develop
ldecicco-USGS Nov 5, 2024
8f93afe
Fix test due to my last minute addition of count=no to legacy WQP
ldecicco-USGS Nov 5, 2024
8ee4a7a
change example
ldecicco-USGS Nov 5, 2024
0b60de4
Another set of multi's
ldecicco-USGS Nov 5, 2024
6146ebb
wqp_check_status example
ldecicco-USGS Nov 5, 2024
722ed47
Trying new GH actions to reduce suggest list, and responding to a few…
ldecicco-USGS Nov 25, 2024
0b30821
Shame, shame, shame! 😔
ldecicco-USGS Nov 25, 2024
1704e18
Meant to include this so we can test if the GH actions work (building…
ldecicco-USGS Nov 25, 2024
29ecfcb
More updates thanks to Joe's review
ldecicco-USGS Nov 25, 2024
9ce4776
Custom .multi for legacy
ldecicco-USGS Nov 25, 2024
35a957f
Merge pull request #738 from ldecicco-USGS/httr2
ldecicco-USGS Nov 25, 2024
e2fe792
First pass at samples-data
ldecicco-USGS Nov 25, 2024
536e9c1
Adding some verification
ldecicco-USGS Nov 25, 2024
afef6e5
More samples-data updates
ldecicco-USGS Nov 26, 2024
8b1d407
Fix examples
ldecicco-USGS Nov 26, 2024
0667ec1
point within
ldecicco-USGS Nov 26, 2024
443d587
add more services
ldecicco-USGS Nov 26, 2024
866100c
Adding sample-data tests
ldecicco-USGS Nov 26, 2024
17fd956
Only run verification on main branch, but do create development pages…
ldecicco-USGS Nov 27, 2024
4a75a03
Rejigger state/county code lookups
ldecicco-USGS Nov 27, 2024
c920ec0
Don't think we need to rebuild the image each time we change the ci f…
ldecicco-USGS Nov 27, 2024
e72c7aa
Cleaning up a few more argument descriptions.
ldecicco-USGS Nov 27, 2024
8d81e41
Fix some tests
ldecicco-USGS Nov 27, 2024
4683cb7
start a vignette
ldecicco-USGS Nov 27, 2024
a7076d7
get pkgdown working
ldecicco-USGS Nov 28, 2024
1efac0d
Always causing problems
ldecicco-USGS Nov 29, 2024
003e8cd
Update vignette
ldecicco-USGS Dec 2, 2024
e8188e4
Merge branch 'main' of https://github.com/DOI-USGS/dataRetrieval into…
ldecicco-USGS Dec 2, 2024
09cfb45
another wade causing trouble
ldecicco-USGS Dec 3, 2024
9957587
moving all nldi tests to "long running", so should only run when trig…
ldecicco-USGS Dec 3, 2024
46d2a32
Adding more text.
ldecicco-USGS Dec 3, 2024
8c58d4c
Switch to summarize
ldecicco-USGS Dec 3, 2024
126f077
Updates from Lee's review
ldecicco-USGS Dec 3, 2024
89d54de
trying to avoid the longrunner
ldecicco-USGS Dec 3, 2024
7b5d81f
renamed summarize
ldecicco-USGS Dec 3, 2024
e9c188e
upstream pull
ldecicco-USGS Dec 3, 2024
d15ee15
Cleanup mapping code
ldecicco-USGS Dec 4, 2024
3cb309c
Ignore samples_data in package
ldecicco-USGS Dec 21, 2024
670924d
Response to Elise's review.
ldecicco-USGS Jan 15, 2025
dc71fc4
Merge branch 'samples_data' of github.com:ldecicco-USGS/dataRetrieval…
ldecicco-USGS Jan 15, 2025
fbb7e5e
sample_s_
ldecicco-USGS Jan 23, 2025
769c992
rename
ldecicco-USGS Jan 24, 2025
5a95dc0
Switching to Swagger inputs
ldecicco-USGS Feb 3, 2025
83cd2ea
taking out non-legacy tests
ldecicco-USGS Feb 3, 2025
2bc7474
Missed a Narrow
ldecicco-USGS Feb 3, 2025
8972763
take out qwdata
ldecicco-USGS Feb 3, 2025
1460f56
Merge pull request #741 from ldecicco-USGS/samples_data
ldecicco-USGS Feb 4, 2025
b53ab3c
streamline counties
ldecicco-USGS Feb 10, 2025
0588753
Adding back variable info
ldecicco-USGS Feb 10, 2025
899b850
minor edits samples_data.rmd
lstanish-usgs Feb 12, 2025
e64e5a4
Getting ready for CRAN update
ldecicco-USGS Feb 25, 2025
a010646
getting ready for CRAN
ldecicco-USGS Feb 25, 2025
9e3a66d
rerun readme
ldecicco-USGS Feb 25, 2025
39f307a
Merge pull request #747 from ldecicco-USGS/develop
ldecicco-USGS Feb 25, 2025
5ffaac5
Merge branch 'develop' into 'develop'
ldecicco-USGS Feb 26, 2025
f4f9f93
Merge pull request #748 from ldecicco-USGS/develop
ldecicco-USGS Feb 26, 2025
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
3 changes: 2 additions & 1 deletion .Rbuildignore
Original file line number Diff line number Diff line change
Expand Up @@ -94,4 +94,5 @@ vignettes/dataretrieval_discrete_changes_images/*
^ci$
^public$
^docker$
vignettes/WQX_3.Rmd
vignettes/WQX_3.Rmd
vignettes/samples_data.Rmd
9 changes: 5 additions & 4 deletions .github/workflows/R-CMD-check.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -2,9 +2,9 @@
# Need help debugging build failures? Start at https://github.com/r-lib/actions#where-to-find-help
on:
push:
branches: [main]
branches: [main, develop]
pull_request:
branches: [main]
branches: [main, develop]

name: R-CMD-check

Expand Down Expand Up @@ -32,15 +32,16 @@ jobs:

- uses: r-lib/actions/setup-pandoc@6012817847b5f064d0882d67a7b5e2ca6639afb2

- uses: r-lib/actions/setup-r@15cf1013badbaf6d25f100593ad5d7d75e65d64b
- uses: r-lib/actions/setup-r@473c68190595b311a74f208fba61a8d8c0d4c247
with:
r-version: ${{ matrix.config.r }}
http-user-agent: ${{ matrix.config.http-user-agent }}
use-public-rspm: true

- uses: r-lib/actions/setup-r-dependencies@96b1dc658a45175f93ed5f33fda2b2cebbb12ee8
with:
extra-packages: any::rcmdcheck
extra-packages: |
any::rcmdcheck
needs: check

- uses: r-lib/actions/check-r-package@3e56ca41aa267855f36891af7a495d24bfaa8373
Expand Down
10 changes: 9 additions & 1 deletion .github/workflows/pkgdown.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -40,7 +40,15 @@ jobs:

- uses: r-lib/actions/setup-r-dependencies@473c68190595b311a74f208fba61a8d8c0d4c247
with:
extra-packages: any::pkgdown, local::.
extra-packages: |
any::pkgdown
any::rcmdcheck
any::DT
any::data.table
any::dplyr
any::tidyr
any::gridExtra
local::.
needs: website

- name: Build site
Expand Down
20 changes: 15 additions & 5 deletions .gitlab-ci.yml
Original file line number Diff line number Diff line change
Expand Up @@ -42,7 +42,6 @@ build-image:
rules:
- changes:
- docker/Dockerfile
- .gitlab-ci.yml
script:
- echo ${CI_REGISTRY_PASSWORD} | docker login -u ${CI_REGISTRY_USER} --password-stdin $CI_REGISTRY
- docker pull ${CI_REGISTRY_IMAGE}:latest || true
Expand Down Expand Up @@ -81,22 +80,33 @@ unittests:
coverage_format: cobertura
path: cobertura.xml
coverage: '/Coverage: \d+.\d+\%/'


longtest:
stage: test
dependencies:
- build-image
- buildcheck
script:
- Rscript -e 'testthat::test_local(path = "tests/manual")'
rules:
- if: $RUN_LONG_TESTS == "FALSE"
when: always
- when: never

pages:
stage: end
cache: []
only:
- main
script:
- Rscript -e 'pkgdown::build_site(override = list(destination = "public"))'
- Rscript -e 'source("deploy_simple.R")'
artifacts:
paths:
- $PAGES_OUTDIR
expire_in: 1 week

Validate Inventory:
stage: end
only:
- main
image: ${INTERNAL_REGISTRY}software/software-management:latest
script:
- software-management review
Expand Down
13 changes: 4 additions & 9 deletions DESCRIPTION
Original file line number Diff line number Diff line change
@@ -1,7 +1,7 @@
Package: dataRetrieval
Type: Package
Title: Retrieval Functions for USGS and EPA Hydrology and Water Quality Data
Version: 2.7.17.9000
Version: 2.7.18
Authors@R: c(
person("Laura", "DeCicco", role = c("aut","cre"),
email = "[email protected]",
Expand Down Expand Up @@ -37,24 +37,19 @@ Copyright: This software is in the public domain because it contains materials
that originally came from the United States Geological Survey, an agency of
the United States Department of Interior.
Depends:
R (>= 3.5.0)
R (>= 4.1.0)
Imports:
httr (>= 1.0.0),
curl,
lubridate (>= 1.5.0),
stats,
utils,
xml2,
readr (>= 1.4.0),
jsonlite
jsonlite,
httr2
Suggests:
covr,
dplyr,
ggplot2,
tidyr,
data.table,
DT,
gridExtra,
knitr,
rmarkdown,
sf,
Expand Down
4 changes: 4 additions & 0 deletions NAMESPACE
Original file line number Diff line number Diff line change
Expand Up @@ -3,9 +3,11 @@
export(addWaterYear)
export(calcWaterYear)
export(checkWQPdates)
export(check_param)
export(constructNWISURL)
export(constructUseURL)
export(constructWQPURL)
export(construct_USGS_sample_request)
export(countyCd)
export(countyCdLookup)
export(create_NWIS_bib)
Expand Down Expand Up @@ -40,10 +42,12 @@ export(readNWISuv)
export(readWQPdata)
export(readWQPqw)
export(readWQPsummary)
export(read_USGS_samples)
export(renameNWISColumns)
export(setAccess)
export(stateCd)
export(stateCdLookup)
export(summarize_USGS_samples)
export(whatNWISdata)
export(whatNWISsites)
export(whatWQPdata)
Expand Down
4 changes: 4 additions & 0 deletions NEWS
Original file line number Diff line number Diff line change
@@ -1,6 +1,10 @@
dataRetrieval 2.7.18
===================
* Switched from httr to httr2
* Added a way to include a custom user-agent suffix via an enviornmental variable "CUSTOM_DR_UA"
* Added function for USGS discrete data samples_data service: read_USGS_samples
* Restructured stateCdLookup and countyCdLookup to use web services that only
list states and counties that have water quality data.

dataRetrieval 2.7.17
===================
Expand Down
4 changes: 3 additions & 1 deletion R/checkWQPdates.R
Original file line number Diff line number Diff line change
Expand Up @@ -16,7 +16,9 @@
checkWQPdates <- function(values) {
dateNames <- c(
"startDateLo", "startDateHi",
"startDate", "endDate"
"startDate", "endDate",
"activityStartDateLower",
"activityStartDateUpper"
)

if (any(names(values) %in% dateNames)) {
Expand Down
Loading
Loading