rfreadread.csv
Website forbidden when scraping web data in R but works fine in browser
I'm trying to import the data here:
https://download.bls.gov/pub/time.series/cu/cu.series
But when I run
fread('https://download.bls.gov/pub/time.series/cu/cu.series')
I get:
Error in curl::curl_download(input, tmpFile, mode = "wb", quiet = !showProgress) :
HTTP error 403.
Update: Still getting error even when using custom user agent in Rstudio Cloud
Solution
This worked for me at the BLS time series site: preface the url with "https://", and then for the user_agent string, insert your email address instead of the browser string. Ex:
GET("https://download.bls.gov/...",user_agent("[email protected]"))
- generaly disable warnings and messagers in R markdown
- Why are the minimums different in R for summary and minimum?
- Ellipsis `...` to list of unevaluated expressions
- How to obtain the height of tree in cutree() knowing the number of clusters
- Calculating 5 Year Moving Average in R with inflation-adjusted exchange rates
- Efficiently find the number of different classmates from course-level data
- Empty dateRangeInput() is giving an error
- Convert a list into a tibble with nested columns
- Datatable formatting with JS disappears on button click
- Apply command for complex functions and calculations on a dataset in R
- Check if two file paths resolve to the same file
- R extract first number from string
- Extract the first 2 Characters in a string
- Check if two paths resolve to the same directory
- How to integrate GPT-4 model hosted on Azure with the gptstudio package?
- How to use a different fill gradient based on value threshold in ggplot2?
- Convert bounds into raster in R
- Sorting calendar plot with geom_segment() + fix scale
- Is there a way to add a pop-up window to facet_wrap ggplot titles that shows title descriptions in Quarto?
- Failed to load expression data from Geodataset
- Aggregate / summarize multiple variables per group (e.g. sum, mean)
- Oaxaca decomposition on weighted survey data in R
- I don't understand fitHMM() error on parameter bounds
- Improve processing time of applying a function over a vector and grouping by columns - R
- Why is plotly_legenddoubleclick becoming out of sync?
- How to change legend title in ggplot
- Adding a geom_sf to a long-lat plot with gratia package in R
- change symbol in ggplot2 legend, with geom_line?
- Replacing ggplot2 legend key for geom_line with symbol
- How to enter censored data into R's survival model?