How to mount bucket in GCE and make it available to R Studio-Server
I have setup a Google Compute Engine (GCE) instance and I want to mount a Google Cloud Bucket to it. Basically, I have uploaded my data to Google Cloud and I want to make it available for use in the R Studio-server I have installed in my instance. It seems my mounting was successful, but I cannot see the data on R (or in the shell).
I want the bucket to be mounted in /home/roberto/remote. I have run chmod 777 /home/roberto/remote and then gcsfuse my-project /home/roberto/remote. I got the following output:
2023/01/28 22:49:01.004683 Start gcsfuse/0.41.12 (Go version go1.18.4) for app "" using mount point: /home/roberto/remote
2023/01/28 22:49:01.022553 Opening GCS connection...
2023/01/28 22:49:01.172583 Mounting file system "my-project"...
2023/01/28 22:49:01.176837 File system has been successfully mounted.
However, I can't see anything inside /home/roberto/remote when I run ls or when I look inside of it from R Studio-server (see image below). What should I do?
UPDATE: I had uploaded my folders to google cloud, but when I uploaded an individual file, it suddenly showed up! This makes me think the issue has something to do with implicit directories. Supposedly, if I run the same command as before with the --implicit-dirs flag that would be enough (something like this: gcsfuse --implicit-dirs my-project /home/roberto/remote). However, this is returning an error message and I am not sure how to deal with it.
Error message:
2023/01/29 01:33:15.428752 Start gcsfuse/0.41.12 (Go version go1.18.4) for app "" using mount point: /home/roberto/remote
2023/01/29 01:33:15.446696 Opening GCS connection...
2023/01/29 01:33:15.548211 Mounting file system "my-project"...
daemonize.Run: readFromProcess: sub-process: mountWithArgs: mountWithConn: Mount: mount: running /usr/bin/fusermount3: exit status 1
Other answers here could be useful depending on your issue. In my case, what solved it was indeed running the command gcsfuse --implicit-dirs my-project /home/roberto/remote. The error I was getting in the edit for my question was due to the fact that I had previously mounted the bucket and was trying to mount it again without unmounting it first (here is the official documentation on how to unmount the bucket). For more details on the importance of the --implicit-dirs flag take a look at the official documentation here. There are very similar solutions using, for instance, the /etc/fstab file. For that, take a look at this discussion in the official github page of gcsfuse.
- How to put infinity and -infinity on a graph with plot
- Is there a way to make R beep/play a sound at the end of a script?
- Understanding why grepl doesn't appear to be correctly identifying words
- How to modify legend symbol for geom_text using key_glyph?
- In R, how to check if a data.table contains a column and if it doesnt, create it and fill it with NA?
- Adabag package in R
- Group variables into toplevel variables within tbl_summary()
- Scrape Home Run Leaderboard from Baseball Savant using R
- Little hack for ggplot -- an easy way to add a text with the real means and standard deviation when using lines or bars
- How to retrieve Common Table Expressions (CTEs) as a R list?
- R Calculate multiple aggregations on several variables
- How to force shiny to update UI before reactive process finishes
- How to change GitHub Actions OS from macOS to Windows or Ubuntu?
- Assigndifferent paletes to different geoms but same scale
- R: Error "incorrect number of subscripts on matrix" when trying boot with roc
- How do I reference a function parameter inside a data.table with a column of the same name?
- ggraph: adjusting text label position on circular dendrogram
- List all months between two dates in R
- How to get column-wise summary statistics with missing codes?
- How to display only integer values on an axis using ggplot2
- How do I plot two geom_textlines + one geom_bar in a single ggplot?
- Convert Canadian Postal Code to Longitude and Latitude
- Adding percentage instead of observed counts on y axis on R figure
- Compute the Beta function with negative arguments
- Long to wide format based on variable suffixes in tidyverse in R
- ggplot2 0.9.0 automatically dropping unused factor levels from plot legend?
- Testing async ExtendedTask with shinytest2
- Dynamic geom_text() pastes of labels across facets in fact_wrap()
- Check if a directory is empty in R
- Read large number of small files efficiently in R