Search code examples
rtimedataframesamplingresampling

Resampling data efficiently in R (linear extrapolation)


I have a set of observations (gamma and time) recorded at 1 second interval. I want to resample this data at 0.1 seconds. The data look like this:

38804.96    12.59222222
38805.12    12.5925
38805.38    12.59277778
38805.4     12.59305556
38805.27    12.59333333
38805.36    12.59361111
38805.33    12.59388889
38805.23    12.59416667
38805.3     12.59444444
38805.18    12.59472222
38805.21    12.595
38805.28    12.59527778

I came up with the following code to resample (linearly extrapolate) the gamma but it is very time consuming since my data set has more than 30000 observations.

    #Resampling la diurnal drift
    j <- (0:9)
    A <- 0
    VectorT <- numeric()
    VectorG <- numeric()
    for (I in 1:nrow(R20140811)){ 
       # Calculate the increment of time
       Rate <- (R20140811[I+1,2]- R20140811[I,2])/10
       Time <- R20140811[I,2]
       # Calculate the increment of gamma
       nT <- (R20140811[I+1,1] - R20140811[I,1])/10
       Gamma <- R20140811[I,1]
       print(I)
       for (j in 0:9){ 
          A <- A + 1
          VectorT[A] <- Time + (j*Rate)
          VectorG[A] <- Gamma + (j*nT)
          R20140811[A,3] <- VectorG[A]
          R20140811[A,4] <- VectorT[A]
       }
    }

Do you know a more efficient way to do this?


Solution

  • You need to vectorize your calculation.

    Given your matrix:

    R20140811 <- matrix(
    c(38804.96   ,12.59222222,
    38805.12   ,12.5925    ,
    38805.38   ,12.59277778,
    38805.4    ,12.59305556,
    38805.27   ,12.59333333,
    38805.36   ,12.59361111,
    38805.33   ,12.59388889,
    38805.23   ,12.59416667,
    38805.3    ,12.59444444,
    38805.18   ,12.59472222,
    38805.21   ,12.595     ,
    38805.28   ,12.59527778),ncol=2,byrow=TRUE)
    

    Separate times and gammas:

    times <- R20140811[,2]
    gammas <- R20140811[,1]
    

    Then define your extrapolation function:

    # given a vector vect, extrapole nInt points between points
    Extrapol <- function(vect,nInt){
            # the starting points of your intervals
            zeros <- vect[1:(length (vect)-1)]
            # determine the increments
            increments <- (vect[2:length (vect)]-zeros)/nInt
            # get the new sample
            newSample <- rep(zeros[1: (length (times)-1)],each=10) + as.vector(outer (0:9,increments))
            return(newSample)
    }
    

    And apply the extrapolation function to both your times and gammas

    newSampleGamma <- Extrapol(gammas,10)
    newSampleTimes <- Extrapol(times,10)
    

    It should be orders of magnitude faster :-)