Search code examples
rdataframedata.tablesubsetcombn

Subset data.table based on all possible combinations of two or more variables


I want to subset a data.frame based on if some variables are all positive, all negative or some combination in between. For n variables this should lead to 2^n possible combinations.

I think combn can be used to achieve this but I'm struggling to do it properly.

Sample data:

library(data.table)
dt <- data.table(x = runif(100, -1, 1), y = runif(100, -1, 1), z = runif(100, -1, 1))

What I want:

dt[x < 0 & y < 0 z < 0, ]
dt[x < 0 & y < 0 z > 0, ]
dt[x < 0 & y > 0 z < 0, ]
dt[x < 0 & y > 0 z > 0, ]
dt[x > 0 & y < 0 z < 0, ]
dt[x > 0 & y < 0 z > 0, ]
dt[x > 0 & y > 0 z < 0, ]
dt[x > 0 & y > 0 z > 0, ]

What I've tried so far:

combinator <- function(z){
  cnames <- colnames(z)
  combinations <- t(combn(c(rep("<", ncol(z)), rep(">", ncol(z))),ncol(z)))

  retval <- t(sapply(1:nrow(combinations), function(p){
    sapply(1:ncol(z), function(q) paste(cnames[q], combinations[p,q], 0))
  }))

  return(apply(retval, 1, paste, collapse = " & "))
}

Output:

> l <- combinator(dt)
> l
 [1] "x < 0 & y < 0 & z < 0" "x < 0 & y < 0 & z > 0" "x < 0 & y < 0 & z > 0" "x < 0 & y < 0 & z > 0"
 [5] "x < 0 & y < 0 & z > 0" "x < 0 & y < 0 & z > 0" "x < 0 & y < 0 & z > 0" "x < 0 & y > 0 & z > 0"
 [9] "x < 0 & y > 0 & z > 0" "x < 0 & y > 0 & z > 0" "x < 0 & y < 0 & z > 0" "x < 0 & y < 0 & z > 0"
[13] "x < 0 & y < 0 & z > 0" "x < 0 & y > 0 & z > 0" "x < 0 & y > 0 & z > 0" "x < 0 & y > 0 & z > 0"
[17] "x < 0 & y > 0 & z > 0" "x < 0 & y > 0 & z > 0" "x < 0 & y > 0 & z > 0" "x > 0 & y > 0 & z > 0"

> l[1]
[1] "x < 0 & y < 0 & z < 0"

> subset(dt, eval(l[1]))
Error in subset.data.table(dt, eval(l[1])) : 
  'subset' must evaluate to logical

Also if the following shows that I'm not listing all the desired combinations:

> unique(l)
[1] "x < 0 & y < 0 & z < 0" "x < 0 & y < 0 & z > 0" 
[3] "x < 0 & y > 0 & z > 0" "x > 0 & y > 0 & z > 0"

the output should have 8 unique results instead of the 4 shown above.


Solution

  • Just do dt[, sign_combi := do.call(paste, lapply(dt, sign))] and you can split or by = that column as needed, e.g., split(dt, dt$sign_combi). Trying to paste together code is a Bad Idea.

    For example:

    set.seed(47) # setting seed for reproducibility
    dt <- data.table(x = runif(100, -1, 1), y = runif(100, -1, 1), z = runif(100, -1, 1))
    
    # create combination column (you could keep it separate if you prefer)
    dt[, sign_combi := do.call(paste, lapply(dt, sign))]
    
    # split original data by sign combinations
    result = split(dt, dt$sign_combi)
    
    # list of 8 resulting data tables
    length(result)
    # [1] 8
    
    # peaking at the first three rows of the first three tables:
    lapply(head(result, 3), head, 3)
    # $`-1 -1 -1`
    #             x          y          z sign_combi
    # 1: -0.5713038 -0.7103555 -0.6873705   -1 -1 -1
    # 2: -0.1407803 -0.8371153 -0.3686299   -1 -1 -1
    # 3: -0.6478446 -0.7629461 -0.7458949   -1 -1 -1
    # 
    # $`-1 -1 1`
    #             x          y         z sign_combi
    # 1: -0.8070969 -0.3952283 0.9212030    -1 -1 1
    # 2: -0.1190934 -0.4969318 0.8082232    -1 -1 1
    # 3: -0.6536104 -0.3280965 0.6880454    -1 -1 1
    # 
    # $`-1 1 -1`
    #              x         y          z sign_combi
    # 1: -0.78789241 0.8577848 -0.7586369    -1 1 -1
    # 2: -0.04442825 0.4736388 -0.3354734    -1 1 -1
    # 3: -0.22105744 0.3012645 -0.4160631    -1 1 -1