I want to use Wilcoxon 2-sided test for two treatments across multiple groups, i.e. there is a before and after treatment (Conc) for each of several sample sites. I want to split the dataset into a list by Site then apply the test so i can have an output for each Site individually, however, i am having trouble setting this up as a function that can repeat.
I have a number of sites (Site) and two levels of treatment (Scenario), with resulting scores (Conc):
'data.frame': 7344 obs. of 6 variables:
$ Site : chr "A" "B" "C" "D" ...
$ Scenario : chr "1" "1" "1" "1" "2" "2" "2" "2" ...
$ Conc : num 4.7727 0.055 0.0552 0.055 0.055 ...
there are multiple Conc data points (~60) within each Site/Scenario combination. The reason i chose a Wilcoxon test is primarily because i have slightly uneven sample numbers between treatments (Scenario) for each Site.
When i use this code for the entire dataset i get a sensible result:
t1 <- wilcox.test(Conc ~ Scenario, data = data.frame)
t1
However, this code doesn't apply the test for each site individually.
I have looked looked at all similar examples i could find (on SO and elsewhere) and this is the best code i could come up with:
t2 = data.frame %>% group_by(Site) %>% do(tidy(wilcox.test(Conc~Scenario, data=data.frame), na.rm=TRUE, equal.var=FALSE))
t2
this code is giving me an output for each site but all test outputs are the same, even the p value:
# A tibble: 107 x 5
# Groups: Site [107]
Site statistic p.value method alternative
<chr> <dbl> <dbl> <chr> <chr>
1 A 6145702 0.690 Wilcoxon rank sum test with continuity correction two.sided
2 B 6145702 0.690 Wilcoxon rank sum test with continuity correction two.sided
3 C 6145702 0.690 Wilcoxon rank sum test with continuity correction two.sided
4 D 6145702 0.690 Wilcoxon rank sum test with continuity correction two.sided
5 E 6145702 0.690 Wilcoxon rank sum test with continuity correction two.sided
6 F 6145702 0.690 Wilcoxon rank sum test with continuity correction two.sided
Can anyone see what I'm doing wrong? thanks for your help
EDITED 21/08/2020 to more closely mirror your data
Here's a solution with dplyr
and purrr
EDITED to include broom::tidy
results...
# 'data.frame': 5626 obs. of 3 variables:
# $ Site.Year: Factor w/ 3 levels "Baffle Creek at Newton Road_2018_2019",..: 1 1 1 1 1 1 1 1 1 1 ...
# $ Scenario : chr "FF_Total" "FF_Total" "FF_Total" "FF_Total" ...
# $ PAF : num 4.77 4.77 4.77 4.77 4.77
set.seed(2020)
Site.Year <- rep(c("Baffle Creek at Newton Road_2018_2019",
"Baffle Creek at Newton Road_2017_2018",
"Baffle Creek at Newton Road_2019_2020"), 50)
Scenario <- rep_len(c(rep("FF_Total", 4), rep("Not_FF_Total", 4)), 150)
PAF <- rnorm(150, mean = 2.5, sd = 1)
DailyPAF_long <- data.frame(Site.Year, Scenario, PAF)
DailyPAF_long$Site.Year <- factor(DailyPAF_long$Site.Year)
# str(DailyPAF_long)
# wilcox.test(PAF ~ Scenario, data = DailyPAF_long)
library(dplyr)
library(purrr)
DailyPAF_long %>%
base::split(Site.Year) %>%
purrr::map(~ wilcox.test(PAF ~ Scenario, data = .)) %>%
purrr::map_dfr(~ broom::tidy(.))
#> # A tibble: 3 x 4
#> statistic p.value method alternative
#> <dbl> <dbl> <chr> <chr>
#> 1 361 0.355 Wilcoxon rank sum exact test two.sided
#> 2 219 0.0723 Wilcoxon rank sum exact test two.sided
#> 3 380 0.195 Wilcoxon rank sum exact test two.sided