This doesn't apply
ProgressView("\(spinnerLabel)")
.accentColor(.white)
This changes the label
.foregroundColor(.white)
Try the following:
For iOS15+
.tint(.white)
For iOS13+
.progressViewStyle(CircularProgressViewStyle(tint: Color.white))