-
Notifications
You must be signed in to change notification settings - Fork 34
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
clustercritval for AUC? #45
Comments
Hi @yoojchoo !
Two-sided tests can be useful when there's a possibility of a pattern-reversal between train and test data (e.g., in memory experiments). |
Hi Dr. Treder, Following this, I'm wondering if you are planning to add two-sided test in your toolbox at some point. Again, thanks for the great toolbox! Best, |
Yes, you are right, it's one-sided tests (lower or upper tail). In principle a two-tailed test could be implemented. The problem is that a two-tailed test mixes together both directions (significantly higher than chance and significantly lower than chance), although they represent different types of effect. It's numerically possible but I'm not sure it's useful. It might be better to run both test ( Thank you for the feedback, glad you find MVPA-Light useful :) |
Hi,
I've been working through the tutorials in MVPA Light toolbox.
As I'm using the AUC and am interested in whether the decoding performance is above chance level (0.5), I was thinking that I was going to use the critical cut-off z =1.65 (right-tailed). However, in the tutorial, the z val is set as 1.96 which corresponds to uncorrected p value of 0.05 (two-tailed).
Could you explain why it is the case?
Thank you in advance!
The text was updated successfully, but these errors were encountered: