Reliability_test

[JasonAMK]

Hello,

Since I'm not sure where I have to ask my question, and if I can ask one in here so feel free to move the message or delete it.
I have some problems making a reliability test and I'm not sure if I'm doing something wrong or if I didn't understand how it is supposed to work. I'm new to DataVyu and Ruby so I think the solution is kind of basic but I'm stuck anyway!

So, to make it simple:

I have two columns, one named "test" the other named "rel_test". The code is the same for the two of them obviously, let's say it is "input"; which can be completed with "x" or "y".

Now, I want to see if the first experimenter did code the same "input" that the second experimenter.

So I use this script:

require 'Datavyu_API.rb'
begin
dump_file = File.expand_path("file_path")
checkReliability("rel_test", "test", "input", 5, dump_file)
end

Basically, I want to compare the cells of each column with the same onset, and see if the code is the same or not, but it really doesn't work. it gives me this output:

Running Script: test_for_inter_reliability.rb on project: name_of_the_project
ERROR in rel_test at Ordinal 1, rel ordinal 1 in argument onset: 6435, 6435
ERROR in rel_test at Ordinal 1, rel ordinal 1 in argument offset: 0, 0
ERROR in rel_tes at Ordinal 1, rel ordinal 2 in argument onset: 6435, 19668
ERROR in rel_tes at Ordinal 1, rel ordinal 2 in argument offset: 0, 0
Total errors for input: 0, Agreement:100.00%
Total errors for onset: 2, Agreement:0.00%
Total errors for offset: 2, Agreement:0.00%
Script has finished running

I really don't understand why it compares the onset of different Ordinal, or even of the same. And why is there an error since it's obviously the same onset?
And why is there 0 errors for input even though I put one deliberately to test?

I'm quite lost there, so if you could tell me where I could ask my question, or if you could give me some insights, it would be much appreciated!

Best,
Jason

[sh0sh1n]

Alas, I no longer receive notifications for this repo so I'm too late to help. But, for the sake of completion here's the likely reason for what you are seeing:

The third argument for the checkReliability function is the "match_arg": https://databrary.github.io/datavyu-docs/top-level-namespace.html#check_reliability-instance_method

This is the code the function uses to pair up cells between the two columns. A simple value to use for this is ordinal or onset to match up cells using the sequence number or the onset time, respectively. In your case, you have set the match_arg to "input", which means the function will pair the every "x" in column "test" with every "x" in column "rel_test".