Experiment building - non-software-specific notes, and timing
Notes related to setting up behavioural experiments and such.
|
Experiment builders are one possible term for 'software that lets you fairly easily create and run a well-controlled behavioural experiment, to research the validity of a theory or belief'.
This may sound no harder than making a nice powerpoint, but since various experiments care about reaction speed (e.g. as a measure of confusion),
you care about precise stimuli timing, and precise response timing.
The lower you want to push this, the more specialized both the software and other practical details become.
Thinking about counterbalancing
On online experiments
Online experiments, as convenient as they are, means there are many things you can no longer control for - display time, hardware response time, browser details, whether it is a computer or a phone (I have a years-old phone and I wouldn't trust its timing), headphone quality (there are some tests you can do to get a gauge of this)
Browsers
Assume that browsers tend to merge movement into 60Hz intervals - or whatever monitor-limited speed it's drawing at - so negating the effects of a 1000Hz keyboard / mouse / button device.
Also, multitasking in browsers varies more between browsers. Maybe there's a video stream in another tab making things... more varied.
Since it's not something you can control, at all, it's not a good environment for precision timing.
Easy for questionnaire style stuff, though.
Semi-sorted
D Bridges et al. (2020) "The timing mega-study: comparing a range of experiment generators, both lab-based and online"