Experiment Data

The complete dataset from the eyeCode experiment is available in the eyecode.data module.

Hansen 2012

Pandas dataframes with information about the experiment programs, individual trials, experiments/participants are available for the combined Mechanical Turk and eye-tracking participant sets.

eyecode.data.hansen_2012.programs()

Code metrics for all programs.

Returns :

df : pandas DataFrame

• base: program base category
• version: program version
• code_chars: number of characters in code
• code_lines: number of lines in code
• cyclo_comp: cyclomatic complexity of program
• hal_effort: Halstead effort of program
• hal_volume: Halstead volume of program
• output_chars: number of characters in correct output
• output_lines: number of lines in correct output
• category: ‘expectation’ or ‘notation’
• program_name: joined base_version

eyecode.data.hansen_2012.program_code(base, version)

Lines of code for the given program base and version

eyecode.data.hansen_2012.program_output(base, version)

Lines of correct text output for the given program base and version

eyecode.data.hansen_2012.trials()

Individual trial information

eyecode.data.hansen_2012.experiments()

Experiment/participant information.

Returns :

df : pandas DataFrame

• exp_id: experiment/participant id

• age: age of participant in years

• degree: highest degree obtained by participant

  • One of [‘bachelors’, ‘masters’, ‘phd’, ‘none’, ‘other’]

• gender: participant’s gender

  • One of [‘male’, ‘female’, ‘unreported’]

• py_years: years of Python experience

• prog_years: years of overall programming experience

• cs_major: participant is/was a Computer Science major

  • One of [‘current’, ‘no’, ‘past’]

• difficulty: post-experiment perceived program difficulty

  • One of [‘easy’, ‘medium’, ‘hard’]

• guess_correct: post-experiment guess at correct answers

  • One of [‘most’, ‘half’, ‘few’]

• total_grade: sum of all trial grades (usually out of 100)

• duration_sec : experiment duration in seconds

• location: participant set

  • One of [‘bloomington’, ‘mturk’, ‘web’]

• xxx_num: numeric representation of column xxx

For the eye-tracking experiments (29 out of 162 experiments), fixations, areas of interest, and screenshots are available. Full trial videos can be seen at the eyecode website.

eyecode.data.hansen_2012.all_fixations()

Hit-tested fixations for all trials

eyecode.data.hansen_2012.areas_of_interest()

AOI rectangles for all trials

eyecode.data.hansen_2012.trial_screen(trial_id)

Screenshot image for the given eye-tracking trial