Dataset for "Understanding Freehand Cursorless Pointing Variability and Its Impact on Selection Performance"

1594 91 19527 2 79268 document 19527 PointingBlockQuestionnaire.pdf application/pdf 20dd9a6f3e3dd4081054f817388e3204 MD5 136040 2025-09-12 15:11:01 https://researchdata.bath.ac.uk/1594/3/PointingBlockQuestionnaire.pdf 1594 3 3 application/pdf other Questionnaires used for collecting self report fatigue measures after each condition is completed en public cc_by

PointingBlockQuestionnaire.pdf

template 19536 2 79280 document 19536 lightbox.jpg image/png 50ed441323a5143ec81242738eaa5b5c MD5 46084 2025-09-12 17:01:03 https://researchdata.bath.ac.uk/1594/12/lightbox.jpg 1594 12 12 image/png other Thumbnails conversion from other to thumbnail_lightbox en public

lightbox.jpg

http://eprints.org/relation/isVersionOf https://researchdata.bath.ac.uk/id/document/19527 http://eprints.org/relation/isVolatileVersionOf https://researchdata.bath.ac.uk/id/document/19527 http://eprints.org/relation/islightboxThumbnailVersionOf https://researchdata.bath.ac.uk/id/document/19527 19537 2 79281 document 19537 preview.jpg image/png a1575aa70ec00db8606bdd6ec88908f4 MD5 18422 2025-09-12 17:01:03 https://researchdata.bath.ac.uk/1594/13/preview.jpg 1594 13 13 image/png other Thumbnails conversion from other to thumbnail_preview en public

preview.jpg

http://eprints.org/relation/isVersionOf https://researchdata.bath.ac.uk/id/document/19527 http://eprints.org/relation/isVolatileVersionOf https://researchdata.bath.ac.uk/id/document/19527 http://eprints.org/relation/ispreviewThumbnailVersionOf https://researchdata.bath.ac.uk/id/document/19527 19538 2 79282 document 19538 medium.jpg image/png 0b9ba5e73f6fad1cae0ff7ad23f73869 MD5 7654 2025-09-12 17:01:04 https://researchdata.bath.ac.uk/1594/14/medium.jpg 1594 14 14 image/png other Thumbnails conversion from other to thumbnail_medium en public

medium.jpg

http://eprints.org/relation/isVersionOf https://researchdata.bath.ac.uk/id/document/19527 http://eprints.org/relation/isVolatileVersionOf https://researchdata.bath.ac.uk/id/document/19527 http://eprints.org/relation/ismediumThumbnailVersionOf https://researchdata.bath.ac.uk/id/document/19527 19539 2 79283 document 19539 small.jpg image/png 46597c4818bd32babefb3349b9310e62 MD5 1770 2025-09-12 17:01:04 https://researchdata.bath.ac.uk/1594/15/small.jpg 1594 15 15 image/png other Thumbnails conversion from other to thumbnail_small en public

small.jpg

http://eprints.org/relation/isVersionOf https://researchdata.bath.ac.uk/id/document/19527 http://eprints.org/relation/isVolatileVersionOf https://researchdata.bath.ac.uk/id/document/19527 http://eprints.org/relation/issmallThumbnailVersionOf https://researchdata.bath.ac.uk/id/document/19527 19542 1 79286 document 19542 indexcodes.txt text/plain 01a7d5bb543f74dc30661645e6533c93 MD5 1333 2025-09-12 17:03:36 https://researchdata.bath.ac.uk/1594/18/indexcodes.txt 1594 18 18 text/plain other Generate index codes conversion from other to indexcodes en public

indexcodes.txt

http://eprints.org/relation/isVersionOf https://researchdata.bath.ac.uk/id/document/19527 http://eprints.org/relation/isVolatileVersionOf https://researchdata.bath.ac.uk/id/document/19527 http://eprints.org/relation/isIndexCodesVersionOf https://researchdata.bath.ac.uk/id/document/19527 19558 2 79402 document 19558 AverageCameraTrackingResiduals.txt text/plain 6426b2f95ea7c6a853a25d5084b28823 MD5 1163 2025-09-23 10:37:48 https://researchdata.bath.ac.uk/1594/19/AverageCameraTrackingResiduals.txt 1594 19 19 text/plain other The camera tracking residuals, averaged over each run study, from the Qualisys motion capture system. en public cc_by

AverageCameraTrackingResiduals.txt

data 19559 4 79405 document 19559 EncodedGestures_FINAL.csv text/csv 51b8f7dd54b4690cd42462e2f682bb9e MD5 5287363 2025-09-23 10:39:42 https://researchdata.bath.ac.uk/1594/20/EncodedGestures_FINAL.csv 1594 20 20 text/csv other Encoded gesture statistics. For each trial, for which a valid pointing gesture could be extracted, an encoding of the gesture performed, derived from the medians for body pose features (e.g. elbow flexion), fatigue measures (e.g. consumed endurance), and rays (e.g. vector and accuracy). See README for descriptions of specific fields. en public cc_by

EncodedGestures_FINAL.csv

data 19560 4 79408 document 19560 GestureAnnotations.json text/plain 44a2b64657f563eca1dc1e375095f269 MD5 11518745 2025-09-23 10:40:09 https://researchdata.bath.ac.uk/1594/21/GestureAnnotations.json 1594 21 21 text/plain other Trial Annotations. Metadata for each trial, such as the target position, labels for when pointing occurs, and observed behaviour labels. See README for description of file contents. en public cc_by

GestureAnnotations.json

data 19561 3 79412 document 19561 SubjectiveQuestionnaires.csv text/csv bfcced5fca1672cb1b18ff9c7d0d6368 MD5 9757 2025-09-23 10:40:51 https://researchdata.bath.ac.uk/1594/22/SubjectiveQuestionnaires.csv 1594 22 22 text/csv other Self-reported user data. Including participant age, hand dominance, and fatigue measures (obtained after completing pointing within each condition). See README for descriptions of the fields within the file. en public cc_by

SubjectiveQuestionnaires.csv

data 19562 3 79415 document 19562 code.zip application/zip edd4caa0bd0814ca46c9982d3f428612 MD5 139064 2025-09-23 10:42:19 https://researchdata.bath.ac.uk/1594/23/code.zip 1594 23 23 application/zip other A zip file containing the supporting code and scripts. This includes code for 1) visualising the trials, including a subset of the rays used in our subsequent analysis, 2) generating our encoded gestures, using the motion capture data and annotations, and 3) the script used to perform the analysis over our encoded gestures. en public cc_by

code.zip

code 19564 2 79426 document 19564 trials.zip application/zip 656946e53fd8dc589010388b93207569 MD5 8884100566 2025-09-23 10:53:38 https://researchdata.bath.ac.uk/1594/25/trials.zip 1594 25 25 application/zip other Motion capture data for each trial (grouped by participant). This contains body landmarks - captured via a markerless motion capture system and finger landmarks - tracked with infrared markers. en public cc_by

trials.zip

data 19565 2 79431 document 19565 README.md text/plain b064f369ebd03c43ce2a50f343171cfe MD5 22117 2025-09-23 11:03:18 https://researchdata.bath.ac.uk/1594/26/README.md 1594 26 26 text/plain other A README for the dataset, explaining the contents of the provided files and usage of the accompanying scripts. en public cc_by

README.md

documentation 19566 1 79439 document 19566 indexcodes.txt text/plain 911053c9a1da655ece04f51b955a5601 MD5 697 2025-09-23 11:19:45 https://researchdata.bath.ac.uk/1594/27/indexcodes.txt 1594 27 27 text/plain other Generate index codes conversion from other to indexcodes en public

indexcodes.txt

http://eprints.org/relation/isVersionOf https://researchdata.bath.ac.uk/id/document/19558 http://eprints.org/relation/isVolatileVersionOf https://researchdata.bath.ac.uk/id/document/19558 http://eprints.org/relation/isIndexCodesVersionOf https://researchdata.bath.ac.uk/id/document/19558 19567 3 79441 document 19567 PIS.pdf application/pdf 2379c926e1d8d405be46e1426fef1393 MD5 244768 2025-09-23 12:39:27 https://researchdata.bath.ac.uk/1594/28/PIS.pdf 1594 28 28 application/pdf other Participant information sheet provided to participants when performing the study. en staffonly all_rights_reserved

PIS.pdf

ethics 19569 2 79448 document 19569 lightbox.jpg image/png 3c08084ee8dcb215b92ffedf30c72be7 MD5 41378 2025-09-23 12:49:30 https://researchdata.bath.ac.uk/1594/30/lightbox.jpg 1594 30 30 image/png other Thumbnails conversion from other to thumbnail_lightbox en staffonly

lightbox.jpg

http://eprints.org/relation/isVersionOf https://researchdata.bath.ac.uk/id/document/19567 http://eprints.org/relation/isVolatileVersionOf https://researchdata.bath.ac.uk/id/document/19567 http://eprints.org/relation/islightboxThumbnailVersionOf https://researchdata.bath.ac.uk/id/document/19567 19570 2 79449 document 19570 preview.jpg image/png ff5d0c99c18427142268c75beed191b4 MD5 17541 2025-09-23 12:49:30 https://researchdata.bath.ac.uk/1594/31/preview.jpg 1594 31 31 image/png other Thumbnails conversion from other to thumbnail_preview en staffonly

preview.jpg

http://eprints.org/relation/isVersionOf https://researchdata.bath.ac.uk/id/document/19567 http://eprints.org/relation/isVolatileVersionOf https://researchdata.bath.ac.uk/id/document/19567 http://eprints.org/relation/ispreviewThumbnailVersionOf https://researchdata.bath.ac.uk/id/document/19567 19571 2 79450 document 19571 medium.jpg image/png be296e0562428e0201d27bf125398192 MD5 6167 2025-09-23 12:49:30 https://researchdata.bath.ac.uk/1594/32/medium.jpg 1594 32 32 image/png other Thumbnails conversion from other to thumbnail_medium en staffonly

medium.jpg

http://eprints.org/relation/isVersionOf https://researchdata.bath.ac.uk/id/document/19567 http://eprints.org/relation/isVolatileVersionOf https://researchdata.bath.ac.uk/id/document/19567 http://eprints.org/relation/ismediumThumbnailVersionOf https://researchdata.bath.ac.uk/id/document/19567 19572 2 79451 document 19572 small.jpg image/png 931b288be59ebb07747e2510ae41c9d5 MD5 1798 2025-09-23 12:49:31 https://researchdata.bath.ac.uk/1594/33/small.jpg 1594 33 33 image/png other Thumbnails conversion from other to thumbnail_small en staffonly

small.jpg

http://eprints.org/relation/isVersionOf https://researchdata.bath.ac.uk/id/document/19567 http://eprints.org/relation/isVolatileVersionOf https://researchdata.bath.ac.uk/id/document/19567 http://eprints.org/relation/issmallThumbnailVersionOf https://researchdata.bath.ac.uk/id/document/19567 19573 1 79452 document 19573 indexcodes.txt text/plain 944736a4311f7e6ade2e3f6d033ed2a0 MD5 4026 2025-09-23 12:49:31 https://researchdata.bath.ac.uk/1594/34/indexcodes.txt 1594 34 34 text/plain other Generate index codes conversion from other to indexcodes en staffonly

indexcodes.txt

http://eprints.org/relation/isVersionOf https://researchdata.bath.ac.uk/id/document/19567 http://eprints.org/relation/isVolatileVersionOf https://researchdata.bath.ac.uk/id/document/19567 http://eprints.org/relation/isIndexCodesVersionOf https://researchdata.bath.ac.uk/id/document/19567 19580 3 79467 document 19580 Consent.pdf application/pdf 8ac09fc7c0d8f3abf99b946172cf49db MD5 157890 2025-09-23 14:00:56 https://researchdata.bath.ac.uk/1594/35/Consent.pdf 1594 35 35 application/pdf other Consent form given to participants ahead of their participation within the study. en staffonly all_rights_reserved

Consent.pdf

ethics 19581 2 79471 document 19581 lightbox.jpg image/png 31d90b6cbd1d9ff6ef2c164ba637b4b3 MD5 46518 2025-09-23 14:11:12 https://researchdata.bath.ac.uk/1594/36/lightbox.jpg 1594 36 36 image/png other Thumbnails conversion from other to thumbnail_lightbox en staffonly

lightbox.jpg

preview.jpg

medium.jpg

small.jpg

indexcodes.txt

http://eprints.org/relation/isVersionOf https://researchdata.bath.ac.uk/id/document/19580 http://eprints.org/relation/isVolatileVersionOf https://researchdata.bath.ac.uk/id/document/19580 http://eprints.org/relation/isIndexCodesVersionOf https://researchdata.bath.ac.uk/id/document/19580 archive 14614 disk0/00/00/15/94 2025-10-13 10:47:33 2025-10-18 04:52:41 2025-10-13 10:47:33 data_collection show Whiffing James jw2304@bath.ac.uk 0009-0000-8589-5517 University of Bath TRUE Langlotz Tobias tobias.langlotz@cs.au.dk 0000-0003-1275-2026 Aarhus University FALSE Lutteroth Christof cl2073@bath.ac.uk 0000-0003-0634-7569 University of Bath FALSE Sharma Adwait as5339@bath.ac.uk 0000-0001-5676-3136 University of Bath FALSE Clarke Christopher cjc234@bath.ac.uk 0000-0003-3916-7708 University of Bath TRUE Dataset for "Understanding Freehand Cursorless Pointing Variability and Its Impact on Selection Performance" FB0090 dept_compsci pointing, freehand, cursorless, motion capture, interaction, hci Motion capture data is grouped into zips for each participant, where each participant has been given a unique ID (GUUID). Each zip contains files representing each captured trial for the given participant, where the name of the file details the condition and trial number, e.g. ACCURATE_FOCUSED_3.csv, where 'ACCURATE_FOCUSED' is the condition and '3' is the trial number within that condition. Metadata for the trials is located within the GestureAnnotations.json. Additionally, and encoding of each valid gesture can be located within the encoded_gestures.csv Please refer to the dataset README file for an explanation of the dataset structure and fields within specific files. This dataset supports the journal entry "Understanding Freehand Cursorless Pointing Variability and Its Impact on Selection Performance" (TOCHI, 2025), containing motion capture data, of the body and hands, captured during a range of pointing gestures from 23 participants. The user study that captured this data systematically explored how target position (3 rows by 5 columns), task focus (Pointing as a Primary Task vs Secondary Task), and user effort (Accurate pointing vs Casual pointing), affect pointing behaviour and performance. The dataset includes: - Motion capture data for each trial (grouped by participant). This contains body landmarks – captured via a markerless motion capture system and finger landmarks – tracked with infrared markers. - Trial Annotations. Metadata for each trial, such as the target position, labels for when pointing occurs, and observed behaviour labels. - Encoded gesture statistics. For each trial, for which a valid pointing gesture could be extracted, an encoding of the gesture performed, derived from the medians for body pose features (e.g. elbow flexion), fatigue measures (e.g. consumed endurance), and rays (e.g. vector and accuracy). - Self-reported user data. Including participant age, hand dominance, and fatigue measures (obtained after completing pointing within each condition). - Code for visualising the trials, including a subset of the rays used in our subsequent analysis, code for generating our encoded gestures, using the motion capture data and annotations, and the script used to perform the analysis over our encoded gestures. This dataset has been provided for two purposes: 1. For further investigation into pointing behaviour and for the development of pointing interaction systems. For this, please refer to the Pointing Dataset section of the README to understand the structure and dataset contents, and the Trial Visualiser section of the README for usage of a script for visualising the motion capture data. 2. For reproduction of data used in the analysis of the accompanying paper (Understanding Freehand Cursorless Pointing Variability and Its Impact on Selection Performance), for which please see Pointing Dataset section of the README to understand the structure and dataset contents, along with the Gesture Encoder and Analysis Script sections of the README for the code used to perform our analysis. 2025-10-10 University of Bath public RightsHolder University of Bath Engineering and Physical Sciences Research Council https://doi.org/10.13039/501100000266 EP/W524712/1 DTP 2022-2024 University of Bath Engineering and Physical Sciences Research Council https://doi.org/10.13039/501100000266 EP/T022523/1 Centre for the Analysis of Motion, Entertainment Research and Applications (CAMERA) - 2.0 hci For the complete methodology used in the data collection, please refer to the paper. We used a repeated measures within-subject design with Pointing Style (accurate or casual) and Focus (focused or distracted) as independent variables (IV). We asked participants to "point as accurately and precisely as possible" for the accurate pointing condition. In contrast, in the casual pointing condition participants were instructed to "point as casually and relaxed as possible...". The distracted condition involved participants completing a Stroop effect test while pointing to targets, while the focused condition had pointing as the primary and only task. Please refer to the README file for instructions to visualise the recorded pointing gestures or use any of the other provided scripts. Please refer to the README file for an explanation of the dataset structure and fields within specific files. For the technical details of the study setup and data collection, please refer to the paper. In summary, we utilised a set of 135 targets, which were grouped into 15 clusters of 9 (3×3), arranged into a 3 × 5 (rows × columns) array, with each target within a cluster spaced 8.4cm apart. The middle row was located 1.4 m from the floor and 2 m away from the participant, and the top and bottom rows were pitched ±25° from the middle row. Each column was yawed ±35° relative to the adjacent column. We used 12 Arqus infrared (IR) tracking cameras, and 10 Miqus cameras capturing RGB images at 1080p (4:3), with recording and marker tracking managed by QTM. The cameras provided coverage of a 4 m wide × 3 m deep × 2.5 m tall volume, within which the participant would be placed 2 m from the shorter edges, and ∼1 m from the long edge. The system was calibrated at the start of each day, with an average residual of 0.732 mm and standard deviation of 0.174 mm. We used 28 6.5 mm IR reflective markers to track all fingers on both hands; two for each finger and four to capture the palm and wrist. To aid in the tracking of the hands, we employed QTM’s AIM models and skeleton-assisted labelling. All sensing apparatus sampled data at 100Hz. https://doi.org/10.1145/3770583 2024-03-18 2024-05-09 en 1 10.15125/BATH-01594 https://doi.org/10.1145/3770583 pub open