Skip to main content
Have a personal or library account? Click to login
Cognitive Human Factors and Forensic Document Examiner Methods and Procedures: Writing Characteristics, Visual Context, and Handwriting Examination Decision Accuracy Cover

Cognitive Human Factors and Forensic Document Examiner Methods and Procedures: Writing Characteristics, Visual Context, and Handwriting Examination Decision Accuracy

Open Access
|Dec 2020

Figures & Tables

Figure 1

An example of two counter-balanced stimuli for the Questioned Signature Position format as they were displayed on the eye-tracking system. These stimuli differ only in the position of the questioned and known signatures. The order of the known signatures did not vary, so that in the left example known signatures 1, 3, and 5 were adjacent to the questioned signature. In the example on the right, signatures 2, 4, and 6 were adjacent to the questioned signature.

Figure 2

An example of two counterbalanced Protocol 2 stimuli as they were displayed on the eye-tracking system. These stimuli differ in the order of presentation of the questioned and known signatures. In the top example the questioned signature was presented alone, followed by the questioned signature paired with the known signatures. In the counterbalanced example at the bottom, the known signatures were presented first, followed by the questioned/known pairing. The order of the known signatures did not vary.

Figure 3

These images demonstrate different ways of visualizing eye-tracking data. The gaze plots at the left provide several kinds of information. Each circle represents a “fixation” where the participant’s gaze fell remained within a 50-pixel area for a time of greater than 100 msec. The size of the circle indicates “fixation duration,” or how much time in total the participant spent in that area. Larger circles indicate that the participant fixated in that area a greater amount time. The lines represent “saccades,” which are recordings of the movement of the eyes as they travel from one fixation to another. Thus, the gaze plot shows what the participant looked at, how long they looked at it, and the order in which the fixations occurred. The heat map displayed in the center image is a visualization of gaze concentration. Red and yellow areas indicate where the participant’s gaze was more concentrated. These areas correspond to the areas in the gaze plot where many fixations were recorded. The image on the right demonstrates how “areas of interest” (AOIs) were developed from the gaze plot and heat map visualizations. AOIs permit analysis of specific areas within an image.

Figure 4

The eye-tracking computer, pictured at the right, rests on an adjustable laptop stand. The experimenter controlled all activities and recorded all verbal responses by keyboard and mouse from the operator station, pictured on the left. This ensured that the participant’s gaze remained on the eye-tracker screen during the gaze recording sessions.

Figure 5

The Tobii X2-60® eye-tracker is located at the bottom of the computer display. The system projects infrared light into the participant’s eyes, illuminating the retina. The eye-tracking software records the position of the illuminated retina for each eye as X/Y coordinates. The raw data for the gaze position coordinates are then processed by the Tobii Pro Studio© software using the ClearView Fixation filter, which designates as a fixation any eye movement slowing below a velocity threshold of 50 pixels/100ms. During calibration, the eye- tracker records the position of the participant’s gaze as the participant visually follows the movement of a red spot as it travels randomly to each of the nine positions on the calibration grid displayed at the right.

Table 1

Known Signature Fixation Count by Ground Truth and Decision Accuracy.

Known Signature Fixation Count and Ground Truth
95% Confidence Interval
Ground TruthNMSDtdfpLower CIUpper CI
FC Known 1Genuine76317.6825.589.36962< .0017.2811.15
Simulated9358.4710.28
FC Known 2Genuine76316.1220.439.371032< .0015.959.10
Simulated9358.599.57
FC Known 3Genuine76318.8423.189.711145< .0017.2910.99
Simulated9359.7013.06
FC Known 4Genuine76315.7519.0310.841026< .0016.639.56
Simulated9357.668.81
FC Known 5Genuine76312.1417.609.001059< .0014.917.65
Simulated9355.868.66
FC Known 6Genuine76311.0614.149.601118< .0014.356.59
Simulated9355.597.66
Known Signature Fixation Count and Decision Accuracy
95% Confidence Interval
Decision AccuracyNMSDtdfpLower CIUpper CI
FC Known 1Accurate149311.9217.31-2.69223.008-9.90–1.53
Misleading20517.6329.72
FC Known 2Accurate149311.3914.79-3.07230.002-7.91-1.73
Misleading20516.2121.80
FC Known 3Accurate149313.2818.29-2.67243.008-7.55-1.14
Misleading20517.6322.31
FC Known 4Accurate149310.7714.19-3.19237.002- 7.04-1.67
Misleading20515.1218.81
FC Known 5Accurate14938.2212.51-2.57225.011-6.70-0.89
Misleading20512.0220.61
FC Known 6Accurate14937.7810.92-2.15238.032-4.24-0.19
Misleading2059.9914.17
Figure 6

Mean fixation counts for the Ground Truth analyses are presented at the left. Mean fixation counts for Decision Accuracy analyses are presented at the right. Fixation counts in the Ground Truth analyses were significantly greater for genuine than for simulated signatures. Fixation counts were significantly greater for misleading opinions than for accurate decisions. The three highest mean fixation counts for genuine and simulated signatures are indicated by the arrows. This demonstrates that FDEs utilized known signatures 1, 2, and 3 to a greater extent overall than they did known signatures 4, 5, and 6. The same pattern is revealed in the known signature fixation counts in the Decision Accuracy analyses.

Table 2

Regression Coefficients for Predictors of Ground Truth and Decision Accuracy.

Ground Truth
95% Confidence Interval
Areas of Interest All KnownsBWalddfpOddsLower CIUpper CI
FC Known 1 (center left)-0.025.251.0220.980.971.00
FC Known 2 (center right)0.000.031.8641.000.981.01
FC Known 3 (top left)0.000.201.6551.000.991.01
FC Known 4 (top right)-0.0317.761<.0010.970.950.98
FC Known 5 (bottom left)0.000.131.7231.000.991.02
FC Known 6 (bottom right)-0.010.6710.4130.990.971.01
Decision Accuracy
95% Confidence Interval
Areas of Interest All KnownsBWalddfpOddsLower CIUpper CI
FC Known 1 (center left)0.000.351.5531.000.991.02
FC Known 2 (center right)0.012.281.1311.011.001.03
FC Known 3 (top left)-0.010.641.4230.990.981.01
FC Known 4 (top right)0.011.351.2451.010.991.03
FC Known 5 (bottom left)0.011.311.2521.010.991.03
FC Known 6 (bottom right)-0.023.151.0760.980.951.00
Table 3

Known Signature Fixation Count by Signature Type and Signature Complexity.

Known Signature Fixation Count by Signature Type
95% Confidence Interval
Area of InterestTypeNSDtdfpLower CIUpper CI
FC Known 1Text93422.094.081643< .0011.915.46
Stylized76415.01
FC Known 2Text93417.814.221672< .0011.684.61
Stylized76412.90
FC Known 3Text93421.033.681682< .0011.535.03
Stylized76415.65
FC Known 4Text93417.075.211632< .0012.254.97
Stylized76411.37
FC Known 5Text93416.405.011532< .0011.944.43
Stylized7649.41
FC Known 6Text93412.904.931655< .0011.583.67
Stylized7648.97
Known Signature Fixation Count by Signature Complexity
95% Confidence Interval
Area of InterestComplexityNSDtdfpLower CIUpper CI
FC Known 1High84918.62–1.541688.123-3.280.39
Low84919.96
FC Known 2High84916.37-0.831696.409-2.150.88
Low84915.35
FC Known 3High84920.14-1.081696.282-2.780.81
Low84917.49
FC Known 4High84916.22-0.301639.766-1.631.20
Low84913.43
FC Known 5High84914.67-0.201667.841- 1.451.18
Low84912.86
FC Known 6High84912.32-0.091647.929-1.131.03
Low84910.35
Figure 7

Mean fixation counts for the Signature Type analyses are presented at the left. Mean fixation counts for Signature Complexity analyses are presented at the right. Fixation counts in the Signature Type analyses were significantly greater for text-based than for stylized signatures. Fixation counts were not significantly greater for low complexity than for high complexity signatures. The two highest mean fixation counts for text- based and for stylized signatures are indicated by the arrows. This demonstrates that FDEs utilized known signatures 1 and 3 to a greater extent than the other knowns in both the text-based and the stylized signatures. Similarly, at the right, the two highest mean fixation counts for high and low complexity signatures, known signatures 1 and 3, are indicated by the arrows, although these differences were not statistically significant.

Table 4

Regression Coefficients for Predictors of Signature Type and Signature Complexity.

Signature Type95% Confidence Interval
Areas of Interest All KnownsBWalddfPOddsLower CIUpper CI
FC Known 1 (center left)0.000.021.8931.000.991.01
FC Known 2 (center right)0.010.841.3601.010.991.02
FC Known 3 (top left)0.011.481.2251.011.001.02
FC Known 4 (top right)-0.026.351.0120.980.971.00
FC Known 5 (bottom left)-0.012.661.1030.990.971.00
FC Known 6 (bottom right)-0.010.811.3680.990.971.01
Signature Complexity95% Confidence Interval
Areas of Interest All KnownsBWalddfPOddsLower CIUpper CI
FC Known 1 (center left)0.013.781.0521.011.001.02
FC Known 2 (center right)0.010.651.4191.010.991.02
FC Known 3 (top left)0.000.241.6241.000.991.01
FC Known 4 (top right)-0.010.961.3280.990.981.01
FC Known 5 (bottom left)-0.011.971.1610.990.971.00
FC Known 6 (bottom right)-0.010.441.5090.990.981.01
Table 5

Known Signature Fixation Count by Signature Presentation Sequence and Questioned Signature Position.

Known Signature Fixation Count and Signature Presentation Sequence
95% Confidence Interval
SequenceNMSDtdfPLower CIUpper CI
FC Known 1Questioned First84916.2222.847.831412< .0015.419.02
Known First8499.0014.09
FC Known 2Questioned First84914.8217.987.521533< .0014.217.18
Known First8499.1312.82
FC Known 3Questioned First84917.2921.407.741528< .0015.218.74
Known First84910.3215.16
FC Known 4Questioned First84914.5517.679.241380< .0015.137.90
Known First8498.0410.49
FC Known 5Questioned First84911.3916.828.251306< .0014.136.71
Known First8495.979.11
FC Known 6Questioned First84910.3313.358.431427< .0013.505.62
Known First8495.768.39
Known Signature Fixation Count and Questioned Signature Position
95% Confidence Interval
Q PositionNMSDtdfpLower CIUpper CI
FC Known 1Q Right8499.4815.92-6.761554< .001-8.07-4.44
Q Left84915.7421.76
FC Known 2Q Right84914.4416.516.491676< .0013.446.43
Q Left8499.5114.80
FC Known 3Q Right84910.9816.45-6.241616< .001-7.43-3.88
Q Left84916.6420.63
FC Known 4Q Right84912.4115.823.0916650.0020.813.64
Q Left84910.1813.81
FC Known 5Q Right8497.1911.52-4.471560< .001-4.28-1.67
Q Left84910.1715.61
FC Known 6Q Right8498.2611.460.7916960.428-0.651.52
Q Left8497.8211.30
Figure 8

Mean fixation counts for the Signature Presentation Sequence analyses are presented at the left. Mean fixation counts for Questioned Signature Position analyses are presented at the right. Fixation counts in the Signature Presentation Sequence analyses were significantly greater for questioned-before known than for the known-before-questioned sequence. Fixation counts were significantly greater when the questioned signature was presented on the left than when the questioned signature was on the right. The three highest mean fixation counts for each condition are indicated by the arrows. This demonstrates that participants utilized known signatures 1, 2, and 3 to a greater extent overall than they did known signatures 4, 5, and 6 in the Presentation Sequence protocol. A slightly different pattern is demonstrated in the Questioned Signature Position protocol, where the participants fixated more on signatures 3, 1, and 4 when questioned signatures were presented on the left, and signatures 2, 4, and 3 when the questioned signature was on the right.

Table 6

Regression Coefficients for Predictors of Presentation Sequence and Questioned Signature Position.

Presentation Sequence95% Confidence Interval
Areas of Interest All KnownsBWalddfPOddsLower CIUpper CI
FC Known 1 (center left)-0.011.1810.2780.990.981.01
FC Known 2 (center right)0.011.7910.1811.011.001.03
FC Known 3 (top left)00.2610.6080.990.991.01
FC Known 4 (top right)-0.0316.441< .0010.970.950.98
FC Known 5 (bottom left)-0.011.4510.2280.990.971.01
FC Known 6 (bottom right)-0.011.6310.2010.990.971.01
Questioned Signature Position95% Confidence Interval
Areas of Interest All KnownsBWalddfpOddsLower CIUpper CI
FC Known 1 (center left)0.1298.221< .0011.121.101.15
FC Known 2 (center right)-0.17173.141< .0010.840.820.86
FC Known 3 (top left)0.0648.841< .0011.071.051.09
FC Known 4 (top right)-0.0631.191< .0010.940.920.96
FC Known 5 (bottom left)0.022.9710.0851.021.001.05
FC Known 6 (bottom right)0.022.7710.0961.021.001.05
Table 7

Regression Coefficients for Decision Accuracy Predictors.

95% Confidence Interval
Predictor VariablesBWalddfpOddsLower CIUpper CI
FC Known 1-0.010.381.5370.990.981.01
FC Known 20.023.671.0551.021.001.04
FC Known 3-0.010.421.5150.990.981.01
FC Known 40.010.651.4221.010.991.03
FC Known 50.022.451.1181.021.001.04
FC Known 6- 0.034.011.0450.970.941.00
Signature Type1.3025.761<.0013.652.216.02
Signature Complexity-2.32126.301<.0010.100.070.15
Presentation Sequence1.0015.381<.0012.731.654.50
Questioned Signature Position-0.120.381.5360.890.611.29
DOI: https://doi.org/10.69525/jasqde.266 | Journal eISSN: 1524-7287
Language: English
Page range: 3 - 20
Published on: Dec 1, 2020
Published by: American Society of Questioned Document Examiners
In partnership with: Paradigm Publishing Services

© 2020 Mara L. Merlino, Veronica B. Dahir, Charles P. Edwards, Derek L. Hammond, Chandler Al Namer, Taleb Al Namer, Denise Schaar-Buis, published by American Society of Questioned Document Examiners
This work is licensed under the Creative Commons Attribution 4.0 License.