Reports and Publications
Effective Aug. 15, 2020
In the firearm/toolmark pattern match Uniform Language for Testimony and Reports (ULTR), the new guidance for Department of Justice firearm examiners includes:
[A]n examiner shall not:
- assert that a ‘source identification’ or a ‘source exclusion’ conclusion is based on the ‘uniqueness’ of an item of evidence.
- use the terms ‘individualize’ or ‘individualization’ when describing a source conclusion.
- assert that two toolmarks originated from the same source to the exclusion of all other sources.
These new requirements are in addition to prior ULTR guidance that an examiner shall not claim infallibility, zero error rate, or absolute certainty.
The 2016 PCAST Report found that “firearms analysis currently falls short of the criteria for foundational validity, because there is only a single appropriately designed study to measure validity and estimate reliability. The scientific criteria for foundational validity require more than one such study, to demonstrate reproducibility. Whether firearms analysis should be deemed admissible based on current evidence is a decision that belongs to the courts. If firearms analysis is allowed in court, the scientific criteria for validity as applied should be understood to require clearly reporting the error rates seen in appropriately designed black-box studies (estimated at 1 in 66, with a 95 percent confidence limit of 1 in 46, in the one such study to date).” See p. 112.
Letter from the DOJ regarding the results of a US DOJ and FBI review of lab reports and testimony of FBI lab examiners in the Willie Manning case finds that testimony stating that a specific gun fired a specific bullet “to the exclusion of all other guns in the world” is not scientifically supported.
See pp. 150-155 for the National Research Counsel’s assessment of the discipline of Toolmark and Firearms Identification.
The National Academies Press, 2008. Provides information about the range of acceptable conclusions in this field, as well as the lack of error rate and subjectivity of the comparison techniques.
From the Blog
- The National Institute of Justice has published several reports on novel techniques that are being investigated in order to improve forensic analysis. Take a look at the reports below to learn about some of the latest techniques that are being developed and to get a forecast of what techniques you may see coming soon to …
- SBI to Begin Using New Reference Standard to Assist Examiners in Identifying Cartridge Casings, 9/10/2012A new reference standard for comparing cartridge casings has been developed by the National Institute of Standards and Technology (NIST). The standard is known as SRM 2461, Standard Casing. It was developed to assist firearms examiners by ensuring that the equipment used to match cartridge cases to those in the National Integrated Ballistic Information Network …
- Two Bullets, One Gun?, 1/20/2012By Alyson Grine, Defender Educator, UNC School of Government In State v. Britt, __ N.C. App. __, __ S.E.2d __ (Dec. 6, 2011) the North Carolina Court of Appeals addressed the admissibility of expert testimony regarding firearms and toolmark identification. The facts, in brief: Nancy Britt, a Wake County school teacher, was shot and killed …
The National Institute of Standards and Technology (NIST) is a scientific research agency that works to advance measurement science, standards, and technology and that has been working to strengthen forensic science methods for almost a century. In recent years, several scientific advisory bodies have expressed the need for scientific foundation reviews of forensic disciplines and identified NIST as an appropriate agency for conducting them.
The purpose of a scientific foundation review is to identify and document information supporting methods and practices used in forensic analysis and to identify knowledge gaps where they exist. Beginning in fiscal year 2018, Congress appropriated funds for NIST to conduct scientific foundation reviews.
NIST has begun reviews of DNA mixture interpretation, bitemark analysis, digital evidence, and firearms examination. In addition to providing insights into these specific disciplines, the initial reviews serve as pilot studies which will guide future efforts.
This document outlines NIST’s approach to conducting scientific foundation reviews, including data sources used, evaluation criteria, and expected outputs.
Jan. 28, 2020 article in Science & Justice finding that bias occurs in non-blind peer reviewed bullet and cartridge case comparisons. Higher status examiners have a large influence on the outcome of a discussion. Blind peer review may reduce the probability of bias during peer review.
Article by Adina Schwartz, in The Columbia Science and Technology Law Review
- Gunshot residue contamination of the hands of police offices following start-of-shift handling of their firearm
Forensic Science International published a research article by Michael Cook in Nov. 2016. The study found that 85 percent of officers had 3-component GSR particles on their hands immediately following the start-of-shift handling of their firearms.
2014 article by F. Riva and C. Champod in the Journal of Forensic Sciences. Addresses new solutions to decrease the subjective component of firearm/spent cartridge case comparisons.
- Hypothesis Testing of the Critical Underlying Premise of Discernible Uniqueness in Firearms-Toolmarks Forensic Practice
Article by William A. Tobin and Peter J. Blau that argues that existing studies that are typically presented in court as support for firearm/projectile comparisons are fatally flawed and thus are of no value for validation of the techniques used. The authors offer a solution that would allow a scientifically defensible opinion to be proffered to courts until comprehensive and meaningful hypothesis testing can be conducted by the mainstream scientific community. Article is available for free download.
- Analysis of experiments in forensic firearms/toolmarks practice offered as support for low rates of practice error and claims of inferential certainty
Article by Clifford Spiegelman and William A. Tobin that evaluates experiments used to justify conclusions of “individualization” or specific source attribution to “100% certainty” and “near-zero” rates of error claimed by firearm toolmark examiners in court testimonies and suggests approaches for establishing statistical foundations for this firearm and toolmark comparisons.
- Knife and Saw Toolmark Analysis in Bone: A Manual Designed for the Examination of Criminal Mutilation and Dismemberment
by Steven A. Symes, Ph.D. et al. for the U.S. Department of Justice. Available through the National Criminal Justice Reference Service (2010)
by Dennis L. McGuire, M.S., Forensic Magazine – discusses the lack of a uniform standard for GSR analyses based upon validated studies. States that until those studies are completed, “positive determinations of GSR should be seriously scrutinized.”
Article by Paul Gianelli
by Julie Bykowicz, The Baltimore Sun. 2006 article which discusses a 2001 contamination study and the FBI’s decision to no longer analyze gunshot residue in its investigations.
Article that summarizes the findings of a group of scientists and practitioners who met to address issues with gunshot residue analysis and attempt to create guidelines for this type of analysis. This document references several studies that have been published regarding contamination of subjects and proper collection, testing, and reporting procedures.
- Presenter: Keith Morris. Offered by CSAFE, on June 14, 2021. Recording and materials are available.
- Presenter: Maria Cuellar. Offered by CSAFE, on June 14, 2021. Recording and materials are available.
- Presenter: Heike Hofmann. Offered by CSAFE, on June 14, 2021. Recording and materials are available.
- Speakers: Brandon Garrett, Nicholas Scurich, and William Crozier. Presented by CSAFE. Recording available.
- FORENSICS@NIST 2020, NISTOffered by NIST
This presentation, now available to view for free, was given as a part of the Center for Statistics and Applications in Forensic Evidence’s (CSAFE) 2020 All Hands Meeting. The meeting brings together researchers, forensic partners, and interested community members to discover potential areas for collaboration, highlight the organization’s achievements, and discuss goals for the future.
This presentation, given by Dr. Heike Hofmann, a professor of statistics at Iowa State University, discusses the results of a previous study related to comparison standards in Firearms and Toolmark analysis. The presentation also addresses the objectives of research being done in that area going forward.
- To view the presentation in it’s entirety click here
- To view only the slides click here
The importance of taking on prosecution forensic experts on behalf of clients cannot be overstated. It is no mystery how powerful forensic evidence is to jurors. Yet countless wrongful convictions are, in fact, the result of inaccurate, faulty, or unchallenged forensics. This practical workshop will prepare defense counsel to challenge unreliable expert testimony using a mock case involving firearm and digital evidence.
Tuition is $795.00. Program dates are January 16-18, 2020 at the University of Arizona James E. Rogers College of Law at Address: 1201 E. Speedway, Tucson, AZ 85721. Accommodations (not included in tuition) are offered at the Aloft Tucson University, just 1 mile from the law school. Special hotel block rate is $179.00 (plus tax)/night. Hotel block expires 12/24.
The National Criminal Defense College will offer a program in Tucson, Arizona on challenging faulty forensic testimony.
Tuition is $795.00. Program dates are January 16-18, 2020 at the University of Arizona James E. Rogers College of Law at Address: 1201 E. Speedway, Tucson, AZ 85721. Accommodations (not included in tuition) are offered at the Aloft Tucson University, just 1 mile from the law school with a special hotel block rate of $179.00 (plus tax)/night. (Hotel block expires 12/24.)
Co-sponsored by the NC State Crime Laboratory & Office of Indigent Defense Services
The NC State Crime Laboratory and NC Office of Indigent Defense Services will offer a free-to-attend CLE that is designed to enhance the knowledge of criminal defense attorneys and criminal defense investigators. Senior forensic scientists from the State Crime Lab will present updates and key information about the analysis of physical evidence in the disciplines of Forensic Biology (DNA), Firearms, and Digital Evidence. The Laboratory is working on validating the use of a new software program (STRMix) to interpret DNA mixtures. Once this software is implemented, DNA laboratory reports will have a new format and new conclusions will be used. This program aims to familiarize attorneys with this new program and the testimony that will be provided in court.
Following these presentations, the speakers will address questions from attorneys. Due to the confidential nature of casework, questions about specific cases will not be answered. Attorneys can schedule a meeting at the State Crime Lab to discuss the case with the analyst. Registration is available here. Attendees are encouraged to submit questions ahead of time using the registration form or by emailing email@example.com.
Attorneys receiving CLE credit will be billed $3.50 per credit hour by the NC State Bar. 3.0 hours of general CLE credit is anticipated. Non-attorneys who wish to receive continuing education credit will receive certificates of attendance.
The National Institute of Justice has an online training that includes topics such as Bullet Comparison and Identification, Gunshot Residue and Distance Determination, and Toolmark Identification. The training provides both a general understanding of firearms/firearms evidence and gives a detailed explanation of techniques used by firearm examiners. The program is for criminal justice professionals and you must create a login to access the content.
Document created by the Georgia Bureau of Investigation provides a clear description of the analyses performed by firearms and toolmark examiners. It is presented from the perspective of a crime lab, so it does not question the reliability of any of the techniques presented, but it is a helpful document for attorneys because it explains the procedures used and illustrates them with photographs.
The University of Utah Health Sciences Library has several firearms tutorials posted which cover information about the different types of firearms and how they work, ballistics (the science of the travel or a projectile in flight), patterns of tissue injury, laboratory methods, and examination of gunshot residue. The tutorials provide basic foundational information as well as more technical information about firearm function.
An international organization dedicated to the advancement of Firearm and Toolmark Identification. See the Admissibility Resource Kitfor links to opinions, transcripts, motions, briefs and articles supporting and opposing the practice of firearm identifications.
This Scientific Area Committee (part of the OSAC) has taken over the work previously done by the Scientific Working Group For Firearms and Toolmarks (SWGGUN). The SAC will focus on standards and guidelines related to the examination of firearm and toolmark evidence. This includes the comparison of microscopic toolmarks on bullets, cartridge cases, and other ammunition components and may also include firearm function testing, serial number restoration, muzzle-to-object distance determination, tools, and toolmarks
Sample direct and cross-examinations of various forensic witnesses, including a firearm/toolmark expert, fingerprint expert, pathologist, DNA expert, and other forensic experts.
The National Forensic Science Technology Center created this website to explain in simplified terms the principles of each type of forensic analysis and how the analysis is performed. Topics include DNA, digital evidence, fingerprints, firearms, trace evidence, blood stains, and more.
Information about a new research database and techniques used in firearm-toolmark comparisons.
After applying Daubert, the court concluded that the expert testimony in the case should be limited because the conclusions were not supported by a quantifiable or replicable scientific process.
Decision on a Frye Motion requesting that the court preclude all ballistic expert testimony comparing shell casings from the crime scene to a gun found in one of the defendants’ car. The court concluded that an expert cannot offer opinions that are not supported by the relevant scientific community. Testimony by an expert that is unfounded or that uses subjective terms are not permitted as they could mislead the jury.
After applying the Daubert factors, the court reached the conclusion that ballistic matching lacks the scientific integrity to make statements of certainty. The court limited the ballistics expert testimony to only stating that the gun could not be excluded as a potential source of the bullet.
The court allows the ballistics expert testimony, but limits the testimony to say that the gun in question could not be eliminated as a source of the bullet.
The court affirmed the admissibility of the Government’s expert witness’s statement of certainty concerning the ballistic evidence. The expert testified that the markings were, “unique to that gun, and that gun only.” Id. at 346. Due to a failure to object by the defense and a lack of binding law that says otherwise, the inclusion of this statement was affirmed.
The court finds that ballistics science is admissible, and notes the level of subjectivity and the impossibility of a perfect match in this field of science. The court prohibits the expert testimony from saying that the ballistic match is to a scientific, practical, or absolute certainty to exclude all other firearms.
The court finds that ballistics examination lacks the rigor and certainty of other forensic sciences, and there a limit is needed on the degree of confidence given during testimony. The court limits testimony to “more likely than not”.
Defendant filed a motion to exclude expert testimony which was denied in part and granted in part. The court held that the expert could provide testimony concerning toolmark evidence, but could not testify that a match was found to a degree of certainty which excludes all other firearms in the world from being the source.
Although the defendant’s motion to exclude testimony was denied, the court held that the toolmark expert may not testify that a match was found to an “absolute” or “practical” certainty. This conclusion was reached after evidence was presented that suggested this level of certainty was impossible.
The Court holds that it will allow ballistics testimony with limitations. The expert testimony can include things such as the methodology and the fact that a match was found, but the expert cannot make claims of certainty that the match excludes all other possible firearms in the world. Id. at 124.
The court ruled that toolmark evidence is relevant, helpful, and reliable if offered by a qualified examiner who followed the AFTE theory. Id. at 569-570. There should be documentation (photographs, notes, etc.) of the conclusions reached to allow confirmation by a second qualified examiner on how an identification was reached. Id. This documentation should also be sufficient for a defense expert to challenge if one is sought. Id. The testimony of the examiner is admissible so long as the examiner is prevented from making unsupported claims about the degree of certainty of their identification. Id. Additionally, the court holds that, “the government should be required to strictly and timely comply with its Fed.R.Crim.P. 16 obligations . . .” concerning this testimony. Id.
A SCL analyst performed an experiment measuring the direction and distance that shell casings traveled when a gun was fired at various angles and testified to the results, offering opinions about location of the shooter. On appeal, counsel argued that the tests were not “substantially similar.” The COA held that Rule 702 governs admission of expert evidence, including experimental evidence.
Decision on Frye Motion making a finding that the relevant scientific community consists of the fields of forensic science, scientific methodology in studies and statistics, and psychology. The court ruled that the examiner may testify about class characteristics, but may not offer qualitative opinions on matters not adequately supported by the relevant scientific community, including the significance of marks other than class characteristics as the reliability of that subjective practice has not been established.
Motions and Briefs
- Order Allowing Testing and Inspection of Firearms Evidence and to Transport Evidence to Defense Expert
Order granted in 2009, filed under seal until case was resolved.
Trial court denied the motion, but initially prohibited the State from offering testimony “that the bullets in question were fired from the same weapon” because of potential for misleading the jury. However, the testimony was allowed after the trial court found the defense opened the door to the testimony during opening statements.
- Motion to Exclude Firearm Identification Testimony, Memorandum of Law, State’s Brief in Response to Defendant’s Motion, and Order
2011 motion in limine by Richard Ramsey. Example of how to use the National Academy of Sciences report and other professional standards in a motion to exclude or suppress forensic evidence. Transcript of motion’s hearing available upon request.
Motion filed by David Botchin and Mark Rabil.
Firearms in the News
- Police Are Telling ShotSpotter to Alter Evidence From Gunshot-Detecting AI, by Todd Feathers, Vice, 7/26/2021
- Judge Limits Evidence from Prosecutor Witness Based on Junk Science, by David M. Greenwald, Davis Vanguard, 6/17/2021
- D.C. Appeals Forensic Lab Suspension, Alleges Misdoings By U.S. Attorney’s Office, by Colleen Grablick, NPR, 6/11/2021
- Documents: DC crime lab says it never concealed findings, by Jack Moore, WTOP, 6/11/2021
- 86% of alerts from city’s gunshot detection system led to ‘dead-end deployments,’ researchers find, by Tom Schuba, Chicago Sun Times, 5/3/2021
- Groups say gunshot detection systems unreliable, seek review, by Don Babwin and Sara Burnett, AP, 5/3/2021
- Long before latest DC crime lab troubles, some employees raised concerns, by Jack Moore and Megan Cloherty, WTOP, 4/29/2021
- Who pulled the trigger? Gun muzzle exhaust may complicate analysis of crime scenes, by Ian Randall, Science, 4/20/2021
- William Bailey, Rougemont, NC
- Peter D. Barnett, Hayward, CA
- Jack Benton, Lubbock, TX
- Curtis Caldwell, NC
- Steven Carpenter, Cary, NC
- William E. Conrad, Fredericksburg, VA
- Frankie E. “Eddie” Harrant, Dunn, NC
- Francis T. “Jay” Jarvis, Armuchee, GA
- Don Mikko, Ellenwood, GA
- John Nixon, Bippus, IN
- Lester Roane, Street, MD
- Ronald L. Singer, M.S., Fort Worth, TX
- Russell Thomas, Roxboro, NC
- William (Bill) Tobin, Lake Anna, VA
- Robert S. White, Charleston, WV
- Josh Wright, Asheville, NC