Election Audits
This Page: copswiki.org/Common/ElectionAudits
Latest News
This project provides a place to gather up and organize links to various initiatives regarding audits, including statistical and exhaustive approaches.
Background
- http://bcn.boulder.co.us/~neal/electionaudits/rlacalc.html -- rlacalc: Online Calculator for Risk-Limiting Audit Sample Sizes
- https://www.usenix.org/legacy/events/evtwote10/tech/full_papers/Stark.pdf -- Stark.pdf - "Super-Simple Simultaneous Single-Ballot Risk-Limiting Audits"
- https://www.stat.berkeley.edu/~stark/Preprints/gentle12.pdf -- A Gentle Introduction to Risk-limiting Audits -- Mark Lindeman and Philip B. Stark
- https://github.com/ron-rivest/2018-bctool/blob/master/code/bctool.py -- Bayesian Comparison audit tool
- https://cran.r-project.org/web/packages/bayesm/bayesm.pdf -- Bayesian toolkit
SUITE: Risk-Limiting Audits by Stratified Union-Intersection Tests of Elections (SUITE) | SpringerLink
Several other methods at:
- Next Steps for the Colorado Risk-Limiting Audit (CORLA) Program
- https://arxiv.org/abs/1803.00698
Work continues studying Bayesian methods that are much more efficient, but aren't yet known to be risk-limiting.
From Harvie Branscomb:
The following linked document is a comprehensive set of steps for a risk limiting ballot comparison tabulation audit that I assembled prior to the second meeting of the audit advisory group appointed by the CO SOS in January 2017. I believe it largely complies with the guidelines listed in the Lutz memo just sent out. And the CO audit is actually being implemented along the lines of these steps as well. The major differences between these steps and the actual implementation are the use of the RLATool special purpose software rather than basic paper forms for capture of sampled voter intent, and the selection of contests to drive the audit done by the SOS rather than by choice of narrowest margin countywide contest. I think it may be useful for designers of other risk limiting post election tabulation audits to read this document:
https://www.sos.state.co.us/pubs/elections/VotingSystems/riskAuditFiles/20170217Branscomb-StepsRiskLimitingVoteTabulationAudit.pdf
There is a shorter more abstracted version was also contemporaneously created by members of SAWG linked here:
https://www.sos.state.co.us/pubs/elections/VotingSystems/riskAuditFiles/20170217McBurnett-BriefCORLASummary.pdf
The public records of the audit advisory group including the two above are located here (many other comment documents may be useful):
https://www.sos.state.co.us/pubs/elections/VotingSystems/riskAuditGroup.html
There is a vast public record rulemaking that implemented regulations for the Colorado audit.
There is extensive written testimony regarding proposed rules for implementation of the RLTA such as this here:
http://www.sos.state.co.us/pubs/rule_making/written_comments/2017/20170718BranscombMcCarthy.pdf
and in more detail here, focusing on the discussion of the text of Rule 25 that implements the CO RLTA:
http://www.sos.state.co.us/pubs/rule_making/written_comments/2017/20170710Branscomb.pdf
and this followup to the above in response to comments by Boulder County:
http://www.sos.state.co.us/pubs/rule_making/written_comments/2017/20170717Branscomb.pdf
The following linked writing discusses the need for disassociation of tabulation batches from eligibility batches, both in numbering and in content such that batches cannot be linked in a mail ballot or central count process with mixed styles (e.g.vote center). Sufficient disassociation will allow paper ballots to be viewed in public, as the best practices for audit require:
http://www.sos.state.co.us/pubs/rule_making/written_comments/2017/20170718Branscomb.pdf
Above documents are all from this rulemaking page:
http://www.sos.state.co.us/pubs/rule_making/hearings/2017/ElectionsRulesHearing20170711.html
And the the resulting Rule 25 that implements the audit in current form is found here:
http://www.sos.state.co.us/pubs/rule_making/CurrentRules/8CCR1505-1/Rule25.pdf
I. think Ray has asked me to provide this kind of material in the past, and I apologize for not sending it earlier. Harvie Branscomb
Colorado Audt Center
- http://www.sos.state.co.us/pubs/elections/auditCenter.html -- will take some work to fully undestand what they are providing and if we can provide sufficient oversight.
- Colorado RLA (CORLA) -- http://bcn.boulder.co.us/~neal/elections/corla/
Summary of articles submitted for this project:

M2056 2026-06-08 1% Random Draw (2nd) San Diego 20260608 -- RayLutz Citizens Overight 
M2053 2026-04-27 Comment on: Election Audit Standards (EAC Document) -- RayLutz CitizensOversight 
M2051 2026-04-06 Passaic County NJ BIA Narrative Report 2025-11-04 -- RayLutz CitizensOversight 
M2052 2026-04-06 Hudson County NJ BIA Narrative Report 2025-11-04 -- RayLutz CitizensOversight 
M2046 2026-03-09 Comment on RLA procedures In Maryland -- RayLutz CitizensOversight 
M2042 2025-12-04 Ballot Image Audit of 2023-11-07 election in Broomfield County, CO -- Raymond C Lutz CitizensOversight 
M2040 2025-10-30 Oversight of San Diego, 2025 General Election -- Ray Lutz CitizensOversight - M2039 2025-10-23 Analysis of CA in 2024 General Election --

M2036 2025-09-02 Audits of 2024 Election in Burlington and Sussex Counties, NJ -- RayLutz CitizensOversight 
M2033 2025-02-17 Clark County Inquiry Regarding the 2024 Election -- RayLutz CitizensOversight
M2032 2025-01-30 Public Records Request to NV SOS Regarding 2024 Election in NV -- RayLutz CitizensOversight
M2027 2024-09-17 Comparison of Ballot Image Viewers -- RayLutz CitizensOversight 
M2012 2024-06-01 Letter to Ken Bennett re: BIA Classifications, Dallas Data, AZ pilot (M2012) -- RayLutz CitizensOversight 
M2011 2024-04-09 To Raffensperger -- GA Ballot Image Audits including OCR of BMD ballots in light of HB 974 (M2011) -- RayLutz CitizensOversight - M2020 2024-03-05 Dallas, TX 2024-03-05 Primary Election Data -- RayLutz CitizensOversight

M2004 2023-12-05 Letter to CO SOS Griswold re Arvada Mayor's Contest 2023 -- RayLutz CitizensOversight 
M2030 2023-12-05 Pr Rel- Citizens Oversight Announces Independent Audits of 2024 Election -- RayLutz CitizensOversight 
M2026 2023-10 Technical Report: 100% Retabulation Audits: 2022 Primary and General Election Audit Data and Ballot Images from Leon County, FL -- Lonna Rae Atkeson, et al Florida State University 
M2000 2023-08-29 Letter To Monmouth County Clerk (M2000) -- RayLutz CitizensOversight 
M2009 2023-07-04 NJ 2022 Audit of Three Counties, Burlington, Mercer, Monmouth -- RayLutz CitizensOversight
M2041 2022-11-17 1% Manual Tally Observations in San Diego -- 2022-11-17 -- Ray Lutz CitizensOversight
M2019 2022-11-12 CVR Analysis Mistakes -- RayLutz CitizensOversight 
M1989 2022-11-06 Dual Tabulation Issue in ES&S Voting Equipment -- RayLutz CitizensOversight 

M1986 2022-09-30 2020 General Election Audit Reports for Bartow GA, Fulton GA and Dane WI -- RayLutz CitizensOversight 
M1997 2022-08-12 The Antrim County 2020 Election Incident: An Independent Forensic Investigation -- J. Alex Halderman University of Michigan
M1987 2022-07-08 Review of Jovan Pulitzer's Paper Analysis Report for Maricopa County -- RayLutz CitizensOversight 
M1984 2022-05-26 Election Hazards -- RayLutz CitizensOversight 
M1983 2022-02-18 GA_Bartow_20201103 Audit Narrative Report -- RayLutz CitizensOversight
M1982 2022-01-27 GA_Bartow_20201103 Audit Report -- RayLutz CitizensOversight 
M1980 2021-10-03 Review of Arizona Audit of the 2020 General Election in Maricopa County -- RayLutz CitizensOversight
VoterIntent 2021-09-16 Voter Intent -- RayLutz CitizensOversight 
M1978 2021-09-10 Letter to SOS Weber regarding Recall auditing procedures. -- RayLutz CitizensOversight 
M1979 2021-08-28 Ballot auditor: Volusia County supervisor of elections did a good job -- Noah Hertz The West Volusia Beacon 
M1977 2021-08-05 Comments by Citizens' Oversight on RLA regulations -- RayLutz CitizensOversight 
M1976 2021-07-20 Critical Review of the paper 'Unclear Ballot' -- RayLutz CitizensOversight
M1973 2021-06-15 Ballot Images in Florida Regulations -- RayLutz CitizensOversight
AuditEngineFAQs 2021-06-11 AuditEngine Frequently Asked Questions -- RayLutz CitizensOversight 

M1970 2021-05-29 AuditEngine Three Florida Counties -- Case Study Report & Videos (M1970) -- RayLutz CitizensOversight- M1969 2021-05-28 Maricopa County Audit -- 2020 General Election -- RayLutz CitizensOversight
- M1971 2021-05-28 Another election audit coming? Arizona Senate considers using new technology for digital recount -- Jen Fifield Robert Anglen ArizonaRepublic

M1968 2021-04-13 Ballot Images: Essential or Worthless? -- RayLutz CitizensOversight
M1967 2021-04-08 Public Records Request to Bartow County GA for 2020 Ballot Images -- RayLutz CitizensOversight - M1965 2020-12-22 Audits in 2020 General Election -- RayLutz CitizensOversight
M1954 2020-11-03 Tabulation Audit Oversight and Snapshot Protocol Tutorial -- RayLutz CitizensOversight - OversightFor2020GeneralElection 2020-10-29 Oversight for 2020 General Election -- RayLutz CitizensOversight
M1950 2020-07-11 2020 General Election Oversight Plan -- RayLutz CitizensOversight 
M1947 2020-07-07 Letter to Gov. Newsom to include all ballots in the audit -- RayLutz CitizensOversight
M1946 2020-06-22 Citizens' Oversight's Comments on VVSG 2.0 Draft -- RayLutz CitizensOversight
M1981 2020-06-22 Guidelines and Terminology on the Ease of Voter-verification -- RayLutz CitizensOversight 
M1944 2020-03-26 Comment on AB-2400, RLA revisions -- RayLutz CitizensOversight 
M1943 2020-03-18 Request for 2020 Primary Election Ballot Images to CA Counties -- RayLutz CitizensOversight
M1940 2019-12-06 Uniform Audit Report -- RayLutz CitizensOversight
M1938 2019-11-30 The Four Fatal Flaws of RLA Audits -- RayLutz CitizensOversight
M1936 2019-11-11 Securing Digital Ballot Images to Enable Auditing -- RayLutz CitizensOversight 
M1931 2019-11-04 Earth Summit Presentation: Elections: Stop Scams with Oversight and Audits -- RayLutz CitizensOversight 
M1928 2019-10-05 !AuditEngine Announcement at 3rd National Election Integrity Conference, Berkeley -- RayLutz CitizensOversight
M1926 2019-09-19 Staff Report and Comments by Ray Lutz at Rhode Island BOE on Audits -- RayLutz CitizensOversight 
M1923 2019-09-13 ES&S Voting Machine Equipment Demo -- RayLutz CitizensOversight 
M1925 2019-09-13 Clear Ballot Voting System Demonstration -- RayLutz CitizensOversight
M1919 2019-08-21 The Surprising Wisdom of Batch Comparison Election Audits -- RayLutz CitizensOversight
M1917 2019-08-19 Ballot Image Samples -- RayLutz CitizensOversight
M1916 2019-08-18 Tutorial on Risk Limiting Audits -- Ballot Polling -- RayLutz CitizensOversight 
M1914 2019-08-16 Letter to Rhode Island Board of Elections regarding Risk Limiting Audits -- RayLutz CitizensOversight 

M1918 2019-08-14 Rhode Island Board of Elections on RLA report -- Rhode Island Board of Elections CitizensOversight 
M1913 2019-08-12 Comprehensive Risk Estimation of Election Audits -- RayLutz CitizensOversight 
M1915 2019-08-07 Presentation by Steven Rosenfeld on Ballot Image Audits in Maryland -- StevenRosenfeld AuditUsa
M1939 2019-06-15 Uniform Audit Tally Sheets -- RayLutz CitizensOversight 
M1900 2019-04-09 Letter to San Diego City Council re: Item 53 on April 9 (Election Integrity) -- RayLutz CitizensOversight 
M1899 2019-04-05 Letter to SDROV requesting party affiliation breakdown by precinct for years 2012-2018 -- RayLutz CitizensOversight 

M1896 2019-03-26 Letter to San Diego BOS on Election Integrity for 2019-03-26 meeting -- RayLutz CitizensOversight 
M1893 2019-03-17 Letter to LA ROV requesting Batch Report for Nov 2018 -- RayLutz CitizensOversight 
M1894 2019-03-17 2019-03-17 (M1894) Letter to SD ROV requesting Batch report -- RayLutz CitizensOversight 
M1895 2019-03-17 Letter to OC ROV requesting Ballot Images -- RayLutz CitizensOversight
M1892 2019-03-10 Election Integrity Update -- Ray Lutz -- RayLutz CitizensOversight
M1879 2018-09-10 White Paper: Election Audit Strategy and BRAWL -- Balanced Risk Audit with Workload Limitation -- RayLutz CitizensOversight
M1949 2017-12-29 Random drawing scheduled to break tie in disputed Va. House race -- Denise Lavoie AssociatedPress 
M1884 2017-01-31 CLIP Audit -- Ronald Rivest MIT
M1693 2016-09-06 CPRA -- Procedures of San Diego Registrar of Voters (2016) -- RayLutz CitizensOversight
ElectionAuditBestPractices 2016-08-08 Election Audit Best Practices -- RayLutz CitizensOversight 
M1678 2012-10 Risk-Limiting Post-Election Audits: Why and How -- Risk-Limiting Audits Working Group Risk-Limiting Audits Working Group
M1807 2012 BRAVO: Ballot-polling Risk-limiting Audits to Verify Outcomes -- Mark Lindeman, Philip Stark Vincent Yates Department of Statistics University of California, Berkeley 
M1729 2008-09 Principles and Best Practices for Post-Election Audits -- electionaudits.org 
M1503 2008-07-01 Improving the Security, Transparency and Efficiency of California's 1% Manual Tally Procedures -- Joseph Lorenzo Hall UC Berkeley School of Information 
M1683 2008 Procedures for California's 1% Manual Tally -- Joseph Hall UCBerkeley
M1883 2007-11-05 Elections board workers take plea deal -- Karl Turner cleveland.com 
M1922 2000-04-05 Probabilistic Risk Assessment: What Is It And Why Is It Worth Performing It? -- Dr. Michael Stamatelatos NASA Office of Safety and Mission Assurance
Discussion List
See ListServe for all email discussion lists and to add more. %KEYWORDTOPICLISTSERVE%