Toolkit · Administrative Law
The Government Transparency and Public Records Toolkit
5 U.S.C. § 552
- Type
- Toolkit
- Jurisdiction
- National
- Date
- 2024-12-04
- Topic
- Administrative Law
A research and resource map for federal and state transparency practice, built for requesters, agency counsel, and companies whose submissions are at stake. Ten pillars organize the field: scope and what counts as an agency record, the request and the fee structure, deadlines and constructive exhaustion, the adequacy of the search, the national security and statutory exemptions, Exemption 4 after Food Marketing Institute v. Argus Leader Media, Exemption 5 and the deliberative process privilege, the privacy and law enforcement exemptions, the procedural tools of Glomar, the Vaughn index and the foreseeable harm standard, and litigation with attorney fees under the restored catalyst theory. Each pillar states the doctrine, names the controlling authorities, flags the trap and its second-order consequence, and points deeper. An authority shelf collects the statutes, executive orders, leading cases, and secondary sources. Two appendices supply a denial-response matrix mapping each exemption to its counterargument, and a comparison of federal FOIA against typical state public records regimes.
The Government Transparency and Public Records Toolkit
Administrative Law > Government Transparency | Published 4 December 2024 - Updated 17 July 2026 | UpLaw - uplaw.us
In brief. Four things determine whether a records request succeeds: how narrowly it was drafted, whether the requester used the missed deadline, whether the appeal made specific arguments instead of general ones, and whether the requester was willing to file a complaint. The doctrine below is what fills in the arguments.
Keywords: agency record, reasonably describe, fee categories, constructive exhaustion, search adequacy, exemptions 1–9, Argus Leader, deliberative process, Reporters Committee, Glomar, Vaughn, foreseeable harm, catalyst theory, reverse FOIA, state open records
How This Toolkit Is Organized
Ten pillars, each giving the doctrine, the anchors, the trap and its second order consequence, and where to go deeper. Then the authority shelf, then two appendices: a denial-response matrix and a federal-versus-state comparison.
The narrative entry point is Asking the Government for Its Own Documents: FOIA's Nine Exemptions and How They Are Used. The doctrinal treatment is The Freedom of Information Act and State Public Records Laws: A Comprehensive Guide. The operational sequence is Filing a FOIA Request and Appealing a Denial: A Practical Checklist.
Pillar 1 — Scope and the Agency Record
Doctrine. Any person may request any agency record for any reason. The agency must have created or obtained the record and have control of it when the request was made. Format is irrelevant; email, texts, databases, and metadata all count.
Anchors. 5 U.S.C. § 552, including § 552(f)(1) (definition of agency). Presidential Records Act; Federal Records Act.
Trap. Requesting from an entity FOIA does not reach — Congress, the courts, the President and sole-advisory EOP units, state and local bodies, or private contractors. The contractor's own files are not agency records; its submissions to the agency are.
Trap, second order. Accepting "no responsive records" when agency business moved to personal email, text messages, or a messaging platform. Substance controls, not the account it lived in, and agencies must make reasonable efforts to reach such records. Say the word "text messages" in the request so the answer is checkable.
Go deeper: Guide Part I
Pillar 2 — The Request and the Fee Structure
Doctrine. A request must reasonably describe the records and follow the agency's published rules. Fee category — commercial, educational, scientific, news media, or other — sets what is chargeable; a fee waiver is a separate showing.
Anchors. § 552(a)(3)(A) (reasonably describe), (a)(4)(A) (fees and waiver), (a)(6)(A) (determination). Agency FOIA regulations.
Trap. "Any and all documents relating to X." It draws a not-reasonably-described response, or a fee estimate that ends the project, or a nominal search whose adequacy is measured against the sprawling request you wrote.
Trap, second order. Omitting a fee ceiling. A fee notice tolls the clock until the requester responds, so a notice that lands in a spam folder stalls the request indefinitely with no one at fault. State a ceiling and pre-authorize it, and the tolling never begins.
Go deeper: Guide Parts II–III · Checklist Phases 2–3
Pillar 3 — Deadlines and Constructive Exhaustion
Doctrine. 20 business days to issue a determination — the scope of the response and the exemptions claimed — extendable by 10 days for unusual circumstances. Failure to meet the deadline constructively exhausts administrative remedies and permits immediate suit, and generally bars search fees.
Anchors. § 552(a)(6)(A)–(C); § 552(a)(4)(A)(viii) (fee prohibition for untimely response); § 552(a)(6)(E) (expedited processing).
Trap. Treating an acknowledgment letter as a determination. It is not; it does not stop the clock, and a requester who waits patiently after receiving one has usually given up the fee prohibition and the exhaustion argument without noticing.
Trap, second order. Silence. Agencies manage queues by human attention, and the day-21 letter — noting the missed deadline, invoking the fee prohibition, requesting a completion estimate, and stating that suit is authorized — moves requests more reliably than anything else that costs nothing. It also builds the diligence record that supports fee entitlement later.
Go deeper: Guide Part IV · Checklist Phase 5
Pillar 4 — Adequacy of the Search
Doctrine. The agency must show a search reasonably calculated to uncover all relevant documents. The test is the search's reasonableness, not whether documents were found.
Anchors. § 552(a)(3)(C)–(D) (reasonable efforts to search electronic records); agency declarations and the standards developed in the D.C. Circuit.
Trap. Failing to raise search adequacy in the administrative appeal. Courts have found the issue unexhausted when the appeal challenged only withholding. Raise it in a paragraph even when you are not yet sure.
Trap, second order. Not chasing positive leads. One produced email referring to an unproduced attachment usually defeats summary judgment on adequacy — and it is the cheapest thing in FOIA practice to find, because it is sitting in the production you already have.
Go deeper: Guide Part V · Checklist Phase 7
Pillar 5 — Exemptions 1, 2, 3: Security, Housekeeping, Other Statutes
Doctrine. Exemption 1 protects properly classified national security information. Exemption 2 protects internal personnel rules and practices, and nothing more. Exemption 3 protects what another statute specifically exempts.
Anchors. § 552(b)(1)–(3). Milner v. Department of the Navy, 562 U.S. 562 (2011) (rejecting "High 2"; Exemption 2 covers human resources matters). CIA v. Sims, 471 U.S. 159 (1985) (intelligence sources and methods, read broadly). Executive Order 13,526 (classification); the Mandatory Declassification Review and ISCAP process.
Trap. Letting an Exemption 3 claim stand on a citation. Demand the statute and read it — the qualifying statutes differ enormously in scope, and post-2009 a statute qualifies only if it specifically cites § 552(b)(3).
Trap, second order. Not testing the post-Milner migration. Material once withheld as "High 2" now appears under Exemption 7(E), which requires a law enforcement purpose many agencies cannot establish for the record at issue. The relabeling is frequently unjustified and rarely challenged.
Go deeper: Guide Parts VI–VIII
Pillar 6 — Exemption 4 After Argus Leader
Doctrine. Trade secrets and commercial or financial information obtained from a person and confidential — meaning customarily and actually treated as private by its owner, provided under an assurance of privacy. No competitive harm showing required.
Anchors. § 552(b)(4). Food Marketing Institute v. Argus Leader Media, 588 U.S. 427 (2019) (displacing National Parks & Conservation Ass'n v. Morton, 498 F.2d 765 (D.C. Cir. 1974)). Executive Order 12,600 (pre-disclosure notification). 18 U.S.C. § 1905 (Trade Secrets Act).
Trap. Conceding that everything the contractor touched is exempt. Exemption 4 covers information obtained from a person — the agency's own inspection findings, analyses, and enforcement decisions are the agency's, however much they discuss the contractor's data.
Trap, second order. Not pressing the foreseeable harm standard against Exemption 4. Argus Leader defined "confidential"; it did not repeal § 552(a)(8)(A)(i)'s requirement that the agency reasonably foresee harm to a protected interest. Several courts have required an articulation of actual harm anyway. This is the most productive open argument in FOIA practice right now.
Go deeper: Guide Parts IX, XVIII · Checklist Phase 11
Pillar 7 — Exemption 5 and the Deliberative Process
Doctrine. The civil discovery privileges, imported into FOIA: deliberative process (predecisional and deliberative), attorney-client, and work product.
Anchors. § 552(b)(5). NLRB v. Sears, Roebuck & Co., 421 U.S. 132 (1975) (post-decisional explanations and adopted "working law" are not protected). U.S. Fish & Wildlife Service v. Sierra Club, Inc., 592 U.S. 261 (2021) (unfinalized draft biological opinions remain predecisional). Department of the Interior v. Klamath Water Users Protective Ass'n, 532 U.S. 1 (2001) (consultant corollary does not cover outsiders pursuing their own adverse interests). FOIA Improvement Act 25-year sunset.
Trap. Accepting a deliberative-process claim over a final document. The final assessment transmitted to a regulated party, the decision memorandum that was signed, the guidance the staff actually applies — these are the agency's working law and are not protected however deliberative their drafting history.
Trap, second order. Forgetting the 25-year sunset. For historical work it is dispositive and free: deliberative process simply cannot be claimed for records created 25 or more years before the request, and agencies assert it against old records anyway.
Go deeper: Guide Part X
Pillar 8 — Exemptions 6 and 7: Privacy and Law Enforcement
Doctrine. Exemption 6 balances privacy against the public interest for records whose disclosure would be a clearly unwarranted invasion. Exemption 7 protects law-enforcement-compiled records against six specified harms, with 7(C)'s privacy standard lower than Exemption 6's.
Anchors. § 552(b)(6), (b)(7)(A)–(F); § 552(c) (exclusions). Department of State v. Washington Post Co., 456 U.S. 595 (1982) ("similar files" read broadly). Department of Justice v. Reporters Committee for Freedom of the Press, 489 U.S. 749 (1989) (practical obscurity; the only cognizable public interest is light on agency performance). NARA v. Favish, 541 U.S. 157 (2004) (survivor privacy; evidentiary threshold for misconduct claims).
Trap. Arguing the public interest in terms of newsworthiness. Under Reporters Committee the interest must be in what the government is up to — so frame every privacy argument as revealing agency performance, not as revealing an interesting fact about a person.
Trap, second order. Treating a 7(A) withholding as permanent. It protects only while the enforcement proceeding is pending and expires when the proceeding ends. Calendar a re-filing; the same records become releasable with no change in the law and no new argument.
Go deeper: Guide Parts XI–XII
Pillar 9 — Glomar, Vaughn, and Foreseeable Harm
Doctrine. An agency may refuse to confirm or deny existence where existence itself is exempt; it must itemize withholdings in litigation; and since 2016 it may withhold only where it reasonably foresees harm to a protected interest.
Anchors. Phillippi v. CIA, 546 F.2d 1009 (D.C. Cir. 1976) (Glomar). Vaughn v. Rosen, 484 F.2d 820 (D.C. Cir. 1973) (index). FOIA Improvement Act of 2016, § 552(a)(8) (foreseeable harm; partial disclosure; 25-year sunset; proactive posting of records requested three or more times; 90-day appeal window; OGIS notification). § 552(b) (segregability, with a required court finding).
Trap. Not building the official acknowledgment file. Glomar falls to a prior official, documented, public disclosure of the same specific information — agency press releases, congressional testimony, budget justifications, IG reports, court filings. Leaks and press speculation do not count.
Trap, second order. Not demanding record-specific foreseeable harm. A determination letter that names an exemption and stops is now legally defective, not merely terse. Courts have rejected generic "release could chill deliberations" assertions. Cite § 552(a)(8) in every appeal and demand a document-by-document articulation.
Go deeper: Guide Parts XIII–XIV · Checklist Phases 6, 8
Pillar 10 — Litigation and Fees
Doctrine. De novo review with the burden on the agency, decided on cross-motions supported by declarations and a Vaughn index. A requester who substantially prevails may recover fees, including through a voluntary change in agency position.
Anchors. § 552(a)(4)(B) (jurisdiction and venue), (a)(4)(E) (fees), (a)(4)(F) (Special Counsel referral). OPEN Government Act of 2007 (restoring the catalyst theory for FOIA). Open America v. Watergate Special Prosecution Force, 547 F.2d 605 (D.C. Cir. 1976) (exceptional-circumstances stay). Chrysler Corp. v. Brown, 441 U.S. 281 (1979) (no private right of action to block disclosure; reverse FOIA proceeds under the APA).
Trap. Not documenting the chronology. Fee eligibility under the catalyst theory turns on showing the suit caused the release, and that argument is built from dated letters, not recollection. Keep time records from the first pre-litigation letter.
Trap, second order. Filing pro se as a non-attorney. It forecloses attorney fees entirely, which changes the economics of the case — and it is worth knowing before the complaint rather than after the production.
Go deeper: Guide Parts XVI–XVIII · Checklist Phase 9
The Authority Shelf
Statutes
- Freedom of Information Act, 5 U.S.C. § 552
- Privacy Act of 1974, 5 U.S.C. § 552a
- Government in the Sunshine Act, 5 U.S.C. § 552b
- Administrative Procedure Act, 5 U.S.C. §§ 701–706
- Federal Advisory Committee Act, 5 U.S.C. App.
- Trade Secrets Act, 18 U.S.C. § 1905
- Federal Records Act, 44 U.S.C. §§ 3101–3107; Presidential Records Act, 44 U.S.C. §§ 2201–2209
- Amending acts: Freedom of Information Reform Act of 1986; Electronic FOIA Amendments of 1996; OPEN Government Act of 2007; FOIA Improvement Act of 2016
Executive orders and regulations
- Executive Order 13,526 (classified national security information)
- Executive Order 12,600 (pre-disclosure notification to submitters of confidential commercial information)
- Agency FOIA regulations (each agency's own; controlling on submission, fees, and appeals)
Leading cases
- EPA v. Mink, 410 U.S. 73 (1973) · Vaughn v. Rosen, 484 F.2d 820 (D.C. Cir. 1973) · Department of the Air Force v. Rose, 425 U.S. 352 (1976) · NLRB v. Sears, Roebuck & Co., 421 U.S. 132 (1975) · Phillippi v. CIA, 546 F.2d 1009 (D.C. Cir. 1976) · Open America v. Watergate Special Prosecution Force, 547 F.2d 605 (D.C. Cir. 1976) · Chrysler Corp. v. Brown, 441 U.S. 281 (1979) · Department of State v. Washington Post Co., 456 U.S. 595 (1982) · CIA v. Sims, 471 U.S. 159 (1985) · Department of Justice v. Reporters Committee for Freedom of the Press, 489 U.S. 749 (1989) · Department of the Interior v. Klamath Water Users Protective Ass'n, 532 U.S. 1 (2001) · NARA v. Favish, 541 U.S. 157 (2004) · Milner v. Department of the Navy, 562 U.S. 562 (2011) · McBurney v. Young, 569 U.S. 221 (2013) · Food Marketing Institute v. Argus Leader Media, 588 U.S. 427 (2019) · U.S. Fish & Wildlife Service v. Sierra Club, Inc., 592 U.S. 261 (2021)
Secondary sources
- Department of Justice, Guide to the Freedom of Information Act (the government's own treatise; essential precisely because it is what agency counsel relies on)
- Harry A. Hammitt et al., Litigation Under the Federal Open Government Laws (the requester-side counterpart)
- Reporters Committee for Freedom of the Press, Open Government Guide (the standard fifty-state comparison of public records and open meetings laws)
- Office of Government Information Services annual reports and mediation case summaries
- Chief FOIA Officer reports and agency annual FOIA reports (backlog, median processing times, and exemption usage by agency — useful for setting expectations and for Open America argument)
- Antonin Scalia, The Freedom of Information Act Has No Clothes, Regulation (1982) (the classic skeptical critique, still the best statement of the case against)
Appendix A — Denial-Response Matrix
| Claimed basis | First questions | Best counterarguments |
|---|---|---|
| No responsive records | Which systems, custodians, and terms? Was email included? | Positive leads in the production; records schedules; parallel requests to other components |
| Not reasonably described | Did the request name custodians, dates, and terms? | Offer to confer and narrow; re-file with named documents from a prior release |
| Exemption 1 | Was classification proper and contemporaneous? | Official acknowledgment; segregability; Mandatory Declassification Review as a parallel track |
| Exemption 2 | Is this a human resources matter? | Milner; if relabeled 7(E), challenge the law enforcement purpose |
| Exemption 3 | Which statute, and does it cite § 552(b)(3)? | Read the statute; its scope is usually narrower than the citation implies |
| Exemption 4 | Is this the submitter's information or the agency's analysis? | Argus Leader requires actual private treatment; foreseeable harm under § 552(a)(8) |
| Exemption 5 | Predecisional or final? Working law? Age? | Sears (adopted reasoning); 25-year sunset; Klamath (outside consultants) |
| Exemption 6 / 7(C) | What agency conduct would release illuminate? | Frame the public interest as agency performance per Reporters Committee; redaction rather than withholding |
| Exemption 7(A) | Is the proceeding still pending? | Calendar a re-filing after closure; demand identification of the proceeding |
| Exemption 7(E) | Is the technique already public? | Public source evidence; law enforcement purpose threshold |
| Glomar | Has the agency officially acknowledged this? | Press releases, testimony, IG reports, court filings — specific, matching, official |
| Fee category | What are the dissemination facts? | News media is functional, not institutional; freelancers qualify |
| Fee waiver denial | Were all four factors argued? | Re-argue with dissemination specifics; appeal separately |
| Delay / backlog | Was a determination issued or only an acknowledgment? | Constructive exhaustion; fee prohibition; OGIS mediation; suit |
Appendix B — Federal FOIA Versus Typical State Regimes
| Federal FOIA | Typical state law | |
|---|---|---|
| Deadline | 20 business days, widely missed | 3–10 business days; some require prompt or immediate production of records on hand |
| Enforcement of deadline | Constructive exhaustion; fee prohibition | Deemed denial; some states impose personal penalties on officials |
| Fees | Category-based; search chargeable for some | Often duplication at cost only; search and review frequently not chargeable |
| Fee waiver | Four-factor public interest test | Varies; several states have no waiver mechanism |
| Exemptions | Nine, plus three exclusions | Frequently 50–200+ enumerated categories |
| Administrative appeal | Required before suit (or constructive exhaustion) | Often none; some states offer an ombudsman or AG opinion |
| Free non-judicial review | OGIS mediation (non-binding) | Public access counselor or AG opinion, sometimes binding |
| Attorney fees | Discretionary; catalyst theory restored in 2007 | Frequently mandatory for a prevailing requester |
| Personal liability | None | Civil penalties and, in some states, criminal liability for willful violation |
| Standing | Any person | A handful of states limit to citizens — upheld in McBurney v. Young |
| Open meetings | Sunshine Act, multi-member agencies only | Comprehensive; action taken in an improperly closed session may be void |
The practical takeaway. For police, schools, jails, utilities, zoning, elections, and local public health, go to the state statute first — it is usually faster, cheaper, and backed by mandatory fee shifting. Reserve FOIA for the subjects only the federal government has.
Related Documents
Articles
- Asking the Government for Its Own Documents: FOIA's Nine Exemptions and How They Are Used
- Blowing the Whistle: How a Civil War Statute Became the Government's Sharpest Fraud Weapon
- Qualified Immunity and the Clearly Established Right
Guides
- The Freedom of Information Act and State Public Records Laws: A Comprehensive Guide
- Administrative Law: A Comprehensive Guide to Rulemaking, Adjudication, and Judicial Review
- Government Contracts: A Comprehensive Guide to the FAR, Bid Protests, and Claims
- The False Claims Act: A Comprehensive Guide to Qui Tam Litigation and Government Fraud Enforcement
Checklists
- Filing a FOIA Request and Appealing a Denial: A Practical Checklist
- Bidding on a Federal Contract: A Compliance Checklist
- Filing a Qui Tam Complaint Under Seal: A Relator's Checklist
Toolkits