ResearchGate: Human-in-the-loop tabular data extraction methods for historical climate data rescue. “…we propose a human-in-the-loop workflow with benchmarks of open- and closed-source methods for extracting and processing handwritten tabular data. We explain through the case of climatological data from the Congo region (1907–1960) how HIL workflows can be implemented and their trade-offs […]

https://rbfirehose.com/2025/05/14/researchgate-human-in-the-loop-tabular-data-extraction-methods-for-historical-climate-data-rescue/

#politics #GovernmentData #DataRescue #BigData #activism

"As President Donald Trump's administration purges public records since storming back to power, experts and volunteers are preserving thousands of web pages and government sites devoted to climate change, health or LGBTQ rights and other issues."

https://www.ibtimes.com/web-archivists-scrambling-save-us-public-data-deletion-3772837

International Business Times: Web Archivists Scrambling To Save US Public Data From Deletion. “As President Donald Trump’s administration purges public records since storming back to power, experts and volunteers are preserving thousands of web pages and government sites devoted to climate change, health or LGBTQ rights and other issues.”

https://rbfirehose.com/2025/05/08/international-business-times-web-archivists-scrambling-to-save-us-public-data-from-deletion/

The Eagle (American University): American University librarians take up the mantle with government data rescue project. “A team of four librarians at American University is joining a nationwide effort to preserve removed or redacted data in a Government Information Data Rescue guide. Editors Jessica Breen, Gwendolyn Reece, Olivia Ivey and Sarah Gilchrist each bring their own expertise to the […]

https://rbfirehose.com/2025/05/02/the-eagle-american-university-librarians-take-up-the-mantle-with-government-data-rescue-project/

#politics #nonprofits #DataRescue

"What happens when a nonprofit program or an entire organization needs to shut down? The communities being served, and often society as a whole, are the losers. What if it were possible to mitigate some of that damage by sharing valuable intellectual property assets of the closing effort for longer term benefit? Organizations in these tough circumstances must give serious thought to a responsible exit for their intangible assets."

https://ssir.org/articles/entry/closing-nonprofits-exit-to-open#

Stanford Social Innovation Review: Exit to Open. “What happens when a nonprofit program or an entire organization needs to shut down? The communities being served, and often society as a whole, are the losers. What if it were possible to mitigate some of that damage by sharing valuable intellectual property assets of the closing effort for longer term benefit? Organizations in these tough […]

https://rbfirehose.com/2025/04/28/stanford-social-innovation-review-exit-to-open/

Data Rescue Project: ERICA to the Rescue!. “Several volunteers and partners of the Data Rescue Project (DRP) have been working tirelessly for the last few weeks to back up the ERIC catalog and full-text PDFs. A DRP volunteer going by the username of crizzo has single-handedly submitted the links to 500,000 PDFs to the Internet Archive’s Wayback Machine. To ensure continued access to the […]

https://rbfirehose.com/2025/04/28/data-rescue-project-erica-to-the-rescue/

#politics #DataRescue #education #ERIC

'Several volunteers and partners of the Data Rescue Project (DRP) have been working tirelessly for the last few weeks to back up the ERIC catalog and full-text PDFs. A DRP volunteer going by the username of crizzo has single-handedly submitted the links to 500,000 PDFs to the Internet Archive’s Wayback Machine.'

https://www.datarescueproject.org/erica-to-the-rescue/

National Press Foundation: Data Helps Tell Education Stories, and Journalists Need to Find the Best Sources. “Rachel Rush-Marlowe, the founder and executive director of the education policy think tank ResearchEd and a former Education Department employee, spoke with NPF’s Widening the Pipeline fellows about how to access education data and accurately represent what the statistics […]

https://rbfirehose.com/2025/04/15/national-press-foundation-data-helps-tell-education-stories-and-journalists-need-to-find-the-best-sources/

From the Data Rescue Project: the Data Rescue Tracker. “The Data Rescue Tracker is a collaborative tool built to catalog existing public data rescue efforts so that we can coordinate better across initiatives. At this stage, you can use the tool to help reduce duplication of rescue efforts. The Data Rescue Tracker aims to provide a consolidated overview of who is backing up which dataset from […]

https://rbfirehose.com/2025/04/13/the-data-rescue-tracker/

NOAA’s Oceanic & Atmospheric Research office was the office we were concerned about last week. The various #DataRescue groups are coordinating as much as possible, but remember there is only so much we can do. Call your representatives and tell them you don't want this to happen. Make some noise.

RE: https://bsky.app/profile/did:plc:dzezcmpb3fhcpns4n4xm4ur5/post/3lmkhuqm3wk2u

Thanks to a paper by @ztirfhtor I came across a comprehensive list of #DataRescue initiatives compiled by @datarescueproject.org

https://www.datarescueproject.org/current-efforts/

Today, we added more PubMed and NCBI stuff from NIH:

https://git.lsit.ucsb.edu/publicdata/nih-gov

Today I noticed a heck of a lot of 404's when I was fetching #pubmed data. Seems there was a thorough gutting there this week. Links to articles are still there but the articles themselves are going missing en masse. I'm going to continue to grab and post what I can here:

https://git.lsit.ucsb.edu/publicdata/nih-gov

Just published a sizable update to NIH archives, including among other things a bunch of pubmed article and book data.

https://git.lsit.ucsb.edu/publicdata/nih-gov

More coming soon!

Today we published a sizable update to the Social Security Administration public archive. (Please note that the layout of the repo has changed to accommodate other subdomains of the SSA.)

https://git.lsit.ucsb.edu/publicdata/ssa-gov

More on the way soon!

If you work(ed) in federal government and know of some public websites or data that is likely to be taken down sooner than later, I would appreciate knowing about it so we can prioritize archiving it.

We still have a bunch more on the way, but we prioritize requests and tips over my own inklings.

Installed and started the ArchiveTeam Warrior. Very smooth experience.

It downloads stuff and puts it into the Internet Archive.

I took the "ArchiveTeam’s Choice" project and it chose public telegram channels. It's not taking a lot of bandwidth or memory or space or computing, as far as I can tell. It might take too much of my time and focus if I continue staring at the dashboard to try and figure out what all that stuff is.

http://warrior.archiveteam.org/

@internetarchive

For those of you who work with US federal government data or rely on US government websites as resources, check out the Data Rescue Project (https://www.datarescueproject.org/) and the End of Term Archive (https://eotarchive.org/)! Both archive US government data or website content and provide it free of charge to anyone. 1/3