The Internet Archive discovers and captures web pages through many different web crawls.
At any given time several distinct crawls are running, some for months, and some every day or longer.
View the web archive through the Wayback Machine.
This collaborative project is an extension of the 2016 End of Term project, intended to document the federal government's web presence by archiving government websites and data. As part of this preservation effort, URLs supplied from partner institutions, as well as nominated by the public, will be crawled regularly to provide an on-going view of federal agencies' web and social media presence. Key partners on this effort are the Environmental Data & Governance Initiative and the Data Refuge project. This collection is a continuation of the 2016 End of Term web archiving and, as such, is deduplicated against that collection. It allows for the ongoing archiving of publicly nominated websites beyond the "official" end of the End of Term project.
Interested members of the public, particularly government information specialists, are invited to submit selected web sites to be included in the collection using the public nomination tool.
For more information on partner institutions, web crawling and past End of Term projects, please visit the End of Term Archive.
TIMESTAMPS
The Wayback Machine - https://web.archive.org/web/20170519024459/https://github.com/filedescriptor
