points by toomuchtodo 3 days ago

Great docs. If you want to create WARC files for archival purposes [1], wget supports doing so natively [2]. grab-site automates this [3].

[1] https://en.wikipedia.org/wiki/WARC_(file_format)

[2] https://wiki.archiveteam.org/index.php/Wget_with_WARC_output

[3] https://github.com/ArchiveTeam/grab-site