ArchiveBox is evolving: the future of self-hosted internet archives (docs.sweeting.me)

Article summary

The article discusses the evolution of ArchiveBox, a self-hosted internet archiving tool, and its future developments. The comments reveal that the tool has had issues with site compatibility and security, but the developer is working to address these concerns. The discussion also touches on the importance of private and secure archiving, as well as the challenges of achieving this. The tool is gearing up to support cryptographic signing of archives and distributed archiving.

Main themes

• Internet Archiving
• Self-Hosted Solutions
• Security and Privacy
• Distributed Archiving
• Web Preservation
• Data Integrity

What commenters say

• ArchiveBox has had issues with site compatibility and security, but the developer is working to address these concerns.
• The default settings of ArchiveBox should prioritize privacy and security, rather than sending data to archive.org by default.
• Achieving private and secure archiving is challenging due to the potential for reflected session cookies, usernames, and PII to be captured.
• The use of cryptographic signing of archives, such as with TLSNotary, can provide a solution to the problem of ensuring data integrity and authenticity.
• Some commenters argue that the focus on cryptographic signing is a nice-to-have feature, and that the primary concern should be maximizing data download and scale.
• Others see the importance of ensuring data integrity and authenticity, particularly in the context of a potential future where data manipulation and censorship are prevalent.
• There are trade-offs to be made in archiving, including the choice between browser-based archiving and proxy-based archiving, each with their own limitations and advantages.
• The development of ArchiveBox is seen as a step towards a distributed and federated archiving system, which could provide a more resilient and decentralized solution for web preservation.