news.volyx.in

I only lost 10 minutes of data, thanks to ZFS (mastodon.social)

436 points by chromakode · 1099 days ago · 280 comments on HN

Article summary

The article is not available, but the discussion suggests that the author experienced a data loss of only 10 minutes due to the use of ZFS. The discussion focuses on the potential causes of the data loss and the benefits of using ZFS, including its snapshotting capabilities. ZFS's copy-on-write mechanism is highlighted as a key feature that allows for efficient snapshotting. The conversation also touches on the potential wear and tear on SSDs due to frequent snapshotting.

Main themes

  • ZFS snapshotting
  • SSD wear and tear
  • Database corruption
  • Filesystem performance
  • Data integrity and recovery
  • Backup strategies

What commenters say

  • Frequent snapshotting with ZFS is unlikely to cause significant wear on SSDs due to its copy-on-write mechanism.
  • The overhead of snapshotting with ZFS is relatively low, making it a viable option for frequent backups.
  • Some commenters argue that snapshotting a running database can lead to corruption, while others claim that ZFS's atomic snapshots can prevent this issue.
  • The use of ZFS can provide significant benefits, including easy data integrity verification and recovery, but may come at the cost of reduced performance in certain use cases.
  • The discussion suggests that the actual cause of the data loss is unclear, and that snapshotting may not have been a significant contributing factor.
  • Some commenters believe that the write endurance of SSDs is not a significant concern, even with frequent snapshotting, while others argue that it could be a potential issue.
  • The trade-offs between using ZFS and other filesystems, such as ext4, are discussed, with some arguing that ZFS is a clear win for durable storage, but not for ephemeral storage.