Open Source Python Archiving Software for Linux

ArchiveBox is a powerful, self-hosted internet archiving solution to collect, save, and view websites offline. Without active preservation effort, everything on the internet eventually disappears or degrades. Archive.org does a great job as a centralized service, but saved URLs have to be public, and they can't save every type of content. ArchiveBox is an open source tool that lets organizations & individuals archive both public & private web content while retaining control over their data. It can be used to save copies of bookmarks, preserve evidence for legal cases, backup photos from FB/Insta/Flickr or media from YT/Soundcloud/etc., save research papers, and more. ArchiveBox is an open-source, self-hosted web archiving tool for saving websites offline. It helps organizations and individuals preserve bookmarks, research papers, and social media content, among others.

Crunch is an image compression tool for lossy PNG image file optimization. Using a combination of selective bit depth, color palette reduction and color type, as well as zopfli DEFLATE compression algorithm encoding that employs the pngquant and zopflipng PNG optimization tools, Crunch is effectively able to optimize and compress images with minimal decrease in image quality. While it may produce file size gains larger than those produced by lossless approaches, the impact on image quality is often imperceptible, and optimized file sizes are still significantly lower than the original.

This project provides an open-source setup for IPFS Kubo (public and private pinning) combined with IPFS Cluster replication, designed for reliable, production-ready decentralized storage. It is suitable for developers, infrastructure operators, and Web3 projects that need predictable IPFS availability without maintaining complex node infrastructure. The system supports multiple retention plans for IPFS Kubo pinning, allowing users to choose how long data remains pinned, with transparent pay-per-GB prepaid pricing. Retention options include short-term and long-term storage, making it suitable for websites, datasets, backups, and distributed applications. For higher availability, IPFS Cluster replication is available with 1, 2, or 3 replicas, enabling redundancy across nodes and improved resilience against node failure. Bandwidth usage is tracked separately, with included allowances and predictable overage pricing.https://github.com/branislav1989/ipfs-kubo-private-public-ipfs-cluste

Metakit is an efficient database library with a small footprint. It's a cross between flat-file, RDBMS, and OODBMS. Keywords: structured storage, transacted, load on-demand, portable, C++, Python, Tcl, instant schema versioning.

A cloud backup solution that employs the "ChaCha20 + Serpent-256 CBC + HMAC-SHA3-512" authenticated encryption scheme for data encryption and ML-KEM-1024 for quantum-resistant key exchange. Check it out at https://plum-cave.netlify.app/ GitHub page: https://github.com/Northstrix/plum-cave

bKappa is a 2009 experiment in crude but transparent and cross-platform incremental backup. bKappa backups are simple directory trees and lists of files. They are easy to browse and examine and do not use symbolic or hard links. It is crude in the sense that bKappa only tracks files by name, not by content. This means it cannot detect that a file has been renamed and makes full copies of renamed and partially modified files. It generates standalone restore scripts for the POSIX shell and PowerShell. While it saw real use, bKappa isn't tested enough to be your main backup software. If you are looking for that, BorgBackup and restic are good options as of 2024. Warning! Old 1.x versions of bKappa are insecure. Do not use them. Because backup metadata is serialized with the "pickle" Python module (https://docs.python.org/2.7/library/pickle.html), a malicious backup can take over your machine.

Yet Another Rsync Rotator is a simple, rsync-based online backup tool, doing away with some of the existing tools' limitations that bug me most. It is usable but not feature-complete. Yarr!