Showing 60 open source projects for "deduplication"

View related business solutions
  • Outgrown Windows Task Scheduler? Icon
    Outgrown Windows Task Scheduler?

    Free diagnostic identifies where your workflow is breaking down—with instant analysis of your scheduling environment.

    Windows Task Scheduler wasn't built for complex, cross-platform automation. Get a free diagnostic that shows exactly where things are failing and provides remediation recommendations. Interactive HTML report delivered in minutes.
    Download Free Tool
  • Our Free Plans just got better! | Auth0 Icon
    Our Free Plans just got better! | Auth0

    With up to 25k MAUs and unlimited Okta connections, our Free Plan lets you focus on what you do best—building great apps.

    You asked, we delivered! Auth0 is excited to expand our Free and Paid plans to include more options so you can focus on building, deploying, and scaling applications without having to worry about your security. Auth0 now, thank yourself later.
    Try free now
  • 1
    XSIBackup-DC

    XSIBackup-DC

    VMWare ESXi Virtual Machine Backup, runs in free ESXi

    ©XSIBackup-DC is a C binary that runs in the ©ESXi shell and behaves as a backup and replica service. It follows the same principles as our previous ©XSIBackup editions, that is: a utility that runs in the hypervisor command line and accepts arguments and values stating which VMs to backup and where to copy them. It accepts local and remote SSH paths, thus you can backup and replicate VMs to local datastores or to remote repositories in any additional ©ESXi or Linux server. Download...
    Downloads: 1 This Week
    Last Update:
    See Project
  • 2
    graphql-react

    graphql-react

    A GraphQL client for React using modern context and hooks APIs

    graphql-react is a lightweight GraphQL client for React that emphasizes efficiency and simplicity. It provides built-in caching, request deduplication, and declarative data fetching without the complexity of larger GraphQL clients.
    Downloads: 1 This Week
    Last Update:
    See Project
  • 3
    XSIBackup-Classic

    XSIBackup-Classic

    Local and over IP backups for ©VMWare ©ESXi 5.1 to 6.7

    ...Consists in a cron programmable service running in the hypervisor. Hot backups, fully functional, standalone, ideal for dedicated servers. Full version supports quiescing, differential backup, deduplication and much more... Download link: https://33hops.com/xsibackup-vmware-esxi-backup.html Free VMWare backup solution for the ESXi hypervisor. Linux style command line tool. Crontab with configurable disk space autoprovision, set the room you want to reserve for your backups and rotate them. Full backups may be done with vmkfstools or by means of Rsync and its Delta algorithm (read: https://33hops.com/blog_xsibackup-rsync-considerations.html), to a local datastore or over TCP/IP tunneled through SSH, so any transfer over IP is secure.
    Downloads: 0 This Week
    Last Update:
    See Project
  • 4

    wadmerge

    Merges WAD files for Doom engine games.

    ...Takes any number of input wads, and produces a sorted single output .WAD file. Runs on Linux and Windows, does not duplicate wad entries and allows space saving with an optional 'deduplication' method, where different entries which have the same data, only have the data stored once.
    Downloads: 0 This Week
    Last Update:
    See Project
  • Enterprise-grade ITSM, for every business Icon
    Enterprise-grade ITSM, for every business

    Give your IT, operations, and business teams the ability to deliver exceptional services—without the complexity.

    Freshservice is an intuitive, AI-powered platform that helps IT, operations, and business teams deliver exceptional service without the usual complexity. Automate repetitive tasks, resolve issues faster, and provide seamless support across the organization. From managing incidents and assets to driving smarter decisions, Freshservice makes it easy to stay efficient and scale with confidence.
    Try it Free
  • 5

    zsfx

    zpaqfranz/zpaq SFX module for Windows 32 and 64 bit

    Convert zpaq archive (full features) to self extraction (SFX) executable for Windows 32/64 bit Now embedded in zpaqfranz (for Windows) https://sourceforge.net/projects/zpaqfranz
    Downloads: 0 This Week
    Last Update:
    See Project
  • 6
    This is a simple BASH script which will backup source directories to a destination target, such as a mounted NFS share. It will create a full directory structure matching the source, but only use disk space for new/changed files. This is done by linking existing files. Essentially, it backs up like an incremental backup, and consumes space like an incremental backup, but restores like a full backup.
    Downloads: 0 This Week
    Last Update:
    See Project
  • 7
    Open Source Data Quality and Profiling

    Open Source Data Quality and Profiling

    World's first open source data quality & data preparation project

    This project is dedicated to open source data quality and data preparation solutions. Data Quality includes profiling, filtering, governance, similarity check, data enrichment alteration, real time alerting, basket analysis, bubble chart Warehouse validation, single customer view etc. defined by Strategy. This tool is developing high performance integrated data management platform which will seamlessly do Data Integration, Data Profiling, Data Quality, Data Preparation, Dummy Data...
    Downloads: 4 This Week
    Last Update:
    See Project
  • 8
    BackupPC

    BackupPC

    BackupPC is a high-performance, enterprise-grade system

    BackupPC is a high-performance, enterprise-grade system for backing up Linux, Windows, and macOS systems to a central server using rsync, tar, SMB, or FTP. It uses hard-linking and compression to efficiently store multiple backups of the same files and offers a web interface for administration and restore. BackupPC is suitable for environments where centralized, disk-based backups are needed.
    Downloads: 0 This Week
    Last Update:
    See Project
  • 9
    UrBackup

    UrBackup

    Open Source Client/Server Network Backup System

    Efficient Client-Server Backup system for Linux, macOS and Windows. A client for Windows, FreeBSD and Linux lets you backup open files and complete partition images (Windows). Backups are stored to disks in a efficient way (deduplication) on either Windows or Linux servers.
    Downloads: 13 This Week
    Last Update:
    See Project
  • Desktop and Mobile Device Management Software Icon
    Desktop and Mobile Device Management Software

    It's a modern take on desktop management that can be scaled as per organizational needs.

    Desktop Central is a unified endpoint management (UEM) solution that helps in managing servers, laptops, desktops, smartphones, and tablets from a central location.
    Learn More
  • 10

    KonDB

    Organizer for your Kontakt files

    - Easily Organize, Sort Through, and Load your Kontakt NKI/NKM Files in Windows - This project was built to satisfy a need to have a separate app to manage a large Kontakt files collection. - This app does not delete/move/rename/etc. your files, but it will make management of your files a lot easier. Getting Started: Drag-and-drop files/folders into this app from your computer at any time to add to your index. If you drag in the same file(s) twice, it won't be re-added. Drag-and-drop...
    Downloads: 0 This Week
    Last Update:
    See Project
  • 11

    PRIMAL_RAD

    DICOM tag modification and routing tool

    PRIMAL can be used to route, modify and store DICOM Radiology image files. Typically this tool is put between a image acquisition station (modality) and a PACS to route images and modify the DICOM tags in ways that are not easy to do on the acquisition station but needs to be done prior to the study arriving at the PACS. PRIMAL is designed to turn a Fedora or Redhat Linux server into a DICOM routing appliance. Most information can be viewed through the web interface. Commercial...
    Downloads: 1 This Week
    Last Update:
    See Project
  • 12

    tbackup2

    Backup tool

    Backup files using rsync and deduplication with hardlinks. Written in ruby.
    Downloads: 0 This Week
    Last Update:
    See Project
  • 13

    Offnet

    Program that saves complete web pages retaining multiple timestamps

    Offnet is an open source tool for mirroring web pages. It lets you manage several snapshots of web pages in order to retain the newest as well as some elder versions of a web page. It has also file based deduplication features to store content efficiently. The application comes with an integrated web server to navigate directly through your web browser. Project goals: - Web page downloads for less experienced users, including easy setup - Project based page maintanance - Not too plain functions that include also multiple snapshots per project - Iterative, understandable and storage efficient data structure to enable more manual control over stored pages (meta files editable with Easy Folder Morpher) - Retain archived files and query links as original, altering links only during query Current status: - Alpha stadium, archivation quality below Heritrix
    Downloads: 0 This Week
    Last Update:
    See Project
  • 14

    BinDiff

    Helper app for VMware .vmdk files differential backup

    This application is intended to make a diff files for the backup purposes. Imagine that you have a VM with 10GB vmdk file that you backup every day. So, you need to keep 100GB (let say 60GB with compression) for 10 days. However from those 10GB file only ~500MB is daily changed and you can shrink your backup storage to 15GB, if you keep only the daily difference. The BinDiff makes this job for you. Initially you make a full copy of vmfk file (let's say every month or two). That time you...
    Downloads: 1 This Week
    Last Update:
    See Project
  • 15
    RSMQ

    RSMQ

    Redis Simple Message Queue

    A lightweight Redis-backed message queue for handling simple distributed messaging and job processing.
    Downloads: 0 This Week
    Last Update:
    See Project
  • 16
    GraphQL multipart request specification

    GraphQL multipart request specification

    A spec for GraphQL multipart form requests (file uploads).

    An interoperable multipart form field structure for GraphQL requests, used by various file upload client/server implementations. An “operations object” is an Apollo GraphQL POST request (or array of requests if batching). An “operations path” is an object-path string to locate a file within an operations object.
    Downloads: 0 This Week
    Last Update:
    See Project
  • 17
    DataCleaner

    DataCleaner

    Data quality analysis, profiling, cleansing, duplicate detection +more

    DataCleaner is a data quality analysis application and a solution platform for DQ solutions. It's core is a strong data profiling engine, which is extensible and thereby adds data cleansing, transformations, enrichment, deduplication, matching and merging. Website: http://datacleaner.github.io
    Downloads: 16 This Week
    Last Update:
    See Project
  • 18
    ZipSnapNG

    ZipSnapNG

    Portable multi-platform backup tool with advanced features

    ZipSnapNG is a portable multi-platform backup tool which, despite its simplicity (200Kb and no installation required), provides advanced features such as incremental backup, data deduplication, encryption and configurable retention. It may run through the command line or within a graphical interface.
    Downloads: 0 This Week
    Last Update:
    See Project
  • 19
    New Server Setup
    New Server Setup was designed from the floor up to be a one stop solution for standardising, installing and configuring new server installs within an Educational Establishment. It has grown from a basic AD Structure import tool to be a comprehensive installer that covers many aspects and processes that need to be completed in a logical manner to achieve the highest quality result. This script takes the hassle out of having to manually create OU's, GPO’s and File Structures leaving you...
    Downloads: 0 This Week
    Last Update:
    See Project
  • 20
    cyphertite

    cyphertite

    Secure, encrypted, zero-knowledge online data backup.

    Introducing Cyphertite 2.0: An all new look and feel in Windows! Cyphertite is a tar-like secure remote archiver. It deduplicates, compresses, and encrypts data prior to transmission, providing total privacy while reducing unnecessary wire traffic. It seamlessly supports IPv6 and IPv4 on a variety of platforms.
    Downloads: 0 This Week
    Last Update:
    See Project
  • 21

    winpoolbackup

    Backup many PCs to one backup drive - without waste of backup space

    Requirements: cygwin+perl and "run as Administrator". This backup script copies every new source file on any drive to a "pool"-directory on the backup drive AND creates a hard link to MACHINENAME-YYYY-MM-DD--HH-MI-SS/cygdrive/... The SHA-256-ckecksum of each file to be copied is calculated, and this file is then copied to it's checksum name like pool/12/34/567890ABCDEF... Theoretically, there could occur a unwanted collision; in practice, this does not matter if you're want to...
    Downloads: 0 This Week
    Last Update:
    See Project
  • 22
    Lessfs is an userspace (fuse) inline data de-duplicating filesystem for Linux that includes support for lzo or QuickLZ compression and encryption.
    Downloads: 20 This Week
    Last Update:
    See Project
  • 23

    lsdup

    List files with duplicate contents

    lsdup, short for "list duplicates", is a command line tool which can assist in finding and removing files with identical contents. Unlike many file deduplication tools, this has a "comparison mode" which lets you tell lsdup to "only read the files in this directory, do not consider any for duplicates... but, the files in that other directory may have duplicates, so delete (or move) any of those." lsdup also has normal deduplication, where, if given a single directory, it will sort the originals from the duplicates. ...
    Downloads: 2 This Week
    Last Update:
    See Project
  • 24

    ZPAQ

    Archiver and compression library

    zpaq is a journaling archive for incremental backups with deduplication. Journaling means that the archive is append-only and you can revert to an earlier state to recover old versions of files. Compression is based on the open ZPAQ standard, a self-describing format that preserves compatibility as improved algorithms are developed. The default compression level is faster than zip with better compression.
    Downloads: 0 This Week
    Last Update:
    See Project
  • 25
    Data Deduplication in cloud computing
    Downloads: 0 This Week
    Last Update:
    See Project