Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Looking for software for delta compression #106

Open
christophgil opened this issue Jun 3, 2023 · 1 comment
Open

Looking for software for delta compression #106

christophgil opened this issue Jun 3, 2023 · 1 comment

Comments

@christophgil
Copy link

Hi Lemire,

I found your software when searching for a solution regarding large binary data.

We are using files with an unpublished proprietory file format.
With hexdump I noticed that it belongs of long data blocks which could efficiently compressed with
delta-compression techniques. It is 4 bytes each. Longs or floats (mantissa+exp) I do not know yet.

Do you know of a compression programs that could compress such file. It would need to identify these block positions
automatically. Could this be done with FastPFor?

Many thanks

Christoph

@lemire
Copy link
Member

lemire commented Jun 5, 2023

We do have delta compression routines in FastPFor, yes.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants