[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

Re: Data Compression



> 
> Hello,
> 
>    A week or so ago, somebody on this list was talkign about needing fast
> data compression - I think, in regard to the FAA flight data CD-ROM. 
> Comment was made that Gzip was too slow, and faster results were obtained
> with a compression library.
> 
Snip, or lossy compressed as the case may be ;-).
> 
>    This approach has two main advantages:  first, you never have to store
> the complete uncompressed file anywhere!  Each packet ( or sector, or
> read()) can be compressed as it comes in.  Which can save your computer
> from going into swap.  Second, the time spent compressing is partially
> ( or maybe wholly ) subsumed into the I/O time.  In other words, the
> computer can be compressing while the network is networking, or the disk
> is disking :-).
> 
The Lzo library I mentioned before must work in a similar manner.
I supposedly takes no memory to decompress the files.
De-Compression runs in a realtime streaming mode the way I understand it.

There are Perl and Java libs as well unless I'm mistaken.

Marc

-
Archives of linux-aviation: http://mail.nl.linux.org/lists/linux-aviation/
To unsubscribe: send the command "unsubscribe linux-aviation" in the body
of a mail message to <Majordomo@mail.nl.linux.org>.