snap/lib.rs
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 91 92 93 94 95 96 97 98 99 100 101 102 103 104 105 106 107 108 109
/*!
This crate provides an implementation of the
[Snappy compression format](https://github.com/google/snappy/blob/master/format_description.txt),
as well as the
[framing format](https://github.com/google/snappy/blob/master/framing_format.txt).
The goal of Snappy is to provide reasonable compression at high speed. On a
modern CPU, Snappy can compress data at about 300 MB/sec or more and can
decompress data at about 800 MB/sec or more.
# Install
To use this crate with
[Cargo](https://doc.rust-lang.org/cargo/),
simply add it as a dependency to your `Cargo.toml`:
```ignore
[dependencies]
snap = "1"
```
# Overview
This crate provides two ways to use Snappy. The first way is through the
[`read::FrameDecoder`](read/struct.FrameDecoder.html)
and
[`write::FrameEncoder`](write/struct.FrameEncoder.html)
types, which implement the `std::io::Read` and `std::io::Write` traits with the
Snappy frame format. Unless you have a specific reason to the contrary, you
should only use the Snappy frame format. Specifically, the Snappy frame format
permits streaming compression or decompression.
The second way is through the
[`raw::Decoder`](raw/struct.Decoder.html)
and
[`raw::Encoder`](raw/struct.Encoder.html)
types. These types provide lower level control to the raw Snappy format, and
don't support a streaming interface directly. You should only use these types
if you know you specifically need the Snappy raw format.
Finally, the `Error` type in this crate provides an exhaustive list of error
conditions that are probably useless in most circumstances. Therefore,
`From<snap::Error> for io::Error` is implemented in this crate, which will let
you automatically convert a Snappy error to an `std::io::Error` (when using
`?`) with an appropriate error message to display to an end user.
# Example: compress data on `stdin`
This program reads data from `stdin`, compresses it and emits it to `stdout`.
This example can be found in `examples/compress.rs`:
```no_run
use std::io;
fn main() {
let stdin = io::stdin();
let stdout = io::stdout();
let mut rdr = stdin.lock();
// Wrap the stdout writer in a Snappy writer.
let mut wtr = snap::write::FrameEncoder::new(stdout.lock());
io::copy(&mut rdr, &mut wtr).expect("I/O operation failed");
}
```
# Example: decompress data on `stdin`
This program reads data from `stdin`, decompresses it and emits it to `stdout`.
This example can be found in `examples/decompress.rs`:
```no_run
use std::io;
fn main() {
let stdin = io::stdin();
let stdout = io::stdout();
// Wrap the stdin reader in a Snappy reader.
let mut rdr = snap::read::FrameDecoder::new(stdin.lock());
let mut wtr = stdout.lock();
io::copy(&mut rdr, &mut wtr).expect("I/O operation failed");
}
```
*/
#![deny(missing_docs)]
#[cfg(test)]
doc_comment::doctest!("../README.md");
pub use crate::error::{Error, Result};
/// We don't permit compressing a block bigger than what can fit in a u32.
const MAX_INPUT_SIZE: u64 = std::u32::MAX as u64;
/// The maximum number of bytes that we process at once. A block is the unit
/// at which we scan for candidates for compression.
const MAX_BLOCK_SIZE: usize = 1 << 16;
mod bytes;
mod compress;
mod crc32;
mod crc32_table;
mod decompress;
mod error;
mod frame;
pub mod raw;
pub mod read;
mod tag;
pub mod write;