Safe Haskell	None
Language	Haskell98

Data.Avro

Contents

Some(!) complex types.

Synopsis

Documentation

(.=) :: ToJSON a => String -> a -> (Text, Value) Source

Support for Avro. Current status is that we can generate schemas for certain Haskell values, serialize to binary and JSON representations, and write Container files using the null codec. The C implementation likes some, but not all of these containers; it's unclear if that's the fault of the C implementation, though.

Meanwhile, serialization works for nested sums-of-products, as long as the product uses record syntax and the top level is a plain record. The obvious primitives are supported.

string :: String -> Value Source

class Avro a where Source

This is the class of types we can embed into the Avro infrastructure. Right now, we can derive a schema, encode to the Avro binary format, and encode to the Avro JSON encoding.

Methods

toSchema :: a -> MkSchema Value Source

Produces the schema for this type. Schemas are represented as JSON values. The monad is used to keep a table of already defined types, so the schema can refer to them by name. (The concrete argument serves to specify the type, it is not actually used.)

toBin :: a -> Builder Source

Serializes a value to the binary representation. The schema is implied, serialization to related schemas is not supported.

fromBin :: Get a Source

Deserializzes a value from binary representation. Right now, no attempt at schema matching is done, the schema must match the expected one exactly.

toAvron :: a -> Value Source

Serializes a value to the JSON representation. Note that even the JSON format needs a schema for successful deserialization, and here we support only the one implied schema.

Instances

Avro Bool Source
Avro Double Source
Avro Float Source
Avro Int Source
Avro Int64 Source
Avro () Source	The Avro "null" type is represented as the empty tuple.
Avro ByteString Source
Avro Text Source
Avro GenoCallSite Source
Avro GenoCallBlock Source
Avro a => Avro [a] Source	A list becomes an Avro array The chunked encoding for lists may come in handy. How to select the chunk size is not obvious, though.
Avro a => Avro (Vector a) Source	A generic vector becomes an Avro array
(Avro a, Unbox a) => Avro (Vector a) Source	An unboxed vector becomes an Avro array
Avro a => Avro (HashMap Text a) Source	A map from Text becomes an Avro map.

newtype MkSchema a Source

Constructors

MkSchema
Fields mkSchema :: (a -> HashMap Text Value -> Value) -> HashMap Text Value -> Value

Instances

Monad MkSchema Source
Functor MkSchema Source
Applicative MkSchema Source

memoObject :: String -> [(Text, Value)] -> MkSchema Value Source

runMkSchema :: MkSchema Value -> Value Source

wordToFloat :: Word32 -> Float Source

wordToDouble :: Word64 -> Double Source

floatToWord :: Float -> Word32 Source

doubleToWord :: Double -> Word64 Source

cast :: (MArray (STUArray s) b (ST s), MArray (STUArray s) a (ST s)) => a -> ST s b Source

zig :: (Storable a, Bits a) => a -> a Source

Implements Zig-Zag-Coding like in Protocol Buffers and Avro.

zag :: (Storable a, Bits a, Num a) => a -> a Source

Reverses Zig-Zag-Coding like in Protocol Buffers and Avro.

encodeWordBase128 :: (Integral a, Bits a) => a -> Builder Source

Encodes a word of any size using a variable length "base 128" encoding.

decodeWordBase128 :: (Integral a, Bits a) => Get a Source

encodeIntBase128 :: (Integral a, Bits a, Storable a) => a -> Builder Source

Encodes an int of any size by combining the zig-zag coding with the base 128 encoding.

decodeIntBase128 :: (Integral a, Bits a, Storable a) => Get a Source

Decodes an int of any size by combining the zig-zag decoding with the base 128 decoding.

zigInt :: Int -> Builder Source

zagInt :: Get Int Source

Some(!) complex types.

deriveAvros :: [Name] -> Q [Dec] Source

deriveAvro :: Name -> Q [Dec] Source

data ContainerOpts Source

Constructors

ContainerOpts
Fields objects_per_block :: Int filetype_label :: ByteString

writeAvroContainer :: (MonadIO m, Nullable s, ListLike s a, Avro a) => ContainerOpts -> Enumeratee s ByteString m r Source

readAvroContainer :: (Monad m, ListLike s a, Avro a) => Enumeratee ByteString s m r Source

iterLoop :: (Nullable s, Monad m) => (a -> Iteratee s m a) -> a -> Iteratee s m a Source

Repeatedly apply an Iteratee to a value until end of stream. Returns the final value.

iterGet :: Monad m => Get a -> Iteratee ByteString m a Source