hwk: Commandline text processing with Haskell functions

This is a package candidate release! Here you can preview how this package release will appear once published to the main package index (which can be accomplished via the 'maintain' link below). Please note that once a package has been published to the main package index it cannot be undone! Please consult the package uploading documentation for more information.

[maintain] [Publish]

A commandline tool for text processing with Haskell functions, complementing unix-style tools like awk, grep, and sed. hwk applies the function supplied on the commandline using hint to lines of input and outputs the results.


[Skip to Readme]

Properties

Versions 0.2.0, 0.3, 0.4, 0.5, 0.6, 0.6
Change log ChangeLog.md
Dependencies base (<5), directory (>=1.2.3.0), extra, filepath, hint (>=0.8.0), simple-cmd-args (>=0.1.2) [details]
License MIT
Copyright 2016-2017 Lukas Martinelli, 2020-2021 Jens Petersen
Author Lukas Martinelli
Maintainer Jens Petersen <juhpetersen@gmail.com>
Category Development
Home page https://github.com/juhp/hwk
Source repo head: git clone https://github.com/juhp/hwk.git
Uploaded by JensPetersen at 2021-06-14T07:07:46Z

Downloads

Maintainer's Corner

Package maintainers

For package maintainers and hackage trustees


Readme for hwk-0.6

[back to package description]

hwk MIT licensed

hwk (pronounced "hawk") is a simple Haskell-based commandline text processing tool, somewhat similar to tools like awk, grep, sed. hwk applies composed pure Haskell functions to a list of lines of input, enabling text processing without having to remember an obscure DSL or awkward cli options. This tool can also help to encourage people to think functionally.

[hawk image]

hwk was originally written by Lukas Martinelli in 2016-2017: see the original README file.

hwk is pretty similar to Hawk, so you may also want to try that for a different more sophisticated monadic implementation. Some of main differences are:

Examples

Some simple use-cases are in the examples directory.

Change and append a string to each line:

$ seq 0 2 | hwk --line '(++ ".txt") . show . (+1) . int'
1.txt
2.txt
3.txt

or without line-mode: hwk 'map ((++ ".txt") . show . (+1) . int)'.

Sum all negative numbers:

$ seq -100 100 | hwk 'sum . filter (< 0) . ints'
-5050

The ints function transforms a list of strings into a list of ints

Factorials in your shell scripts!:

$ seq 10 12 | hwk --line 'let {fact 0 = 1; fact n = n * fact (n - 1)} in fact . int'
3628800
39916800
479001600

Extract data from a file:

$ cat /etc/passwd | hwk -l 'reverse . filter (/= "x") . take 3 . splitOn ":"' | head -3
0 root
1 bin
2 daemon

(uses splitOn from the extra library; -l is the short form of --line).

The argument passed to hwk must be a valid Haskell function: a function that takes a list of strings and returns a new list or a single value.

Check whether the input contains a certain string:

$ cat /etc/passwd | hwk --all 'bool "no" "yes" . isInfixOf "1000"'
yes

You can also type-check functions:

$ hwk --typecheck take
Int -> [a] -> [a]

or expressions:

$ hwk -t [1,2]
Num a => [a]

And evaluate expressions:

$ hwk -e '2 ^ 32 `div` 1024'
4194304

Run commands:

$ hwk --run getCurrentDirectory
/home/user/src

Configuration

hwk uses a Haskell configuration file ~/.config/hwk/Hwk.hs which provides the context for the hint evaluation of the supplied function. Hint (ghci) checks the current directory first when loading, so one can override the configuration on a directory basis.

The first time hwk is run it sets up ~/.config/hwk/Hwk.hs.

The default Hwk module configuration imports Prelude, Data.List, Data.Char, and System.FilePath into the hint interpreter.

You can add other modules to import to userModules or define your own functions to use in hwk expressions if you wish.

After a hwk version update you may need or wish to sync up your Hwk.hs file to take account of any new changes: a copy of the latest default Hwk.hs is also put in ~/.config/hwk/ with version suffix.

One can specify -c/--config-dir to load Hwk.hs from a different location.

Installation

Either use the install.sh script, or install by cabal-install or stack as described below:

install.sh script from source tree or git

Use stack unpack hwk or git clone https://github.com/juhp/hwk.

Then go to the source directory and run the install.sh script, which first runs stack install, then moves the binary installed by stack install to ~/.local/lib/hwk, and sets up a wrapper script ~/.local/bin/hwk which runs it.

If you wish you can change the resolver in stack.yaml first: it is also used to determine the resolver used by the created hwk wrapper script.

cabal

If you are on a Linux distro with a system installed ghc and Haskell libaries, you can install with cabal install to make use of them.

stack

Installing and running with stack is better if you do not have a system ghc and/or global system Haskell libraries installed.

If you prefer not to use install.sh in the source dir, you can install by hand: run stack install, and then run it with stack exec hwk ... using the same resolver.

How does hwk work?

Note the equivalences:

Supported return types

The following return values are supported:

Contribute

Open an issue or pull request at https://github.com/juhp/hwk to report problems or make suggestions and contributions.

Usage example contributions are also welcome.

Related/alternative projects