Skip to content

zirkular/halcyon

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

17 Commits
 
 
 
 
 
 
 
 

Repository files navigation

halcyon

A mythical bird said by ancient writers to breed in a nest floating at sea at the winter solstice, charming the wind and waves into calm.

Halcyon is a Twitter dataset processor, that builds an in-memory database of the dataset, runs specific analysis on it and exports certain data to GPU-friendly CSV files.

Usage

First, get the Rust compiler: https://www.rust-lang.org/tools/install. Then run the following command to build the executable.

git clone [email protected]:zirkular/halcyon.git
cd halcyon
cargo build

To run the application on a Twitter dataset using Cargo:

cargo run /path/to/twitter.csv

or by calling the executable directly:

halcyon /path/to/twitter.csv

Preprocessing

Halcyon can export the first N lines of an input file (helpful for development). It creates a file named <filename>.N, which results in filename.csv.1000:

halcyon filename.csv --export-raw 1000

Contact

## halcyon ##

  /\ \  
 / /\ \ 
/ /__\ \
\/____\/

https://zirkular.io
http://000.graphics

About

Halcyon tweet processor

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages