huviz

Installation

# Install huviz from github
git clone https://github.com/smurp/huviz.git

Installation (for running orlandoScrape.py)

# On OSX Mavericks install homebrew
http://crosstown.coolestguidesontheplanet.com/os-x/55


# If you want to run
# On OSX you should set up pyenv-virtualenv
https://github.com/yyuu/pyenv-virtualenv

# Make a virtualenv
pyenv virtualenv huvizenv

# use it
echo "PYENV_VERSION=huvizenv" > .python-version

# install the python requirements
pip install -r requirements.txt

Installation (for running the server)

# install NodeJS from https://nodejs.org
# known to work on NodeJS > 0.10.1

# in package.json comment libxmljs back in then do
npm install

Running the server during development

npm run dev

Running the server

npm start

Operating orlandoScrape.py

--limit 2
    limit the number of writers processed

Converting XML to Turtle (TTL)

./orlandoScrape.py --outfile data/test_20.ttl  --limit 20 -v

See data/test_20.ttl

Converting XML to NQuads

./orlandoScrape.py  --outfile data/test_1.nq   --limit 1

See data/test_q.nq

Converting XML to JSON

How to produce the full JSON output as orlando_all_entries_2013-03-04.json (the default behaviour):

./orlandoScrape.py --infile orlando_all_entries_2013-03-04.xml --outfile orlando_all_entries_2013-03-04.json  --regexes orlando2RDFregex4.txt

How to produce the poetess JSON output as orlando_poetesses_2013-02-12.json:

./orlandoScrape.py --infile orlando_poetesses_2013-02-12.xml --outfile orlando_poetesses_2013-02-12.json  --regexes orlando2RDFregex4.txt

How to produce orlando_timeline.json

egrep 'dateOf|standardName' orlando2RDFregex4.txt > orlando_timeline.regex
./orlandoScrape.py --infile orlando_all_entries_2013-03-04.xml --outfile orlando_timeline.json --regex orlando_timeline.regex -v

Running the Orlando timeline locally

git clone https://github.com/smurp/huviz
python -m SimpleHTTPServer
open http://localhost:8000/timeline.html

Generating tag_tree.json

./extractOrlandoTagInfo.py --compact --outfile orlando_tag_tree.json