The CLiC Dickens project demonstrates through corpus stylistics how computer-assisted methods can be used to study literary texts and lead to new insights into how readers perceive fictional characters. As part of the project we are developing the web app CLiC, designed specifically for the analysis of literary texts. CLiC Dickens started at the University of Nottingham in 2013, it is now a collaborative project with the University of Birmingham.
CLiC code is divided into 2 halves, the python API server in server/ and the HTML/Javascript client in client/.
Documentation for CLiC is stored in docs/.
For more information, cf. CLiC Dickens - University of Birmingham.
The installation instructions below expect an apt based OS, e.g. Debian Stretch, Ubuntu Bionic or later.
First, configure your system to include the Yarn repository:
# See https://yarnpkg.com/lang/en/docs/install/ but the gist is... curl -sS https://dl.yarnpkg.com/debian/pubkey.gpg | sudo apt-key add - echo "deb https://dl.yarnpkg.com/debian/ stable main" | sudo tee /etc/apt/sources.list.d/yarn.list
...then the nodejs repository:
curl -s https://deb.nodesource.com/gpgkey/nodesource.gpg.key | apt-key add - echo "deb https://deb.nodesource.com/node_6.x xenial main" > /etc/apt/sources.list.d/nodesource.list apt-get update
Then install the following from your system repositories:
# Server prerequisites
sudo apt install \
postgresql postgresql-contrib \
python3 python3-venv python3-dev \
libicu-dev \
# NB: ICU needs to at least be version 56, postgresql at least version 9.5
# Client prerequisites
sudo apt install make nodejs yarn nginx
# If you require web traffic to be encrypted (read: production)
sudo apt install dehydrated ssl-cert
Clone this repository onto your computer, for example:
git clone git://github.com/birmingham-ccr/clic /srv/clic
Note that the directory name CLiC is cloned into is used for the systemd service name and NGINX configuration.
This allows multiple installations to live side-by-side, e.g. /srv/clic16 and /srv/clic17 will have systemd units clic16 and clic17 respectively.
All instructions assume you used clic, if something else is used you will have to substitute.
Before building, you need to set your configuration.
Local configuration is stored in local-conf.mk, the variables you can override are defined in conf.mk.
For development, defaults should be sufficient and you can ignore local-conf.mk, an empty file will be created.
For production, the following is a minimal example:
cat <<EOF > local-conf.mk PROJECT_MODE = production WWW_SERVER_NAME = clic.bham.ac.uk WWW_SERVER_ALIASES = another.dns.name yet.another.dns.name GA_KEY = UA-XXXXX-Y EOF
WWW_SERVER_NAME controls the DNS entry the web server responds to.
Download dependencies and compile both server/client by running:
make
Next, run install.sh as root. This script automates the following steps:
- Create the postgres schema, and ensure the user that will run the API can access it (in development this is the user you used to check out the project).
- Configure systemd to launch the UWSGI process running CLiC, and start it if in production mode.
- Create / update an NGINX site config to use CLiC, and get NGINX to reload the config.
Each step is performed by the relevant */install.sh script, and configured by make. Each can be inspected before running.
Run the install with the following:
sudo ./install.sh
At this point CLiC can run, but there will be no content in the database. CLiC content is stored in the corpora repository, to add this content do the following:
git clone git://github.com/birmingham-ccr/corpora corpora ./server/bin/import_corpora_repo corpora/*/*.txt
As of 2018, this process takes just under 3 hours.
At this point CLiC should be ready for use. For more detail on various topics, see the docs directory.
For production installations using dehydrated, at this point CLiC will be using an invalid cert. However, dehydrated will have been configured as part of the install. Run:
sudo /usr/bin/dehydrated -c
...to update the certs, then re-run sudo ./install.sh to reconfigure CLiC with the new certs.
You will also want to ensure dehydrated is run weekly, with a cron-job such as:
cat <<EOF > /etc/cron.weekly/dehydrated #!/bin/sh -e date >> /var/log/dehydrated.log /usr/bin/dehydrated -c >> /var/log/dehydrated.log 2>> /var/log/dehydrated.log systemctl reload nginx EOF chmod a+x /etc/cron.weekly/dehydrated
This work was supported by the Arts and Humanities Research Council grant reference AH/K005146/1
Please reference CLiC as the following:
Michaela Mahlberg, Peter Stockwell, Johan de Joode, Catherine Smith, Matthew Brook O’Donnell (forthcoming). “CLiC Dickens – Novel uses of concordances for the integration of corpus stylistics and cognitive poetics”, Corpora
This work is released under MIT.