Skip to content

Latest commit

 

History

History
66 lines (38 loc) · 1.25 KB

setup.rst

File metadata and controls

66 lines (38 loc) · 1.25 KB
Raw

Setup Test Environment

  1. Setup test ELK stack
docker run -p 5601:5601 -p 9200:9200 -p 5044:5044 -it --name elk sebp/elk

or

docker start elk
  1. Open Kibana at http://localhost:5601
  2. Download Spacy model if not already installed
python -m spacy download en_core_web_sm

  1. Install ArangoDB

    On OS X you can:

    brew install arangodb

    To start the server:

    /usr/local/Cellar/arangodb/3.4.4/sbin/arangod

  2. Open the ArangoDB client at http://localhost:8529

  3. Install Kafka

    On OS X you can:

    brew install kafka

  4. Start Zookeeper and Kafka:

    To have launchd start kafka now and restart at login:

    brew services start kafka

    Or, if you don't want/need a background service you can just run:

    zookeeper-server-start /usr/local/etc/kafka/zookeeper.properties & \
kafka-server-start /usr/local/etc/kafka/server.properties

Cleanup

  1. Cleanup Kafka topics

    kafka-topics --bootstrap-server localhost:9092 --delete --topic raw_logs
kafka-topics --bootstrap-server localhost:9092 --delete --topic parsed_logs
kafka-topics --bootstrap-server localhost:9092 --delete --topic log_keys