Skip to content
Youngwoo Kim edited this page Jun 14, 2017 · 36 revisions

Ambari https://issues.apache.org/jira/browse/AMBARI-19429

https://dataworkssummit.com/san-jose-2017/sessions/leveraging-docker-for-hadoop-build-automation-and-big-data-stack-provisioning/

http://events.linuxfoundation.org/sites/events/files/slides/Leveraging%20Docker%20for%20Hadoop%20Build%20Automation%20and%20Big%20Data%20Stack%20Provisioning.pdf

git format-patch HEAD^..HEAD --stdout > BIGTOP-1031.patch
docker run -ti --rm -v `pwd`:/bigtop bigtop/slaves:trunk-centos-7 bash -l

docker run -ti --rm -v `pwd`:/bigtop bigtop/slaves:trunk-ubuntu-16.04 bash -l

-- user namesapce
docker run -ti --rm -u jenkins -v `pwd`:/bigtop bigtop/slaves:trunk-centos-7 bash -l

CentOS 7:

yum update -y java\*
keytool -import -alias hynix -keystore  /usr/lib/jvm/java-1.8.0/jre/lib/security/cacerts -file /bigtop/sslproxy.crt

BOM:

./gradlew -Dbomfile=metatron.bom zeppelin-clean zeppelin-rpm

http://blogs.aws.amazon.com/bigdata/post/TxNJ6YS4X6S59U/Building-and-Deploying-Custom-Applications-with-Apache-Bigtop-and-Amazon-EMR

Ansible roles and playbooks for Bigtop, https://issues.apache.org/jira/browse/BIGTOP-1584

package tests are for testing the correctness of the packages through the development cycle. They are usually pretty trivial and you can find the examples of those under bigtop-tests/test-artifacts/package/

Slaves:

FROM bigtop/slaves:trunk-centos-7

RUN yum install -y epel-release
RUN yum install -y R R-devel libcurl-devel openssl-devel
RUN yum clean all

docker build --no-cache --force-rm -t youngwookim/bigtop-slaves:centos-7 .
Clone this wiki locally