broken download links (Yosemite Mac OS X): zookeeper?

[abitofalchemy]

the files CMakeList.txt points to download files that aren't not the right size.
after: ./configure and 'make' in folder debug/toolkits/graph_analytics/ I initially get:
[ 45%] No install step for 'boost'
[ 45%] Completed 'boost'
[ 45%] Built target boost
make: *** [all] Error 2

if I type make again to get more specific details:
[ 29%] Performing build step for 'zookeeper'
libtool: compile: gcc -DHAVE_CONFIG_H -I. -I./include -I./tests -I./generated -Wall -Werror -g -O2 -D_GNU_SOURCE -MT zookeeper.lo -MD -MP -MF .deps/zookeeper.Tpo -c src/zookeeper.c -o zookeeper.o
In file included from src/zookeeper.c:27:
In file included from ./include/zookeeper.h:34:
./include/recordio.h:76:9: error: expected ')'
int64_t htonll(int64_t v);
^
/usr/include/sys/_endian.h:141:25: note: expanded from macro 'htonll'

define htonll(x) __DARWIN_OSSwapInt64(x)

                    ^

/usr/include/libkern/_OSByteOrder.h:78:30: note: expanded from macro '__DARWIN_OSSwapInt64'
(__builtin_constant_p(x) ? __DARWIN_OSSwapConstInt64(x) : _OSSwapInt64(x))
^
./include/recordio.h:76:9: note: to match this '('
/usr/include/sys/_endian.h:141:25: note: expanded from macro 'htonll'

define htonll(x) __DARWIN_OSSwapInt64(x)

                    ^

/usr/include/libkern/_OSByteOrder.h:78:5: note: expanded from macro '__DARWIN_OSSwapInt64'
(__builtin_constant_p(x) ? __DARWIN_OSSwapConstInt64(x) : _OSSwapInt64(x))
^
In file included from src/zookeeper.c:27:
In file included from ./include/zookeeper.h:34:
./include/recordio.h:76:9: error: conflicting types for '__builtin_constant_p'
int64_t htonll(int64_t v);
^
/usr/include/sys/_endian.h:141:25: note: expanded from macro 'htonll'

define htonll(x) __DARWIN_OSSwapInt64(x)

                    ^

/usr/include/libkern/_OSByteOrder.h:78:6: note: expanded from macro '__DARWIN_OSSwapInt64'
(__builtin_constant_p(x) ? __DARWIN_OSSwapConstInt64(x) : _OSSwapInt64(x))
^
./include/recordio.h:76:9: note: '__builtin_constant_p' is a builtin with type 'int ()'
/usr/include/sys/_endian.h:141:25: note: expanded from macro 'htonll'

define htonll(x) __DARWIN_OSSwapInt64(x)

                    ^

/usr/include/libkern/_OSByteOrder.h:78:6: note: expanded from macro '__DARWIN_OSSwapInt64'
(__builtin_constant_p(x) ? __DARWIN_OSSwapConstInt64(x) : _OSSwapInt64(x))
^
2 errors generated.
make[5]: *** [zookeeper.lo] Error 1
make[4]: *** [all] Error 2
make[3]: *** [all] Error 2
make[2]: *** [../deps/zookeeper/src/zookeeper-stamp/zookeeper-build] Error 2
make[1]: *** [CMakeFiles/zookeeper.dir/all] Error 2
make: *** [all] Error 2

[intoraw]

It seems boost compile failed.
I came across the same problem, and find that cmake downloaded a 4KB boost_1_53_0.tar.gz file.
Update boost download link in CMakeLists.txt to
URL "http://tcpdiag.dl.sourceforge.net/project/boost/boost/1.53.0/boost_1_53_0.tar.gz"
may fix this issue.

[abitofalchemy]

I tried the above and fixed the problem in zookeeper by applying the patch listed here

[yusong-shen]

Hi abitofalchemy . I came across the same problem. So how do you applying the patch to fix zookeeper? Could you explain a little bit more?
Thanks very much!
@zorksylar

[yusong-shen]

Never mind, I manage to figure it out. Since zookeeper 3.4.6 has some problems in Mac Yosemite, I just change the CmakeLists.txt on powerGraph root folder's zookeeper url to the newest version.
older one is :

ExternalProject_Add(zookeeper
PREFIX ${GraphLab_SOURCE_DIR}/deps/zookeeper
URL http://apache.cs.utah.edu/zookeeper/zookeeper-3.4.6/zookeeper-3.4.6.tar.gz
URL_MD5 971c379ba65714fd25dc5fe8f14e9ad1
PATCH_COMMAND ${CMAKE_COMMAND} -E copy_directory ${GraphLab_SOURCE_DIR}/patches/zookeeper/ <SOURCE_DIR>
BUILD_IN_SOURCE 1
CONFIGURE_COMMAND ./configure --prefix=<INSTALL_DIR> --disable-shared
INSTALL_DIR ${GraphLab_SOURCE_DIR}/deps/local)

New one is :

ExternalProject_Add(zookeeper
PREFIX ${GraphLab_SOURCE_DIR}/deps/zookeeper
URL http://mirror.metrocast.net/apache/zookeeper/zookeeper-3.5.1-alpha/zookeeper-3.5.1-alpha.tar.gz
URL_MD5 d85f9751724d3f20f792803b61c4db24
PATCH_COMMAND ${CMAKE_COMMAND} -E copy_directory ${GraphLab_SOURCE_DIR}/patches/zookeeper/ <SOURCE_DIR>
BUILD_IN_SOURCE 1
CONFIGURE_COMMAND ./configure --prefix=<INSTALL_DIR> --disable-shared
INSTALL_DIR ${GraphLab_SOURCE_DIR}/deps/local)

[larryxiao]

@yusong-shen Thanks, the link works!
However I see

[  0%] Performing patch step for 'zookeeper'
cd graphlab/deps/zookeeper/src/zookeeper && cmake -E copy_directory graphlab/patches/zookeeper/

Do you have idea about how to fix this? Thank you!

[yusong-shen]

@larryxiao
I didn't encounter this problem. Do you mean it stuck at this step? Is there any error massage?

[sekruse]

I couldn't build PowerGraph, as well, because the cs.utah.edu mirror for Zookeeper is not working anymore. I changed it the CmakeLists.txt to https://archive.apache.org/dist/zookeeper/zookeeper-3.4.6/zookeeper-3.4.6.tar.gz and the build worked. The MD5 is the same. This URL looks like a stable mirror.

Edit: on Ubuntu, not MacOS X

[larryxiao]

@yusong-shen thanks for replying
sorry, I forgot to include the error, the message is cmake usage. It seems that cmake -E copy_directory takes `source destination - copy directory 'source' content to directory 'destination'`` as parameter. I guess it's missing the destination.