[AUTOCUT] OS Distribution Build Failed for neural-search-2.4.0

[opensearch-ci-bot]

Received Error: Error building neural-search, retry with: ./build.sh manifests/2.4.0/opensearch-2.4.0.yml --component neural-search.
The distribution build for neural-search has failed.
Please see build log at https://build.ci.opensearch.org/job/distribution-build-opensearch/6267/consoleFull

[jmazanec15]

It appears build is failing because neural-search plugin and k-NN are getting built at the same time, when neural-search needs to be built after k-NN. Seeing the following in the logs:

[ 97%] Built target opensearchknn_common
[ 97%] Building CXX object CMakeFiles/opensearchknn_faiss.dir/src/org_opensearch_knn_jni_FaissService.cpp.o
</span><span class="pipeline-node-322">[ 47%] Building CXX object external/faiss/faiss/CMakeFiles/faiss.dir/IndexShards.cpp.o
</span><span class="pipeline-node-303">/tmp/tmp2u_c0lc6/k-NN/jni/src/org_opensearch_knn_jni_FaissService.cpp: In function 'jlong Java_org_opensearch_knn_jni_FaissService_loadIndex(JNIEnv*, jclass, jstring)':
/tmp/tmp2u_c0lc6/k-NN/jni/src/org_opensearch_knn_jni_FaissService.cpp:75:12: warning: converting to non-pointer type 'long int' from NULL [-Wconversion-null]
     return NULL;
            ^
[100%] Building CXX object CMakeFiles/opensearchknn_faiss.dir/src/faiss_wrapper.cpp.o
</span><span class="pipeline-node-321">[ 44%] Building CXX object external/nmslib/similarity_search/src/CMakeFiles/NonMetricSpaceLib.dir/params.cc.o
</span><span class="pipeline-node-303">[100%] Linking CXX shared library release/libopensearchknn_faiss.so
</span><span class="pipeline-node-321">[ 47%] Building CXX object external/nmslib/similarity_search/src/CMakeFiles/NonMetricSpaceLib.dir/params_cmdline.cc.o
</span><span class="pipeline-node-322">[ 47%] Building CXX object external/faiss/faiss/CMakeFiles/faiss.dir/InvertedLists.cpp.o
</span><span class="pipeline-node-303">[100%] Built target opensearchknn_faiss
[  2%] Building CXX object external/nmslib/similarity_search/src/CMakeFiles/NonMetricSpaceLib.dir/distcomp_bregman.cc.o
</span><span class="pipeline-node-322">[ 50%] Building CXX object external/faiss/faiss/CMakeFiles/faiss.dir/MatrixStats.cpp.o
</span><span class="pipeline-node-303">[  5%] Building CXX object external/nmslib/similarity_search/src/CMakeFiles/NonMetricSpaceLib.dir/distcomp_diverg.cc.o
</span><span class="pipeline-node-322">[ 50%] Building CXX object external/faiss/faiss/CMakeFiles/faiss.dir/MetaIndexes.cpp.o
</span><span class="pipeline-node-303">[  5%] Building CXX object external/nmslib/similarity_search/src/CMakeFiles/NonMetricSpaceLib.dir/distcomp_edist.cc.o
</span><span class="pipeline-node-321">[ 47%] Building CXX object external/nmslib/similarity_search/src/CMakeFiles/NonMetricSpaceLib.dir/query.cc.o
</span><span class="pipeline-node-303">[  8%] Building CXX object external/nmslib/similarity_search/src/CMakeFiles/NonMetricSpaceLib.dir/distcomp_js.cc.o
</span><span class="pipeline-node-321">[ 50%] Building CXX object external/nmslib/similarity_search/src/CMakeFiles/NonMetricSpaceLib.dir/rangequery.cc.o
</span><span class="pipeline-node-322">[ 52%] Building CXX object external/faiss/faiss/CMakeFiles/faiss.dir/VectorTransform.cpp.o
</span><span class="pipeline-node-303">[  8%] Building CXX object external/nmslib/similarity_search/src/CMakeFiles/NonMetricSpaceLib.dir/distcomp_l2sqr_sift.cc.o
In file included from /tmp/tmp2u_c0lc6/k-NN/jni/external/nmslib/similarity_search/src/distcomp_l2sqr_sift.cc:17:0:
/tmp/tmp2u_c0lc6/k-NN/jni/external/nmslib/similarity_search/src/distcomp_l2sqr_sift.cc: In function 'similarity::DistTypeSIFT similarity::l2SqrSIFTPrecompAVX(const uint8_t*, const uint8_t*)':
/tmp/tmp2u_c0lc6/k-NN/jni/external/nmslib/similarity_search/include/utils.h:53:53: note: #pragma message: /tmp/tmp2u_c0lc6/k-NN/jni/external/nmslib/similarity_search/src/distcomp_l2sqr_sift.cc(103) : WARNING: l2SqrSIFTPrecompAVX: AVX2 is not available
 #   define WARN(exp) (FILE_LINE_LINK "WARNING: " exp)
                                                     ^
/tmp/tmp2u_c0lc6/k-NN/jni/external/nmslib/similarity_search/src/distcomp_l2sqr_sift.cc:103:17: note: in expansion of macro 'WARN'
 #pragma message WARN("l2SqrSIFTPrecompAVX: AVX2 is not available")
                 ^
/tmp/tmp2u_c0lc6/k-NN/jni/external/nmslib/similarity_search/include/utils.h:53:53: note: #pragma message: /tmp/tmp2u_c0lc6/k-NN/jni/external/nmslib/similarity_search/src/distcomp_l2sqr_sift.cc(105) : WARNING: l2SqrSIFTPrecompAVX: SSE4 is not available
 #   define WARN(exp) (FILE_LINE_LINK "WARNING: " exp)
                                                     ^
/tmp/tmp2u_c0lc6/k-NN/jni/external/nmslib/similarity_search/src/distcomp_l2sqr_sift.cc:105:19: note: in expansion of macro 'WARN'
   #pragma message WARN("l2SqrSIFTPrecompAVX: SSE4 is not available")
                   ^
/tmp/tmp2u_c0lc6/k-NN/jni/external/nmslib/similarity_search/src/distcomp_l2sqr_sift.cc: In function 'similarity::DistTypeSIFT similarity::l2SqrSIFTPrecompSSE2(const uint8_t*, const uint8_t*)':
/tmp/tmp2u_c0lc6/k-NN/jni/external/nmslib/similarity_search/src/distcomp_l2sqr_sift.cc:69:34: warning: 'zero' is used uninitialized in this function [-Wuninitialized]
   zero = _mm_xor_si128(zero,zero);
                                  ^
[ 11%] Building CXX object external/nmslib/similarity_search/src/CMakeFiles/NonMetricSpaceLib.dir/distcomp_lp.cc.o
[ 14%] Building CXX object external/nmslib/similarity_search/src/CMakeFiles/NonMetricSpaceLib.dir/distcomp_overlap.cc.o
</span><span class="pipeline-node-321">[ 50%] Building CXX object external/nmslib/similarity_search/src/CMakeFiles/NonMetricSpaceLib.dir/searchoracle.cc.o
</span><span class="pipeline-node-303">[ 14%] Building CXX object external/nmslib/similarity_search/src/CMakeFiles/NonMetricSpaceLib.dir/distcomp_rankcorr.cc.o
</span><span class="pipeline-node-349">
FAILURE: Build failed with an exception.

* Where:
Build file '/tmp/tmpl0iebms1/neural-search/build.gradle' line: 145
* What went wrong:
A problem occurred evaluating root project 'neural-search'.
&gt; Could not resolve all files for configuration ':zipArchive'.
   &gt; Could not find org.opensearch.plugin:opensearch-knn:2.4.0.0.
     Searched in the following locations:
       - <a href='https://repo.maven.apache.org/maven2/org/opensearch/plugin/opensearch-knn/2.4.0.0/opensearch-knn-2.4.0.0.pom'>https://repo.maven.apache.org/maven2/org/opensearch/plugin/opensearch-knn/2.4.0.0/opensearch-knn-2.4.0.0.pom</a>
       - file:/usr/share/opensearch/.m2/repository/org/opensearch/plugin/opensearch-knn/2.4.0.0/opensearch-knn-2.4.0.0.pom
       - <a href='https://aws.oss.sonatype.org/content/repositories/snapshots/org/opensearch/plugin/opensearch-knn/2.4.0.0/opensearch-knn-2.4.0.0.pom'>https://aws.oss.sonatype.org/content/repositories/snapshots/org/opensearch/plugin/opensearch-knn/2.4.0.0/opensearch-knn-2.4.0.0.pom</a>
       - <a href='https://plugins.gradle.org/m2/org/opensearch/plugin/opensearch-knn/2.4.0.0/opensearch-knn-2.4.0.0.pom'>https://plugins.gradle.org/m2/org/opensearch/plugin/opensearch-knn/2.4.0.0/opensearch-knn-2.4.0.0.pom</a>
     Required by:
         project :
   &gt; Could not find org.opensearch:opensearch-ml-plugin:2.4.0.0.
     Searched in the following locations:
       - <a href='https://repo.maven.apache.org/maven2/org/opensearch/opensearch-ml-plugin/2.4.0.0/opensearch-ml-plugin-2.4.0.0.pom'>https://repo.maven.apache.org/maven2/org/opensearch/opensearch-ml-plugin/2.4.0.0/opensearch-ml-plugin-2.4.0.0.pom</a>
       - file:/usr/share/opensearch/.m2/repository/org/opensearch/opensearch-ml-plugin/2.4.0.0/opensearch-ml-plugin-2.4.0.0.pom
       - <a href='https://aws.oss.sonatype.org/content/repositories/snapshots/org/opensearch/opensearch-ml-plugin/2.4.0.0/opensearch-ml-plugin-2.4.0.0.pom'>https://aws.oss.sonatype.org/content/repositories/snapshots/org/opensearch/opensearch-ml-plugin/2.4.0.0/opensearch-ml-plugin-2.4.0.0.pom</a>
       - <a href='https://plugins.gradle.org/m2/org/opensearch/opensearch-ml-plugin/2.4.0.0/opensearch-ml-plugin-2.4.0.0.pom'>https://plugins.gradle.org/m2/org/opensearch/opensearch-ml-plugin/2.4.0.0/opensearch-ml-plugin-2.4.0.0.pom</a>
     Required by:
         project :

* Try:
&gt; Run with --stacktrace option to get the stack trace.
&gt; Run with --info or --debug option to get more log output.
&gt; Run with --scan to get full insights.

* Get more help at <a href='https://help.gradle.org'>https://help.gradle.org</a>

BUILD FAILED in 8s
2022-10-25 03:52:31 ERROR    Error building neural-search, retry with: ./build.sh manifests/2.4.0/opensearch-2.4.0.yml --component neural-search

[bbarani]

@peterzhuamazon @jmazanec15 Whats the current status? It looks like the 2.4.0 builds are still failing due to this issue.

[jmazanec15]

Working with @peterzhuamazon on this. Submitted PR: opensearch-project/k-NN#596. Seems there may be some issues related to opensearch-project/notifications#501.

[jmazanec15]

Closing as this issue is resolved.