Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

core: Add utilities for generating SHA256 hashes. #491

Merged
merged 58 commits into from
Jul 31, 2024
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
58 commits
Select commit Hold shift + click to select a range
32c4705
add authentication signer
wraymo Apr 1, 2024
2231742
add s3 log ingestion support for clp
wraymo Apr 5, 2024
ae8bac6
refactor the code
wraymo Apr 5, 2024
b789ecb
Update Openssl apis to get rid of warnings
haiqi96 Jul 18, 2024
86e9d5c
Refactor checkpoint
haiqi96 Jul 19, 2024
3b4815c
Replace constants with string_view
haiqi96 Jul 19, 2024
423934f
Change more string to sting_view and move some static functions out f…
haiqi96 Jul 19, 2024
4bf4005
refactoring
haiqi96 Jul 19, 2024
fb8a46f
Move hash utils in to clp/ and refactor constructors.
haiqi96 Jul 19, 2024
303aaaf
simple refactoring to parse and encode
haiqi96 Jul 19, 2024
ad868f0
Update constructor
haiqi96 Jul 19, 2024
e26a010
Apply linter
haiqi96 Jul 19, 2024
2be15a9
More refactoring
haiqi96 Jul 22, 2024
836f9b3
Use trailing return type
haiqi96 Jul 22, 2024
94ec93e
Update function to return Errorcode
haiqi96 Jul 22, 2024
80cb961
Further updates
haiqi96 Jul 22, 2024
93662b5
Add preliminary docstrings
haiqi96 Jul 22, 2024
7e359b9
disable unused constructors
haiqi96 Jul 22, 2024
1a7b394
caller code
haiqi96 Jul 22, 2024
1d8d3b4
Merge branch 'main' into s3_ingestion
haiqi96 Jul 22, 2024
edd65e0
Temporarily revert the changes that are not for this PR
haiqi96 Jul 22, 2024
3acb838
polishing
haiqi96 Jul 22, 2024
8ba9228
polishing
haiqi96 Jul 22, 2024
ba97295
Linter
haiqi96 Jul 22, 2024
3c5fb34
Remove unused constructors
haiqi96 Jul 23, 2024
98188f1
Refactor
haiqi96 Jul 24, 2024
fdcb235
touches
haiqi96 Jul 24, 2024
3147316
Update function interface
haiqi96 Jul 24, 2024
b02069f
Merge branch 's3_ingestion' of https://github.com/haiqi96/clp_fork in…
haiqi96 Jul 24, 2024
48c14b0
Add simply unit-test
haiqi96 Jul 24, 2024
7b2b83b
Remove S3 related changes
haiqi96 Jul 24, 2024
2e58200
Include header properly
haiqi96 Jul 24, 2024
9fbc529
Merge branch 'main' into s3_ingestion
haiqi96 Jul 24, 2024
2cfeee0
try a fix
haiqi96 Jul 24, 2024
8c41959
try another fix for macos
haiqi96 Jul 24, 2024
d67e7ab
remove unnecessary install
haiqi96 Jul 25, 2024
6e5bf52
Maybe I Only Need crypto
haiqi96 Jul 25, 2024
4b3338c
Remove openssl makefile
haiqi96 Jul 25, 2024
6f6687f
Update minimal cmake version
haiqi96 Jul 25, 2024
adf85e8
Apply suggestions from code review
haiqi96 Jul 25, 2024
21087c9
address code review concern
haiqi96 Jul 25, 2024
d18d204
fix based on offline discussion
haiqi96 Jul 25, 2024
1894ee4
Apply suggestions from code review
haiqi96 Jul 25, 2024
9286d05
Polishing
haiqi96 Jul 25, 2024
d5ef0fe
Grammar and linter
haiqi96 Jul 25, 2024
1822fb2
Apply suggestions from code review
haiqi96 Jul 27, 2024
9cfcb85
refactor to address code review concerns
haiqi96 Jul 27, 2024
2fc868d
Add openssl error string
haiqi96 Jul 27, 2024
8ba2177
move namespace
haiqi96 Jul 28, 2024
fc38bed
update
haiqi96 Jul 28, 2024
d8277a4
introduce a public exception class
haiqi96 Jul 29, 2024
02634a8
Small touch
haiqi96 Jul 29, 2024
e6109d2
Apply suggestions from code review
haiqi96 Jul 30, 2024
63f4673
Apply suggestions from code review
haiqi96 Jul 30, 2024
29e6058
Address codeview comments
haiqi96 Jul 30, 2024
c9d2a17
Linter
haiqi96 Jul 30, 2024
6f2296c
update error message
haiqi96 Jul 30, 2024
b1c3f0f
Minor comment fix.
kirkrodrigues Jul 31, 2024
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 1 addition & 1 deletion components/core/.clang-format
Original file line number Diff line number Diff line change
Expand Up @@ -75,7 +75,7 @@ IncludeCategories:
# Library headers. Update when adding new libraries.
# NOTE: clang-format retains leading white-space on a line in violation of the YAML spec.
- Regex: "<(absl|antlr4|archive|boost|bsoncxx|catch2|curl|date|fmt|json|log_surgeon|mariadb\
|mongocxx|msgpack|outcome|regex_utils|simdjson|spdlog|sqlite3|string_utils|yaml-cpp|zstd)"
|mongocxx|msgpack|openssl|outcome|regex_utils|simdjson|spdlog|sqlite3|string_utils|yaml-cpp|zstd)"
Priority: 3
# C system headers
- Regex: "^<.+\\.h>"
Expand Down
14 changes: 13 additions & 1 deletion components/core/CMakeLists.txt
Original file line number Diff line number Diff line change
@@ -1,4 +1,4 @@
cmake_minimum_required(VERSION 3.5.1)
cmake_minimum_required(VERSION 3.16.3)
project(CLP LANGUAGES CXX C)

if (NOT CMAKE_BUILD_TYPE AND NOT CMAKE_CONFIGURATION_TYPES)
Expand Down Expand Up @@ -146,6 +146,14 @@ else()
message(FATAL_ERROR "Could not find ${CLP_LIBS_STRING} libraries for CURL")
endif()

# Find OpenSSL
find_package(OpenSSL REQUIRED)
if (OPENSSL_FOUND)
message(STATUS "Found OpenSSL (${OPENSSL_VERSION})")
else ()
message(FATAL_ERROR "OpenSSL not found")
endif ()

# Add log surgeon
add_subdirectory(submodules/log-surgeon EXCLUDE_FROM_ALL)

Expand Down Expand Up @@ -344,6 +352,8 @@ set(SOURCE_FILES_unitTest
src/clp/GlobalSQLiteMetadataDB.hpp
src/clp/Grep.cpp
src/clp/Grep.hpp
src/clp/hash_utils.cpp
src/clp/hash_utils.hpp
src/clp/ir/constants.hpp
src/clp/ir/LogEvent.hpp
src/clp/ir/LogEventDeserializer.cpp
Expand Down Expand Up @@ -462,6 +472,7 @@ set(SOURCE_FILES_unitTest
tests/test-encoding_methods.cpp
tests/test-ffi_SchemaTree.cpp
tests/test-Grep.cpp
tests/test-hash_utils.cpp
tests/test-ir_encoding_methods.cpp
tests/test-ir_parsing.cpp
tests/test-kql.cpp
Expand Down Expand Up @@ -497,6 +508,7 @@ target_link_libraries(unitTest
LibArchive::LibArchive
MariaDBClient::MariaDBClient
spdlog::spdlog
OpenSSL::Crypto
${sqlite_LIBRARY_DEPENDENCIES}
${STD_FS_LIBS}
clp::regex_utils
Expand Down
Loading
Loading