Skip to content

Commit

Permalink
Auto-deploy docs built from commit b5c4338
Browse files Browse the repository at this point in the history
  • Loading branch information
slawr committed Aug 12, 2024
1 parent 1a28c08 commit bc1eccf
Show file tree
Hide file tree
Showing 16 changed files with 392 additions and 331 deletions.
2 changes: 1 addition & 1 deletion docs-gen/content/examples/_index.md
Original file line number Diff line number Diff line change
Expand Up @@ -13,7 +13,7 @@ Note: There is not a separate section for the VSS data model because the vast ma
## Data Layer, Processing and Analysis
Data Reduction \| Data Quality \| Events \| Data Streams etc.

Tip: well you wait for some examples consider how you could use the IoTDB data processing functions in the [UDF library](https://iotdb.apache.org/UserGuide/latest/Reference/UDF-Libraries.html).
Tip: well you wait for some examples consider how you could use the [IoTDB data processing functions]({{< ref "apache-iotdb#data-processing-functions" >}} "IoTDB data processing").

## Knowledge Layer, Reasoning and Data Models
Data Layer Connector \| A \| B \| C etc.
Expand Down
63 changes: 46 additions & 17 deletions docs-gen/content/manuals/apache-iotdb.md
Original file line number Diff line number Diff line change
Expand Up @@ -111,23 +111,52 @@ At the time of writing the playground docker deployment deploys the single node

Of course if your cloud development requires higher performance then you can integrate the cluster version.

## UDF and UDF library for data processing
Whilst IoTDB has a series of built-in timeseries processing functions you can add your own as User Defined Functions (UDF).

The [UDF section](https://iotdb.apache.org/UserGuide/latest/User-Manual/Database-Programming.html#user-defined-function-udf) of the IoTDB documentation explains how to develop and register your own.

The IoTDB project also maintains UDF Library an extensive collection of data processing functions covering:
- Data Quality
- Data Profiling
- Anomaly Detection
- Frequency Domain Analysis
- Data Repair
- Series Discovery
- Machine Learning

The UDF Library is an optional install. How to install the library is documented [here](https://iotdb.apache.org/UserGuide/latest/User-Manual/Database-Programming.html#data-quality-function-library). Documentation for the functions can be found [here](https://iotdb.apache.org/UserGuide/latest/Reference/UDF-Libraries.html).

The combination of built-in and UDF library functions, built on the low latency queries enabled by IoTDB and its TsFile format gives you a lot to explore.
## Data processing functions
### Built-in functions
IoTDB has an extensive collection of built-in data processing functions covering areas including:

- Aggregate Functions, such as `SUM`.
- Arithmetic Functions, such as `SIN`.
- Comparison Functions, such as `ON_OFF`.
- String Processing Functions, such as `STRING_CONTAINS`.
- Data Type Conversion Function, such as `CAST`.
- Constant Timeseries Generating Functions, such as `CONST`.
- Selector Functions, such as `TOP_K`.
- Continuous Interval Functions, such as `ZERO_DURATION`.
- Variation Trend Calculation Functions, such as `TIME_DIFFERENCE`.
- Sampling Functions, such as `M4`.
- Change Points Function, such as `CHANGE_POINTS`.

A full function list with examples can be found in the upstream [IoTDB Function reference manual](https://iotdb.apache.org/UserGuide/latest/Reference/Function-and-Expression.html).

### Data Quality Library functions
The IoTDB project also maintains a Data Quality Library which provides an additional collection of functions covering:
- Data Quality, such as `Accuracy`.
- Data Profiling, such as `Sample`.
- Anomaly Detection, such as `Outlier`.
- Frequency Domain Analysis, such as `HighPass`.
- Data Repair, such as `TimestampRepair`.
- Series Discovery, such as `ConsecutiveSequences`.
- Machine Learning, such as `AR`.

A full function list with examples can be found in the upstream [IoTDB Data Quality Library reference manual](https://iotdb.apache.org/UserGuide/latest/Reference/UDF-Libraries.html).

#### Setup
In the upstream IoTDB project the library is an optional install.

For your convenience it is included in the Playground IoTDB image for you. However to call the functions they must first be registered in the running IoTDB instance, which you only need to do once. The script `/iotdb/sbin/register-UDF.sh` is included in the IoTDB image to do this for you.

Steps:

1. Start the Playground if it is not already running.
2. From your host execute the following command to run the registration script in the IoTDB container image:
```
sudo docker exec -ti iotdb-service /iotdb/sbin/register-UDF.sh
```


### User Defined functions
IoTDB also allows you intergrate your own functions as User Defined Functions (UDF). The [UDF section](https://iotdb.apache.org/UserGuide/latest/User-Manual/Database-Programming.html#user-defined-function-udf) of the IoTDB documentation explains how to develop and register your own.

## VISSR (VISS) integration
As part of the initial development of the playground the team extended VISSR to support connections to Apache IoTDB as a VISSR data store backend and upstreamed the support.
Expand Down
16 changes: 8 additions & 8 deletions docs/404.html
Original file line number Diff line number Diff line change
Expand Up @@ -9,15 +9,15 @@
<title>404 Page not found</title>


<link href="/cdsp/css/nucleus.css?1716543461" rel="stylesheet">
<link href="/cdsp/css/fontawesome-all.min.css?1716543461" rel="stylesheet">
<link href="/cdsp/css/hybrid.css?1716543461" rel="stylesheet">
<link href="/cdsp/css/featherlight.min.css?1716543461" rel="stylesheet">
<link href="/cdsp/css/perfect-scrollbar.min.css?1716543461" rel="stylesheet">
<link href="/cdsp/css/theme.css?1716543461" rel="stylesheet">
<link href="/cdsp/css/hugo-theme.css?1716543461" rel="stylesheet">
<link href="/cdsp/css/nucleus.css?1723481452" rel="stylesheet">
<link href="/cdsp/css/fontawesome-all.min.css?1723481452" rel="stylesheet">
<link href="/cdsp/css/hybrid.css?1723481452" rel="stylesheet">
<link href="/cdsp/css/featherlight.min.css?1723481452" rel="stylesheet">
<link href="/cdsp/css/perfect-scrollbar.min.css?1723481452" rel="stylesheet">
<link href="/cdsp/css/theme.css?1723481452" rel="stylesheet">
<link href="/cdsp/css/hugo-theme.css?1723481452" rel="stylesheet">

<link href="/cdsp/css/theme-blue.css?1716543461" rel="stylesheet">
<link href="/cdsp/css/theme-blue.css?1723481452" rel="stylesheet">

<style>
:root #header + #content > #left > #rlblock_left {
Expand Down
48 changes: 24 additions & 24 deletions docs/categories/index.html
Original file line number Diff line number Diff line change
Expand Up @@ -12,21 +12,21 @@
<title>Categories :: Central Data Service Playground</title>


<link href="/cdsp/css/nucleus.css?1716543461" rel="stylesheet">
<link href="/cdsp/css/fontawesome-all.min.css?1716543461" rel="stylesheet">
<link href="/cdsp/css/hybrid.css?1716543461" rel="stylesheet">
<link href="/cdsp/css/featherlight.min.css?1716543461" rel="stylesheet">
<link href="/cdsp/css/perfect-scrollbar.min.css?1716543461" rel="stylesheet">
<link href="/cdsp/css/auto-complete.css?1716543461" rel="stylesheet">
<link href="/cdsp/css/atom-one-dark-reasonable.css?1716543461" rel="stylesheet">
<link href="/cdsp/css/theme.css?1716543461" rel="stylesheet">
<link href="/cdsp/css/hugo-theme.css?1716543461" rel="stylesheet">
<link href="/cdsp/css/nucleus.css?1723481452" rel="stylesheet">
<link href="/cdsp/css/fontawesome-all.min.css?1723481452" rel="stylesheet">
<link href="/cdsp/css/hybrid.css?1723481452" rel="stylesheet">
<link href="/cdsp/css/featherlight.min.css?1723481452" rel="stylesheet">
<link href="/cdsp/css/perfect-scrollbar.min.css?1723481452" rel="stylesheet">
<link href="/cdsp/css/auto-complete.css?1723481452" rel="stylesheet">
<link href="/cdsp/css/atom-one-dark-reasonable.css?1723481452" rel="stylesheet">
<link href="/cdsp/css/theme.css?1723481452" rel="stylesheet">
<link href="/cdsp/css/hugo-theme.css?1723481452" rel="stylesheet">

<link href="/cdsp/css/theme-blue.css?1716543461" rel="stylesheet">
<link href="/cdsp/css/theme-blue.css?1723481452" rel="stylesheet">



<script src="/cdsp/js/jquery-3.3.1.min.js?1716543461"></script>
<script src="/cdsp/js/jquery-3.3.1.min.js?1723481452"></script>

<style>
:root #header + #content > #left > #rlblock_left{
Expand Down Expand Up @@ -59,14 +59,14 @@
<span data-search-clear=""><i class="fas fa-times"></i></span>
</div>

<script type="text/javascript" src="/cdsp/js/lunr.min.js?1716543461"></script>
<script type="text/javascript" src="/cdsp/js/auto-complete.js?1716543461"></script>
<script type="text/javascript" src="/cdsp/js/lunr.min.js?1723481452"></script>
<script type="text/javascript" src="/cdsp/js/auto-complete.js?1723481452"></script>
<script type="text/javascript">

var baseurl = "https:\/\/covesa.github.io\/cdsp\/";

</script>
<script type="text/javascript" src="/cdsp/js/search.js?1716543461"></script>
<script type="text/javascript" src="/cdsp/js/search.js?1723481452"></script>


</div>
Expand Down Expand Up @@ -591,19 +591,19 @@ <h1>
<div style="left: -1000px; overflow: scroll; position: absolute; top: -1000px; border: none; box-sizing: content-box; height: 200px; margin: 0px; padding: 0px; width: 200px;">
<div style="border: none; box-sizing: content-box; height: 200px; margin: 0px; padding: 0px; width: 200px;"></div>
</div>
<script src="/cdsp/js/clipboard.min.js?1716543461"></script>
<script src="/cdsp/js/perfect-scrollbar.min.js?1716543461"></script>
<script src="/cdsp/js/perfect-scrollbar.jquery.min.js?1716543461"></script>
<script src="/cdsp/js/jquery.sticky.js?1716543461"></script>
<script src="/cdsp/js/featherlight.min.js?1716543461"></script>
<script src="/cdsp/js/highlight.pack.js?1716543461"></script>
<script src="/cdsp/js/clipboard.min.js?1723481452"></script>
<script src="/cdsp/js/perfect-scrollbar.min.js?1723481452"></script>
<script src="/cdsp/js/perfect-scrollbar.jquery.min.js?1723481452"></script>
<script src="/cdsp/js/jquery.sticky.js?1723481452"></script>
<script src="/cdsp/js/featherlight.min.js?1723481452"></script>
<script src="/cdsp/js/highlight.pack.js?1723481452"></script>
<script>hljs.initHighlightingOnLoad();</script>
<script src="/cdsp/js/modernizr.custom-3.6.0.js?1716543461"></script>
<script src="/cdsp/js/learn.js?1716543461"></script>
<script src="/cdsp/js/hugo-learn.js?1716543461"></script>
<script src="/cdsp/js/modernizr.custom-3.6.0.js?1723481452"></script>
<script src="/cdsp/js/learn.js?1723481452"></script>
<script src="/cdsp/js/hugo-learn.js?1723481452"></script>


<script src="/cdsp/mermaid/mermaid.js?1716543461"></script>
<script src="/cdsp/mermaid/mermaid.js?1723481452"></script>

<script>
mermaid.initialize({ startOnLoad: true });
Expand Down
50 changes: 25 additions & 25 deletions docs/examples/index.html
Original file line number Diff line number Diff line change
Expand Up @@ -12,21 +12,21 @@
<title>Playground examples :: Central Data Service Playground</title>


<link href="/cdsp/css/nucleus.css?1716543461" rel="stylesheet">
<link href="/cdsp/css/fontawesome-all.min.css?1716543461" rel="stylesheet">
<link href="/cdsp/css/hybrid.css?1716543461" rel="stylesheet">
<link href="/cdsp/css/featherlight.min.css?1716543461" rel="stylesheet">
<link href="/cdsp/css/perfect-scrollbar.min.css?1716543461" rel="stylesheet">
<link href="/cdsp/css/auto-complete.css?1716543461" rel="stylesheet">
<link href="/cdsp/css/atom-one-dark-reasonable.css?1716543461" rel="stylesheet">
<link href="/cdsp/css/theme.css?1716543461" rel="stylesheet">
<link href="/cdsp/css/hugo-theme.css?1716543461" rel="stylesheet">
<link href="/cdsp/css/nucleus.css?1723481452" rel="stylesheet">
<link href="/cdsp/css/fontawesome-all.min.css?1723481452" rel="stylesheet">
<link href="/cdsp/css/hybrid.css?1723481452" rel="stylesheet">
<link href="/cdsp/css/featherlight.min.css?1723481452" rel="stylesheet">
<link href="/cdsp/css/perfect-scrollbar.min.css?1723481452" rel="stylesheet">
<link href="/cdsp/css/auto-complete.css?1723481452" rel="stylesheet">
<link href="/cdsp/css/atom-one-dark-reasonable.css?1723481452" rel="stylesheet">
<link href="/cdsp/css/theme.css?1723481452" rel="stylesheet">
<link href="/cdsp/css/hugo-theme.css?1723481452" rel="stylesheet">

<link href="/cdsp/css/theme-blue.css?1716543461" rel="stylesheet">
<link href="/cdsp/css/theme-blue.css?1723481452" rel="stylesheet">



<script src="/cdsp/js/jquery-3.3.1.min.js?1716543461"></script>
<script src="/cdsp/js/jquery-3.3.1.min.js?1723481452"></script>

<style>
:root #header + #content > #left > #rlblock_left{
Expand Down Expand Up @@ -59,14 +59,14 @@
<span data-search-clear=""><i class="fas fa-times"></i></span>
</div>

<script type="text/javascript" src="/cdsp/js/lunr.min.js?1716543461"></script>
<script type="text/javascript" src="/cdsp/js/auto-complete.js?1716543461"></script>
<script type="text/javascript" src="/cdsp/js/lunr.min.js?1723481452"></script>
<script type="text/javascript" src="/cdsp/js/auto-complete.js?1723481452"></script>
<script type="text/javascript">

var baseurl = "https:\/\/covesa.github.io\/cdsp\/";

</script>
<script type="text/javascript" src="/cdsp/js/search.js?1716543461"></script>
<script type="text/javascript" src="/cdsp/js/search.js?1723481452"></script>


</div>
Expand Down Expand Up @@ -415,7 +415,7 @@ <h2 id="getting-started">Getting started</h2>
<p><a href="https://github.com/COVESA/cdsp/blob/main/docker/README.md">Docker sanity test</a> | <a href="https://github.com/COVESA/cdsp/tree/main/examples/cdsp-hello-world">Hello-world</a></p>
<h2 id="data-layer-processing-and-analysis">Data Layer, Processing and Analysis</h2>
<p>Data Reduction | Data Quality | Events | Data Streams etc.</p>
<p>Tip: well you wait for some examples consider how you could use the IoTDB data processing functions in the <a href="https://iotdb.apache.org/UserGuide/latest/Reference/UDF-Libraries.html">UDF library</a>.</p>
<p>Tip: well you wait for some examples consider how you could use the <a href="/cdsp/manuals/apache-iotdb/#data-processing-functions" title="IoTDB data processing">IoTDB data processing functions</a>.</p>
<h2 id="knowledge-layer-reasoning-and-data-models">Knowledge Layer, Reasoning and Data Models</h2>
<p>Data Layer Connector | A | B | C etc.</p>
<h2 id="feeders">Feeders</h2>
Expand Down Expand Up @@ -637,19 +637,19 @@ <h2 id="other-examples">Other examples</h2>
<div style="left: -1000px; overflow: scroll; position: absolute; top: -1000px; border: none; box-sizing: content-box; height: 200px; margin: 0px; padding: 0px; width: 200px;">
<div style="border: none; box-sizing: content-box; height: 200px; margin: 0px; padding: 0px; width: 200px;"></div>
</div>
<script src="/cdsp/js/clipboard.min.js?1716543461"></script>
<script src="/cdsp/js/perfect-scrollbar.min.js?1716543461"></script>
<script src="/cdsp/js/perfect-scrollbar.jquery.min.js?1716543461"></script>
<script src="/cdsp/js/jquery.sticky.js?1716543461"></script>
<script src="/cdsp/js/featherlight.min.js?1716543461"></script>
<script src="/cdsp/js/highlight.pack.js?1716543461"></script>
<script src="/cdsp/js/clipboard.min.js?1723481452"></script>
<script src="/cdsp/js/perfect-scrollbar.min.js?1723481452"></script>
<script src="/cdsp/js/perfect-scrollbar.jquery.min.js?1723481452"></script>
<script src="/cdsp/js/jquery.sticky.js?1723481452"></script>
<script src="/cdsp/js/featherlight.min.js?1723481452"></script>
<script src="/cdsp/js/highlight.pack.js?1723481452"></script>
<script>hljs.initHighlightingOnLoad();</script>
<script src="/cdsp/js/modernizr.custom-3.6.0.js?1716543461"></script>
<script src="/cdsp/js/learn.js?1716543461"></script>
<script src="/cdsp/js/hugo-learn.js?1716543461"></script>
<script src="/cdsp/js/modernizr.custom-3.6.0.js?1723481452"></script>
<script src="/cdsp/js/learn.js?1723481452"></script>
<script src="/cdsp/js/hugo-learn.js?1723481452"></script>


<script src="/cdsp/mermaid/mermaid.js?1716543461"></script>
<script src="/cdsp/mermaid/mermaid.js?1723481452"></script>

<script>
mermaid.initialize({ startOnLoad: true });
Expand Down
48 changes: 24 additions & 24 deletions docs/index.html
Original file line number Diff line number Diff line change
Expand Up @@ -12,21 +12,21 @@
<title>Central Data Service Playground :: Central Data Service Playground</title>


<link href="/cdsp/css/nucleus.css?1716543461" rel="stylesheet">
<link href="/cdsp/css/fontawesome-all.min.css?1716543461" rel="stylesheet">
<link href="/cdsp/css/hybrid.css?1716543461" rel="stylesheet">
<link href="/cdsp/css/featherlight.min.css?1716543461" rel="stylesheet">
<link href="/cdsp/css/perfect-scrollbar.min.css?1716543461" rel="stylesheet">
<link href="/cdsp/css/auto-complete.css?1716543461" rel="stylesheet">
<link href="/cdsp/css/atom-one-dark-reasonable.css?1716543461" rel="stylesheet">
<link href="/cdsp/css/theme.css?1716543461" rel="stylesheet">
<link href="/cdsp/css/hugo-theme.css?1716543461" rel="stylesheet">
<link href="/cdsp/css/nucleus.css?1723481452" rel="stylesheet">
<link href="/cdsp/css/fontawesome-all.min.css?1723481452" rel="stylesheet">
<link href="/cdsp/css/hybrid.css?1723481452" rel="stylesheet">
<link href="/cdsp/css/featherlight.min.css?1723481452" rel="stylesheet">
<link href="/cdsp/css/perfect-scrollbar.min.css?1723481452" rel="stylesheet">
<link href="/cdsp/css/auto-complete.css?1723481452" rel="stylesheet">
<link href="/cdsp/css/atom-one-dark-reasonable.css?1723481452" rel="stylesheet">
<link href="/cdsp/css/theme.css?1723481452" rel="stylesheet">
<link href="/cdsp/css/hugo-theme.css?1723481452" rel="stylesheet">

<link href="/cdsp/css/theme-blue.css?1716543461" rel="stylesheet">
<link href="/cdsp/css/theme-blue.css?1723481452" rel="stylesheet">



<script src="/cdsp/js/jquery-3.3.1.min.js?1716543461"></script>
<script src="/cdsp/js/jquery-3.3.1.min.js?1723481452"></script>

<style>
:root #header + #content > #left > #rlblock_left{
Expand Down Expand Up @@ -59,14 +59,14 @@
<span data-search-clear=""><i class="fas fa-times"></i></span>
</div>

<script type="text/javascript" src="/cdsp/js/lunr.min.js?1716543461"></script>
<script type="text/javascript" src="/cdsp/js/auto-complete.js?1716543461"></script>
<script type="text/javascript" src="/cdsp/js/lunr.min.js?1723481452"></script>
<script type="text/javascript" src="/cdsp/js/auto-complete.js?1723481452"></script>
<script type="text/javascript">

var baseurl = "https:\/\/covesa.github.io\/cdsp\/";

</script>
<script type="text/javascript" src="/cdsp/js/search.js?1716543461"></script>
<script type="text/javascript" src="/cdsp/js/search.js?1723481452"></script>


</div>
Expand Down Expand Up @@ -547,19 +547,19 @@ <h3 id="examples">Examples</h3>
<div style="left: -1000px; overflow: scroll; position: absolute; top: -1000px; border: none; box-sizing: content-box; height: 200px; margin: 0px; padding: 0px; width: 200px;">
<div style="border: none; box-sizing: content-box; height: 200px; margin: 0px; padding: 0px; width: 200px;"></div>
</div>
<script src="/cdsp/js/clipboard.min.js?1716543461"></script>
<script src="/cdsp/js/perfect-scrollbar.min.js?1716543461"></script>
<script src="/cdsp/js/perfect-scrollbar.jquery.min.js?1716543461"></script>
<script src="/cdsp/js/jquery.sticky.js?1716543461"></script>
<script src="/cdsp/js/featherlight.min.js?1716543461"></script>
<script src="/cdsp/js/highlight.pack.js?1716543461"></script>
<script src="/cdsp/js/clipboard.min.js?1723481452"></script>
<script src="/cdsp/js/perfect-scrollbar.min.js?1723481452"></script>
<script src="/cdsp/js/perfect-scrollbar.jquery.min.js?1723481452"></script>
<script src="/cdsp/js/jquery.sticky.js?1723481452"></script>
<script src="/cdsp/js/featherlight.min.js?1723481452"></script>
<script src="/cdsp/js/highlight.pack.js?1723481452"></script>
<script>hljs.initHighlightingOnLoad();</script>
<script src="/cdsp/js/modernizr.custom-3.6.0.js?1716543461"></script>
<script src="/cdsp/js/learn.js?1716543461"></script>
<script src="/cdsp/js/hugo-learn.js?1716543461"></script>
<script src="/cdsp/js/modernizr.custom-3.6.0.js?1723481452"></script>
<script src="/cdsp/js/learn.js?1723481452"></script>
<script src="/cdsp/js/hugo-learn.js?1723481452"></script>


<script src="/cdsp/mermaid/mermaid.js?1716543461"></script>
<script src="/cdsp/mermaid/mermaid.js?1723481452"></script>

<script>
mermaid.initialize({ startOnLoad: true });
Expand Down
Loading

0 comments on commit bc1eccf

Please sign in to comment.