Skip to content

Commit

Permalink
Update template: Real-time data warehouse is built based on Flink+Hol…
Browse files Browse the repository at this point in the history
…ogres
  • Loading branch information
yingzhao committed Dec 26, 2023
1 parent b136ca9 commit 451b1d5
Showing 1 changed file with 57 additions and 19 deletions.
76 changes: 57 additions & 19 deletions documents/solution/data-analysis/flink-hologres-data-warehouse.yml
Original file line number Diff line number Diff line change
Expand Up @@ -3,7 +3,7 @@ Description:
zh: 基于Flink+Hologres搭建实时数仓。
en: Build real-time warehouse based on Flink+Hologres.
Parameters:
ZoneId:
FlinkZoneId:
Type: String
Label:
en: Available Zone ID
Expand All @@ -13,6 +13,16 @@ Parameters:
VSwitch and used for Flink instance.</font></b>
zh-cn: 可用区ID。<br><b>注:用于创建VSwitch,并给Flink实例使用。
AssociationProperty: ZoneId
HologresZoneId:
Type: String
Label:
en: Available Zone ID
zh-cn: 可用区ID
Description:
en: Availability Zone ID,<br><b>note: <font color='blue'>It is used to create
VSwitch and used for Hologres instance.</font></b>
zh-cn: 可用区ID。<br><b>注:用于创建VSwitch,并给Hologres实例使用。
AssociationProperty: ZoneId
BucketName:
Type: String
Label:
Expand All @@ -24,7 +34,13 @@ Parameters:
and hyphens (-).;<br><b>note:<font color='blue'>A bucket name must be globally
unique within OSS. Bucket names cannot be changed after the bucket is created.</b></font>
zh-cn: 长度为3~63个字符,必须以小写字母或数字开头和结尾,可以包含小写字母、数字和连字符(-);<br><b>注:<font color='blue'>需要全网唯一性,已经存在的不能在创建。</b></font>
Default: bucket-create-by-ros
AssociationProperty: AutoCompleteInput
AssociationPropertyMetadata:
Length: 10
Prefix: bucket-create-by-ros-
CharacterClasses:
- Class: lowercase
min: 1
FlinkInstanceName:
Type: String
Label:
Expand All @@ -37,7 +53,13 @@ Parameters:
unique within Flink. The name cannot be changed after the flink instance is
created.</b></font>
zh-cn: 长度为1~60个字符,必须以小写字母开头和结尾,可以包含小写字母、数字和连字符(-);<br><b>注:<font color='blue'>需要全网唯一性,已经存在的不能在创建。</b></font>
Default: instance-create-by-ros
AssociationProperty: AutoCompleteInput
AssociationPropertyMetadata:
Length: 10
Prefix: instance-create-by-ros-
CharacterClasses:
- Class: lowercase
min: 1
HologresInstanceName:
Type: String
Label:
Expand All @@ -46,7 +68,13 @@ Parameters:
Description:
en: The name must be 2 to 64 bytes in length.
zh-cn: 长度为2~64个字符。
Default: instance-create-by-ros
AssociationProperty: AutoCompleteInput
AssociationPropertyMetadata:
Length: 10
Prefix: instance-create-by-ros-
CharacterClasses:
- Class: lowercase
min: 1
DBInstanceNetType:
Type: String
Label:
Expand Down Expand Up @@ -92,7 +120,7 @@ Parameters:
zh-cn: 实例规格
AssociationProperty: ALIYUN::RDS::Instance::InstanceType
AssociationPropertyMetadata:
ZoneId: ${VSwitchZoneId}
ZoneId: ${FlinkZoneId}
EngineVersion: ${EngineVersion}
DBInstanceStorageType: ${DBInstanceStorageType}
Engine: MySQL
Expand Down Expand Up @@ -156,20 +184,29 @@ Parameters:
NoEcho: true

Resources:
ECSVPC:
VPC:
Type: ALIYUN::ECS::VPC
Properties:
VpcName: vpc-create-by-ros
CidrBlock: 192.168.0.0/16
ECSVSwitch:
FlinkVSwitch:
Type: ALIYUN::ECS::VSwitch
Properties:
ZoneId:
Ref: FlinkZoneId
VpcId:
Ref: VPC
VSwitchName: vsw-create-by-ros
CidrBlock: 192.168.0.0/24
HologresVSwitch:
Type: ALIYUN::ECS::VSwitch
Properties:
ZoneId:
Ref: ZoneId
Ref: HologresZoneId
VpcId:
Ref: ECSVPC
Ref: VPC
VSwitchName: vsw-create-by-ros
CidrBlock: 192.168.0.0/20
CidrBlock: 192.168.255.0/24
OSSBucket:
Type: ALIYUN::OSS::Bucket
Properties:
Expand All @@ -179,11 +216,11 @@ Resources:
Type: ALIYUN::Flink::Instance
Properties:
ZoneId:
Ref: ZoneId
Ref: FlinkZoneId
VpcId:
Ref: ECSVPC
Ref: VPC
VSwitchIds:
- Ref: ECSVSwitch
- Ref: FlinkVSwitch
InstanceName:
Ref: FlinkInstanceName
ChargeType: Postpaid
Expand All @@ -193,13 +230,13 @@ Resources:
Type: ALIYUN::Hologram::Instance
Properties:
ZoneId:
Ref: ZoneId
Ref: HologresZoneId
ProductCode: hologram_postpay_public_cn
Endpoints:
- VpcId:
Ref: ECSVPC
Ref: VPC
VSwitchId:
Ref: ECSVSwitch
Ref: HologresVSwitch
Type: VPCSingleTunnel
InstanceType: Standard
PaymentType: PostPaid
Expand All @@ -225,9 +262,9 @@ Resources:
Ref: DBInstanceStorage
Engine: MySQL
VpcId:
Ref: ECSVPC
Ref: VPC
VSwitchId:
Ref: ECSVSwitch
Ref: FlinkVSwitch
AllocatePublicConnection: true
DBMappings:
- CharacterSetName: utf8
Expand Down Expand Up @@ -257,7 +294,8 @@ Metadata:
'ALIYUN::ROS::Interface':
ParameterGroups:
- Parameters:
- ZoneId
- FlinkZoneId
- HologresZoneId
Label:
default:
en: Availability Zone
Expand Down

0 comments on commit 451b1d5

Please sign in to comment.