Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Bpg img #244

Open
wants to merge 79 commits into
base: v2
Choose a base branch
from
Open
Show file tree
Hide file tree
Changes from 18 commits
Commits
Show all changes
79 commits
Select commit Hold shift + click to select a range
92cb811
init bpg
DenisBorzenkov Mar 8, 2024
cc47d13
test bpg-img deploy
DenisBorzenkov Mar 8, 2024
22dfe23
test bpg-img deploy+
DenisBorzenkov Mar 8, 2024
1a818fa
test bpg-img deploy++
DenisBorzenkov Mar 8, 2024
6fef811
test bpg-img deploy+++
DenisBorzenkov Mar 8, 2024
42819b0
test bpg-img deploy++++
DenisBorzenkov Mar 8, 2024
b3086c3
update vars
DenisBorzenkov Mar 11, 2024
8add445
bump infra version
DenisBorzenkov Mar 11, 2024
c8e6245
switch to dev slack branch
duartecoelhomovai Mar 11, 2024
b5842ae
bump infra version
DenisBorzenkov Mar 11, 2024
bb5d85c
Merge branch 'bpg-img' of github.com:MOV-AI/.github into bpg-img
DenisBorzenkov Mar 11, 2024
d06c252
test credentials for proxmox
DenisBorzenkov Mar 11, 2024
237b0d9
fix vars++
DenisBorzenkov Mar 11, 2024
e99e769
fix vars+++
DenisBorzenkov Mar 11, 2024
fe4a089
fix vars++++
DenisBorzenkov Mar 11, 2024
ecd4186
fix vars+++++
DenisBorzenkov Mar 11, 2024
90b463e
fix teardown
DenisBorzenkov Mar 11, 2024
7a3bfae
test without rombar and conf ssh
DenisBorzenkov Mar 11, 2024
f4267c4
test rewrite vars bpg
DenisBorzenkov Mar 14, 2024
9188792
test deploy
DenisBorzenkov Mar 19, 2024
f9b20ad
test deploy+
DenisBorzenkov Mar 19, 2024
a7595dc
test deploy++
DenisBorzenkov Mar 19, 2024
80f96b9
test deploy++++
DenisBorzenkov Mar 19, 2024
ada5185
test deploy+++++
DenisBorzenkov Mar 19, 2024
17b5109
test deploy++++++
DenisBorzenkov Mar 19, 2024
b54950c
test deploy+++++++
DenisBorzenkov Mar 19, 2024
e8a5d45
test deploy++++++++
DenisBorzenkov Mar 19, 2024
cf72e18
test deploy+++++++++
DenisBorzenkov Mar 19, 2024
9cc09cd
update vga
DenisBorzenkov Mar 19, 2024
95b8045
debug quikstart
DenisBorzenkov Mar 20, 2024
4a6e874
debug quikstart+
DenisBorzenkov Mar 20, 2024
c77270d
fix quikstart
DenisBorzenkov Mar 20, 2024
a37c13f
fix quikstart+
DenisBorzenkov Mar 20, 2024
a27554c
fix quikstart++
DenisBorzenkov Mar 20, 2024
53d19e0
fix quikstart++
DenisBorzenkov Mar 20, 2024
cbe2ddf
fix quikstart+++
DenisBorzenkov Mar 20, 2024
7cae004
test display
DenisBorzenkov Mar 20, 2024
8583944
have fleet validations
duartecoelhomovai Mar 22, 2024
5d4fc31
remove old path
duartecoelhomovai Mar 22, 2024
2ab4d37
use conf envs
duartecoelhomovai Mar 26, 2024
07e0d62
lets try
duartecoelhomovai Mar 26, 2024
bfda7dd
lets try
duartecoelhomovai Mar 26, 2024
0207180
fix bash
duartecoelhomovai Mar 26, 2024
909ee32
another one
duartecoelhomovai Mar 26, 2024
102d983
fix i hope
duartecoelhomovai Mar 26, 2024
38e7239
fix i hope
duartecoelhomovai Mar 26, 2024
4f161e1
fix i hope
duartecoelhomovai Mar 26, 2024
d7eeb1b
fix i hope
duartecoelhomovai Mar 26, 2024
c1c4dfc
fix i hope
duartecoelhomovai Mar 26, 2024
c9bc7ba
fix i hope
duartecoelhomovai Mar 26, 2024
75b6e37
fix i hope
duartecoelhomovai Mar 27, 2024
f6a980c
have vars as input
duartecoelhomovai Mar 27, 2024
72a0417
have vars as input
duartecoelhomovai Mar 27, 2024
0fdb61a
have vars as input
duartecoelhomovai Mar 27, 2024
56847c8
have vars as input
duartecoelhomovai Mar 27, 2024
1dca27c
have vars as input
duartecoelhomovai Mar 27, 2024
7cb5f0f
have vars as input
duartecoelhomovai Mar 27, 2024
d666ee3
have vars as input
duartecoelhomovai Mar 27, 2024
850cd6c
have vars as input
duartecoelhomovai Mar 27, 2024
0178f02
have vars as input
duartecoelhomovai Mar 27, 2024
3403e78
bump env conf repo
duartecoelhomovai Mar 27, 2024
4aba221
adapt to new inventory filename
duartecoelhomovai Mar 27, 2024
2db2637
bump env confs
duartecoelhomovai Mar 27, 2024
9d8016d
bump tf version
duartecoelhomovai Mar 27, 2024
c938320
switch ensuring vm is ready mechanism
duartecoelhomovai Mar 27, 2024
ff2fac6
attempt to force file descriptors blocking
duartecoelhomovai Mar 27, 2024
4b1bfa8
attempt to force file descriptors blocking
duartecoelhomovai Mar 27, 2024
e0f1edf
attempt to force file descriptors blocking
duartecoelhomovai Mar 27, 2024
2e391ae
attempt to force file descriptors blocking
duartecoelhomovai Mar 27, 2024
8831f92
attempt to force file descriptors blocking
duartecoelhomovai Mar 27, 2024
5e90119
attempt to force file descriptors blocking
duartecoelhomovai Mar 27, 2024
3eb97ad
attempt to force file descriptors blocking
duartecoelhomovai Mar 27, 2024
690e5fc
bump tf
duartecoelhomovai Mar 27, 2024
cc9360d
fix manager ip exposal
duartecoelhomovai Mar 27, 2024
3f82771
try again without file descriptor hammer
duartecoelhomovai Mar 28, 2024
31bd6f0
attempt not using the ssh call
duartecoelhomovai Mar 28, 2024
ac35b4a
swtich from ssh to ansible to see descriptor complain
duartecoelhomovai Mar 28, 2024
89a9198
lets roll
duartecoelhomovai Mar 28, 2024
cd9311d
lets roll
duartecoelhomovai Mar 28, 2024
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
146 changes: 95 additions & 51 deletions .github/workflows/integration-build-product.yml
Original file line number Diff line number Diff line change
Expand Up @@ -75,9 +75,9 @@ on:
required: true
proxmox_api_url:
required: true
proxmox_api_token_id:
proxmox_ve_username:
required: true
proxmox_api_token_secret:
proxmox_ve_password:
required: true
ssh_priv_key:
required: true
Expand All @@ -100,12 +100,12 @@ env:
MID_REGISTRY: registry.cloud.mov.ai
USERSPACE_FOLDER_PATH: userspace
REMOTE_WORKSPACE_PATH: workspace
PROVISION_INFRA_REPO: "devops-tf-proxmox-fleet"
PROVISION_INFRA_VERSION: "0.1.0-7"
PROVISION_INFRA_REPO: "devops-tf-proxmox-bpg"
PROVISION_INFRA_VERSION: "0.0.0-5"
# slack channel movai-projects
SLACK_CHANNEL: ${{ inputs.overwrite_slack_channel }}
#SLACK_CHANNEL: ${{ inputs.overwrite_slack_channel }}
# development slack channel
#SLACK_CHANNEL: "C05K2KF1UP8"
SLACK_CHANNEL: "C05K2KF1UP8"
PROJECT_DATA_VIEWER_API: "https://personal-7vf0v2cu.outsystemscloud.com/ProjectDataViewer5/rest/V1//CreateProject"
MINIO_S3_URL: "https://s3.mov.ai"

Expand Down Expand Up @@ -1160,8 +1160,9 @@ jobs:
rm -rf $provision_infra_dir
export PATH="$HOME/.local/bin:$PATH"
integration-pipeline fetch_by_tag --repo $provision_infra_repo_name --version $provision_infra_version --gh_api_user $GITHUB_API_USR --gh_api_pwd ${{ secrets.auto_commit_pwd }} --target_dir $provision_infra_dir

ls -la $provision_infra_dir
echo "target_dir=${provision_infra_dir}/hosts/generic/" >> $GITHUB_OUTPUT
echo "target_dir=${provision_infra_dir}/" >> $GITHUB_OUTPUT

- name: Define Instance names
if: ${{ inputs.with_simulation_tests }}
Expand Down Expand Up @@ -1190,25 +1191,48 @@ jobs:

env:
TF_VAR_number_agents: 0
# TF_VAR_proxmox_api_url: ${{ secrets.proxmox_api_url }}
DenisBorzenkov marked this conversation as resolved.
Show resolved Hide resolved
# TF_VAR_proxmox_api_token_id: ${{ secrets.proxmox_api_token_id }}
# TF_VAR_proxmox_api_token_secret: ${{ secrets.proxmox_api_token_secret }}
# TF_VAR_provision_ssh_pem: ${{ secrets.ssh_priv_key }}
# TF_VAR_ip_list: '["dhcp"]'
# TF_VAR_storage: "local-lvm"
# TF_VAR_proxmox_host_list: '["mary"]'
# TF_VAR_vm_gateway: "10.10.1.254"
# TF_VAR_ip_mask: 23
# TF_VAR_bios: "ovmf"
# TF_VAR_pool: "IP-Temp-VMs"
# TF_VAR_tags: "ip-simul-ci"
# TF_VAR_fleet_hosts_user: "devops"
# TF_VAR_template_name: "u22dci-gpu"
# TF_VAR_fleet_manager_name: ${{ steps.infra_names.outputs.simul_prefix }}
# TF_VAR_fleet_manager_memory: 51200
# TF_VAR_fleet_manager_cores: 14
# TF_VAR_fleet_manager_disk_size: "110G"
# TF_VAR_fleet_manager_balloon: 0
TF_VAR_proxmox_ve_username: ${{ secrets.proxmox_ve_username }}
TF_VAR_proxmox_ve_password: ${{ secrets.proxmox_ve_password }}
TF_VAR_proxmox_host: "mary"
TF_VAR_proxmox_api_url: ${{ secrets.proxmox_api_url }}
TF_VAR_proxmox_api_token_id: ${{ secrets.proxmox_api_token_id }}
TF_VAR_proxmox_api_token_secret: ${{ secrets.proxmox_api_token_secret }}
TF_VAR_provision_ssh_pem: ${{ secrets.ssh_priv_key }}
TF_VAR_ip_list: '["dhcp"]'
TF_VAR_storage: "local-lvm"
TF_VAR_proxmox_host_list: '["mary"]'
TF_VAR_vm_gateway: "10.10.1.254"
TF_VAR_ip_mask: 23
TF_VAR_bios: "ovmf"
TF_VAR_pool: "IP-Temp-VMs"
TF_VAR_tags: "ip-simul-ci"
TF_VAR_fleet_hosts_user: "devops"
TF_VAR_template_name: "u22dci-gpu"
TF_VAR_fleet_manager_name: ${{ steps.infra_names.outputs.simul_prefix }}
TF_VAR_fleet_manager_memory: 51200
TF_VAR_fleet_manager_cores: 14
TF_VAR_fleet_manager_disk_size: "110G"
TF_VAR_fleet_manager_balloon: 0
TF_VAR_vm_name: "test-bpg-tf"
DenisBorzenkov marked this conversation as resolved.
Show resolved Hide resolved
TF_VAR_vm_memory: 8192
TF_VAR_vm_cores: 4
TF_VAR_vm_core_type: "host"
TF_VAR_vm_disk_size: 20
TF_VAR_vm_disk_interface: "scsi0"
TF_VAR_vm_type: "q35"
TF_VAR_vm_os_type: "l26"
TF_VAR_vm_network_bridge: "vmbr0"
TF_VAR_vm_network_ip_address: "dhcp"
TF_VAR_vm_disk_storage: "nas-mary"
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

vm disk should be same as TF_VAR_storage: "local-lvm"

TF_VAR_vm_img_id: "nas-mary:iso/0.0.1-13-desktop-jammy_local.img"
TF_VAR_vm_bios: "ovmf"
TF_VAR_cloud_init_storage: "local"
TF_VAR_hostpci_device: "hostpci0"
TF_VAR_hostpci_device_id: "0000:01:00.0"
TF_VAR_hostpci_device_pcie: "true"
TF_VAR_hostpci_device_xvga: "true"
# TF_VAR_hostpci_device_rombar: "true"
DenisBorzenkov marked this conversation as resolved.
Show resolved Hide resolved

- name: Gather Terraform outputs
if: ${{ inputs.with_simulation_tests }}
Expand All @@ -1222,18 +1246,18 @@ jobs:
echo "host_user=$(echo $user | sed "s;\";;g")" >> $GITHUB_OUTPUT
echo "ssh_connect_string=$(echo $user | sed "s;\";;g")@$(echo $ip | sed "s;\";;g")" >> $GITHUB_OUTPUT

- name: Configure SSH
if: ${{ inputs.with_simulation_tests }}
id: remote_ssh_setup
shell: bash
run: |
ssh-keygen -f ~/.ssh/known_hosts -R ${{ steps.infra_outputs.outputs.host_ip }} || true
ssh-keyscan -H ${{ steps.infra_outputs.outputs.host_ip }} >> ~/.ssh/known_hosts || true
# - name: Configure SSH
# if: ${{ inputs.with_simulation_tests }}
# id: remote_ssh_setup
# shell: bash
# run: |
# ssh-keygen -f ~/.ssh/known_hosts -R ${{ steps.infra_outputs.outputs.host_ip }} || true
# ssh-keyscan -H ${{ steps.infra_outputs.outputs.host_ip }} >> ~/.ssh/known_hosts || true

ssh ${{ steps.infra_outputs.outputs.ssh_connect_string }} -i ~/.ssh/ci_priv_key.pem -o StrictHostKeyChecking=no '
set -e
cloud-init status --wait; rm -rf ./${{ env.REMOTE_WORKSPACE_PATH }}; mkdir -p ./${{ env.REMOTE_WORKSPACE_PATH }}
'
# ssh ${{ steps.infra_outputs.outputs.ssh_connect_string }} -i ~/.ssh/ci_priv_key.pem -o StrictHostKeyChecking=no '
# set -e
# cloud-init status --wait; rm -rf ./${{ env.REMOTE_WORKSPACE_PATH }}; mkdir -p ./${{ env.REMOTE_WORKSPACE_PATH }}
# '
DenisBorzenkov marked this conversation as resolved.
Show resolved Hide resolved


- name: Prepare Devops provisioning slack message
Expand Down Expand Up @@ -1604,22 +1628,42 @@ jobs:
env:
TF_VAR_number_agents: 0
TF_VAR_proxmox_api_url: ${{ secrets.proxmox_api_url }}
TF_VAR_proxmox_api_token_id: ${{ secrets.proxmox_api_token_id }}
TF_VAR_proxmox_api_token_secret: ${{ secrets.proxmox_api_token_secret }}
TF_VAR_proxmox_ve_username: ${{ secrets.proxmox_ve_username }}
TF_VAR_proxmox_ve_password: ${{ secrets.proxmox_ve_password }}
TF_VAR_provision_ssh_pem: ${{ secrets.ssh_priv_key }}
TF_VAR_ip_list: '["dhcp"]'
TF_VAR_proxmox_host_list: '["mary"]'
TF_VAR_vm_gateway: "10.10.1.254"
TF_VAR_ip_mask: 23
TF_VAR_bios: "ovmf"
TF_VAR_pool: "IP-Temp-VMs"
TF_VAR_tags: "ip-simul-ci"
TF_VAR_fleet_hosts_user: "devops"
TF_VAR_template_name: "u22dci-gpu"
TF_VAR_fleet_manager_name: ${{ steps.infra_names.outputs.simul_prefix }}
TF_VAR_fleet_manager_memory: 30000
TF_VAR_fleet_manager_cores: 10
TF_VAR_fleet_manager_disk_size: "110G"
# TF_VAR_ip_list: '["dhcp"]'
# TF_VAR_proxmox_host_list: '["mary"]'
# TF_VAR_vm_gateway: "10.10.1.254"
# TF_VAR_ip_mask: 23
# TF_VAR_bios: "ovmf"
# TF_VAR_pool: "IP-Temp-VMs"
# TF_VAR_tags: "ip-simul-ci"
# TF_VAR_fleet_hosts_user: "devops"
# TF_VAR_template_name: "u22dci-gpu"
# TF_VAR_fleet_manager_name: ${{ steps.infra_names.outputs.simul_prefix }}
# TF_VAR_fleet_manager_memory: 30000
# TF_VAR_fleet_manager_cores: 10
# TF_VAR_fleet_manager_disk_size: "110G"
# TF_VAR_proxmox_host: "mary"
# TF_VAR_proxmox_api_url: ${{ secrets.proxmox_api_url }}
TF_VAR_vm_name: "test-bpg-tf"
TF_VAR_vm_memory: 8192
TF_VAR_vm_cores: 4
TF_VAR_vm_core_type: "host"
TF_VAR_vm_disk_size: 20
TF_VAR_vm_disk_interface: "scsi0"
TF_VAR_vm_type: "q35"
TF_VAR_vm_os_type: "l26"
TF_VAR_vm_network_bridge: "vmbr0"
TF_VAR_vm_network_ip_address: "dhcp"
TF_VAR_vm_disk_storage: "nas-mary"
TF_VAR_vm_img_id: "nas-mary:iso/0.0.1-13-desktop-jammy_local.img"
TF_VAR_vm_bios: "ovmf"
TF_VAR_cloud_init_storage: "local"
TF_VAR_hostpci_device: "hostpci0"
TF_VAR_hostpci_device_id: "0000:01:00.0"
TF_VAR_hostpci_device_pcie: "true"
TF_VAR_hostpci_device_xvga: "true"
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

too many env vars here too, please use something more maintainable


publish:
needs: [Install-Robot, Install-Simulator-Robot, Validation-Simulator-Tests]
Expand Down
2 changes: 1 addition & 1 deletion README.md
Original file line number Diff line number Diff line change
Expand Up @@ -3,4 +3,4 @@
## - name: Publish to project data viewer
This step publishes data to the [project data viewer website](https://personal-7vf0v2cu.outsystemscloud.com/ProjectDataViewer5/). The site is used to visualize which packages are installed in the spawner container in the projects. By default this step is disabled. To enable set the `use_project_data_viewer` parameter to true in the workflow file of your project. If failed the step is skipped.

The credentials to the site is given in the [confluence page](https://movai.atlassian.net/wiki/spaces/MF/pages/2403074053/Project+Data+Viewer).
The credentials to the site is given in the [confluence page](https://movai.atlassian.net/wiki/spaces/MF/pages/2403074053/Project+Data+Viewer).
DenisBorzenkov marked this conversation as resolved.
Show resolved Hide resolved