Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add Vmotion Guidelines to EKS-A docs #8852

Merged
merged 53 commits into from
Oct 23, 2024
Merged
Show file tree
Hide file tree
Changes from 52 commits
Commits
Show all changes
53 commits
Select commit Hold shift + click to select a range
2d905fc
Add Vmotion Guidelines
mimcdevitt Oct 16, 2024
d8699bc
Update docs/content/en/docs/troubleshooting/troubleshooting.md
mimcdevitt Oct 17, 2024
68d4513
Update docs/content/en/docs/troubleshooting/troubleshooting.md
mimcdevitt Oct 17, 2024
b7f88a3
Update docs/content/en/docs/troubleshooting/troubleshooting.md
mimcdevitt Oct 17, 2024
6d4e4a4
Update docs/content/en/docs/troubleshooting/troubleshooting.md
mimcdevitt Oct 17, 2024
592565a
Adding Nodes section to Cluster management
mimcdevitt Oct 17, 2024
056c475
Adding Nodes section to Cluster management
mimcdevitt Oct 17, 2024
8b1511d
removing vmotion section from eks-a troubleshooting
mimcdevitt Oct 17, 2024
a48152c
Update docs/content/en/docs/clustermgmt/nodes/_index.md
mimcdevitt Oct 18, 2024
fcec3ee
Update docs/content/en/docs/clustermgmt/nodes/vmotion.md
mimcdevitt Oct 18, 2024
5b50c7e
Update docs/content/en/docs/clustermgmt/nodes/vmotion.md
mimcdevitt Oct 18, 2024
5ba2f79
Update docs/content/en/docs/clustermgmt/nodes/vmotion.md
mimcdevitt Oct 18, 2024
79dd1bc
Update docs/content/en/docs/clustermgmt/nodes/vmotion.md
mimcdevitt Oct 18, 2024
9f64b19
Update docs/content/en/docs/clustermgmt/nodes/vmotion.md
mimcdevitt Oct 18, 2024
7747e0b
Update docs/content/en/docs/clustermgmt/nodes/vmotion.md
mimcdevitt Oct 18, 2024
5458c5c
Update docs/content/en/docs/clustermgmt/nodes/vmotion.md
mimcdevitt Oct 18, 2024
f59543a
Update docs/content/en/docs/clustermgmt/nodes/vmotion.md
mimcdevitt Oct 18, 2024
83ac178
Update docs/content/en/docs/clustermgmt/nodes/vmotion.md
mimcdevitt Oct 19, 2024
c1ea995
Update docs/content/en/docs/clustermgmt/nodes/vmotion.md
mimcdevitt Oct 21, 2024
a05c24c
Update docs/content/en/docs/clustermgmt/nodes/vmotion.md
mimcdevitt Oct 21, 2024
d5cf4f0
Update docs/content/en/docs/clustermgmt/nodes/vmotion.md
mimcdevitt Oct 21, 2024
b2c4e54
Update docs/content/en/docs/clustermgmt/nodes/vmotion.md
mimcdevitt Oct 21, 2024
275f7e9
Update docs/content/en/docs/clustermgmt/nodes/vmotion.md
mimcdevitt Oct 21, 2024
3b94444
Update docs/content/en/docs/clustermgmt/nodes/vmotion.md
mimcdevitt Oct 21, 2024
9baf914
Update docs/content/en/docs/clustermgmt/nodes/vmotion.md
mimcdevitt Oct 21, 2024
aeb187f
Update docs/content/en/docs/clustermgmt/nodes/vmotion.md
mimcdevitt Oct 21, 2024
fc6215f
Update docs/content/en/docs/clustermgmt/nodes/vmotion.md
mimcdevitt Oct 21, 2024
1b7ee63
Update docs/content/en/docs/clustermgmt/nodes/vmotion.md
mimcdevitt Oct 21, 2024
c96511d
Update docs/content/en/docs/clustermgmt/nodes/vmotion.md
mimcdevitt Oct 21, 2024
526dc37
Update docs/content/en/docs/clustermgmt/nodes/vmotion.md
mimcdevitt Oct 21, 2024
eae6edd
Update docs/content/en/docs/clustermgmt/nodes/vmotion.md
mimcdevitt Oct 21, 2024
e353583
Update docs/content/en/docs/clustermgmt/nodes/vmotion.md
mimcdevitt Oct 21, 2024
33fabf8
Update docs/content/en/docs/clustermgmt/nodes/vmotion.md
mimcdevitt Oct 21, 2024
5d850fc
Update docs/content/en/docs/clustermgmt/nodes/vmotion.md
mimcdevitt Oct 21, 2024
650de44
Update docs/content/en/docs/clustermgmt/nodes/vmotion.md
mimcdevitt Oct 21, 2024
cee5afa
Update docs/content/en/docs/clustermgmt/nodes/vmotion.md
mimcdevitt Oct 21, 2024
b0e62d0
Update docs/content/en/docs/clustermgmt/nodes/vmotion.md
mimcdevitt Oct 21, 2024
f56e24e
Update docs/content/en/docs/clustermgmt/nodes/vmotion.md
mimcdevitt Oct 21, 2024
6d45346
Update docs/content/en/docs/clustermgmt/nodes/vmotion.md
mimcdevitt Oct 21, 2024
ba04626
Update docs/content/en/docs/clustermgmt/nodes/vmotion.md
mimcdevitt Oct 21, 2024
f24b470
Update docs/content/en/docs/clustermgmt/nodes/vmotion.md
mimcdevitt Oct 21, 2024
26a6f4f
Update docs/content/en/docs/clustermgmt/nodes/vmotion.md
mimcdevitt Oct 21, 2024
1f2c3a3
Update docs/content/en/docs/clustermgmt/nodes/vmotion.md
mimcdevitt Oct 21, 2024
6570614
Update docs/content/en/docs/clustermgmt/nodes/vmotion.md
mimcdevitt Oct 21, 2024
6f3ee0b
Updating vmotion to VMotion and fixing code bock formating
mimcdevitt Oct 22, 2024
6cb5f77
Update docs/content/en/docs/clustermgmt/nodes/vmotion.md
mimcdevitt Oct 22, 2024
34a2c9d
Update docs/content/en/docs/clustermgmt/nodes/vmotion.md
mimcdevitt Oct 22, 2024
8d4fe41
Update docs/content/en/docs/clustermgmt/nodes/vmotion.md
mimcdevitt Oct 22, 2024
97fec9f
Update docs/content/en/docs/clustermgmt/nodes/vmotion.md
mimcdevitt Oct 22, 2024
e36e840
Update docs/content/en/docs/clustermgmt/nodes/vmotion.md
mimcdevitt Oct 22, 2024
1b15b79
Update docs/content/en/docs/clustermgmt/nodes/vmotion.md
mimcdevitt Oct 22, 2024
a39b2d8
Update docs/content/en/docs/clustermgmt/nodes/vmotion.md
mimcdevitt Oct 22, 2024
80d1357
restore formatting of kubectl commands section
mimcdevitt Oct 23, 2024
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
8 changes: 8 additions & 0 deletions docs/content/en/docs/clustermgmt/nodes/_index.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,8 @@
---
title: "Nodes"
linkTitle: "Nodes"
date: 2017-01-05
weight: 30
description: >
Managing EKS Anywhere nodes
---
81 changes: 81 additions & 0 deletions docs/content/en/docs/clustermgmt/nodes/vmotion.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,81 @@
---
title: "Manage vSphere VMs with vMotion "
linkTitle: "Manage vSphere VMs"
weight: 20
description: >
Using vMotion to manage vSphere VMs used in clusters
aliases:
---

## vMotion with EKS Anywhere


VMware vMotion is a feature within vSphere that allows live migration of virtual machines (VMs) between ESXi hypervisor hosts. This document outlines the guidelines for using vMotion to migrate EKS Anywhere nodes between vSphere ESXi hosts using vMotion while ensuring cluster stability.

### Considerations for node migration using vMotion

When migrating EKS Anywhere nodes with vMotion, several considerations must be kept in mind, particularly around configuration values defined in the [vSphere cluster spec file]({{< relref "/docs/getting-started/vsphere/vsphere-spec" >}}) . These configurations must remain unchanged during the migration and the infrastructure these configurations represent should also not change.


* **No cross-vCenter vMotion**

EKS Anywhere nodes cannot be migrated between different vCenter environments using vMotion. The nodes must remain within the same vCenter instance for proper EKS Anywhere operation. The vCenter Server managing the EKS Anywhere cluster is specified in the `VSphereDatacenterConfig` section of the EKS Anywhere [vSphere cluster spec file]({{< relref "/docs/getting-started/vsphere/vsphere-spec" >}}), under the `spec.server` field, and cannot be changed.


* **vSphere infrastructure settings in** `VSphereDatacenterConfig`

In addition to the vCenter element, two additional elements defined in the `VSphereDatacenterConfig` section of the EKS Anywhere cluster spec file are immutable must remain unchanged during the vMotion process:


* datacenter `(spec.datacenter)` - The datacenter specified in the EKS Anywhere cluster spec file must not change during the vMotion migration. This value refers to the vSphere datacenter that hosts the EKS Anywhere nodes.


* network `(spec.network)` - The network defined in the EKS Anywhere cluster spec file must not change during the vMotion migration. This value refers the vSphere network in which the EKS Anywhere nodes are operating. Any changes to this network configuration would disrupt node connectivity and lead to outages in the EKS Anywhere cluster.


* **VMware Storage vMotion is not supported for EKS Anywhere nodes**

datastore `(spec.datastore)` - Defined in the `VSphereMachineConfig` section of the EKS Anywhere cluster spec file is immutable. This value refers to the vSphere datastore that holds EKS Anywhere node vm backing store. Modifying the datastore during vMotion (storage vMotion) would require a change to this value, which is not supported.


* **Node network configuration stability**

The IP address, subnet mask, and default gateway of each EKS Anywhere node must remain unchanged during the vMotion process. Any modifications to the IP address configuration can cause communication failures between the EKS Anywhere nodes, pods, and the control plane, leading to disruptions in EKS Anywhere cluster operations.


* **EKS Anywhere configuration stabiltiy**

The EKS Anywhere environment itself should remain unchanged during vMotion. Do not perform or trigger any EKS Anywhere changes or life cycle events while performing vmotion.


### Best practices for vMotion with EKS Anywhere clusters

* **Follow VMware vMotion best practices**

* General best practices: Review VMware's general guidelines for optimal vMotion performance, such as ensuring sufficient CPU, memory, and network resources, and minimizing load on the ESXi hosts during the migration. Refer to the [VMware vMotion documentation](https://docs.vmware.com/) for details.

* VMware vMotion Networking Best Practices: Whenever possible, follow the [Networking Best Practices for VMware vMotion](https://docs.vmware.com/en/VMware-vSphere/7.0/com.vmware.vsphere.vcenterhost.doc/GUID-7DAD15D4-7F41-4913-9F16-567289E22977.html) to optimize performance and reduce the risk of issues during the migration process.

* Use High-Speed Networks: A 10GbE or higher speed network is recommended to ensure smooth vMotion operations for EKS Anywhere nodes, particularly those with large memory footprints.


* **Shared Storage**

Shared storage is a requirement for vmotion of EKS Anywhere clusters. Storage such as vSAN, Fiber Channel SAN, or NFS should be shared between the supporting vSphere ESXi hosts for maintaining access to the VM's backing data without relying on storage vMotion, which is not supported in EKS Anywhere environments.


* **Monitoring before and after migration**

To verify cluster health and node stability, monitor the EKS Anywhere nodes and pods before and after the vMotion migration:

* Before migration, run the following commands to check the current health and status of the EKS Anywhere nodes and pods.
* After vMotion activity is completed, run the commands again to verify that the nodes and pods are still operational and healthy.

kubectl get nodes
mimcdevitt marked this conversation as resolved.
Show resolved Hide resolved
kubectl get pods -a



* **Infrastructure maintenance during vMotion**

It is recommended that no other infrastructure maintenance activities be performed during the vMotion operation. The underlying datacenter infrastructure supporting the network, storage, and server resources utilized by VMware vSphere must remain stable during the vMotion process. Any interruptions in these services could lead to partial or complete failures in the vMotion process, potentially causing the EKS Anywhere nodes to lose connectivity or experience disruptions in normal operations.
Loading