Switching between different versions (pattern 2)¶
Old version |
New version |
11.0 Standard Edition | 12.0 Standard Edition |
10.5 Standard Edition | 12.1 Standard Edition |
12.0 Standard Edition | 12.1 Standard Edition |
System configuration to replace in this guide¶
Prerequisites¶
Version upgrade is not possible, as described in the Service Descriptions .
For with-VRRP replacing from the old to new version, it is necessary to stop VRRP of the old LB and add VRRP settings of the new LB, because operations differ between the versions.
The customer is expected to check the functions with the new version beforehand.
It is assumed that VRRP operates in the interface for client side and does not operate in the interface for distribution server side because SNAT works there.
In vserver setting, please note that contents of settings are different between Pattern A where Virtual IP addresses are registered in the different segment from Virtual IPs registered for VRRP and are set as IP addresses to distribute so that redundancy of multiple VIP become possible, and Pattern B where Virtual IPs registered for VRRP are set as Virtual IP addresses.
As deleted vrID has to be newly created at the time of changeback, record the set values of vrID in advance.
Though the settings are not saved on the old LB side in this procedure, save the settings as required because rebooting will return the settings to those before saving. For saving method, please refer to Setting for configuration saving of NetScaler VPX.
For this procedure, operations have been checked with the following settings made.
`An error occurs when operating the customer portal of the load balancer (NetScaler VPX)<https://ecl.ntt.com/en/known-issues/loadbalancer-status-error/> `_ has been confirmed. In particular, this pattern includes the interface cutting process, so be careful when selecting the pattern. If an error occurs, the customer will need to recreate the load balancer, so be sure to make a backup of the config.
#Enable feature
enable ns feature LB SSL
#VRID
add vrID 40 -priority 200 -preemption ENABLED
#VRRP
add ns ip 192.168.10.251 255.255.255.0 -type VIP -snmp DISABLED -mgmtAccess ENABLED -vrID 40 -td 10
#server
add server Web-server-01 172.16.10.11 -td 10
add server Web-server-02 172.16.10.12 -td 10
#service group
add serviceGroup HTTPGroup HTTP -td 10 -maxClient 0 -maxReq 0 -cip DISABLED -usip NO -useproxyport YES -cltTimeout 180 -svrTimeout 360 -CKA NO -TCPB NO -CMP NO
bind serviceGroup HTTPGroup Web-server-01 80
bind serviceGroup HTTPGroup Web-server-02 80
bind serviceGroup HTTPGroup -monitorName http
#vserver(a: In case of using different Virtual Server IP and VIP for VRRP)
add lb vserver http-vserver HTTP 172.16.100.100 80 -persistenceType NONE -Listenpolicy None -cltTimeout 180 -td 10
add lb vserver ssl-vserver SSL 172.16.100.200 443 -persistenceType NONE -Listenpolicy None -cltTimeout 180 -td 10
#vserver(b: In case of using same Virtual Server IP and VIP for VRRP)
add lb vserver http-vserver HTTP 192.168.10.251 80 -persistenceType NONE -Listenpolicy None -cltTimeout 180 -td 10
add lb vserver ssl-vserver SSL 192.168.10.251 443 -persistenceType NONE -Listenpolicy None -cltTimeout 180 -td 10
#ssl
add ssl certKey server1 -cert server1.crt -key server1.key.pass -passcrypt "PrivateKeyPassword"
add ssl certKey midCA -cert midcacert.pem
link ssl certKey server1 midCA
bind ssl vserver ssl-vserver -certkeyName server1
#bind
bind lb vserver http-vserver HTTPGroup
bind lb vserver ssl-vserver HTTPGroup
#hostname
set ns hostName lb1
#timezone
set ns param -timezone "GMT+09:00-JST-Asia/Tokyo"
#Enable feature
enable ns feature LB SSL
#VMAC
add vrID 40 -priority 100 -preemption ENABLED
#VRRP
add ns ip 192.168.10.251 255.255.255.0 -type VIP -snmp DISABLED -mgmtAccess ENABLED -vrID 40 -td 10
#server
add server Web-server-01 172.16.10.11 -td 10
add server Web-server-02 172.16.10.12 -td 10
#service group
add serviceGroup HTTPGroup HTTP -td 10 -maxClient 0 -maxReq 0 -cip DISABLED -usip NO -useproxyport YES -cltTimeout 180 -svrTimeout 360 -CKA NO -TCPB NO -CMP NO
bind serviceGroup HTTPGroup Web-server-01 80
bind serviceGroup HTTPGroup Web-server-02 80
bind serviceGroup HTTPGroup -monitorName http
#vserver(a: In case of using different Virtual Server IP and VIP for VRRP)
add lb vserver http-vserver HTTP 172.16.100.100 80 -persistenceType NONE -Listenpolicy None -cltTimeout 180 -td 10
add lb vserver ssl-vserver SSL 172.16.100.200 443 -persistenceType NONE -Listenpolicy None -cltTimeout 180 -td 10
#vserver(b: In case of using same Virtual Server IP and VIP for VRRP)
add lb vserver http-vserver HTTP 192.168.10.251 80 -persistenceType NONE -Listenpolicy None -cltTimeout 180 -td 10
add lb vserver ssl-vserver SSL 192.168.10.251 443 -persistenceType NONE -Listenpolicy None -cltTimeout 180 -td 10
#ssl
add ssl certKey server1 -cert server1.crt -key server1.key.pass -passcrypt "PrivateKeyPassword"
add ssl certKey midCA -cert midcacert.pem
link ssl certKey server1 midCA
bind ssl vserver ssl-vserver -certkeyName server1
#bind
bind lb vserver http-vserver HTTPGroup
bind lb vserver ssl-vserver HTTPGroup
#hostname
set ns hostName lb2
#timezone
set ns param -timezone "GMT+09:00-JST-Asia/Tokyo"
The image of replacing¶
1.Advance state¶
2.Create new LB¶
3.New / old LB2 interface switching and new LB2 setting¶
4.Stop communication of old LB1¶
5.New LB2 communication started¶
6.New / old LB1 interface switching and new LB1 setting¶
Important
Check the config before disconnecting the interface, and if the target "interface name" and "IP address" are included in other settings, be sure to delete them. In particular, please be careful to delete the SNMP settings and syslog forwarding settings. If you disconnect without deleting it, an error will occur and you will need to recreate the load balancer.
7.Delete old LB¶
8.Failback (only if communication does not recover)¶
Work procedure¶
1 Pre-check¶
1-1. Save configuration of old LB1¶
1-2. Save configuration of old LB2¶
2.Creating new LB¶
2-1. Create new LB1¶
Note
2-2. Create a new LB2¶
Note
3.Switching the interfaces of new and old LB2¶
3-1. Stop VRRP of the old LB2¶
Note
Note
3-2. Old LB2 interface disconnection¶
(Please refer to VRRP setting , and cancel the VRRP communication settings. Click the name of old LB2, click the right (▼) of the interface having VRRP configured, and then select “Cancel VRRP communication settings”.)
Click the name of old LB2, click the right (▼) of the interface, and then select “Disconnect Logical Network“
3-3. New LB2 interface connection¶
(Please refer to Connecting the Logical Network , and connect the interface.)
Note
(Please refer to the VRRP communication setting registration , and register VRRP communication setting.)
Note
Note
(Please refer to Syslog transfer setting , and perform syslog transfer setting.)
Note
3-4. Pre-configuration restore to new LB2¶
For details, please refer to How to access NetScaler VPX CLI (SSH).
$ ssh user-admin@172.16.10.249
###############################################################################
# #
# WARNING: Access to this system is for authorized users only #
# Disconnect IMMEDIATELY if you are not an authorized user! #
# #
###############################################################################
Password:
a.If VIP of VRRP and Virtual Server IP are different
#VRRP
add ns ip 192.168.10.251 255.255.255.0 -type VIP -snmp DISABLED -mgmtAccess ENABLED -vrID 40 -td 10
#Disable Virtual IP for loadbalancing
disable ns ip 172.16.100.100 -td 10
disable ns ip 172.16.100.200 -td 10
#Removing configuration in order to configure via GUI (ssl)
add ssl certKey server1 -cert server1.crt -key server1.key.pass -passcrypt "PrivateKeyPassword"
add ssl certKey midCA -cert midcacert.pem
link ssl certKey server1 midCA
b.If VIP of VRRP and Virtual Server IP are same
#VRRP
add ns ip 192.168.10.251 255.255.255.0 -type VIP -snmp DISABLED -mgmtAccess ENABLED -vrID 40 -td 10
#VirtualServer for loadbalancing
add lb vserver http-vserver HTTP 192.168.10.251 80 -persistenceType NONE -Listenpolicy None -cltTimeout 180 -td 10
add lb vserver ssl-vserver SSL 192.168.10.251 443 -persistenceType NONE -Listenpolicy None -cltTimeout 180 -td 10
#SSL
bind ssl vserver ssl-vserver -certkeyName server1
#bind configuration for VirtualServer
bind lb vserver http-vserver HTTPGroup
bind lb vserver ssl-vserver HTTPGroup
#Removing configuration in order to configure via GUI (ssl)
add ssl certKey server1 -cert server1.crt -key server1.key.pass -passcrypt "PrivateKeyPassword"
add ssl certKey midCA -cert midcacert.pem
link ssl certKey server1 midCA
Note
4.Stop communication of old LB1¶
4-1. Virtual IP disable of old LB1¶
Note
Note
4-2. Delete Virtual Router ID of old LB1¶
4-3. Save configuration of old LB1¶
5.New LB2 communication started¶
5-1. VRRP setting of new LB2¶
#Enable Virtual IP for loadbalancing
enable ns ip 172.16.100.100 -td 10
enable ns ip 172.16.100.200 -td 10
#VRRP
add ns ip 192.168.10.251 255.255.255.0 -type VIP -snmp DISABLED -mgmtAccess ENABLED -vrID 40 -td 10
#VRRP
add ns ip 192.168.10.251 255.255.255.0 -type VIP -snmp DISABLED -mgmtAccess ENABLED -vrID 40 -td 10
#VirtualServer for loadbalancing
add lb vserver http-vserver HTTP 192.168.10.251 80 -persistenceType NONE -Listenpolicy None -cltTimeout 180 -td 10
add lb vserver ssl-vserver SSL 192.168.10.251 443 -persistenceType NONE -Listenpolicy None -cltTimeout 180 -td 10
#SSL
bind ssl vserver ssl-vserver -certkeyName server1
#bind configuration for VirtualServer
bind lb vserver http-vserver HTTPGroup
bind lb vserver ssl-vserver HTTPGroup
5-2. Confirm VRRP status of new LB2¶
#VRRP check command
> sh vrid
5-3. Confirm communication of new LB2¶
-Confirm the communication through the load balancer (browser, wget, etc.). If communication is not recovered, failback is performed. (Refer to “8 Failback” in this guide for the specific failback procedure.) -Check whether the configuration input to the load balancer (new LB2) matches the expected one. -Execute the following command to save the load balancer (new LB2) configuration. (No error is displayed)
> save ns config
Done
>
6.New / old LB1 interface switching and new LB1 setting¶
6-1. Old LB1 interface disconnection¶
(Please refer to VRRP setting ,and cancel the VRRP communication settings. Click the name of old LB1, click the right (▼) of the interface having VRRP configured, and then select “Cancel VRRP communication settings”.)
Click the name of old LB1, click the right (▼) of the interface, and then select “Disconnect Logical Network“
6-2. Interface connection of new LB1¶
(Please refer to Connecting the Logical Network , and connect the interface.)
Note
(Please refer to the VRRP communication setting registration , and register VRRP communication setting.)
Note
Note
(Please refer to Syslog transfer setting , and perform syslog transfer setting.)
Note
6-3. Pre-configuration restore to new LB1¶
$ ssh user-admin@172.16.10.250
###############################################################################
# #
# WARNING: Access to this system is for authorized users only #
# Disconnect IMMEDIATELY if you are not an authorized user! #
# #
###############################################################################
Password:
a.If VIP of VRRP and Virtual Server IP are different
#VRRP
add ns ip 192.168.10.251 255.255.255.0 -type VIP -snmp DISABLED -mgmtAccess ENABLED -vrID 40 -td 10
#Disable Virtual IP for loadbalancing
disable ns ip 172.16.100.100 -td 10
disable ns ip 172.16.100.200 -td 10
#Removing configuration in order to configure via GUI (ssl)
add ssl certKey server1 -cert server1.crt -key server1.key.pass -passcrypt "PrivateKeyPassword"
add ssl certKey midCA -cert midcacert.pem
link ssl certKey server1 midCA
b.If VIP of VRRP and Virtual Server IP are same
#VRRP
add ns ip 192.168.10.251 255.255.255.0 -type VIP -snmp DISABLED -mgmtAccess ENABLED -vrID 40 -td 10
#VirtualServer for loadbalancing
add lb vserver http-vserver HTTP 192.168.10.251 80 -persistenceType NONE -Listenpolicy None -cltTimeout 180 -td 10
add lb vserver ssl-vserver SSL 192.168.10.251 443 -persistenceType NONE -Listenpolicy None -cltTimeout 180 -td 10
#SSL
bind ssl vserver ssl-vserver -certkeyName server1
#bind configuration for VirtualServer
bind lb vserver http-vserver HTTPGroup
bind lb vserver ssl-vserver HTTPGroup
#Removing configuration in order to configure via GUI (ssl)
add ssl certKey server1 -cert server1.crt -key server1.key.pass -passcrypt "PrivateKeyPassword"
add ssl certKey midCA -cert midcacert.pem
link ssl certKey server1 midCA
Note
6-4 VRRP setting of new LB1¶
※Communication interruption may occur during this work because of VRRP switching.
#Enable Virtual IP for loadbalancing
enable ns ip 172.16.100.100 -td 10
enable ns ip 172.16.100.200 -td 10
#VRRP
add ns ip 192.168.10.251 255.255.255.0 -type VIP -snmp DISABLED -mgmtAccess ENABLED -vrID 40 -td 10
#VRRP
#add ns ip 192.168.10.251 255.255.255.0 -type VIP -snmp DISABLED -mgmtAccess ENABLED -vrID 40 -td 10
#VirtualServer for loadbalancing
add lb vserver http-vserver HTTP 192.168.10.251 80 -persistenceType NONE -Listenpolicy None -cltTimeout 180 -td 10
add lb vserver ssl-vserver SSL 192.168.10.251 443 -persistenceType NONE -Listenpolicy None -cltTimeout 180 -td 10
#SSL
bind ssl vserver ssl-vserver -certkeyName server1
#bind configuration for VirtualServer
bind lb vserver http-vserver HTTPGroup
bind lb vserver ssl-vserver HTTPGroup
#VRRP check command
> sh vrid
6-5. Communication check¶
Check the communication through the load balancer (browser, wget, etc.). If communication is not recovered, failback is performed. (Refer to “8 Failback” in this guide for the specific failback procedure.)
Check if the configuration input to the load balancer (new LB1) matches the expected one.
Execute the following command to save the load balancer (new LB1) configuration. (No error is displayed)
> save ns config
Done
>
7.Delete old LB¶
7-1. List of load balancers¶
From the ECL2.0 Customer Portal, go to “Network” → “Load Balancer” to display a list of load balancers.
7-2. Delete old LB1¶
Delete the load balancer (old LB1) from the ECL2.0 Customer Portal.
Note
7-3. Delete old LB2¶
Delete the load balancer (old LB2) from the ECL2.0 Customer Portal.
Note
8.Failback (only if communication does not recover)¶
Note
8-1. Stop communication of new LB2¶
#Disable Virtual IP for loadbalancing
disable ns ip 172.16.100.100 -td 10
disable ns ip 172.16.100.200 -td 10
#Removing Virtual IP for VRRP
rm ns ip 192.168.10.251 -td 10
#Save
save ns config
8-2. Start communication of old LB1¶
8-3. Communication check¶
8-4. Save configuration¶
Note
Though the communication has been recovered in the above, execute the command below if LB2 changeback is also required.
8-5. New LB2 interface disconnection¶
(Please refer to`VRRP setting <https://ecl.ntt.com/en/documents/tutorials/rsts/LoadBalancer/network/lb_vrrp.html>`_ ,and cancel the VRRP communication settings. Click the name of new LB2, click the right (▼) of the interface having VRRP configured, and then select “Cancel VRRP communication settings”.)
Note
8-6. Interface connection of old LB2¶
(Please refer to Connecting the Logical Network , and connect the interface.)
Note
(Click the name of old LB2, click the right (▼) of the interface having VRRP configured, and then select [ Register VRRP communication settings ].)
Note
8-7. Start communication of old LB2¶
8-8. Check status of old LB1,2¶
Check the VRRP status of the load balancer (old LB1,2).
9.Input configuration example¶
#Enable feature
enable ns feature LB SSL
#VRID
add vrID 40 -priority 200
#Server
add server Web-server-01 172.16.10.11 -td 10
add server Web-server-02 172.16.10.12 -td 10
#ServiceGroup
add serviceGroup HTTPGroup HTTP -td 10 -maxClient 0 -maxReq 0 -cip DISABLED -usip NO -useproxyport YES -cltTimeout 180 -svrTimeout 360 -CKA NO -TCPB NO -CMP NO
bind serviceGroup HTTPGroup Web-server-01 80
bind serviceGroup HTTPGroup Web-server-02 80
bind serviceGroup HTTPGroup -monitorName http
#vserver for loadbalancing
add lb vserver http-vserver HTTP 172.16.100.100 80 -persistenceType NONE -Listenpolicy None -cltTimeout 180 -td 10
add lb vserver ssl-vserver SSL 172.16.100.200 443 -persistenceType NONE -Listenpolicy None -cltTimeout 180 -td 10
##Disable Virtual IP for loadbalancing
disable ns ip 172.16.100.100 -td 10
disable ns ip 172.16.100.200 -td 10
#SSL
bind ssl vserver ssl-vserver -certkeyName server1
#bind
bind lb vserver http-vserver HTTPGroup
bind lb vserver ssl-vserver HTTPGroup
#hostname
set ns hostName lb1
#timezone
set ns param -timezone "GMT+09:00-JST-Asia/Tokyo"
#save
save ns config
Note
#Enable feature
enable ns feature LB SSL
#VRID
add vrID 40 -priority 200
#Server
add server Web-server-01 172.16.10.11 -td 10
add server Web-server-02 172.16.10.12 -td 10
#ServiceGroup
add serviceGroup HTTPGroup HTTP -td 10 -maxClient 0 -maxReq 0 -cip DISABLED -usip NO -useproxyport YES -cltTimeout 180 -svrTimeout 360 -CKA NO -TCPB NO -CMP NO
bind serviceGroup HTTPGroup Web-server-01 80
bind serviceGroup HTTPGroup Web-server-02 80
bind serviceGroup HTTPGroup -monitorName http
#hostname
set ns hostName lb1
#timezone
set ns param -timezone "GMT+09:00-JST-Asia/Tokyo"
#save
save ns config
Note
#Eisable Virtual IP for loadbalancing
enable ns ip 172.16.100.100 -td 10
enable ns ip 172.16.100.200 -td 10
#Virtual IP for VRRP
add ns ip 192.168.10.251 255.255.255.0 -type VIP -snmp DISABLED -mgmtAccess ENABLED -vrID 40 -td 10
#Virtual IP for VRRP
add ns ip 192.168.10.251 255.255.255.0 -type VIP -snmp DISABLED -mgmtAccess ENABLED -vrID 40 -td 10
#VirtualServer for loadbalancing
add lb vserver http-vserver HTTP 192.168.10.251 80 -persistenceType NONE -Listenpolicy None -cltTimeout 180 -td 10
add lb vserver ssl-vserver SSL 192.168.10.251 443 -persistenceType NONE -Listenpolicy None -cltTimeout 180 -td 10
#SSL
bind ssl vserver ssl-vserver -certkeyName server1
#bind configuration for VirtualServer
bind lb vserver http-vserver HTTPGroup
bind lb vserver ssl-vserver HTTPGroup
#Enable feature
enable ns feature LB SSL
#VRID
add vrID 40 -priority 100
#Server
add server Web-server-01 172.16.10.11 -td 10
add server Web-server-02 172.16.10.12 -td 10
#ServiceGroup
add serviceGroup HTTPGroup HTTP -td 10 -maxClient 0 -maxReq 0 -cip DISABLED -usip NO -useproxyport YES -cltTimeout 180 -svrTimeout 360 -CKA NO -TCPB NO -CMP NO
bind serviceGroup HTTPGroup Web-server-01 80
bind serviceGroup HTTPGroup Web-server-02 80
bind serviceGroup HTTPGroup -monitorName http
#VirtualServer for loadbalancing
add lb vserver http-vserver HTTP 172.16.100.100 80 -persistenceType NONE -Listenpolicy None -cltTimeout 180 -td 10
add lb vserver ssl-vserver SSL 172.16.100.200 443 -persistenceType NONE -Listenpolicy None -cltTimeout 180 -td 10
#Disable Virtual IP for loadbalancing
disable ns ip 172.16.100.100 -td 10
disable ns ip 172.16.100.200 -td 10
#SSL
bind ssl vserver ssl-vserver -certkeyName server1
#bind configuration for VirtualServer
bind lb vserver http-vserver HTTPGroup
bind lb vserver ssl-vserver HTTPGroup
#hostname
set ns hostName lb2
#timezone
set ns param -timezone "GMT+09:00-JST-Asia/Tokyo"
#save
save ns config
Note
#Enable feature
enable ns feature LB SSL
#VRID
add vrID 40 -priority 100
#Server
add server Web-server-01 172.16.10.11 -td 10
add server Web-server-02 172.16.10.12 -td 10
#ServiceGroup
add serviceGroup HTTPGroup HTTP -td 10 -maxClient 0 -maxReq 0 -cip DISABLED -usip NO -useproxyport YES -cltTimeout 180 -svrTimeout 360 -CKA NO -TCPB NO -CMP NO
bind serviceGroup HTTPGroup Web-server-01 80
bind serviceGroup HTTPGroup Web-server-02 80
bind serviceGroup HTTPGroup -monitorName http
#hostname
set ns hostName lb2
#timezone
set ns param -timezone "GMT+09:00-JST-Asia/Tokyo"
#save
save ns config
Note
#Eisable Virtual IP for loadbalancing
enable ns ip 172.16.100.100 -td 10
enable ns ip 172.16.100.200 -td 10
#Virtual IP for VRRP
add ns ip 192.168.10.251 255.255.255.0 -type VIP -snmp DISABLED -mgmtAccess ENABLED -vrID 40 -td 10
#Virtual IP for VRRP
add ns ip 192.168.10.251 255.255.255.0 -type VIP -snmp DISABLED -mgmtAccess ENABLED -vrID 40 -td 10
#VirtualServer for loadbalancing
add lb vserver http-vserver HTTP 192.168.10.251 80 -persistenceType NONE -Listenpolicy None -cltTimeout 180 -td 10
add lb vserver ssl-vserver SSL 192.168.10.251 443 -persistenceType NONE -Listenpolicy None -cltTimeout 180 -td 10
#SSL
bind ssl vserver ssl-vserver -certkeyName server1
#bind configuration for VirtualServer
bind lb vserver http-vserver HTTPGroup
bind lb vserver ssl-vserver HTTPGroup