Tag: Failed Upgrade

We’ve all been there. You’re working to stage your VxRail upgrade and something goes terribly, horribly wrong. You’re beside yourself because you’ve got a deadline, and your upgrade is dead in the water. You’ve tried cancelling the upgrade in the GUI, but it JUST. KEEPS. FAILING.

Well, here’s what you do to get back on track.

1. SSH into your VxRail Manager as mystic.
2. Elevate to root using the su command.
3. Run the following string of commands.

psql -U postgres vxrail -c "delete from system.operation_status where (state='FAILED' or state='IN_PROGRESS') and owner like 'Lcm%';"

psql -U postgres vxrail -c "update system.operation_status set state='FAILED' where owner='CustomizeComponentScan' and state='STARTED';"

echo '{"state":"NONE","deployed_for_public_api":false}' > /var/lib/vmware-marvin/bundle_state.jsonvxrail:/home/mystic # mv /var/lib/vmware-marvin/composite-upgrade.json /var/lib/vmware-marvin/composite-upgrade.json.old

curl -X GET --unix-socket /var/lib/vxrail/nginx/socket/nginx.sock "http://127.0.0.1:5000/rest/vxm/internal/lockservice/v1/lock"

curl -X POST --unix-socket /var/lib/vxrail/nginx/socket/nginx.sock "http://127.0.0.1:5000/rest/vxm/internal/lockservice/v1/lock/release"  -H "Content-Type: application/json" -d '{"locked_by": "UPGRADE"}'

systemctl restart runjars
systemctl restart vmware-marvin

The result of the command above should resemble this:

DELETE 1
UPDATE 0
mv: cannot stat '/var/lib/vmware-marvin/composite-upgrade.json': No such file or directory
{"error_code": 1001, "message": "Failed to get the lock information due to the lock does not exist."}
{"error_code": 1001, "message": "Failed to release the lock due to the lock does not exist."}

If you’re not comfortable with executing that command, open …

Read More

We’ve all been there. You’re working to stage your VxRail upgrade and something goes terribly, horribly wrong. You’re beside yourself because you’ve got a deadline, and your upgrade is dead in the water. You’ve tried cancelling the upgrade in the GUI, but it JUST. KEEPS. FAILING.

Well, here’s what you do to get back on track.

1. SSH into your VxRail Manager as mystic.
2. Elevate to root using the su command.
3. Run the following string of commands.

psql -U postgres mysticmanager -c "delete from operation_status where state='FAILED';" ; psql -U postgres mysticmanager -c "delete from operation_status where state='IN_PROGRESS';" ; psql -U postgres mysticmanager -c "update virtual_appliance SET upgrade_status='HAS_NEWER' where component_id='VXRAIL_SYSTEM';" ;psql -U postgres mysticmanager -c "update virtual_appliance SET upgrade_status_response=null where component_id='VXRAIL_SYSTEM';" ;psql -U postgres mysticmanager -c "DELETE FROM composite_upgrade;" ;psql -U postgres mysticmanager -c "DELETE FROM operation_lock;" ;echo "Reset the Database Table and now will clean up LCM Folder" ;rm -rf /data/store2/lcm/* ;echo "This is above 4.7.300, so will reset the bundle_update.json" ;echo "{\"state\":\"NONE\",\"alerts\":[]}" > /var/lib/vmware-marvin/bundle_state.json ;echo "Restarting Services" ; systemctl restart vmware-marvin;systemctl restart runjars

The result of the command above should resemble this:

If you’re not comfortable with executing that command, open up a support ticket with Dell EMC …

Read More