Virtual instances are stuck in the deleting state

Technote (troubleshooting)


Problem(Abstract)

In the "Virtual Systems Instances" section of the IBM SmartCloud Orchestrator user interface, some instances are stuck in the deleting state. These instances were deployed to VMware and do not show in VMware or nova list. However, they still show in the IBM SmartCloud Orchestrator user interface. After restarting IBM Workload Deployer, they still display in the user interface.

Cause

An active task in the task list that is associated with this virtual instance might be blocking the delete task

Resolving the problem

To resolve this issue, complete the following steps:

  1. In the IBM SmartCloud Orchestrator user interface, click Administration > Task Queue.

  2. Look for tasks that are associated with the deletion of the specific virtual machine. The task is probably still in the "Active" state, but it is hung.

  3. Delete any tasks that are listed with the virtual system name in them, if possible.

  4. Try the delete button again from the Virtual Systems Instances panel. The removed tasks will now allow the next deletion to complete instead of just queuing it up. Often a task is "blocking" the delete process and causing it to queue up.


If these steps do not help, then you can use one of the following REST API options to clear the task.

Note: You can install REST clients as add-ons into your browser. For example, RESTClient is an add-on that can be used in Mozilla Firefox.


After the RESTClient is installed in Firefox and you have restarted it, log into IBM SmartCloud Orchestrator, and click Administration > Task Queue.

  • Option 1:
    1. Look for tasks that are associated with the deletion of the virtual machine. Those tasks are probably in the Active state.

    2. In the RESTClient, use the "GET" method and go to https://SCO_IP_address/resources/tasks where SCO_IP_address is the IP address for IBM SmartCloud Orchestrator.


      The response header should be "200 OK".

    3. Look in the Response body for the list of tasks.

    4. Find the same task that is associated with the deletion and its "id" attribute. For example, see the following code:
      {
      "updateduserid": 2,
      "actiontime": 1380814996001,
      "priority": 0,
      "active": "N",
      "created": 1378222970818,
      "dependency": -1,
      "name": "RM51000(\"Before+virtual+system+instance+deletion\"
      ,\"Oracle-3853a5c5-24ea-4d1f-a0f2-f607e1cbce07\")",
      "currentstatus": "RM01036",
      "createduserid": 2,
      "currentmessage": "RM01036",
      "taskcountry": "US",
      "immortal": 0,
      "tasklang": "en",
      "recoveredevent": "",
      "event": "instance-process-stage-plugpoint",
      "updated": 1378224410901,
      "id": 3593,
      "counter": 0,
      "failedevent": "",
      "disk": 0,
      "processingflag": 0
      },


      The id field value is "3593".

    5. Use the RESTClient to delete the task. In the method field, select DELETE, and enter https://SCO_IP_address/resources/tasks/task_id in the URL field. The SCO_IP_address variable is the IP address for IBM SmartCloud Orchestrator. The task_id variable is the ID field value.


    These steps should delete the task.

  • Option 2:
    If you do not find any tasks that are listed with the virtual system name in them, force the virtual machine instance status into the 'stopped' state and remove the virtual machine instance afterwards. The following steps explain this process:
    1. Click the name of the virtual machine instance in the "Virtual System Instances" panel.

    2. Make note of the instance ID (instance_id) at the end of the URL in the address bar. For example:
      https://<SCO.IP.address>/dashboard/runtime/virtual/?domainName=Default&projectName=<project_name>#<instance_id>
    3. In the RESTClient, use the "PUT" method and go to the following URL and request body:

      REST PUT https://<SCO IP address>/resources/virtualSystems/<instance_id>
      Body { "desiredstatus" : "RM01011" }



      When you send the PUT request, the expected status return code is 200. For example:
      Status Code: 200 OK

      {
      "desiredstatus_text": "Stopped",
      "currentstatus_text": "Stopping",
      "name": "<virtual_system_instance>",
      "desiredstatus": "RM01011",
      "pattern": "/resources/patterns/<pattern_id>",
      "id":
      <instance_id>,
      "currentmessage_text": "Stopping virtual machines",
      "created": 1392024033796,
      "currentstatus": "RM01010",
      "currentmessage": "RM07028",
      "owner": "/resources/users/<user_id>",
      "updated": 1396620773989
      }

    4. Click Refresh in the user interface to check the status of the virtual machine.


      The status of the virtual machine instance should show "Stopped". It should now be possible to remove the virtual machine instance from the user interface by clicking Delete in the task bar of the "Virtual System Instances" panel.

Document information


More support for:

IBM Cloud Orchestrator

Software version:

2.2, 2.2.0.1, 2.3

Operating system(s):

Linux

Reference #:

1648846

Modified date:

2014-04-04

Translate my page

Content navigation