Introduction When Exadata Database Machines is shipped to Customer's site it consists of a Cabinet (Rack) and components (Compute nodes, Storage cells, Infiniband Switches and Cisco Switch). The Exadata Rack and its components are assigned a unique Serial Number. The serial number can be found on the Exadata packing slip, at the rear of the unit or can be requested from Oracle when you don't have access to the servers. In Exadata Database Machines, there are 2 types of serial numbers: Rack Serial Number Components (Compute nodes, Storage cells, Infiniband Switches and Cisco Switch) serial number Serial numbers are used when logging a Service Request with Oracle. Assumption Root user password for Compute nodes, Storage cells and Infiniband Switches Root user password for Compute nodes and Storage cells ILOM. Root user equivalence must be setup between compute nodes and storage cells for running DCLI commands. Environment Exadata Model V2 Half Rack 2TB Exadata Components Storage Cell (7), Compute node (4) & Infiniband Switch (3) Exadata Storage cells DBM01CEL01 – DBM01CEL07 Exadata Compute nodes DBM01DB01 – DBM01DB04 Exadata Software Version 12.1.2.1.3 Exadata DB Version 11.2.0.4 BP20 Exadata Infiniband Version 2.1.5-1 How to obtain the Serial Numbers The following commands can help you to obtain the serial numbers after the Exadata Installation. Rack Serial Number – From a Compute node: [root@dbm01db01 ~]# ipmitool sunoem cli "show /SP system_identifier" Connected. Use ^D to exit. -> show /SP system_identifier /SP Properties: system_identifier = Sun Oracle Database Machine 1008AK201A -> Session closed Disconnected Rack Serial Number - From all Compute nodes: [root@dbm01db01 ~]# dcli -g dbs_group -l root -s "-q" 'ipmitool sunoem cli "show /SP system_identifier"' dbm01db01: Connected. Use ^D to exit. dbm01db01: -> show /SP system_identifier dbm01db01: dbm01db01: /SP dbm01db01: Properties: dbm01db01: system_identifier = Sun Oracle Database Machine 1008AK201A dbm01db01: dbm01db01: dbm01db01: -> Session closed dbm01db01: Disconnected dbm01db02: Connected. Use ^D to exit. dbm01db02: -> show /SP system_identifier dbm01db02: dbm01db02: /SP dbm01db02: Properties: dbm01db02: system_identifier = Sun Oracle Database Machine 1008AK201A dbm01db02: dbm01db02: dbm01db02: -> Session closed dbm01db02: Disconnected dbm01db03: Connected. Use ^D to exit. dbm01db03: -> show /SP system_identifier dbm01db03: dbm01db03: /SP dbm01db03: Properties: dbm01db03: system_identifier = Sun Oracle Database Machine 1008AK201A dbm01db03: dbm01db03: dbm01db03: -> Session closed dbm01db03: Disconnected dbm01db04: Connected. Use ^D to exit. dbm01db04: -> show /SP system_identifier dbm01db04: dbm01db04: /SP dbm01db04: Properties: dbm01db04: system_identifier = Sun Oracle Database Machine 1008AK201A dbm01db04: dbm01db04: dbm01db04: -> Session closed dbm01db04: Disconnected Compute node serial Number – One Compute node: [root@dbm01db01 ~]# ipmitool sunoem cli "show /SYS product_serial_number" Connected. Use ^D to exit. -> show /SYS product_serial_number /SYS Properties: product_serial_number = 1005XX5001 -> Session closed Disconnected OR [root@dbm01db01 ~]# dmidecode -s system-serial-number 1005XX5001 Compute node serial Number – All Compute nodes: [root@dbm01db01 ~]# dcli -g dbs_group -l root -s "-q" dmidecode -s system-serial-number dbm01db01: 1005XX5001 dbm01db02: 1005XX5012 dbm01db03: 1005XX5023 dbm01db04: 0328MXX-11039F0100 Storage Cells serial Number – All Storage Cells: [root@dbm01db01 ~]# dcli -g cell_group -l root -s "-q" dmidecode -s system-serial-number dbm01cel01: 1023XXG001 dbm01cel02: 1023XXG012 dbm01cel03: 1024XXG023 dbm01cel04: 1023XXG034 dbm01cel05: 1023XXG045 dbm01cel06: 1023XXG056 dbm01cel07: 1023XXG067 Infiniband Switch serial number: [root@dbm01sw-ib1 ~]# showfruinfo Sun_Man1R: UNIX_Timestamp32 : Mon May 3 11:59:30 2010 Sun_Fru_Description : ASSY,NM2-36P Vendor_ID_Code : 11 E1 Vendor_ID_Code_Source : 01 Vendor_Name_And_Site_Location : 4577 CELESTICA CORP. SAN JOSE CA US Sun_Part_Number : 5111232 Sun_Serial_Number : 0110SXX-10173P0700 Serial_Number_Format : 4V3F1-2Y2W2X4S Initial_HW_Dash_Level : 06 Initial_HW_Rev_Level : 50 Sun_Fru_Shortname : NM2, 36 ports Sun_Hazard_Class_Code : Y Sun_SpecPartNo : 885-1507-06 Sun_FRU_LabelR: Sun_Serial_Number : FRU_Part_Dash_Number : 541-3495-06 OR [root@dbm01sw-ib1 ~]# su - ilom-admin ############################################### # This user never changed the default password. # Please change password immediately! ############################################### Oracle(R) Integrated Lights Out Manager Version ILOM 3.0 r47111 Copyright (c) 2012, Oracle and/or its affiliates. All rights reserved. -> ls /SYS /SYS Targets: MB Switch_Diag Fabric_Mgmt Platform_CLI CHASSIS_STATUS POWER_ATTN TEMP_ATTN COOLING_ATTN IBDEV_ATTN CABLE_ATTN POWER_REDUN COOLING_REDUN CABLE_CONN_STAT PSU0 PSU1 FAN1 FAN2 FAN3 I_POWER I_ATTENTION I_LOCATOR Properties: type = Host System ipmi_name = SYS product_name = Sun Datacenter InfiniBand Switch 36 product_part_number = 5111232 product_serial_number = 0110SXX-10173P0700 product_manufacturer = Sun Microsystems Commands: cd show -> From the above output we can see that the Rack serial number and System serial numbers. If you observer on the compute node 4 the Rack Serial number is set to (none) and the system serial number is incorrect . In this article I will demonstrate how to set and correct the Rack and system serial number on Exadata Database Machine. Steps to update Exadata Rack Serial number Obtain the Rack serial number from one of the Exadata compute nodes. [root@dbm01db01 ~]# ipmitool sunoem cli "show /SP system_identifier" Connected. Use ^D to exit. -> show /SP system_identifier /SP Properties: system_identifier = 1008AK201A -> Session closed Disconnected Connect to problematic compute node and get the Rack serial number. Here the issue is with compute node 4 dbm01db04 [root@dbm01db04 ~]# ipmitool sunoem cli "show /SP system_identifier" Connected. Use ^D to exit. -> show /SP system_identifier /SP Properties: system_identifier = (none) -> Session closed Disconnected Here the Rack serial number is set to none . Set the Rack serial number using the following command. [root@dbm01db04 ~]# ipmitool sunoem cli 'set /SP system_identifier="Sun Oracle Database Machine 1008AK201A"' Connected. Use ^D to exit. -> set /SP system_identifier="Sun Oracle Database Machine 1008AK201A" Set 'system_identifier' to 'Sun Oracle Database Machine 1008AK201A' -> Session closed Disconnected Verify the Rack serial number is updated to correct value. [root@dbm01db01 ~]# ipmitool sunoem cli "show /SP system_identifier" Connected. Use ^D to exit. -> show /SP system_identifier /SP Properties: system_identifier = Sun Oracle Database Machine 1008AK201A -> Session closed Disconnected Steps to update Exadata System Serial number Here the compute node 4 has incorrect serial number. [root@dbm01db04 ~]# ipmitool sunoem cli "show /SYS product_serial_number" Connected. Use ^D to exit. -> show /SYS product_serial_number /SYS Properties: product_serial_number = 0328MXX-11039F0100 -> Session closed Disconnected Get the correct serial number from the Exadata Installation summary document, packing slip or from other records that you may maintain. For dbm01db04: The correct serial number is " 1005XX5034 " Connect to the dbm01db04 ILOM command line and get the serial number [root@dbm01db01 ~]# ssh root@dbm01db04-ilom Password: Oracle(R) Integrated Lights Out Manager Version 3.0.16.15.j r101695 Copyright (c) 2015, Oracle and/or its affiliates. All rights reserved. -> show /SYS -d properties /SYS Properties: type = Host System ipmi_name = /SYS product_name = SUN FIRE X4170 SERVER product_part_number = 541-3874-03 product_serial_number = 0328MXX-11039F0100 product_manufacturer = ORACLE CORPORATION fault_state = OK clear_fault_action = (none) power_state = On Get the firmware -> version SP firmware 3.0.16.15.j SP firmware build number: 101695 SP firmware date: Thu Aug 6 06:34:34 CST 2015 SP filesystem version: 0.1.23 Create a temporary user to be used for correcting the serial number. This is useful specially when you don't have root user access. -> create /SP/users/escalation password=password role=aucros Creating user... Created /SP/users/escalation Connect to ILOM command line using the temporary user [root@dbm01db04 ~]# ssh escalation@dbm01db04-ilom Password: Oracle(R) Integrated Lights Out Manager Version 3.0.16.15.j r101695 Copyright (c) 2015, Oracle and/or its affiliates. All rights reserved. -> show /SP check_physical_presence /SP Properties: check_physical_presence = false Set the temporary user password and session -> set /SP/users/escalation/escalation/ escalation_password=true Password:*** **** ** **** *** *** **** **** *** **** **** **** **** **** **** **** **** **** **** **** **** **** **** **** *** **** *** **** **** * Short form password is: ARMY OHIO FROG -> set SESSION mode=escalation Short Form Password:**** **** **** Now using the "servicetool" command update the serial number: bash-2.05b# servicetool Usage: servicetool OPTIONS OPTIONS: --board_replaced=BOARD update FRU information for BOARD after board has been replaced --fru_product_part_number write a new product part number to the mainboard FRU --fru_product_serial_number write a new product serial number to the mainboard FRU --fru_chassis_serial_number write a new chassis serial number to the mainboard FRU --fru_asset_tag write a new asset tag to the mainboard FRU BOARD may be one of: mainboard service_processor bash-2.05b# servicetool --fru_product_serial_number Servicetool is going to update the mainboard FRU product serial number. Do you want to continue (y|n)? y When entering values, do not use quotes; If you require embedded quotes, escape them with three backslashes; e.g. \\\" What is the new product serial number? 1005XX5034 The product serial number has been updated. The new serial number is: " 1005XX5034 " Updating FRUs... done bash-2.05b# exit -> show /SYS /SYS Targets: MB SP PS0 PS1 DBP PDB PADCRD FB0 FB1 PWRBS INTSW VPS T_AMB OK SERVICE LOCATE PS_FAULT FAN_FAULT TEMP_FAULT Properties: type = Host System ipmi_name = /SYS product_name = SUN FIRE X4170 SERVER product_part_number = 541-3874-03 product_serial_number = 0328MXX-11039F0100 product_manufacturer = ORACLE CORPORATION fault_state = OK clear_fault_action = (none) power_state = On Commands: cd reset set show start stop Reset the ILOM so the changes are visible. -> reset /SP Are you sure you want to reset /SP (y/n)? y Performing reset on /SP -> Connection to dbm01db04-ilom closed by remote host. Connection to dbm01db04-ilom closed. Connect to ILOM command line and verify the changes. [root@dbm01db04 ~]# ssh dbm01db04-ilom Password: Oracle(R) Integrated Lights Out Manager Version 3.0.16.15.j r101695 Copyright (c) 2015, Oracle and/or its affiliates. All rights reserved. [root@dbm01db04 ~]# ssh escalation@dbm01db04-ilom Password: Oracle(R) Integrated Lights Out Manager Version 3.0.16.15.j r101695 Copyright (c) 2015, Oracle and/or its affiliates. All rights reserved. -> show /SYS /SYS Targets: MB SP PS0 PS1 DBP PDB PADCRD FB0 FB1 PWRBS INTSW VPS T_AMB OK SERVICE LOCATE PS_FAULT FAN_FAULT TEMP_FAULT Properties: type = Host System ipmi_name = /SYS product_name = SUN FIRE X4170 SERVER product_part_number = 541-3874-03 product_serial_number = 1005XX5034 product_manufacturer = ORACLE CORPORATION fault_state = OK clear_fault_action = (none) power_state = On Commands: cd reset set show start stop Drop the temporary user created -> set /SP/users/escalation/escalation/ escalation_password=false Mode password has been removed. -> delete /SP/users/escalation Are you sure you want to delete /SP/users/escalation (y/n)? y Deleted /SP/users/escalation -> exit Connection to dbm01db04-ilom closed. Verify server was NOT rebooted [root@dbm01db04 ~]# uptime 05:35:51 up 91 days, 19:44, 2 users, load average: 2.81, 2.86, 2.74 Conclusion In this article we have learnt what is a Serial Number, how to obtain serial numbers for various components in Exadata and also how to update/correct Serial number of Rack and Component. ILOM commands are very useful in obtaining and updating the Serial Numbers. Exadata Serial Numbers – How to obtain and Update Serial Numbers
↧