HPE Storage Users Group

Hello.
we tried to replace a failed disk (position 39) and it still shows as failed
ran the showinvenotory commands and saw that the disk that we replaced in a different position
and the old disk showing as failed as if still in the system:

39 1:19:0? failed 5000C50068570638 SEAGATE SYJKT0300GBAS15K 6XN3ZJBS 3P01 SAS Magnetic 2013-09-19 23:00:18 BST

64 1:19:0 normal 5000C5007637CA8C SEAGATE SYJKT0300GBAS15K 6XN6M1EE 3P01 SAS Magnetic 2021-02-04 07:55:09 GMT

from service status -d
Cage 1, magazine 19:
A servicemag resume command failed on this magazine.
The command completed at Thu Feb 4 17:55:44 2021.
The output of the servicemag resume was:
servicemag resume 1 19
... mag 1 19 already onlooped

... checking for valid disks...
... disks in mag : 1 19
... warning: chunklet 64:0 is used
... warning: chunklet 64:1 is used
... warning: chunklet 64:2 is used
... warning: chunklet 64:3 is used
... warning: chunklet 64:4 is used
... warning: chunklet 64:5 is used
... warning: chunklet 64:6 is used
... warning: chunklet 64:7 is used
... warning: chunklet 64:8 is used
... warning: chunklet 64:9 is used
... warning: chunklet 64:10 is used
... warning: chunklet 64:11 is used
... warning: chunklet 64:12 is used
... warning: chunklet 64:13 is used
... warning: chunklet 64:14 is used
... warning: chunklet 64:15 is used
... warning: chunklet 64:16 is used
... warning: chunklet 64:17 is used
... warning: chunklet 64:18 is used
... warning: chunklet 64:19 is used
... warning: chunklet 64:20 is used
... warning: chunklet 64:21 is used
... warning: chunklet 64:22 is used
... warning: chunklet 64:23 is used
... warning: chunklet 64:24 is used
... warning: chunklet 64:25 is used
... warning: chunklet 64:26 is used
... warning: chunklet 64:27 is used
... warning: chunklet 64:28 is used
... warning: chunklet 64:29 is used
... warning: chunklet 64:30 is used
... warning: chunklet 64:31 is used
... warning: chunklet 64:32 is used
... warning: chunklet 64:33 is used
... warning: chunklet 64:34 is used
... warning: chunklet 64:35 is used
... warning: chunklet 64:36 is used
... warning: chunklet 64:37 is used
... warning: chunklet 64:38 is used
... warning: chunklet 64:39 is used
... warning: chunklet 64:40 is used
... warning: chunklet 64:41 is used
... warning: chunklet 64:42 is used
... warning: chunklet 64:43 is used
... warning: chunklet 64:44 is used
... warning: chunklet 64:45 is used
... warning: chunklet 64:46 is used
... warning: chunklet 64:47 is used
... warning: chunklet 64:48 is used
... warning: chunklet 64:49 is used
... warning: chunklet 64:50 is used
... warning: chunklet 64:51 is used
... warning: chunklet 64:52 is used
... warning: chunklet 64:53 is used
... warning: chunklet 64:54 is used
... warning: chunklet 64:55 is used
... warning: chunklet 64:56 is used
... warning: chunklet 64:57 is used
... warning: chunklet 64:58 is used
... warning: chunklet 64:59 is used
... warning: chunklet 64:60 is used
... warning: chunklet 64:61 is used
... warning: chunklet 64:62 is used
... warning: chunklet 64:63 is used
... warning: chunklet 64:64 is used
... warning: chunklet 64:65 is used
... warning: chunklet 64:66 is used
... warning: chunklet 64:67 is used
... warning: chunklet 64:68 is used
... warning: chunklet 64:69 is used
... warning: chunklet 64:70 is used
... warning: chunklet 64:71 is used
... warning: chunklet 64:72 is used
... warning: chunklet 64:73 is used
... warning: chunklet 64:86 is used
... warning: chunklet 64:87 is used
... warning: chunklet 64:88 is used
... warning: chunklet 64:89 is used
... warning: chunklet 64:90 is used
... warning: chunklet 64:91 is used
... warning: chunklet 64:92 is used
... warning: chunklet 64:93 is used
... warning: chunklet 64:94 is used
... warning: chunklet 64:95 is used
... warning: chunklet 64:96 is used
... warning: chunklet 64:97 is used
... warning: chunklet 64:98 is used
... warning: chunklet 64:99 is used
... warning: chunklet 64:100 is used
... warning: chunklet 64:101 is used
... warning: chunklet 64:102 is used
... warning: chunklet 64:103 is used
... warning: chunklet 64:104 is used
... warning: chunklet 64:105 is used
... warning: chunklet 64:106 is used
... warning: chunklet 64:107 is used
... warning: chunklet 64:108 is used
... warning: chunklet 64:109 is used
... warning: chunklet 64:110 is used
... warning: chunklet 64:111 is used
... warning: chunklet 64:112 is used
... warning: chunklet 64:113 is used
... warning: chunklet 64:114 is used
... warning: chunklet 64:115 is used
... warning: chunklet 64:116 is used
... warning: chunklet 64:117 is used
... warning: chunklet 64:118 is used
... warning: chunklet 64:119 is used
... warning: chunklet 64:120 is used
... warning: chunklet 64:121 is used
... warning: chunklet 64:122 is used
... warning: chunklet 64:123 is used
... warning: chunklet 64:124 is used
... warning: chunklet 64:125 is used
... warning: chunklet 64:126 is used
... warning: chunklet 64:127 is used
... warning: chunklet 64:128 is used
... warning: chunklet 64:129 is used
... warning: chunklet 64:130 is used
... warning: chunklet 64:131 is used
... warning: chunklet 64:132 is used
... warning: chunklet 64:133 is used
... warning: chunklet 64:134 is used
... warning: chunklet 64:135 is used
... warning: chunklet 64:136 is used
... warning: chunklet 64:137 is used
... warning: chunklet 64:138 is used
... warning: chunklet 64:139 is used
... warning: chunklet 64:140 is used
... warning: chunklet 64:141 is used
... warning: chunklet 64:142 is used
... warning: chunklet 64:143 is used
... warning: chunklet 64:144 is used
... warning: chunklet 64:145 is used
... warning: chunklet 64:146 is used
... warning: chunklet 64:147 is used
... warning: chunklet 64:148 is used
... warning: chunklet 64:149 is used
... warning: chunklet 64:150 is used
... warning: chunklet 64:151 is used
... warning: chunklet 64:152 is used
... warning: chunklet 64:153 is used
... warning: chunklet 64:154 is used
... warning: chunklet 64:155 is used
... warning: chunklet 64:156 is used
... warning: chunklet 64:157 is used
... warning: chunklet 64:158 is used
... warning: chunklet 64:159 is used
... warning: chunklet 64:160 is used
... warning: chunklet 64:161 is used
... warning: chunklet 64:162 is used
... warning: chunklet 64:163 is used
... warning: chunklet 64:164 is used
... warning: chunklet 64:165 is used
... warning: chunklet 64:166 is used
... warning: chunklet 64:167 is used
... warning: chunklet 64:168 is used
... warning: chunklet 64:169 is used
... warning: chunklet 64:170 is used
... warning: chunklet 64:171 is used
... warning: chunklet 64:172 is used
... warning: chunklet 64:173 is used
... warning: chunklet 64:174 is used
... warning: chunklet 64:175 is used
... warning: chunklet 64:176 is used
... warning: chunklet 64:177 is used
... warning: chunklet 64:178 is used
... warning: chunklet 64:179 is used
... warning: chunklet 64:180 is used
... warning: chunklet 64:181 is used
... warning: chunklet 64:182 is used
... warning: chunklet 64:183 is used
... warning: chunklet 64:184 is used
... warning: chunklet 64:185 is used
... warning: chunklet 64:186 is used
... warning: chunklet 64:187 is used
... warning: chunklet 64:188 is used
... warning: chunklet 64:189 is used
... warning: chunklet 64:190 is used
... warning: chunklet 64:191 is used
... warning: chunklet 64:192 is used
... warning: chunklet 64:193 is used
... warning: chunklet 64:194 is used
... warning: chunklet 64:195 is used
... warning: chunklet 64:199 is used
... warning: chunklet 64:200 is used
... warning: chunklet 64:201 is used
... warning: chunklet 64:202 is used
... warning: chunklet 64:203 is used
... warning: chunklet 64:204 is used
... warning: chunklet 64:205 is used
... warning: chunklet 64:206 is used
... warning: chunklet 64:207 is used
... warning: chunklet 64:208 is used
... warning: chunklet 64:209 is used
... warning: chunklet 64:210 is used
... warning: chunklet 64:211 is used
... warning: chunklet 64:212 is used
... warning: chunklet 64:213 is used
... warning: chunklet 64:214 is used
... warning: chunklet 64:215 is used
... warning: chunklet 64:216 is used
... warning: chunklet 64:217 is used
... warning: chunklet 64:218 is used
... warning: chunklet 64:219 is used
... warning: chunklet 64:220 is used
... warning: chunklet 64:221 is used
... warning: chunklet 64:222 is used
... warning: chunklet 64:223 is used
... warning: chunklet 64:224 is used
... warning: chunklet 64:225 is used
... warning: chunklet 64:226 is used
... warning: chunklet 64:227 is used
... warning: chunklet 64:228 is used
... warning: chunklet 64:229 is used
... warning: chunklet 64:232 is used
... warning: chunklet 64:233 is used
... warning: chunklet 64:234 is used
... warning: chunklet 64:235 is used
... warning: chunklet 64:236 is used
... warning: chunklet 64:269 is used
... warning: chunklet 64:270 is used
... warning: chunklet 64:271 is used
... verifying spare space for disks 64 and 64
... All chunklets played back / relocated.
... cleared logging mode for cage 1 mag 19
... relocating chunklets from spare space
... chunklet 63:253 - move_error,duplicate_dest, failed move
... chunklet 65:258 - move_error,duplicate_dest, failed move
... chunklet 67:257 - move_error,duplicate_dest, failed move
... chunklet 69:257 - move_error,duplicate_dest, failed move
... chunklet 63:253 - move_error,duplicate_dest, failed move
... chunklet 65:258 - move_error,duplicate_dest, failed move
... chunklet 67:257 - move_error,duplicate_dest, failed move
... chunklet 69:257 - move_error,duplicate_dest, failed move
... chunklet 63:253 - move_error,duplicate_dest, failed move
... chunklet 65:258 - move_error,duplicate_dest, failed move
... chunklet 67:257 - move_error,duplicate_dest, failed move
... chunklet 69:257 - move_error,duplicate_dest, failed move
... chunklet 63:253 - move_error,duplicate_dest, failed move
... chunklet 65:258 - move_error,duplicate_dest, failed move
... chunklet 67:257 - move_error,duplicate_dest, failed move
... chunklet 69:257 - move_error,duplicate_dest, failed move
... chunklet 63:253 - move_error,duplicate_dest, failed move
... chunklet 65:258 - move_error,duplicate_dest, failed move
... chunklet 67:257 - move_error,duplicate_dest, failed move
... chunklet 69:257 - move_error,duplicate_dest, failed move
... chunklet 63:253 - move_error,duplicate_dest, failed move
... chunklet 65:258 - move_error,duplicate_dest, failed move
... chunklet 67:257 - move_error,duplicate_dest, failed move
... chunklet 69:257 - move_error,duplicate_dest, failed move
... chunklet 63:253 - move_error,duplicate_dest, failed move
... chunklet 65:258 - move_error,duplicate_dest, failed move
... chunklet 67:257 - move_error,duplicate_dest, failed move
... chunklet 69:257 - move_error,duplicate_dest, failed move
... chunklet 63:253 - move_error,duplicate_dest, failed move
... chunklet 65:258 - move_error,duplicate_dest, failed move
... chunklet 67:257 - move_error,duplicate_dest, failed move
... chunklet 69:257 - move_error,duplicate_dest, failed move
... chunklet 63:253 - move_error,duplicate_dest, failed move
... chunklet 65:258 - move_error,duplicate_dest, failed move
... chunklet 67:257 - move_error,duplicate_dest, failed move
... chunklet 69:257 - move_error,duplicate_dest, failed move
... chunklet 63:253 - move_error,duplicate_dest, failed move
... chunklet 65:258 - move_error,duplicate_dest, failed move
... chunklet 67:257 - move_error,duplicate_dest, failed move
... chunklet 69:257 - move_error,duplicate_dest, failed move
... chunklet 63:253 - move_error,duplicate_dest, failed move
... chunklet 65:258 - move_error,duplicate_dest, failed move
... chunklet 67:257 - move_error,duplicate_dest, failed move
... chunklet 69:257 - move_error,duplicate_dest, failed move
... chunklet 63:253 - move_error,duplicate_dest, failed move
... chunklet 65:258 - move_error,duplicate_dest, failed move
... chunklet 67:257 - move_error,duplicate_dest, failed move
... chunklet 69:257 - move_error,duplicate_dest, failed move
... chunklet 63:253 - move_error,duplicate_dest, failed move
... chunklet 65:258 - move_error,duplicate_dest, failed move
... chunklet 67:257 - move_error,duplicate_dest, failed move
... chunklet 69:257 - move_error,duplicate_dest, failed move
... chunklet 63:253 - move_error,duplicate_dest, failed move
... chunklet 65:258 - move_error,duplicate_dest, failed move
... chunklet 67:257 - move_error,duplicate_dest, failed move
... chunklet 69:257 - move_error,duplicate_dest, failed move
... chunklet 63:253 - move_error,duplicate_dest, failed move
... chunklet 65:258 - move_error,duplicate_dest, failed move
... chunklet 67:257 - move_error,duplicate_dest, failed move
... chunklet 69:257 - move_error,duplicate_dest, failed move
... chunklet 63:253 - move_error,duplicate_dest, failed move
... chunklet 65:258 - move_error,duplicate_dest, failed move
... chunklet 67:257 - move_error,duplicate_dest, failed move
... chunklet 69:257 - move_error,duplicate_dest, failed move
... chunklet 63:253 - move_error,duplicate_dest, failed move
... chunklet 65:258 - move_error,duplicate_dest, failed move
... chunklet 67:257 - move_error,duplicate_dest, failed move
... chunklet 69:257 - move_error,duplicate_dest, failed move
... chunklet 63:253 - move_error,duplicate_dest, failed move
... chunklet 65:258 - move_error,duplicate_dest, failed move
... chunklet 67:257 - move_error,duplicate_dest, failed move
... chunklet 69:257 - move_error,duplicate_dest, failed move
... chunklet 63:253 - move_error,duplicate_dest, failed move
... chunklet 65:258 - move_error,duplicate_dest, failed move
... chunklet 67:257 - move_error,duplicate_dest, failed move
... chunklet 69:257 - move_error,duplicate_dest, failed move
... chunklet 63:253 - move_error,duplicate_dest, failed move
... chunklet 65:258 - move_error,duplicate_dest, failed move
... chunklet 67:257 - move_error,duplicate_dest, failed move
... chunklet 69:257 - move_error,duplicate_dest, failed move
... chunklet 63:253 - move_error,duplicate_dest, failed move
... chunklet 65:258 - move_error,duplicate_dest, failed move
... chunklet 67:257 - move_error,duplicate_dest, failed move
... chunklet 69:257 - move_error,duplicate_dest, failed move
... chunklet 63:253 - move_error,duplicate_dest, failed move
... chunklet 65:258 - move_error,duplicate_dest, failed move
... chunklet 67:257 - move_error,duplicate_dest, failed move
... chunklet 69:257 - move_error,duplicate_dest, failed move
... chunklet 63:253 - move_error,duplicate_dest, failed move
... chunklet 65:258 - move_error,duplicate_dest, failed move
... chunklet 67:257 - move_error,duplicate_dest, failed move
... chunklet 69:257 - move_error,duplicate_dest, failed move
... chunklet 63:253 - move_error,duplicate_dest, failed move
... chunklet 65:258 - move_error,duplicate_dest, failed move
... chunklet 67:257 - move_error,duplicate_dest, failed move
... chunklet 69:257 - move_error,duplicate_dest, failed move
... chunklet 63:253 - move_error,duplicate_dest, failed move
... chunklet 65:258 - move_error,duplicate_dest, failed move
... chunklet 67:257 - move_error,duplicate_dest, failed move
... chunklet 69:257 - move_error,duplicate_dest, failed move
... chunklet 63:253 - move_error,duplicate_dest, failed move
... chunklet 65:258 - move_error,duplicate_dest, failed move
... chunklet 67:257 - move_error,duplicate_dest, failed move
... chunklet 69:257 - move_error,duplicate_dest, failed move
... chunklet 63:253 - move_error,duplicate_dest, failed move
... chunklet 65:258 - move_error,duplicate_dest, failed move
... chunklet 67:257 - move_error,duplicate_dest, failed move
... chunklet 69:257 - move_error,duplicate_dest, failed move
... chunklet 63:253 - move_error,duplicate_dest, failed move
... chunklet 65:258 - move_error,duplicate_dest, failed move
... chunklet 67:257 - move_error,duplicate_dest, failed move
... chunklet 69:257 - move_error,duplicate_dest, failed move
... chunklet 63:253 - move_error,duplicate_dest, failed move
... chunklet 65:258 - move_error,duplicate_dest, failed move
... chunklet 67:257 - move_error,duplicate_dest, failed move
... chunklet 69:257 - move_error,duplicate_dest, failed move
... chunklet 63:253 - move_error,duplicate_dest, failed move
... chunklet 65:258 - move_error,duplicate_dest, failed move
... chunklet 67:257 - move_error,duplicate_dest, failed move
... chunklet 69:257 - move_error,duplicate_dest, failed move
... chunklet 63:253 - move_error,duplicate_dest, failed move
... chunklet 65:258 - move_error,duplicate_dest, failed move
... chunklet 67:257 - move_error,duplicate_dest, failed move
... chunklet 69:257 - move_error,duplicate_dest, failed move
... chunklet 63:253 - move_error,duplicate_dest, failed move
... chunklet 65:258 - move_error,duplicate_dest, failed move
... chunklet 67:257 - move_error,duplicate_dest, failed move
... chunklet 69:257 - move_error,duplicate_dest, failed move
... chunklet 63:253 - move_error,duplicate_dest, failed move
... chunklet 65:258 - move_error,duplicate_dest, failed move
... chunklet 67:257 - move_error,duplicate_dest, failed move
... chunklet 69:257 - move_error,duplicate_dest, failed move
... chunklet 63:253 - move_error,duplicate_dest, failed move
... chunklet 65:258 - move_error,duplicate_dest, failed move
... chunklet 67:257 - move_error,duplicate_dest, failed move
... chunklet 69:257 - move_error,duplicate_dest, failed move
... chunklet 63:253 - move_error,duplicate_dest, failed move
... chunklet 65:258 - move_error,duplicate_dest, failed move
... chunklet 67:257 - move_error,duplicate_dest, failed move
... chunklet 69:257 - move_error,duplicate_dest, failed move
... chunklet 63:253 - move_error,duplicate_dest, failed move
... chunklet 65:258 - move_error,duplicate_dest, failed move
... chunklet 67:257 - move_error,duplicate_dest, failed move
... chunklet 69:257 - move_error,duplicate_dest, failed move
... chunklet 63:253 - move_error,duplicate_dest, failed move
... chunklet 65:258 - move_error,duplicate_dest, failed move
... chunklet 67:257 - move_error,duplicate_dest, failed move
... chunklet 69:257 - move_error,duplicate_dest, failed move
... chunklet 63:253 - move_error,duplicate_dest, failed move
... chunklet 65:258 - move_error,duplicate_dest, failed move
... chunklet 67:257 - move_error,duplicate_dest, failed move
... chunklet 69:257 - move_error,duplicate_dest, failed move
... chunklet 63:253 - move_error,duplicate_dest, failed move
... chunklet 65:258 - move_error,duplicate_dest, failed move
... chunklet 67:257 - move_error,duplicate_dest, failed move
... chunklet 69:257 - move_error,duplicate_dest, failed move
... chunklet 63:253 - move_error,duplicate_dest, failed move
... chunklet 65:258 - move_error,duplicate_dest, failed move
... chunklet 67:257 - move_error,duplicate_dest, failed move
... chunklet 69:257 - move_error,duplicate_dest, failed move
... chunklet 63:253 - move_error,duplicate_dest, failed move
... chunklet 65:258 - move_error,duplicate_dest, failed move
... chunklet 67:257 - move_error,duplicate_dest, failed move
... chunklet 69:257 - move_error,duplicate_dest, failed move
... chunklet 63:253 - move_error,duplicate_dest, failed move
... chunklet 65:258 - move_error,duplicate_dest, failed move
... chunklet 67:257 - move_error,duplicate_dest, failed move
... chunklet 69:257 - move_error,duplicate_dest, failed move
... chunklet 63:253 - move_error,duplicate_dest, failed move
... chunklet 65:258 - move_error,duplicate_dest, failed move

Failed --
giving up after 101 attempt
servicemag resume 1 19 -- Failed


from showpd -state 39

Id CagePos Type -State- -------------------------Detailed_State------------------------- -SedState-
39 1:19:0? FC failed vacated,missing,invalid_media,smart_threshold_exceeded,servicing unknown
---------------------------------------------------------------------------------------------------

anybody got an idea?

The failed disk needs to remain (logically) until the data has been rebuilt on the replacement (just the way it tracks things). However the replacement did not rebuild, I've not seen those errors before though.

Was the replacement a new blank disk, the errors sound like there was existing data on it, maybe from another array?

i dont know if the disk was from another array, i think we sourced it refurb .
we have another disk we can try to replace to or first to check OS and patch
that could be an old OS issue?

Hello.
in the End i contacted Hpe support
first tried to:
#servicemag unmark 1 9
#servicemag clearstatus 1 9
#servicemag resume 1 9

that didnt work


because the OS hit a bug (3.2.2 MU4)
a manual chunklet relocation was needed.

HPE recommended to up date the OS in order to avoid that Bug in the future.