Hi,
We have a HP 3PAR 7400 4-Node with 128 x 600GB 10K SAS Disks connected via 8Gb Fibre to two HP SN3000B Fibre Switches. We have two 16TB Thin Provisioned VVs presented to a 7-Node ESXi 5.5 Cluster with about 80 VMs.
We use Veeam Backup & Replication 8 Update 1 and backup all VMs using the Storage Snapshot Integration which works well. The Veeam Proxies and ESXi Hosts are HP ProLiant BL460c Gen8 Blade Servers with FlexFabric 10Gb LOMs (configured only for 10Gb Ethernet) and a Dual Port 8Gb Fibre Channel HBA which connects to the Fibre Switches.
We backup to a HP StoreOnce 4430 NAS Share with Veeam. A single backup can run at upwards of 400MB/sec as we have 10GbE between all server infrastructure.
However, when restoring we see terrible speeds, around 11MB/sec. We did some testing and found some interesting results. If we restore a VM using Veeam to a 3PAR Volume that is thick provisioned, we see upwards of 130-140MB/sec restores.
If we restore to one of our existing 16TB Thin Provisioned 3PAR Volumes we see a restore speed that never goes above 11MB/sec. It's almost like it's capped at 100Mb.
We did some further testing and presented a new VV from the 3PAR as thin provisioned. We restored to it and saw 130-140MB/sec restore speeds. Once the restore was finished we then did another restore and the speed again dropped down to 11MB/sec.
We converted the VV to Thick Provisioned on the 3PAR and did another restore and the speed went back up to 130-140MB/sec.
We repeated this a number of times with new test VVs from the 3PAR and found the same results each time. The first restore to a thin VV is fast, but all subsequent restores drop to 11MB/sec. If the VV is thick provisioned the restores are consistently fast.
I understand with a thin provisioned VV that there is some overhead as the 3PAR allocates the chunklets on the fly as the VV is expanding, but would not expect this much of a difference. If I storage vMotion a Virtual Machine between our two 16TB Thin VVs it is very fast. Only a restore seems to be affected.
There is a post on the Veeam Forums from 2013 where a couple of people saw the exact same issue:
http://forums.veeam.com/veeam-backup-re ... 87-15.html. I have posted a message on that topic as well as there was no answer given on that thread.
For reference our 3PAR is running OS 3.1.2 (MU3) and has patches P18, P25, P33, P35 and P39 installed.
I've tried multiple Veeam proxies, both physical and virtual, and always see the same results. This one has me baffled at the moment.
Has anyone ever seen something like this?
Thanks,
Chris