Re: Can anybody explain the Adaptive Optimization concept "IO Rate Density (IO/GiB * min))" Here are some details I got from an expert: IO Rate Density is a measure of how busy a region is. Just because a system is perceived as having a higher importance by the business does not mean that it has a higher regional access density. Size Adaptive Optimization and work with AO reports Interpret different HP 3PAR performance metrics and how the array's features can affect performance Tune and rebalance HP 3PAR storage arrays One of the nice features of the new StoreVirtual 3200 system is the support for performance tiering to SSD. HP 3PAR, using Adaptive Optimization ATS software (High-end Tier 1.5 array) IBM Storwize v7000, using Easy Tier ATS software (High-end Tier 1.5 array) *Note: Both EMC VMAXe and HDS VSP low end configurations are positioned in the high end of Tier 1.5. The Managing HPE 3PAR StoreServ II course is designed for the experienced HPE 3PAR administrator. But I would free space or buy more disks ASAP to resolve this issue. Regional IO density is measured in terms of IOPs per GB per minute. When you create a new VV do so from your middle tier if you are using a 3 tier config. At least start out with a single AO policy containing ALL your tiers of disk and allow ALL data to move freely. After my latest post for 3PAR 8000 series, here are more details about the new family. AO is a licenced feature that is enabled through the creatively named Adaptive Optimization software option and is available across all the hybrid models. Flexible and scalable HP 3PAR StoreServ configuration for SAP by configuring up to eight HP 3PAR controller nodes in combination with nearly 2000 disk drives Built -in dynamic and adaptive optimization features moving SAP data between RAID levels or the storage tiers of In my limited experience with migrating luns to a new CPG, I’d agree with that statement of it taking a while. Your email address will not be published. I 'll plan to delete it. Although it is possible, do notcreate 2 tier AO policy between NL and SSD disk as the speed difference is substantial and will impact response time on the workloads. Beyond the flashy features, many 3PAR customers will find that Primera will not support some of their favorite capabilities. AO occurs on a schedule you cannot force it. Conversely, if a CPG is already in an AO configuration, then it is not possible to create a compressed volume in the CPG. The problem with such truly random workloads is firstly they are very rare, but also by their very naure they don’t display such consistency week on week So optimizing for.week 1 won’t necessarily help with week 2. HPE 3PAR Virtual Lock. Peer Persistence and Adaptive Optimization interoperation on 3PAR. If the access pattern of your data is truly random each day Adaptive Flash Cache may help to soak up some of the hits and can be used conjunction with AO. Having a mix of availability levels will mean that data is protected at the lowest availability level in the AO config. HPE 3PAR 8400:- Can we limit AO with 1TB or 2TB to be occupied in Tier 0? But I think there would be a couple of challenges with this approach. Sunday – Nothing Isn’t what your asking for called cache ? HP 3PAR Adaptive Optimization (AO) enables autonomic storage tiering on HP 3PAR storage arrays. HP 3PAR Dynamic Optimization Software non-disruptively alters service levels of a volume with a single click, without scheduling, planning, or impacting application performance. Explain how space is distributed in HP 3PAR storage arrays Configure, interpret and handle HP 3PAR alerts and notifications Size Adaptive Optimization and work with AO reports Prerequisites: Students must have attended HK902 and HK904 and should have managing a 3PAR array for at least 12 months. You need to be aware that AO only occurs across a node pair. As with most things in life its best kept simple. The information contained in this document should be used along with the documentation set provided by HP for the HP 3PAR StoreServ Storage system, HP 3PAR Operating System, and the documentation And HP do have adaptive flash cache. Learn how your comment data is processed. Hardware Software Brands Solutions Explore SHI Tools . HP 3PAR Dynamic Optimization Software non-disruptively alters service levels of a volume with a single click, without scheduling, planning, or impacting application performance. For AO to be a good fit the regional IO density needs to be high i.e. Yes can change an AO configuration at any time, Hi Richard, It is not available on the all flash models for obvious reasons. 3PAR OS includes the data movement engine, however it has to be unlocked either using Dynamic or Adaptive Optimization. When you hit this level AO will not move any more data to those disks. This is when of the great 3PAR StoreServ features, allowing ‘regions’ of data to be moved between different storage tiers. HPE 3PAR Virtual Service Processor (Not included in HPE 3PAR StoreServ 20000) HPE 3PAR Recovery Manager Central If you are running a two tier system that contains NL disks, provision new VVs from tier 1 so that new writes are not hitting slow NL disks. Is this a case in which a scheduled DO job would make sense, to allow you to manually migrate a lun to a high performing CPG (perhaps a SSD-only CPG) at a certain time, in advance of a known high workload? As long as nothing is directly provisioned from the SSD tier, you can let AO take the utilisation right up to these high levels. The Managing HPE 3PAR StoreServ II course is designed for the experienced HPE 3PAR administrator. HPE 3PAR Smart SAN. The HP Converged Storage philosophy makes this feature now also available on the StoreVirtual platform. If a compressed volume exists within a common provisioning group (CPG), then the CPG i s not available for use in an AO configuration. The goal of the . What would be the impact on the existing volumes in doing this, or can it be done without destroying the data on the volumes? Chunklets are little, virtual pieces of physical disk. Then perhaps another DO job to move it back to the CPG with AO, once the workload drops. I would however say it would be cleaner to create a new CPG, and then to use dynamic optimization to move the volumes over. As NL disks are often used in tier 2 many companies cannot tolerate the hit of new writes initially going to slow disk. Re: Unmanaged I/O Workload Detected - 3Par Adaptive Optimization? My understanding from today’s version of AO is as follows: 1. HPE 3PAR System Reporter. If you find you have certain servers with very specific access patterns adjust the timing to monitor during these periods. There will always be exceptions to simplicity, but at least give simplicity a chance and then tune from there. The minimum amount of Flash Cache that can be specified on an HPE 3PAR StoreServ array regardless of model is 64 GB per node pair. Last edited by abelliot on Mon Jan 28, 2019 9:54 am, edited 1 time in total. With this feature the HP 3PAR storage system analyzes IO and then migrates regions of 128 MB between different storage tiers. You make a good point that not every work load will be suitable for AO. note: 3par_as49_datastore and 3par_optilogistic_datastore is not used. HPE 3PAR Priority Optimization. If you do run multiple AO policies set them to start at the same time, this will minimise the chance of you running into space problems, The three AO modes are quite self-explanatory, at either extreme performance moves data up to higher tiers more aggressively, cost – moves data to cheaper large capacity tiers more aggressively, balanced is a half-way house between the two. I've found in one document with following statement: "Adaptive Optimization (AO) supports RC but until failover, the AO policies on the destination array should remain disabled. HPE 3PAR Priority Optimization. What would happen if I decided to change the RAID levels on the various Tiers? Dynamic optimization is when you manually choose to move an entire virtual volume between tiers. So now we understand AO is a tiering technology that intelligently places our data based on how hot (frequently accessed) or cold it is. Beyond the flashy features, many 3PAR customers will find that Primera will not support some of their favorite capabilities. The minimum amount of Flash Cache that can be specified on an HPE 3PAR StoreServ array regardless of model is 64 GB per node pair. I would suggest selecting balanced to start with then monitoring and adjusting accordingly. If you need it to be more aggressive you can change the mode to performance, Your email address will not be published. So you may expect to see all your VV’s (Virtual Volumes) that are demanding the most IOPs end up in your tier 0 SSD’s, this however is not the case as AO is a sub-lun tiering system, i.e. Hi, dsstao Jan 28, 2014 8:00 AM ( in response to Arun Pandey ) Nope, nothing else accessing it. Now I am very worry disk SSD 100GB alocate 98%. First of all DO operations take time, so if it was a larger volume you could be waiting several days for it to migrate to SSD’s and then several days back again. web caches) in Tier 0. Great post BTW and as you say the best model for AO is to keep it simple and it typically just works. or we will set AO configuration during the CPG creation time ? One of the nice features of the new StoreVirtual 3200 system is the support for performance tiering to SSD. I have very few space left in SSDs and also VVs are TDVVs. Aug28. ... Work with Adaptive Optimization to implement virtual volume tiering to save storage costs • Work with Priority Optimization to prioritize higher priority workloads over lower priority In an AO config you define your tiers of disk through the selection of CPG’s and then choose an operational mode optimised for cost, performance or a balance between the two. Do you want to optimize service levels effortlessly, on a large scale, and for a lower total cost than other solutions? Frequently accessed regions of volumes are moved to higher tiers, less frequently accessed regions are shifted to lower tiers. On the systems screen It shows the SSD as 2 different entries and massively favours the original smaller disk, in fact, when I select an SSD cpg it shows only a small amount of available space left when I know the newer SSD has loads of space. Tier 2: 14TB RAID5 10K disks. I've found in one document with following statement: "Adaptive Optimization (AO) supports RC but until failover, the AO policies on the destination array should remain disabled. We know Adaptive Optimization already from the StoreServ 3PAR platform. Could you please explain how Dynamic Adaptive optimization works ? Peer Persistence and Adaptive Optimization interoperation on 3PAR. It is not recommended to have a 2 tier system that only contains NL and SSD disks as the performance differential would be too great. Adaptive Optimization operates on the principle of I/O access density, which is the You can set a max runtime on AO to make sure that it is not running during business hours. HPE 3PAR Adaptive Optimization (AO). For instance, HPE Primera will not include the Adaptive Optimization technology that 3PAR uses to tier data between hard disk drives and more expensive solid-state drives. To give an example if you have a 100GB VV and only 2 regions are getting hit hard only 256MB of data need to be migrated to SSD, a massive saving in space compared to moving the entire volume. Performance – more data moved to higher tier Balanced – balance in between Cost– more data is moved to lower tier Notes All your writes will be going to Tier 1. HP 3PAR Adaptive Optimization Software Solution brief HP 3PAR® Adaptive Optimization Software is a granular, policy-driven, autonomic storage tiering software solution that delivers service level optimization for enterprises and cloud data centers to reduce cost … BTW there’s a min IOps setting to prevent demotion due to minimal access. HPE 3PAR File Persona. Don’t try and second guess where data would be best placed, the machine will outsmart you. Here, does the R1 mean R1+0? View Adaptive Optimization for HPE 3PAR.pdf from AA 1Adaptive Optimization for HPE 3PAR StoreServ Storage Hybrid storage on HPE 3PAR StoreServ Technical white paper Technical white 6. The goal of the class is to acquaint the 3PAR administrator with additional topics and features of the HPE 3PAR array. The biggest announcement however was the addition of Adaptive Optimization or sub-volume tiering. Under the hood 3PAR allocates space in 128MB blocks or in HP speak regions, and it is at the region level that AO both analyses and moves data. Required fields are marked *. Which one you choose will depend on if your aim leans towards achieving optimum cost or performance. If you change the RAID settings on an existing CPG this will just impact new writes to that tier. Re: Can anybody explain the Adaptive Optimization concept "IO Rate Density (IO/GiB * min))" Here are some details I got from an expert: IO Rate Density is a measure of how busy a region is. Some example tiers would be: Even if you do start with a two tier system without SSDs, leave tier 0 empty in your config so that you can add SSDs at a later date. Save my name, email, and website in this browser for the next time I comment. If a compressed volume exists within a common provisioning group (CPG), then the CPG i s not available for use in an AO configuration. This point effectively summarises all those above. Although the AO config is not replicated, so you may find if you fail over to another site it would take a while for AO to optimise the layout of the regions. You can also now filter by volume, so you can have different schedules for specific VV’s within the same CPG and config. HPE calls this, similar to 3PAR, Adaptive Optimization. AO will not move data to disks and make them over capacity. I made this change for a customer recently moving from an AO config that only allowed business critical apps access to the SSDs, to allowing all data to move freely across all tiers. As of HPE 3PAR OS 3.2.1, the clone can be exported immediately after creation while the data copy continues in the background. The new family 8000 will be shipped with the same fifth-generation ASIC that were introduced in the 20000 series arrays earlier this year. I’ve got no problem with the lun initially being a little slow and then gradually improving over time (as stuff moves up the tiers). Additional CPG’s create additional management overhead in terms of reporting etc. Adaptive Optimization (AO) is 3PAR’s disk tiering technology, which automatically moves the hottest most frequently accessed blocks to the fastest disks and at the same time moves the infrequently accessed cold blocks of data to slower disks. I’m sure the boffin’s at HP could track and analyse this so that AO became predictive. I have couple 3par 7400(source and destination using remote copy) with AO configured using SSD, FC and NL as my tiers. Craig thanks for reading and commenting. We have 3 CPG’s(SSD/FC/NLSAS). to take advantage of HP 3PAR StoreServ’s unique features such as vSphere integration, HP 3PAR Thin Provisioning technologies, Dynamic and Adaptive Optimization, Priority Optimization, and HP 3PAR Recovery Manager for VMware to HPE 3PAR Online Import. Adaptive & Dynamics Optimization. whether I start AO do system occur problem? Hi all, new to 3par with a question with regarding Adaptive Optimization configuration. It would be good if HP could learn the storage characteristic and then adapt for a time period for example lets say you had a workload that ran weekly which was IO intensive. Some thoughts about HP 3PAR Adaptive Optimization, Adaptive Optimization Design Considerations | Storage CH Blog. technologies, Dynamic and Adaptive Optimization, and Recovery Manager for VMware to create a world class virtualized IT and application infrastructure. HPE 3PAR File Persona. This is actually the point that inspired me to write the post and I believe is the most important design principle, keep it simple. Flexible and scalable HP 3PAR StoreServ configuration for SAP by configuring up to eight HP 3PAR controller nodes in combination with nearly 2000 disk drives Built -in dynamic and adaptive optimization features moving SAP data between RAID levels or the storage tiers of Not so much. The HP 3PAR Adaptive Optimization Software is a granular, policy-driven, autonomic storage tiering solution that delivers service level optimization for virtual and cloud data centers to reduce cost while increasing agility and minimizing risk. Patrick Terlisten blog post – Some thoughts about HP 3PAR Adaptive Optimization, HP 3PAR StoreServ Storage best practices guide, HP Technical white paper Adaptive – Optimization for HP 3PAR StoreServ Storage. 7. However if the pattern repeated each week e.g. You can try to get all data laid out in the new RAID style by running a tunesys afterwards. Achieving Balance in HPE 3PAR Environments. HPE 3PAR Adaptive Optimization. Once a region has been marked as a candidate for movement the systems then performs a number of sanity checks, to verify if the region move should go ahead: To understand AO design we next need to consider what the building blocks of an AO setup are. Below the different tiers of disk are shown diagrammatically along with some example of blocks of data tiering both up and down. After running happily for a while I added further SSD disk into my P1000 array which is of a larger size to the original SSD. Start again by keeping things simple, monitor during your core business hours and be careful to not include things like backups in your monitoring period which could throw the results off. This seems ‘understandable’ to me in that I expect most of the data to move down to Tier 2 (e.g. This white paper takes you through an HPE 3PAR Adaptive Optimization Case Study to demonstrate how the AO functions so that you can optimize your HPE 3PAR environment. In this case we will look at how the workload is distributed on the back-end drives and how that relates to the Adaptive Optimization Policies. I’m wondering whether this is possible and whether there are any issues to doing so as all the recommendations I’ve read so far (including the above) seem to suggest that provisioning should always happen from the middle tier in a 3 tier system (which is not possible in my case). We’ve got several volumes now using this config. Is there a possibility to prioritize the data movement? Adaptive optimization builds upon 3PAR’s existing chunklets, dynamic optimization, regions and wide striping technologies. Once you have setup your AO config you then need to schedule a task to run AO. Interesting question Jason. If we’ve determined that we don’t need to run AO, (however, a previous admin created an AO configuration) can this existing AO configuration be deleted? The key design principle here is to keep drives and drive cages balanced across nodes so performance in turn remains balanced. HPE 3PAR Adaptive Optimization configuration demystified Posted on July 28, 2017 by Naz Snidanko Adaptive Optimization is disk tiering technology within 3PAR OS, which automatically moves the most frequently accessed data blocks to the fastest disks and infrequently accessed data blocks of data to slower disks. Dynamic optimization is much simpler to understand. Adaptive & Dynamics Optimization This is when of the great 3PAR StoreServ features, allowing 'regions' of data to be moved between different storage tiers. In this article I will describe the process how to enable Adaptive Optimization. Just provision your VVs from the CPG representing the central tier, allow the volumes access to all the disks and let the system decide which RAID and disk type is appropriate at a sub-lun level. Specifically, I expect these LUNs to be large (e.g. each Monday is an intensive day you could create a schedule which looked at the appropriate period from the previous week, although this would start to take you away from the model of simplicity. An example of AO config is shown in the table below. Last edited by abelliot on Mon Jan 28, 2019 9:54 am, edited 1 time in total. H‰\”Í�›@„ïw+~g$ Ûkɇü(Ş. HP 3PAR, using Adaptive Optimization ATS software (High-end Tier 1.5 array) IBM Storwize v7000, using Easy Tier ATS software (High-end Tier 1.5 array) *Note: Both EMC VMAXe and HDS VSP low end configurations are positioned in the high end of Tier 1.5. This is part one of a two part series on enhancements to the HP 3PAR StoreServ platform announced at HP Discover in June. It is intelligent enough to not move more blocks than there is space available. Frederick0075 Aug 17, 2015 6:03 AM Visibility: Open to anyone . In March 2010, the company introduced 3PAR Adaptive Optimization, the industry's first implementation of autonomic storage tiering for cost optimization in high-end storage systems, targeted at enterprises and service providers. Tier 0: 1TB RAID5 SSD DO NOT set a CPG space limit though this is a hard stop and will stop any data being written. AO is controlled through an AO config. The Managing HPE 3PAR StoreServ II course is designed for the experienced HPE 3PAR administrator. 10. Regions are a narrow stripe of capacity across many chunklets and are assigned to … In summary there is no technical reason not to do this, it’s just if you can accept the slower speed from new writes to 10K disks. I 'll plan to delete it. a high proportion of your IOPs comes from a small proportion of capacity and the workload must have some kind of repeatable pattern to it. In March 2010, the company introduced 3PAR Adaptive Optimization, the industry's first implementation of autonomic storage tiering for cost optimization in high-end storage systems, targeted at enterprises and service providers. 3PAR OS includes the data movement engine, however it has to be unlocked either using Dynamic or Adaptive Optimization. 5. | HPE New Zealand Are they in one CPG? You can have between two and three tiers, 0 being the fastest and 2 being the slowest. I was mostly thinking about something that would fit completely into SSD, which would imply a small amount of data. So if you do go down the route of having multiple AO policies you must have a separate CPG to represent each tier of disks in each different AO policy. HPE 3PAR Adaptive Flash Cache feature is included as part of the HPE 3PAR OS and is supported on all HPE 3PAR StoreServ Storage sys tems that are supported with HPE 3PAR OS 3.2.1 and above. If you want to take advantage of deduplication with thinly deduplicated virtual volumes you will need to place the volumes directly on the SSDs and they cannot be on a CPG which is part of an AO config. For instance, HPE Primera will not include the Adaptive Optimization technology that 3PAR uses to tier data between hard disk drives and more expensive solid-state drives. 2. by Philip Sellers July 7, 2014. written by Philip Sellers July 7, 2014. Making tech simple – 3PAR, Storage, Virtualization and Cloud. òÌ |L/ì*; ùÉ��i ˆfb= g`ëêËÛÏhõëıÙÔe+Ÿõù‚äX¶5CÕm 0 ¢IŞ endstream endobj 67 0 obj <>>> endobj 68 0 obj <> endobj 69 0 obj <>/ExtGState<>/Font<>/ProcSet[/PDF/Text/ImageC]/Properties<>/MC1<>>>/Shading<>/XObject<>>>/Rotate 0/TrimBox[0.0 0.0 612.0 792.0]/Type/Page>> endobj 70 0 obj <> endobj 71 0 obj <> endobj 72 0 obj [/ICCBased 90 0 R] endobj 73 0 obj <> endobj 74 0 obj <> endobj 75 0 obj <> endobj 76 0 obj <> endobj 77 0 obj <>stream Good explanation. HPE 3PAR Host Explorer. HPE 3PAR Smart SAN. Any idea how I can make the array view both sizes of SSD as 1 big pool and use accordingly, they are both 150k and the SSD cpg is set to default speed? The net result was utilisation of each SSD increased from 200 to 1000+ IOPs each, thus reducing the pressure on the lower tiers of disks. In this case we will look at how the workload is distributed on the back-end drives and how that relates to the Adaptive Optimization Policies. Adaptive Optimization (AO) is 3PAR’s disk tiering technology, which automatically moves the hottest most frequently accessed blocks to the fastest disks and at the same time moves the infrequently accessed cold blocks of data to slower disks. A CPG can only exist within one AO config. The inclusion of HP 3PAR Adaptive Optimization software in this suite helps deliver an increase in IOPS and reduced latency at a lower storage cost than traditional storage. I think the other feature you are looking for is Adaptive Optimizer and sub-volume tiering... policies are defined within "System Reporter", which runs on a separate server in your environment and accessed via web browser. Enjoy the videos and music you love, upload original content, and share it all with friends, family, and the world on YouTube. 3PAR + HPE consultancy and hardware – Contact, Never miss the latest 3PAR tips and tricks, Regular 3PAR tips, tricks and news direct to your inbox, Adaptive Optimization Design Considerations.