Skip to end of metadata
Go to start of metadata

 


What is Intel Cloud Edition for Lustre*?

Intel Cloud Edition for Lustre* (ICEL) Software is a product on AWS Marketplace. This product provides a high performance Lustre filesystem on the Amazon Web Services using AWS resources. The full package includes CentOS, Lustre, Ganglia, and Lustre Monitoring Tool (LMT). The product is delivered in the form of an Amazon Machine Image (AMI) available on the AWS Marketplace.


ICEL is intended to be used as the working filesystem for an HPC or other IO intensive workload. It is not intended to be used as a long term storage or alternative to cloud storage options such as S3. We recommend that S3 in particular be used for long term data storage on AWS, and Lustre used wherever a high-performance shared filesystem is required. 


Using ICEL on AWS


Step 1 - Subscribe to a Product Version

The first step in using ICEL on AWS is to navigate to the Amazon Marketplace and subscribe to the produce you will be using. The following products are available on the marketplace:


ICEL - Global Support HVM

ICEL - Global Support

ICEL - Community Version


Step 2 - Launch a Cloud Formation Template

The Intel Lustre AMI is designed to be used with a CloudFormation template that defines all the resources needed by the Lustre filesystem. The templates provided below have a minimal number of a parameters to simplify deployment. To get started you only need to set the KeyName to your ssh-key, and set the LustreAZ to the specific Availability Zone in the region you are using. There is also a Filesystem Name parameter which defaults to "scratch" but this can be changed.


Cloud Formation Templates - Global Support HVM

Cloud Formation Templates - Global Support

Cloud Formation Templates - Community Version


 


 

Product Versions

There are currently three product versions available on AWS. Below is a listing of the versions as well as the associated features.

 

FeaturesCommunity VersionGlobal SupportGlobal Support (HVM)
Intel Supportnoyesyes
Instance TypesM1M1, M3C3
Ephemeral Storageyesyesyes
EBS Storagenoyesyes
VPC*noyesyes
Enhanced Networking**nonoyes
Raw Initialization*noyesyes

* Contact Intel support for information on using these features

** Enhanced Networking is only supported in VPC with C3 and I2 instances

 

 

Global Support (HVM)

The instance types that support hardware assisted virtualization (HVM) provide higher performance on AWS. Consequently, this product offering is our high-end option with support for both Enhanced Networking and the C3 compute optimized instances. Enhanced Networking provides SRIOV, which allows an physical device to be virtualized and connected directly to a virtual machine. This provides lower latency and more consistent performance.

Global Support

The Global Support offering is intended for use with HPC workloads. With HA and EBS storage enabled, this product can recover the filesystem after a Lustre server is terminated. In addition to supporting EBS for more resilient storage, this version also supports higher end instance types (M3) which enable a higher performance filesystem. 

Community Version

The Community Version offering is an entry level product offered on Marketplace which can be used for proof-of-concept and development testing. We only offer ephemeral storage templates for this product, so our recommendation is to limit use to scratch filesystems (data will be lost if one of the Lustre servers is terminated). Support is not included with this version, so we recommend moving to a product which includes Global Support once you have evaluated the product.

Support Details

Product versions containing Global Support are supported directly by the Lustre* experts at Intel®. Customers will get Lustre* software updates, and support is available by email. Please provide your Amazon ID and a description of the issue when filing a ticket: hpdd-cloud-lustre@intel.com




 

  • No labels