Skip to end of metadata
Go to start of metadata

Third-Party Tools Overview

A number of high quality, production ready tools have been developed by members of the Lustre community. These include:

lltop

URL: https://github.com/jhammond/lltop

Description: Lustre load monitor with batch scheduler integration. Covered in LUG2011 presentation:

You need flash player installed to preview ppt and pdf files

Get Adobe Flash player

An enhanced version of the tool is also available, called xltop. It is included at the bottom of this page.

Author: John Hammond (TACC)

 

LMT

https://github.com/chaos/lmt

Description: LMT is a distributed system that provides a "top"-like display of the activity levels of the server-side (MDS, OSSes, and LNET routers) nodes of one or more Lustre-based filesystems.

Author: Christopher J. Morrone (LLNL)

PCP

URL: https://github.com/wtsi-ssg/pcp

Parallel copy tool for Lustre (PCP) is similar to cp -r ; simply give it a source directory and destination and pcp will recursively copy the source directory to the destination in parallel.

Robinhood Policy Engine

URL: http://sourceforge.net/apps/trac/robinhood

Robinhood Policy Engine is a multi-purpose tool for managing content of large filesystems: audit FS content, accounting, remove old unused files according to admin-defined policies, customizable alerts based on file properties, backup data to external storage.
It has advanced capabilities for Lustre filesystems: leverage OST usage, list or purge files per OST, policy criteria based on pools and OST index, processing of MDT changelogs (Lustre v2).

Shine

URL: http://lustre-shine.sourceforge.net/

Description: Shine is a command line tool designed to setup and manage the Lustre file system on a cluster. It aims at centralize and simplify Lustre filesystem management task with:

  • one human-readable configuration file to describe your filesystem
  • start, stop, format (and more) your filesystem from a unique machine, thanks to a simple command line interface.

Author: CEA/Bull

tacc-stat

URL: https://github.com/jhammond/tacc_stats

https://github.com/jhammond/tacc_stats

Description: Probe Lustre interfaces and collect statistics.

Author: John Hammond (TACC)

xltop

URL: https://github.com/jhammond/xltop

Description: xltop is a continuous Lustre monitor with batch scheduler intergation.

Client screenshot:

Author: John Hammond (TACC)

Labels
  • No labels