Wistron Demonstrates How to Set Up IBM PowerAI on Mihawk
Published on Tuesday 30 April 2019
By Wistron Corporation
Applications like AI (Artificial Intelligence) and ML (Machine Learning) have been growing quickly in recent years. Developers need not only powerful systems to accelerate development progress but also a friendly development environment that can easily jumpstart the process.
Wistron POWER9 Mihawk supports PCIe Gen4, which has twice the bandwidth of PCIe Gen3, and up to 10 PCIe slots, which is more flexible for users to install various devices such as GPU or FPGA for AI/ML/DL purposes. Please see here for more system information.
IBM has vast experience and a wide technology presence in the AI domain. PowerAI is the key product and is designed for enterprises to start using AI technology more easily. IBM also delivers PowerAI in Docker, which reaps the benefits of containers that can deploy PowerAI to multiple servers faster and easier.
Here we demonstrate how to set up an IBM PowerAI of Docker image on Mihawk.
We use Ubuntu 18.04.1 with default kernel version as host OS. And other requirements of software components for PowerAI are:
- NVIDIA CUDA : 10.1
- NVIDIA cuDNN : 7.5
- NVIDIA NCCL : 2.4.2
- Conda Package : 4.5.12
- Docker-CE : 18.06.1~ce~3.0~ubuntu
- NVIDIA Docker : 2.0
For NVIDIA components, the CUDA package can be found in here, cuDNN is here and NCCL is here. These NVIDIA components are delivered via conda channel and do not need to be downloaded and installed manually. The driver can be downloaded here.
The Conda package can be found in here. Using Anaconda2 or Anaconda3 is acceptable. IBM’s website shows more details about how to install and set up Anaconda on PowerPC system. And we installed “Anaconda3-2019.03-Linux-ppc64le.sh” for this demonstration.
To install Docker-CE, here is a website that describes more details for installation.
And for the PowerPC platform, there is no “docker-ce-cli” in the repository, so this software package can be ignored. And the Docker-CE version for NVIDIA Docker 2.0 in Ubuntu 18.04 is 18.06.1~ce~3-0~ubuntu. The available versions can be showed with the command:
| $ apt-cache madison docker-ce |
Figure 1: List available versions of Docker-CE
So we need to specify the version to install Docker-CE as the command below:
| $ sudo apt install docker-ce=18.06.1~ce~3-0~ubuntu containerd.io |
For NVIDIA Docker 2.0, the repository configuration can be found here. And then install nvidia-docker2 and reload the Docker daemon configuration using the following commands:
| $ sudo apt install nvidia-docker2$ sudo pkill -SIGHUP dockerd |
After the requirements are installed successfully, we can start to download a PowerAI docker image. Here we download the latest version with all frameworks installed as an example.
| $ docker pull ibmcom/powerai:1.6.0-all-ubuntu18.04-py3-ppc64le_cloud |
Figure 2: Screenshot of PowerAI image downloaded complete
To start the PowerAI container:
| $ docker run --runtime=nvidia --env LICENSE=yes --env -t -i ibmcom/powerai:1.6.0-all-ubuntu18.04-py3-ppc64le_cloud /bin/bash(Note: Use --runtime=nvidia to make sure a docker image that can use NVIDIA GPU modules and NVIDIA software packages from local host.) |
Or
| $ nvidia-docker run --env LICENSE=yes --env ACTIVATE=all -t -i ibmcom/powerai:1.6.0-all-ubuntu18.04-py3-ppc64le_cloud /bin/bash |
Figure 3: Screenshot of some frameworks in PowerAI
With the IBM PowerAI solution, we can easily set up a development environment for AI applications on our P9 Mihawk. Users can focus more on their application developments with no need to worry about software dependency problems.
If you would like to know more information, please contact us at mike_liao@wistron.com or phoebe_li@wistron.com.
About Wistron
As a long-standing partner with IBM, Wistron utilizes more than 10 years PowerPC design and manufacture experience to offer robust services across diverse technical platforms. Wistron provides tailored, flexible business models from barebones to rack integration delivery to meet various business needs.