From Montana Tech High Performance Computing
The HPC cluster's operating system is CentOS 7.3. Remote Access is through ssh (e.g., putty) or the NX web client which provides a desktop environment.
After you log into hpc.mtech.edu for the first time, please change your initial password. This is done using the passwd command - you will be prompted for your old password and then your new password.
When you connect to hpc.mtech.edu, you will be logged into the "head" node, aka the "management" or "login" node. You can compile and test programs, submit jobs, and view results on the head node. Computationally intensive work should be done on the "compute" nodes. Jobs are assigned to the compute nodes through the Moab job scheduler. You request a portion of a compute node, an entire node, or multiple nodes for distributed programs.
Check this wiki for software that is currently installed. You can compile and install software into your home directory or request software be installed for system wide use. If your data and software needs exceed 1 GB, then please let us know so a personal directory can be setup on the main Storage system - /data.
- 1 Graphical Display (optional)
- 2 Connecting to HPC
- 3 Transferring files between your computer and HPC
- 4 Basics
Graphical Display (optional)
Within the Montana University System, the graphical display from hpc.mtech.edu can be redirected to your local PC if you install an X Server. The cygwin x-server (http://x.cygwin.com/ ) is free and works well. You will need to enable X11 forwarding before you login into hpc.mtech.edu - this is done in putty by selecting Connection-SSH-Tunnels and checking the Enable X11 forwarding box. Start the x-server before logging on and test by running "xeyes".
Connecting to HPC
You can use Secure Shell(SSH) to connect to HPC. Depending on the operating system of your computer, you have different options to get connected.
You can directly use the Terminal application comes with your system to connect.
In your terminal, type the following command to connect via ssh:
You will then receive prompt to enter your password, similar to the following line.
You can then enter your password. Note: when you enter your password, nothing will display on the screen.
If you intend to use any applications with GUI interfaces (e.g. MATLAB, COMSOL), you will need to add the '-X' option when connecting:
ssh -X YourUserName@hpc.mtech.edu
You will need to install a terminal emulator program to connect. There are many such programs, below are examples of using MobaXterm and Xshell.
MobaXterm is a single application that has integrations of several tools, e.g., SSH, X11, FTP....
You can download Xshell at https://www.netsarang.com/products/xsh_overview.html It's free for School/Home use.
You'll also need to install an X Server program on your computer if you want to use any graphical applications (e.g. MATLAB, COMSOL). One free X Server is Xming and you can download it at https://sourceforge.net/projects/xming/
After the installation of Xshell/Xming, you can follow the steps below to set up the connection.
- Open Xshell, select New under the File Tab, and click the Connection category.
In the Host field, enter our HPC address (hpc.mtech.edu).
You can also name this connection in the Name field (e.g., TechHpc).
- Click the Authentication category, make sure Password is selected for the Method category.
Then enter your username and password in the User Name and Password fields respectively.
- (Optional for GUI Applications) Click Tunneling category, select Forward X11 connection to and choose X DISPLAY:.
Once the above setup is complete, you can select Open under the File tab (or just use the Open Button) to connect to HPC. Remember to run Xming first, if you need to use graphical interfaces. And you'll see its icon in the Taskbar.
Transferring files between your computer and HPC
After you login to HPC, the files you created/saved is stored on HPC. You will need some tools to transfer files between your computer and HPC.
You can use any FTP programs to transfer files. Just use hpc.mtech.edu as the host address, and provide your username and password. One FTP program is Xftp (free for home/school). You can get it at https://www.netsarang.com/products/xfp_overview.html
If you are logged in using Xshell, you can use the New File Transfer button in the toolbar (or the keyboard shortcut Ctrl+Alt+F) to open the file transfer. By default, in the popped up Xftp window, you'll see your Desktop directory on the left side and the directory you are at in Xshell on the right. You can then Right-Click any files or folders to transfer files.
Once you logged in, you'll see some texts, including the logo and some notice.
At the bottom line, you'll see your cursor after a Unix prompt(possibly a dollar sign):
[YourUserName@scyld ~]$ ❚
The texts before the dollar sign include your username, computer name and your current directory name. For general purposes, these texts will be omitted in the following examples, like
Change your initial password
It's best to change your initial password the first time you log in. To do it, simply use the passwd command:
You will then get the following texts:
Changing password for user YourUserName.
Changing password for YourUserName.
(current) UNIX password: ❚
Enter your initial(current) password and press enter. You'll then be prompt to enter and retype new passoword:
Retype new password:
If change is successful, you'll get:
passwd: all authentication tokens updated successfully.
Your Home Directory
When you login to HPC, you are directed to your default home directory, which generally has the following format:
NOTE: There is limited space available on the /home partition, where your default home directory is on. If you need to store a large amount of data or files (>2G), we will create a directory for you either at
/data1/YourUserName. You can send us an email to request a directory there.
Exercises of Basic Linux Commands
- To check your current directory use the command:
- Copy an folder to your home directory:
$ cp -r /opt/intro ~
Copy a file to your home directory:
$ cp /opt/intro/helloworld.f ~
The tilde symbol is your home directory
- List the contents of your home directory:
- Go to the newly copied directory intro and list contents:
$ cd intro
- Create a new folder, testfolder, here
$ mkdir testfolder
- Move/Rename a file(or folder)
$ mv helloworld.f helloworld2.f
$ mv helloworld2.f ./testfolder/
$ ls ./testfolder
Here the dot above represents the current directory.
- Go back to your home directory
- Delete file/folder
$ rm helloworld.f
$ rm -r intro