Normally we install Apache Hadoop and other ig data tools on our servers. IBM Analytics Demo Cloud is intended to learn Hadoop, Ambari, BigSQL free of cost with SSH access & web console. With various cloud offerings many things these days have a free usage tier like we shown with unrelated things – Heroku and OpenShift PaaS. Here is how to get started with non-root access to this system. In this guide, we will talk basics about SSH. There are lot of documentations but things are difficult to find (at least I felt so). Here is a PDF for you on how to open IBM Analytics Demo Cloud account and details about the web console buttons :
1 | https://courses.cognitiveclass.ai/asset-v1:BigDataUniversity+BD0111EN+2016+type@asset+block/01_Lab_Setup_4.0.0_Cloud_.pdf |
In short, you’ll login from https://my.imdemocloud.com and SSH details, web UI details there. You will get some informative resources here :
1 2 | http://support.datascientistworkbench.com http://support.imdemocloud.com |
IBM Analytics Demo Cloud : Free Hadoop, Ambari With SSH
There is web UI for BigSheets, Text Analytics, Big SQL Console and Ambari Console from that my.imdemocloud.com web UI with old bootstrap design big launch buttons. At the end there will be SSH details in this way :
Your username is XYZ123. All services use your Demo Cloud password. Change the password in your profile
The server hostname is systemt.datascientistworkbench.com
You can use your Demo Cloud username and password to connect to the SSH command line on the cluster. Sample command:
ssh XYZ123@systemt.datascientistworkbench.com
We needed that ssh XYZ123@systemt.datascientistworkbench.com. Now open Terminal (Mac, GNU/Linux, other UNIX) or iTerm2 (Mac) and SSH to the instance :
1 | ssh XYZ123@systemt.datascientistworkbench.com |
Advertisement ---
You can run :
1 2 3 | ls -al pwd repoquery -a --installed |
to understand where you are and what packages are installed. If you run :
1 | cat .bashrc |
you’ll get a lot of $PATH pointing what are installed – jetty, knox, spark, bigsheets, bigsql, hadoop, hive, kafka, oozie, slider, pig, sqoop, zookeeper and so on.
You can run :
1 2 3 | cat /etc/hosts top free -m |
for practical interest. You can wget my IBM ASCII bash script :
1 2 | # https://github.com/AbhishekGhosh/IBM-ASCII-Logo-For-SSH/blob/master/ibm.sh wget https://raw.githubusercontent.com/AbhishekGhosh/IBM-ASCII-Logo-For-SSH/master/ibm.sh |
then chmod it, execute it :
1 2 | chmod +x ibm.sh sh ibm.sh |
So you can use wget, execute bash scripts. Now you can run :
1 2 | mysql show databases; |
you’ll get normal MySQL output. You can use a database and see the tables :
1 2 | use database_name show tables; |
Of course if you run :
1 | hadoop |
you’ll get expected output.
Apart from wget, you can use FTP CLI commands (somewhat like for shared server we shown CLI FTP commands) or use FileZilla to upload and download data files.
