Thursday, January 21, 2016

[BigData] Training Environment for BigData & How to start Oracle BDA Lite 4.2.1 succesfully

Hi,

For all Oracle lovers and swimmers in BigData ocean :)

Now we have a safe amusement park for big data training purpose thanks to Oracle.

You can easily open Oracle BDA Lite VM as a virtual machine your terminals and start testing several hadoop tools and architectures within a lite version of a complete appliance.


Oracle Big Data Lite Virtual Machine provides an integrated environment to help you get started with the Oracle Big Data platform. Many Oracle Big Data platform components have been installed and configured - allowing you to begin using the system right away. The following components are included on Oracle Big Data Lite:
  • Oracle Enterprise Linux 6.6
  • Oracle Database 12c Release 1 Enterprise Edition (12.1.0.2) - including Oracle Big Data SQL-enabled external tables, Oracle Multitenant, Oracle Advanced Analytics, Oracle OLAP, Oracle Partitioning, Oracle Spatial and Graph, and more.
  • Cloudera Distribution including Apache Hadoop (CDH5.4.0)
  • Cloudera Manager (5.4.0)
  • Oracle Big Data Discovery 1.1
  • Oracle Big Data Connectors 4.2
  • Oracle SQL Connector for HDFS 3.3.0
  • Oracle Loader for Hadoop 3.4.0
  • Oracle Data Integrator 12c
  • Oracle R Advanced Analytics for Hadoop 2.5.0
  • Oracle XQuery for Hadoop 4.2.0
  • Oracle NoSQL Database Enterprise Edition 12cR1 (3.3.4)
  • Oracle Big Data Spatial and Graph 1.0
  • Oracle JDeveloper 12c (12.1.3)
  • Oracle SQL Developer and Data Modeler 4.1
  • Oracle Data Integrator 12cR1 (12.1.3.0.1)
  • Oracle GoldenGate 12c
  • Oracle R Distribution 3.1.1
  • Oracle Perfect Balance 2.4.0
  • Oracle CopyToBDA 2.0

You can follow this guide how to make deployment of VM succesfully.

Now after you download and open VM and access it, there will be some issues , so i warn you :)

- Increase RAM as possible as you can :)
- Increase disk mount points especially for "/" directory
- Be careful about setting DATE to local time, you can easily track last modified files
- If you have disk space problem, decrease directory THRESHOLD values or gather all logs in a new mounted disk, because there will lots of LOGS.

Here is a picture of successfully started Cloudera Manager administration page.




Yo can find default passphrases and connection strings of components at local page file:///home/oracle/GettingStarted/StartHere.html




For a succesfull startup, you user built-in services commands .

[root@bigdatalite ~]# 
[root@bigdatalite ~]# cd /opt/bin/
[root@bigdatalite bin]# ls
bee      nosqldb        nosqldb_cli  odi12c.png  oraclelsnr           services       services.prop.bak
fusedfs  nosqldb_admin  odi          oracledb    reset_vboxclient.sh  services.prop  shrink.sh
[root@bigdatalite bin]# 

Here we need services command.

[root@bigdatalite bin]# ./services


You see that Oracle prepared built-in code for start/stop hadoop services. But it says for the starting hadoop services use Cloudera Manager or this commandline help tool.

Note: Using Cloudera Manager and manually starting services are mutually exclusive; you must stop  one to access the other. Also, please perfom a system reboot after shutting down Cloudera  Manager.

So, lets start CM, choose Cloudera Manager on screen and press OK. It says following and starts CM.

##################################################
# Service Actions:
##################################################
** Updating /etc/alternatives to cloudera managed configs **
/etc/spark/conf.cloudera.spark has not been configured as an alternative for spark-conf
### Starting cloudera-scm-server ###
### Starting cloudera-scm-agent ###
[root@bigdatalite bin]#

When you issue ./services command again, it does not show hadoop services, so you have to use CM.


Here, you see stopped services. You can start cluster by pressing Start on link near  bigdatalite "clustername" ( red arrow ) 



Here is services starting ...



After that , you have started hadoop cluster succesfully. Now for the red and orange warnings , they are comes from default configuration . For example, HDFS needs 3 nodes at least, but we have only 1.



Ok, you can also use command line tools like hive, hadoop with no problem.

[root@bigdatalite ~]# hive

Logging initialized using configuration in jar:file:/usr/lib/hive/lib/hive-common-1.1.0-cdh5.4.0.jar!/hive-log4j.properties
WARNING: Hive CLI is deprecated and migration to Beeline is recommended.
hive> show databases;
OK
default
moviedemo
moviework
test123
Time taken: 1.115 seconds, Fetched: 4 row(s)
hive> 

[root@bigdatalite ~]# 
[root@bigdatalite ~]# 
[root@bigdatalite ~]# 
[root@bigdatalite ~]# 
[root@bigdatalite ~]# hadoop fs -ls /
Found 6 items
drwxr-xr-x   - hbase supergroup          0 2015-08-28 17:46 /hbase
drwxrwxrwx   - hdfs  supergroup          0 2015-06-11 16:10 /share
drwxr-xr-x   - solr  solr                0 2015-05-29 16:23 /solr
drwxrwxrwt   - hdfs  supergroup          0 2016-01-21 09:36 /tmp
drwxr-xr-x   - hdfs  supergroup          0 2015-08-06 12:59 /user
drwxr-xr-x   - hdfs  supergroup          0 2015-05-20 14:32 /var
[root@bigdatalite ~]# 

Ok, That's all.

Thanks for reading.

Enjoy & share.

Source:

http://www.oracle.com/technetwork/database/bigdata-appliance/oracle-bigdatalite421-2843803.html 

30 comments :

  1. Wow! It was the best article , actually you have posted something useful than others, because I read many articles related to this basics of programming, but I only get impressed with your post only, keep posting.
    Regards,
    Oracle DBA Training in Chennai|Oracle Training Institutes in Chennai

    ReplyDelete
    Replies
    1. Hi Caroline,

      Thanks for your comments :)

      Erkan
      Enjoy & Share ;)

      Delete
  2. Good information about sharing oracle big data and components. This is useful for all.

    Big Data Services

    ReplyDelete
  3. Analogica data is one of the Best Big Data Analytics Company in pune, services provides advanced Big Data and analytics solutions in pune.

    ReplyDelete
  4. A1 Trainings as one of the best training institute in Hyderabad for online trainings for Hadoop,We have expertise and real time professionals working in hadoop since 7 years. Our training strategy and materials will help the students for the certification exams also. For further details please drop an enquiry to Email : contact@a1trainings.com Ph:+91 7680813158

    Hadoop Training in Hyderabad

    ReplyDelete
  5. Great post! I am see the programming coding and step by step execute the outputs.I am gather this coding more information. It's helpful for me my friend. Also great blog here with all of the valuable information you have.
    Linux Training in Chennai

    ReplyDelete
  6. This is very important and imformative blog,thanks for good info Oracle SOA Online Training Bangalore

    ReplyDelete
  7. This comment has been removed by the author.

    ReplyDelete
  8. awesome post presented by you..your writing style is fabulous and keep update with your blogs Big Data Hadoop Online Training Bangalore

    ReplyDelete
  9. I read this blog i didn't have any knowledge about this but now i got some knowledge so keep on sharing such kind of an interesting blogs.


    Weblogic Administration Training

    ReplyDelete
  10. Nice post ! Thanks for sharing valuable information with us. Keep sharing..Big data hadoop online Course Bnagalore

    ReplyDelete
  11. Awe! What An Blog Very Helpful and interesting Really A great center for acquiring knowledge.Very Helpful Post And Explained Very Clearly About All the things.Very Helpful. Coming To Our Self We Provide Restaurant Equipment Parts .Really Thankfull For the blogger providing such a great information.Thank you. Have a Nice Day.

    ReplyDelete
  12. The Best Blog I Have Seen in the recent times Providing quality information about online it courses,we provide Urgent Care Services in chicago.Thanks For Sharing knowledge With Us.Really Thanks for Posting.

    ReplyDelete
  13. This Blog is very helpful and useful, came to know that I should be strong in my basics and this blog helps me to improve it, US Medical Residency in Chicago Services Provided by Us. Thanks For Posting.

    ReplyDelete
  14. Thanks For Sharing Such an Important and Useful Content On Mulesoft Certification Training

    ReplyDelete
  15. Thanks For Sharing Such an Useful Information........

    Vizag Real Estate

    ReplyDelete
  16. The post is written in very a good manner and it entails many useful information for me. I am happy to find your distinguished way of writing the post. Now you make it easy for me to understand and implement the concept.
    Click here:
    angularjs training in bangalore

    ReplyDelete
  17. Hi, Great.. Tutorial is just awesome..It is really helpful for a newbie like me.. I am a regular follower of your blog. Really very informative post you shared here. Kindly keep blogging.
    Blueprism training in tambaram

    Blueprism training in annanagar

    Blueprism training in velachery

    ReplyDelete
  18. Thanks you for sharing this unique useful information content with us. Really awesome work. keep on blogging
    Devops training in velachery
    Devops training in annanagar

    ReplyDelete
  19. A very nice guide. I will definitely follow these tips. Thank you for sharing such detailed article. I am learning a lot from you.

    rpa training in electronic-city | rpa training in btm | rpa training in marathahalli | rpa training in pune

    ReplyDelete
  20. Wonderful bloggers like yourself who would positively reply encouraged me to be more open and engaging in commenting.So know it's helpful.

    java training in chennai | java training in USA

    ReplyDelete