SQOOP Import and Export Examples

Below are some sample commands to export and import operator in SQOOP to move data from relational databases (e.g., mysql is used here) to HDFS location 

Export:

sqoop export --connect jdbc:mysql://mysqldb.****.****/database --table <table_name> --username ******* -password ****** -fields-terminated-by ',' -m 1 --export-dir <HDFS Path>

Import:

sqoop import --connect jdbc:mysql://mysqldb.******.****/MyDB --table customers --username ****** --password ****** --target-dir batch/sqoop/job1 -m 1

=> m =1 loads all data to single part file.

=> m= 5 loads data to 5 separate part files.

Extracts specific columns:

sqoop import --connect jdbc:mysql://mysqldb.edu.cloudlab.com/retail_db --table customers --username labuser --password edureka --target-dir batch/sqoop/job1 --columns “column1, column2” -m 1 

When We Start Pseudo Distributed Service We Face 'unregognized service' Error Message?

We may come across the below issue when we start HDFS service in cloudera:

$ for x in `cd /etc/init.d ; ls hadoop-hdfs-*` ; do sudo service $x start ; done error unrecognized service 




I was able to overcome this issue by running below commands:

• $ sudo service hadoop-hdfs-namenode start 
• $ sudo service hadoop-hdfs-datenode start 
• $ sudo service hadoop-hdfs-secondarynamenode start