二零二三年 优质公开课sqoop安装使用.pptx

sqoop 安装使用掌握sqoop 安装及其使用一、安装准备条件二、Sqoop安装三、Sqoop的使用1、安装准备版本介绍：sqoop-1.4.5hadoop-2.6.0apache-hive-0.13.0mysql-5.1.66环境介绍：172.18.0.3 namenode/hive/sqoop172.18.0.4 datanode/mysql2、Sqoop安装在.bash_profile文件中增加SQOOP_HOME export SQOOP_HOME=/hadoop/sqoop export PATH=$PATH:$SQOOP_HOME/bin:$SQOOP_HOME/conf下载并解压sqoop软件安装包 tar –zxvf sqoop-1.4.5.bin__hadoop-2.0.4-alpha.tar.gz mv sqoop-1.4.5.bin__hadoop-2.0.4-alpha sqoop将mysql的jdbc驱动包复制到sqoop/lib目录下 cp mysql-connector-java-5.1.34-bin.jar /hadoop/sqoop/lib2、Sqoop安装配置sqoop-env.sh文件#Set path to where bin/hadoop is availableexport HADOOP_COMMON_HOME=/hadoop/hadoop#Set path to where hadoop-*-core.jar is availableexport HADOOP_MAPRED_HOME=/hadoop/hadoop#set the path to where bin/hbase is availableexport HBASE_HOME=/hadoop/hbase#Set the path to where bin/hive is availableexport HIVE_HOME=/hadoop/hive#Set the path for where zookeper config dir isexport ZOOCFGDIR=/hadoop/zookeeper3、Sqoop的使用列出mysql数据库中的所有数据库sqoop-list-databases --connect jdbc:mysql://172.18.0.4:3306/ -username hadoop –P连接mysql并列出数据库中的表sqoop-list-tables --connect jdbc:mysql://172.18.0.4:3306/sqoop --username hadoop–P将hive表中的数据导出到mysql中sqoop-export --connect jdbc:mysql://172.18.0.4:3306/sqoop --username hadoop –P--table bss --export-dir /user/hive/warehouse/bss3、Sqoop的使用将mysql数据库的表结构复制到hive中sqoop-create-hive-table --connect jdbc:mysql://172.18.0.4:3306/sqoop --tablecustomer --username hadoop –P --hive-table customer --fields-terminated-by ,将数据从mysql数据库导入到hive中sqoop-import --connect jdbc:mysql://172.18.0.4:3306/sqoop --username hadoop -P--table customer --hive-import --hive-table customer --fields-terminated-by , -m 1sqoop的安装以及使用命令