cloudera cdh - Oozie Shared Lib: where to place jars -
i have installed cloudera cdh quickstart vm 5.5, , i'm running sqoop action in oozie workflow. encountered error says mysql jdbc driver missing , came across answer here says mysql-connector-java.jar should placed in oozie's hdfs shared lib path, under sqoop
path.
when browse oozie's hdfs shared lib path, however, i've noticed 2 sqoop
subdirectories copy jar.
/user/oozie/share/lib/sqoop
and
/user/oozie/share/lib/lib_20151118030154/sqoop
aside sqoop
, hive
, pig
, distcp
, , mapreduce-streaming
paths exist on both lib
, lib/lib_20151118030154
.
so question is: place connector jar: on first or second one?
what's difference (or difference of purpose) of these 2 paths in relation jars of sqoop
, hive
, pig
, distcp
, , mapreduce-streaming
oozie?
the lib_20151118030154
sub-dir current version of sharelibs, of 18-nov-2015. versioning allows make updates without stopping oozie service -- check documentation here.
in other words: oozie service keeps in memory list of jars in each sharelib (based on present latest version @ boot time), adding jar not make difference until (a) stop/restart service or (b) resync service explained in doc above.
Comments
Post a Comment