Here are some details from the meta store logs:

018-06-08T03:34:20,634 ERROR [pool-13-thread-197([])]:
metastore.RetryingHMSHandler (RetryingHMSHandler.java:invokeInternal(204))
- java.lang.IllegalStateException: Unexpected DataOperationType: UNSET
agentInfo=Unknown txnid:130551
    at
org.apache.hadoop.hive.metastore.txn.TxnHandler.enqueueLockWithRetry(TxnHandler.java:1000)
    at
org.apache.hadoop.hive.metastore.txn.TxnHandler.lock(TxnHandler.java:872)
    at
org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.lock(HiveMetaStore.java:6366)
    at sun.reflect.GeneratedMethodAccessor11.invoke(Unknown Source)
    at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
    at java.lang.reflect.Method.invoke(Method.java:498)
    at
org.apache.hadoop.hive.metastore.RetryingHMSHandler.invokeInternal(RetryingHMSHandler.java:148)
    at
org.apache.hadoop.hive.metastore.RetryingHMSHandler.invoke(RetryingHMSHandler.java:107)
    at com.sun.proxy.$Proxy32.lock(Unknown Source)
    at
org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Processor$lock.getResult(ThriftHiveMetastore.java:14155)
    at
org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Processor$lock.getResult(ThriftHiveMetastore.java:14139)
    at org.apache.thrift.ProcessFunction.process(ProcessFunction.java:39)
    at
org.apache.hadoop.hive.metastore.TUGIBasedProcessor$1.run(TUGIBasedProcessor.java:110)
    at
org.apache.hadoop.hive.metastore.TUGIBasedProcessor$1.run(TUGIBasedProcessor.java:106)
    at java.security.AccessController.doPrivileged(Native Method)
    at javax.security.auth.Subject.doAs(Subject.java:422)
    at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1836)
    at
org.apache.hadoop.hive.metastore.TUGIBasedProcessor.process(TUGIBasedProcessor.java:118)
    at
org.apache.thrift.server.TThreadPoolServer$WorkerProcess.run(TThreadPoolServer.java:286)
    at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
    at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
    at java.lang.Thread.run(Thread.java:748)

Here are some details about the environment

Source :

Storm Topology version : 1.1.1
storm-hive : version 1.1.1
mvn dependency plugin show following depedencies

Hive :

*[INFO]    org.apache.hive.shims:hive-shims-0.23:jar:0.14.0:runtime*

*[INFO]    org.apache.hive:hive-ant:jar:0.14.0:compile*

*[INFO]    org.apache.hive:hive-metastore:jar:0.14.0:compile*

*[INFO]    org.apache.hive:hive-shims:jar:0.14.0:compile*

*[INFO]    org.apache.hive:hive-cli:jar:0.14.0:compile*

*[INFO]    org.apache.hive:hive-exec:jar:0.14.0:compile*

*[INFO]
org.apache.hive.shims:hive-shims-common-secure:jar:0.14.0:compile*

*[INFO]    org.apache.hive.shims:hive-shims-common:jar:0.14.0:compile*

*[INFO]    org.apache.hive:hive-common:jar:0.14.0:compile*

*[INFO]    org.apache.hive.shims:hive-shims-0.20S:jar:0.14.0:runtime*

*[INFO]    org.apache.hive.shims:hive-shims-0.20:jar:0.14.0:runtime*

*[INFO]
org.apache.hive.hcatalog:hive-hcatalog-streaming:jar:0.14.0:compile*

*[INFO]    org.apache.hive:hive-serde:jar:0.14.0:compile*

*[INFO]    org.apache.storm:storm-hive:jar:1.1.1:compile*

*[INFO]    org.apache.hive:hive-service:jar:0.14.0:compile*

*[INFO]    org.apache.hive.hcatalog:hive-hcatalog-core:jar:0.14.0:compile*
Hadoop :

*org.apache.hadoop:hadoop-mapreduce-client-core:jar:2.6.1:compile*

*[INFO]    org.apache.hadoop:hadoop-yarn-common:jar:2.6.1:compile*

*[INFO]    org.apache.hadoop:hadoop-common:jar:2.6.1:compile*

*[INFO]
org.apache.hadoop:hadoop-mapreduce-client-jobclient:jar:2.6.1:compile*

*[INFO]    org.apache.hadoop:hadoop-yarn-api:jar:2.6.1:compile*

*[INFO]    org.apache.hadoop:hadoop-client:jar:2.6.1:compile*

*[INFO]    org.apache.hadoop:hadoop-auth:jar:2.6.1:compile*

*[INFO]    org.apache.hadoop:hadoop-yarn-client:jar:2.6.1:compile*

*[INFO]    org.apache.hadoop:hadoop-mapreduce-client-app:jar:2.6.1:compile*

*[INFO]
org.apache.hadoop:hadoop-mapreduce-client-common:jar:2.6.1:compile*

*[INFO]    org.apache.hadoop:hadoop-annotations:jar:2.6.1:compile*

*[INFO]    org.apache.hadoop:hadoop-hdfs:jar:2.6.1:compile*

*[INFO]
org.apache.hadoop:hadoop-mapreduce-client-shuffle:jar:2.6.1:compile*

*[INFO]    org.apache.hadoop:hadoop-yarn-server-common:jar:2.6.1:compile*

and  HDFS

*[INFO]    org.apache.hadoop:hadoop-hdfs:jar:2.6.1:compile*

Sink:
Hive EMR

Hadoop version :

*hadoop@ip-10-0-6-16 ~]$ hadoop version*

*Hadoop 2.8.3-amzn-0*

Hive version :

*[hadoop@ip-10-0-6-16 ~]$ hive --version*

*Hive 2.3.2-amzn-2*
Any inconsistency leading to such an error ?
On Thu, Jun 7, 2018 at 7:35 PM, Roshan Naik <[EMAIL PROTECTED]> wrote: