hive thrift 或 Apache Airflow 的 HiveMetastore 问题

如何解决hive thrift 或 Apache Airflow 的 HiveMetastore 问题

我们在尝试通过 Apache Airflow 中的 HiveMetastoreHook 连接 Hive Metastore 时遇到问题 thrift.transport.TTransport.TTransportException: b'Error in sasl_decode (-1) SASL(-1): generic failure: Unable to find a callback: 32775'

我们用谷歌搜索了这个问题，但仍然没有找到任何答案

但为了临时修复 - 我们确实重新创建了发生问题的 hive 外部表并重新启动此任务。然后几天后这个问题一次又一次地发生。而且我们不知道哪里需要修复。

注意： 这只会发生在一张大桌子上 我们有 hive 3.1.0 和 Airflow 1.10.5 ， 此问题通过导入气流从 python3 cli 重现， 从 hive 中选择这个大表很好（数据也很好）

完整的堆栈跟踪

[2021-06-30 18:05:41,143] {{base_hook.py:84}} INFO - Using connection to: id: our_hive_metastore_connection. Host: server_name,Port: someport,Schema: our_schema,Login: some_login,Password: None,extra: {'authMechanism': 'GSSAPI','kerberos_service_name': 'some_name'}
>>> hm.get_table(table_name='some_big_table',db='some_schema')
Traceback (most recent call last):
 File "<stdin>",line 1,in <module>
 File "/usr/local/lib/python3.6/site-packages/airflow/hooks/hive_hooks.py",line 608,in get_table
 return client.get_table(dbname=db,tbl_name=table_name)
 File "/usr/local/lib/python3.6/site-packages/hmsclient/genthrift/hive_metastore/ThriftHiveMetastore.py",line 2253,in get_table
 return self.recv_get_table()
 File "/usr/local/lib/python3.6/site-packages/hmsclient/genthrift/hive_metastore/ThriftHiveMetastore.py",line 2266,in recv_get_table
 (fname,mtype,rseqid) = iprot.readMessageBegin()
 File "/usr/local/lib64/python3.6/site-packages/thrift/protocol/TBinaryProtocol.py",line 134,in readMessageBegin
 sz = self.readI32()
 File "/usr/local/lib64/python3.6/site-packages/thrift/protocol/TBinaryProtocol.py",line 217,in readI32
 buff = self.trans.readAll(4)
 File "/usr/local/lib64/python3.6/site-packages/thrift/transport/TTransport.py",line 62,in readAll
 chunk = self.read(sz - have)
 File "/usr/local/lib/python3.6/site-packages/thrift_sasl/__init__.py",line 166,in read
 self._read_frame()
 File "/usr/local/lib/python3.6/site-packages/thrift_sasl/__init__.py",line 180,in _read_frame
 message=self.sasl.getError())
thrift.transport.TTransport.TTransportException: b'Error in sasl_decode (-1) SASL(-1): generic failure: Unable to find a callback: 32775'```

Is anybody have some idea what we need to fix?
Appreciate for help!