問題
實際應(yīng)用中板壮，使用 airflow 運行 BashOperator 操作時坦喘，由于業(yè)務(wù)日志包含中文導(dǎo)致 airflow task log 卡住锄列，任務(wù)其實是正常運行，但是沒辦法 hook task status,問題原因是 python 編碼的問題物喷，work 日志中會出現(xiàn)編碼錯誤，如下：
Exception in thread Thread-1:
Traceback (most recent call last):
File "/usr/lib64/python2.7/threading.py", line 812, in __bootstrap_inner
self.run()
File "/usr/lib64/python2.7/threading.py", line 765, in run
self.__target(*self.__args, **self.__kwargs)
File "/usr/lib/python2.7/site-packages/airflow/task_runner/base_task_runner.py", line 95, in _read_task_logs
self.logger.info('Subtask: {}'.format(line.rstrip('\n')))
UnicodeEncodeError: 'ascii' codec can't encode character u'\u6ce8' in position 55: ordinal not in range(128)
解決辦法
打開 base_task_runner.py 文件遮斥，
vi /usr/lib/python2.7/site-packages/airflow/task_runner/base_task_runner.py將
self.logger.info('Subtask: {}'.format(line.rstrip('\n')))做如下修改
修改前：
def _read_task_logs(self, stream):
while True:
line = stream.readline().decode('utf-8')
if len(line) == 0:
break
self.logger.info('Subtask: {}'.format(line.rstrip('\n')))
修改后
def _read_task_logs(self, stream):
while True:
line = stream.readline().decode('utf-8')
if len(line) == 0:
break
self.logger.info(u'Subtask: {}'.format(line.rstrip('\n')))
