Minor fix to hostname regex and filtering out log messages from Hive output.#2
Minor fix to hostname regex and filtering out log messages from Hive output.#2joshfg wants to merge 2 commits intomate1:masterfrom joshfg:master
Conversation
Hyphen is also a valid character in hostnames
Filter Hive output by removing any logging lines (detected as a line beginning with '['). Currently, when running Hive with Hadoop 2, Hive will output log messages to the console. E.g. [deprecation] - mapred.reduce.tasks is deprecated. Instead, use mapreduce.job.reduces This commit filters out these log messages before processing the Hive output.
|
Hi, Sorry for the delay! I'm fine with the hostname regex change, but I don't really like the change to Hive's logging. It seems like this could hide legitimate [ERROR] logs... Plus, it makes it even more apparent that the duplicated code around hive commands is ugly. I'd like to refactor all that more properly.. Anyway! I'll probably cherry pick the hostname regex change and I don't know yet what I'll do with the hive stuff... -F |
|
Hi Felix, OK that's cool I thought the log filtering was a bit hacky but checked it Thanks, On Mon, Feb 24, 2014 at 4:16 AM, FelixGV notifications@github.com wrote:
|
2 participants
No description provided.