Disable Apache Flink Logging

Question

I'm using an old version of Apache Flink, with Runtime 2.11 and Flink Core 1.1.2. I cannot upgrade it to the newer Apache Flink due to compatibility issues to other libraries. I'm trying to disable the node logging on the Runtime in order to minimize the execution time. I tried to use the following code, but the messages are displayed nethertheless:

Log4jLoggerAdapter logger = (Log4jLoggerAdapter)LoggerFactory
  .getLogger(JobManager.class);
Field loggerField = Log4jLoggerAdapter.class.getDeclaredField("logger");
loggerField.setAccessible(true);
Logger loggerObject = (Logger)loggerField.get(logger);


Field repoField = Category.class.getDeclaredField("repository");
repoField.setAccessible(true);
LoggerRepository repoObject = (LoggerRepository)repoField.get(loggerObject);

repoObject.setThreshold(Level.OFF);

Plus, I'd like to know if there is a way to extimate the number of messages exchanged within each phase of the Execution Plan.

score 2 · Accepted Answer · answered May 28 '17 at 14:38

2

public static ExecutionEnvironment setupLocalEnvironment() {
     Configuration conf = new Configuration();
      env = new LocalEnvironment(conf);
      env.getConfig().disableSysoutLogging();
      return env;
}

answered May 28 '17 at 14:38

jackb

695
8
26

Flink changed a bit, and my issue was on an old version. Did you test it on Runtime 2.11 and Flink Core 1.1.2? – jackb Jul 23 '18 at 19:16

score 1 · Answer 2 · answered Jan 20 '19 at 15:06

1

First, you need to figure out whether you are using slf4j + logback, or slf4j + log4j. If you use slf4j + log4j, then disable log4j by

log4j.rootLogger=OFF

else is you use slf4j + logback, then disable logback by

<!-- This affects logging for both user code and Flink -->
<root level="OFF">
    <appender-ref ref="file"/>
</root>

answered Jan 20 '19 at 15:06

begginghard

141
1
5

Thanks, the first approach worked for me. All I had to do was find the _log4j.properties_ file in _src\main\resources_ and edit the appropriate line. – h4nek Jun 27 '19 at 07:50

score 0 · Answer 3 · answered Apr 10 '17 at 08:39

0

Can you try this in your Main function :

org.apache.log4j.BasicConfigurator.configure(new NullAppender());

I have a doubt for your version, but give it a try.

answered Apr 10 '17 at 08:39

ImbaBalboa

851
9
23

Disable Apache Flink Logging

3 Answers3