debugging - 如何调试 Flink 应用程序进行内存和垃圾收集？

Question

我正在使用 Flink 1.1.4 并已添加到 flink-conf.yaml内存调试的配置参数，如Memory and Performance Debugging中所述:

taskmanager.debug.memory.startLogThread: true
taskmanager.debug.memory.logIntervalMs: 1000

重新启动 Flink 后，我看到 Job Manager 界面中添加了新参数，但我看不到任何新日志。

知道我可能缺少什么吗？

Answer 1

看来这在这个 mailinglist 中得到了解决
关键摘录，包括确认准确设置的摘录已成功测试:

That is exactly the right way to do it. Logging has to be at leastINFO and the parameter "taskmanager.debug.memory.startLogThread" setto true. The log output should be under"org.apache.flink.runtime.taskmanager.TaskManager".

Do you see other outputs for that class in the log?

Make sure you restarted the TaskManager processes after you changedthe config file.

Someone else just used the memory logging with the exact describedsettings - it worked.

There is probably some mixup, you may be looking into the wrong logfile, or may setting the a value in a different config...

How do you start the flink cluster? If it's a standalone cluster andyou don't use a shared directory, then you'll find the log of thetaskmanager on the machine on which the taskmanager runs. If you useYARN then you can activate log aggregation to retrieve the log easilyafter the job has finished.