hadoop - 奥齐 : file and archive tag usage and differences?

Question

在 oozie 模式中，java 操作有两个标记，File 和 Archive。

<xs:element name="file" type="xs:string" minOccurs="0" maxOccurs="unbounded"/>
<xs:element name="archive" type="xs:string" minOccurs="0" maxOccurs="unbounded"/>

我想了解它们的用法？我还注意到这两个标签也应用于 MR/pig 操作。

Answer 1

关于文件和存档标签的快速描述:

The file & archive elements make available, to map-reduce jobs, files and archives. If the specified path is relative, it is assumed the file or archiver are within the application directory, in the corresponding sub-path. If the path is absolute, the file or archive it is expected in the given absolute path.

Files specified with the <file> element, will be symbolic links in the home directory of the task.

If a file is a native library (an '.so' or a '.so.#' file), it will be symlinked as and '.so' file in the task running directory, thus available to the task JVM.

To force a symlink for a file on the task running directory, use a '#' followed by the symlink name. For example 'mycat.sh#cat'.

有关任何 oozie 相关文档的更多信息，请单击链接 https://oozie.apache.org/docs/3.3.1/WorkflowFunctionalSpec.html#a3.2_Workflow_Action_Nodes