groovy - 在 Groovy 和 Jenkins Pipeline 中组合多个 collectEntries

Question

我正在尝试使用多个 collectEntries在我的 Groovy 脚本中串联。最好看看代码，现在我有:

stage('Test') {
            // Reading content of the file
            def portsFileContent = readFile 'UsedPorts.txt'

            // Split the file by next line
            def ports = portsFileContent.split('\n')

            def steps = ports.collectEntries { port ->
                ["UI Test on port $port", {
                    sh "#!/bin/bash -lx \n startServerWithDifferentPort --params=port=$port"
                }]
            }
            parallel steps
        }

在文件“UsedPorts.txt”中，不同的端口由换行符分开，例如:

4723
4733
4743

所以这个数字被存储在变量 ports 中然后这个变量用于为每个端口启动一个服务器实例。因此，在这种情况下，它将通过以下命令启动 3 个不同的服务器实例:

def steps = ports.collectEntries { port ->
                ["UI Test on port $port", {
                    sh "#!/bin/bash -lx \n startServerWithDifferentPort --params=port=$port"
                }]
            }
            parallel steps

因为 parallel steps它同时使用不同的端口启动服务器的 3 个实例。

那工作正常，但我有另一个文件，需要再次执行相同的操作。所以在我的第二个文件中有如下条目:

name1
name2
name3

我再次创建了一个变量，用于存储我的 3 个条目:

def anotherFile = readFile 'Names.txt'
def names = anotherFile.split('\n')

这是我尝试过的:

stage('Test') {
            // Reading content of the file
            def portsFileContent = readFile 'UsedPorts.txt'

            // Split the file by next line
            def ports = portsFileContent.split('\n')

            // Do the same again
            def anotherFile = readFile 'Names.txt'
            def names = anotherFile.split('\n')

            def steps = ports.collectEntries, names.collectEntries { port, name ->
                ["UI Test on $name", {
                    sh "#!/bin/bash -lx \n someMoreShellStuff --params=port=$port"
                }]
            }
            parallel steps
        }

但是我不能分开我的第二个 collectEntries用逗号，因为它给了我一个语法错误。现在我的问题是，如何在同一个命令中使用这个变量。甚至有可能吗？

谢谢

更新 #1

使用 Szymon Stepniak 的答案后，我的新代码如下所示:

stage('Test') {
            // Reading content of the file
            def portsFileContent = readFile 'AppiumUsedPorts.txt'

            // Split the file by next line
            def ports = portsFileContent.split('\n')

            // Getting device IDs to get properties of device
            def deviceIDFileContent = readFile 'DeviceIDs.txt'
            def deviceIDs = deviceIDFileContent.split('\n')

            // Define port and id as an pair
            def pairs = (0..Math.min(ports.size(), deviceIDs.size())).collect { i -> [id: deviceIDs[i], port: ports[i]] }

            def steps = pairs.collectEntries { pair ->
                ["UI Test on ${pair.id}", {
                    sh "echo 'Running test with port ${pair.port}'"
                }]
            }
            parallel steps
        }

这导致了错误 java.lang.ArrayIndexOutOfBoundsException
更新 #2
AppiumUsedPorts.txt的内容:

4723
4733

DeviceIDs.txt的内容

5353352c
G000KU0663550R92

Answer 1

看起来您想从两个列表中压缩元素 - ports和 names并在创建并行执行步骤时使用这些对。所以假设 ports和 names包含以下内容:

def ports = [8080, 8081, 8082, 8083]
def names = ['Host A', 'Host B', 'Host C', 'Host D', 'Host E']

你需要一个对的列表，比如:

def pairs = [[port: 8080, name: 'Host A'], [port: 8081, name: 'Host B'], [port: 8082, name: 'Host C'], [port:8083, 'Host D']]

我故意使用了两个不同大小的列表，以解释压缩两个列表的结果总是相同的大小，然后是最短的列表。

Groovy 有一个方法 GroovyCollections.transpose(List lists) 它需要一个列表列表(例如 [[8080, 8081, 8082, 8083], ['Host A', 'Host B', 'Host C', 'Host D', 'Host E']] )并将两个列表“压缩”在一起，例如:

[[8080, 'Host A'], [8081, 'Host B'], [8082, 'Host C'], [8083, 'Host D']]

但它在 Jenkins Pipeline 中不起作用 - 如果您尝试使用它，您将获得:

org.jenkinsci.plugins.scriptsecurity.sandbox.RejectedAccessException: Scripts not permitted to use staticMethod org.codehaus.groovy.runtime.DefaultGroovyMethods transpose java.util.List

不管怎样，你可以简单地使用 collect 做同样的事情。范围从 0 到 min(ports.size(), names.size())创建一个列表，这些对/映射。看看下面的例子:

node {
    stage('Test') {
        def ports = [8080, 8081, 8082, 8083]
        def names = ['Host A', 'Host B', 'Host C', 'Host D', 'Host E']

        def pairs = (0..<Math.min(ports.size(), names.size())).collect { i -> [name: names[i], port: ports[i]] }

        def steps = pairs.collectEntries { pair ->
            ["UI Test on ${pair.name}", {
                sh "echo 'Running test with port ${pair.port}'"
            }]
        }

        parallel steps
    }
}

在本例中，我们将两个列表转置为映射列表，如 [port: ..., name: ...]我们调用 collectEntries在该映射列表上，在同一执行步骤中同时获取 - 端口和名称。在 Jenkins Pipeline 中运行此脚本会产生以下输出:

[Pipeline] {
[Pipeline] stage
[Pipeline] { (Test)
[Pipeline] parallel
[Pipeline] [UI Test on Host A] { (Branch: UI Test on Host A)
[Pipeline] [UI Test on Host B] { (Branch: UI Test on Host B)
[Pipeline] [UI Test on Host C] { (Branch: UI Test on Host C)
[Pipeline] [UI Test on Host D] { (Branch: UI Test on Host D)
[Pipeline] [UI Test on Host A] sh
[UI Test on Host A] [test-pipeline] Running shell script
[Pipeline] [UI Test on Host B] sh
[UI Test on Host B] [test-pipeline] Running shell script
[Pipeline] [UI Test on Host C] sh
[UI Test on Host C] [test-pipeline] Running shell script
[Pipeline] [UI Test on Host D] sh
[UI Test on Host A] + echo Running test with port 8080
[UI Test on Host A] Running test with port 8080
[UI Test on Host B] + echo Running test with port 8081
[UI Test on Host B] Running test with port 8081
[UI Test on Host D] [test-pipeline] Running shell script
[Pipeline] [UI Test on Host A] }
[UI Test on Host C] + echo Running test with port 8082
[UI Test on Host C] Running test with port 8082
[UI Test on Host D] + echo Running test with port 8083
[UI Test on Host D] Running test with port 8083
[Pipeline] [UI Test on Host B] }
[Pipeline] [UI Test on Host C] }
[Pipeline] [UI Test on Host D] }
[Pipeline] // parallel
[Pipeline] }
[Pipeline] // stage
[Pipeline] }
[Pipeline] // node
[Pipeline] End of Pipeline
Finished: SUCCESS

希望能帮助到你。