go - 解析 io.ReadAll 以匹配特定表达式

Question

我正在使用 Golang Docker SDK 输出容器日志。容器正在运行扫描并输出有关扫描作业开始时间、结束时间、平均扫描持续时间的特定信息，如下所示:

    Selected XML parser javax.xml.bind.util.JAXBSource$1 does not recognize the feature http://xml.org/sax/features/validation
    Generated ./reports/CSR1000V_RTR2.json
    Generated ./reports/CSR1000V_RTR6.json
    Generated ./reports/CSR1000V_RTR3.json
Scan start time: Mon Aug 27 03:39:24 GMT 2018
Scan end time:   Mon Aug 27 03:39:40 GMT 2018
Mean target scan duration: 3906ms

我使用下面的代码将 io.Reader 转换为字符串:

out, err := cli.ContainerLogs(ctx, resp.ID, types.ContainerLogsOptions{
    ShowStdout: true,
    Follow:     true})
if err != nil {
    panic(err)
}
defer out.Close()
//io.Copy(os.Stdout, out)
b, err := ioutil.ReadAll(out)

fmt.Println(string(b))

我如何在 Golang 中仅解析最后 3 行并仅从标准输出中捕获以下值:

fmt.Println("The scan has started at: " +startime)
fmt.Println("The scan has ended at: " +endtime)
fmt.Println("The scan job took xxx ms to scan each device")

Answer 1

另一种解决方案是使用 bufio.Scanner api。

如果您正在处理不想将其全部存储在内存中进行处理的大量输出，这可能会很有趣。

扫描器由读取器、输入数据和拆分函数组成，用于创建有意义的数据 block 。

使用标准 api 可以利用提供的 bufio.ScanLines 函数按行拆分输出，然后简单的前缀相等将产生必要的信息来识别研究的信息。

package main

import (
    "bufio"
    "bytes"
    "fmt"
    "strings"
)

type result struct {
    start string
    end   string
    mean  string
}

func main() {
    raw := `
    Selected XML parser javax.xml.bind.util.JAXBSource$1 does not recognize the feature http://xml.org/sax/features/validation
    Generated ./reports/CSR1000V_RTR2.json
    Generated ./reports/CSR1000V_RTR6.json
    Generated ./reports/CSR1000V_RTR3.json
Scan start time: Mon Aug 27 03:39:24 GMT 2018
Scan end time:   Mon Aug 27 03:39:40 GMT 2018
Mean target scan duration: 3906ms
`
    scanner := bufio.NewScanner(strings.NewReader(raw))

    var res result
    // Create a custom split function by wrapping the existing ScanLines function.
    split := func(data []byte, atEOF bool) (advance int, token []byte, err error) {
        advance, token, err = bufio.ScanLines(data, atEOF)
        if err == nil && token != nil {
            if pattern := []byte("Scan start time:"); bytes.HasPrefix(token, pattern) {
                res.start = strings.TrimSpace(string(token[len(pattern):]))
            } else if pattern := []byte("Scan end time:"); bytes.HasPrefix(token, pattern) {
                res.end = strings.TrimSpace(string(token[len(pattern):]))
            } else if pattern := []byte("Mean target scan duration:"); bytes.HasPrefix(token, pattern) {
                res.mean = strings.TrimSpace(string(token[len(pattern):]))
            }
        }
        return
    }
    // Set the split function for the scanning operation.
    scanner.Split(split)
    // drain the source
    for scanner.Scan() {
    }

    if err := scanner.Err(); err != nil {
        fmt.Printf("Invalid input: %s", err)
    }
    fmt.Printf("%#v\n", res)
}