python - 如何在 caffe python 上测试 FCN(voc-fcn8s)？

Question

我想测试 shelhamer 给出的 FCN caffemodel图片:

但我不确定如何运行测试程序并显示带标签的图像。

我考虑的代码如下:

import caffe
caffe_root = 'fcn.berkeleyvision.org-master/voc-fcn8s/'
model_def = caffe_root + 'deploy.prototxt'
model_weights = caffe_root + 'fcn8s-heavy-pascal.caffemodel'
test_image = caffe_root + 'test.jpg'

net = caffe.Net(model_def, model_weights, caffe.TEST)
image = caffe.io.load_image(test_image)

那么接下来是什么有人可以帮助我吗？我在这里苦苦挣扎了好几天。

Answer 1

可以引用infer.py在存储库中。

# load image, switch to BGR, subtract mean, and make dims C x H x W for Caffe
im = Image.open('pascal/VOC2010/JPEGImages/2007_000129.jpg')
in_ = np.array(im, dtype=np.float32)
in_ = in_[:,:,::-1]
in_ -= np.array((104.00698793,116.66876762,122.67891434))
in_ = in_.transpose((2,0,1))

# load net
net = caffe.Net('voc-fcn8s/deploy.prototxt', 'voc-fcn8s/fcn8s-heavy-pascal.caffemodel', caffe.TEST)
# shape for input (data blob is N x C x H x W), set data
net.blobs['data'].reshape(1, *in_.shape)
net.blobs['data'].data[...] = in_
# run net and take argmax for prediction
net.forward()
out = net.blobs['score'].data[0].argmax(axis=0)

reshape 数据层至关重要，因为测试图像的形状可能不同。