c++ - 如何在caffe中提取图层的blob信息？

Question

我用了caffe用于我在 C++ 中的机器学习。

作为net_->Forward();通过网络后，我喜欢提取单个层的信息。

我做的是

          net_->Forward();

          //Extract layer information
          cout << "Num layers:" << "'" << net_->layer_names().size() << "'"<< endl;
          for (int layer_index = 0; layer_index < net_->layer_names().size(); ++layer_index) 
          {
                // get that layer blob and its dimension
                const boost::shared_ptr<Blob<float> > blob = net_->blob_by_name(net_->blob_names()[layer_index]);
                int batch_size = blob->num();                
                int dim_features = blob->count() / batch_size;
                std::cout << "Layer name:" << "'" << net_->layer_names()[layer_index] << "'" << " Blob name:" << "'" <<net_->blob_names()[layer_index] << "'" << " batch size " << "'" << batch_size << "'" << " dim_features:" << "'" << dim_features << "'" <<  std::endl;
          }

我可以看到所有图层名称和尺寸。

Layer name'image' Blob name'image' batch_size'1' dim_features'921600'
Layer name'conv1/7x7_s2' Blob name'conv1/7x7_s2' batch_size'1' dim_features'4915200'
Layer name'conv1/relu_7x7' Blob name'pool1/3x3_s2' batch_size'1' dim_features'1228800'
Layer name'pool1/3x3_s2' Blob name'pool1/norm1' batch_size'1' dim_features'1228800'
Layer name'pool1/norm1' Blob name'conv2/3x3_reduce' batch_size'1' dim_features'1228800'
Layer name'conv2/3x3_reduce' Blob name'conv2/3x3' batch_size'1' dim_features'3686400'
Layer name'conv2/relu_3x3_reduce' Blob name'conv2/norm2' batch_size'1' dim_features'3686400'

但在这里我还需要更深入的信息。

当前维度为 921600，即批大小 x channel 数 x 高 x 宽 = 921600。

(1)所以我的第一个问题是如何拆分信息？

(2)假设我有这个信息 batch size x channels x height x width = 1 x 3 x 480 x 640。然后

如何提取 1 x 1 x 480 x 640 等 blob 中的每一层，以便我可以打印或绘图。

我可以用 Python 做的那种事

for layer_name, blob in net.blobs.iteritems():
        print layer_name + '\t' + str(blob.data.shape)
            mydata = net.blobs[layer_name].data[0,0,:,:]
            #cv2.imshow("mydata",mydata);
            #cv2.waitKey(1)
            layer_name = layer_name.replace('/', '_')
            np.savetxt("printdata/"+layer_name+".csv", mydata, delimiter=",")

但现在，我喜欢用 C++ 来做。

Answer 1

对于问题 1:

如果你查看 blob.hpp文件它有几种方法来获取 blob 的尺寸。您可以调用 shape()返回 const vector<int>&或弃用的方法，如 num() , channels() , height() , width()返回 int .所以对于你的情况应该是这样的:

int batch_size = blob->num();
int channels = blob->channels();
int height = blob->height();
int width = blob->width();
std::cout << "Layer name:" << "'" << net_->layer_names()[layer_index] << "'" << " Blob name:" << "'" <<net_->blob_names()[layer_index] << "'" << " batch size " << "'" << batch_size << "'" << " channels:" << "'" << channels << "'" << " height:" << "'" << height << "'" << " width:" << "'" << width << "'" <<  std::endl;

编辑:

对于问题 2:如果图层有 3 个 channel ，那么您可以这样做以显示为图像:

// assign channels
std::vector<cv::Mat> ccs;
cv::Size ss(width, height);
float* data = blob->mutable_cpu_data();
for (int i = 0; i < channels; ++i) {
    cv::Mat channel(ss, CV_32FC1, data);
    ccs.push_back(channel);
    data += ss.area();
}
cv::Mat res,dst;
// merge them
cv::merge(ccs, res);
// optional add mean if needed
cv::normalize(res, dst, 0, 1, cv::NORM_MINMAX);
cv::namedWindow("Display window");
cv::imshow("Display window", dst);
cv::waitKey(0);