2019 CVPR

摘要:

以往方法都是从多尺度,多语义角度出发提高鲁棒性和效果,而我们确定了三个对密度估计至关重要的属性:几何/语义/数字属性,并演示了如何有效地利用这些异构属性来帮助人群计数,即将它们构造成多个辅助任务来计数。

人群密度估计--Leveraging Heterogeneous Auxiliary Tasks to Assist Crowd Counting

Figure 1 展示了三种属性

尺度变化大->几何属性

杂乱的背景->语义属性

总数->数字属性

创新点-(其实在摘要里说了,不同的表达形式)

1. 通过三种不同属性提高密度图预测。(几何学属性,语义属性,数字信息)

2. 每一组属性都作为辅助任务,提供联合正则化效应

3. 在三种数据集上的效果

网络结构

人群密度估计--Leveraging Heterogeneous Auxiliary Tasks to Assist Crowd Counting

结构包括一个 encoder 和4个decoder(1 个main 和 3个 auxiliary )

人群密度估计--Leveraging Heterogeneous Auxiliary Tasks to Assist Crowd Counting

所需要的4种标签

1 depth 用已有的预测深度的网络来生成depth label (L2)

2 segment label 由已有的标签生成,简单二值化(L1)

3 number 由已有的标签生成,总数(L3)

4 density map 跟以往论文一样 (L4)

loss

人群密度估计--Leveraging Heterogeneous Auxiliary Tasks to Assist Crowd Counting

人群密度估计--Leveraging Heterogeneous Auxiliary Tasks to Assist Crowd Counting人群密度估计--Leveraging Heterogeneous Auxiliary Tasks to Assist Crowd Counting

人群密度估计--Leveraging Heterogeneous Auxiliary Tasks to Assist Crowd Counting

人群密度估计--Leveraging Heterogeneous Auxiliary Tasks to Assist Crowd Counting

这句话不错~

Attentive Crowd Segmentation:Due to the complex situations such as the extremely limited pixels of pedestrians occupied in the image as well as the clutter background, the crowd density map is usually noisy.

紧接着就是实验参数设置和实验测试对比

人群密度估计--Leveraging Heterogeneous Auxiliary Tasks to Assist Crowd Counting

A lightweight counting FCN model (CFCN) with three convolution layers for both the encoder and decoder is chosen for theMall dataset [3]. Another one is a much deeper model (CSRNet [12]) which adapts VGG network [27] for crowd counting with dilation processing.

人群密度估计--Leveraging Heterogeneous Auxiliary Tasks to Assist Crowd Counting

消融实验验证,联合loss 效果最佳

人群密度估计--Leveraging Heterogeneous Auxiliary Tasks to Assist Crowd Counting

还进行实验选择最好的loss权重,

In our experiment, we select the weights for depth prediction loss, crowd segmentation loss and the count regression loss as 0.6, 0.04 and 1

相关文章:

  • 2021-04-30
  • 2021-07-08
  • 2021-04-03
  • 2021-04-12
  • 2022-01-07
  • 2022-12-23
  • 2021-12-26
  • 2022-01-04
猜你喜欢
  • 2021-11-17
  • 2022-01-18
  • 2022-01-14
  • 2021-11-20
  • 2021-05-30
  • 2022-01-18
  • 2021-07-11
相关资源
相似解决方案