如何在另一个图像中找到模板图像？首选 Kinect 和 AForge

Question

我从这里复制了 AForge-Sample： http://www.aforgenet.com/framework/features/template_matching.html 并希望它可以使用 2 个位图作为源，如下代码所示：

    Bitmap findTemplate (Bitmap sourceImage, Bitmap template)
    {

    // create template matching algorithm's instance
    // (set similarity threshold to x.y%, 1.0f = 100%)
    ExhaustiveTemplateMatching tm = new ExhaustiveTemplateMatching( 0.4f );
    // find all matchings with specified above similarity
    TemplateMatch[] matchings = tm.ProcessImage( sourceImage, template ); **// "Unsupported pixel format of the source or template image." as error message**
    // highlight found matchings
    BitmapData data = sourceImage.LockBits(
        new Rectangle( 0, 0, sourceImage.Width, sourceImage.Height ),
        ImageLockMode.ReadWrite, sourceImage.PixelFormat );
    foreach ( TemplateMatch m in matchings )
    {
        AForge.Imaging.Drawing.Rectangle( data, m.Rectangle, System.Drawing.Color.White );
        // do something else with matching
    }
    sourceImage.UnlockBits( data );
    return sourceImage;
    }

但是当调用 TemplateMatch[] matchings = tm.P.... 时，它给出了上面提到的错误。 模板是这样生成的：

Bitmap templatebitmap=(Bitmap)AForge.Imaging.Image.FromFile("template.jpg");

源是使用 kinect-webcam 生成的，其中 PlanarImage 被格式化为位图（从某处复制的方法，但它一直在工作）

 Bitmap PImageToBitmap(PlanarImage PImage)
        {
            Bitmap bmap = new Bitmap(
              PImage.Width,
              PImage.Height,
              System.Drawing.Imaging.PixelFormat.Format32bppRgb);
            BitmapData bmapdata = bmap.LockBits(
              new Rectangle(0, 0, PImage.Width,
                                   PImage.Height),
              ImageLockMode.WriteOnly,
              bmap.PixelFormat);
            IntPtr ptr = bmapdata.Scan0;
            Marshal.Copy(PImage.Bits,
                         0,
                         ptr,
                         PImage.Width *
                            PImage.BytesPerPixel *
                                 PImage.Height);
            bmap.UnlockBits(bmapdata);
            return bmap;
        }

那么，有人可以帮助我吗，我的错误可能在哪里？ 或者也许有人知道将模板与 Kinect 匹配的更好方法？ 总体工作是用 kinect 检测已知物体，在我的例子中是一只橡皮鸭。

谢谢你。

Answer 1

这是使用 AForge 的解决方案 但它很慢，大约需要 5 秒，但它有效 像往常一样，你需要引入 AForge 框架下载并安装它。 指定使用 AForge 命名空间

并复制粘贴以使其工作

System.Drawing.Bitmap sourceImage = (Bitmap)Bitmap.FromFile(@"C:\SavedBMPs\1.jpg");
System.Drawing.Bitmap template = (Bitmap)Bitmap.FromFile(@"C:\SavedBMPs\2.jpg");
// create template matching algorithm's instance
// (set similarity threshold to 92.5%)

ExhaustiveTemplateMatching tm = new ExhaustiveTemplateMatching(0.921f);
// find all matchings with specified above similarity

TemplateMatch[] matchings = tm.ProcessImage(sourceImage, template);
// highlight found matchings

BitmapData data = sourceImage.LockBits(
    new Rectangle(0, 0, sourceImage.Width, sourceImage.Height),
    ImageLockMode.ReadWrite, sourceImage.PixelFormat);
foreach (TemplateMatch m in matchings)
{

        Drawing.Rectangle(data, m.Rectangle, Color.White);

    MessageBox.Show(m.Rectangle.Location.ToString());
    // do something else with matching
}
sourceImage.UnlockBits(data);

Answer 2

所以，我只是自己实现了它。但它太慢了——所以如果有人有改进的想法，请随时批评我的代码：

    public class Position
    {
        public int bestRow { get; set; }
        public int bestCol { get; set; }
        public double bestSAD { get; set; }
        public Position(int row, int col, double sad)
        {
            bestRow = row;
            bestCol = col;
            bestSAD = sad;
        }
    }

    Position element_position = new Position(0, 0, double.PositiveInfinity);
    Position ownSearch(Bitmap search, Bitmap template) {
        Position position = new Position(0,0,double.PositiveInfinity);
        double minSAD = double.PositiveInfinity;


        // loop through the search image
        for (int x = 0; x <= search.PhysicalDimension.Width - template.PhysicalDimension.Width; x++)
        {
            for (int y = 0; y <= search.PhysicalDimension.Height - template.PhysicalDimension.Height; y++)
            {
                position_label2.Content = "Running: X=" + x + "  Y=" + y;
                double SAD = 0.0;

                // loop through the template image
                for (int i = 0; i < template.PhysicalDimension.Width; i++)
                {
                    for (int j = 0; j < template.PhysicalDimension.Height; j++)
                    {
                        int r = Math.Abs(search.GetPixel(x + i, y + j).R - template.GetPixel(i, j).R);

                        int g = Math.Abs(search.GetPixel(x + i, y + j).G - template.GetPixel(i, j).G);

                        int b = Math.Abs(search.GetPixel(x + i, y + j).B - template.GetPixel(i, j).B);

                        int a = template.GetPixel(i, j).A;

                        SAD = SAD + ((r + g + b)*a/255 );

                    }
                }
                // save the best found position 
                if (minSAD > SAD)
                {
                    minSAD = SAD;
                    // give me VALUE_MAX
                    position.bestRow = x;
                    position.bestCol = y;
                    position.bestSAD = SAD;
                }
            }
        }
        return position;
    }