Camera: Working barcode scanning with software rendering

Barcode scanner apps expect YUV as preview format. However, the
software renderer cannot handle YUV. Thus, RGB 565 is used. Barcode
scanner apps only need the first plane Y which is basically
greyscale.

The solution is a conversion from RGB to greyscale of preview frames
that are requested by apps for processing. Apps request preview frames
via onPreviewFrame(). The conversion is done using native code for
optimal speed. The conversion algorithm is based on the implementations
in the RGBLuminanceSource class of ZXing[1] and the
RGB565LuminanceSource class of FastBarcodeScanner[2].

Signed-off-by: Wolfgang Wiedmeyer <wolfgit@wiedmeyer.de>

[1]  https://github.com/zxing/zxing/blob/cc16a72c85e4958ce406af9547764e5eee9adb6e/core/src/main/java/com/google/zxing/RGBLuminanceSource.java

[2]  https://github.com/tschaumburg/FastBarcodeScanner/blob/5a4c166a722730d0099d4c6a1c15d312b93547da/tracking-barcode-scanner/src/main/java/dk/schaumburgit/trackingbarcodescanner/RGB565LuminanceSource.java

1 files changed, 21 insertions, 1 deletions

diff --git a/core/java/android/hardware/Camera.java b/core/java/android/hardware/Camera.java
index dd15d38..16727fe 100644
--- a/core/java/android/hardware/Camera.java
+++ b/core/java/android/hardware/Camera.java
@@ -1147,7 +1147,16 @@ public class Camera {
                         // Set to oneshot mode again.
                         setHasPreviewCallback(true, false);
                     }
-                    pCb.onPreviewFrame((byte[])msg.obj, mCamera);
+
+                    byte[] luminances = (byte[])msg.obj;
+                    if(getParameters().getPreviewFormat() == ImageFormat.RGB_565)
+                        // Convert to greyscale
+                        // Apps expect YUV as default format. Greyscale is
+                        // only the first layer of YUV, but it's all that's
+                        // needed by barcode scanner apps.
+                        rgbToBw(luminances);
+
+                    pCb.onPreviewFrame(luminances, mCamera);
                 }
                 return;
 
@@ -1216,6 +1225,17 @@ public class Camera {
         }
     }
 
+    private void rgbToBw(byte[] pixels)
+    {
+        Size previewsize = getParameters().getPreviewSize();
+        int height = previewsize.height;
+        int width = previewsize.width;
+
+        native_rgbToBw(pixels, width, height);
+    }
+
+    private native void native_rgbToBw(byte[] pixelBuffer, int bufWidth, int bufHeight);
+
     private static void postEventFromNative(Object camera_ref,
                                             int what, int arg1, int arg2, Object obj)
     {