[经验]

基于SnapDragonBoard410C的手势识别

2018-9-27 16:47:24

2640 Qualcomm 手势识别

目前在物联网的领域里有许多的交互手段，例如语音交互，手势交互，手柄交互。今天我们就来了解下啥是手势交互！措辞有点糙，请大家见谅。

First:we should download a SDK package from internet.it’s called Touch3D

接下来主要是是向大家介绍这个SDK 是如何集成到我们的应用当中去。

mCameraEventListener = new CameraEventListener();
mImageRotationListener = new RotationListener();
// Create camera wrapper to handle camera functionality
mCameraWrapper = new CameraWrapper();
// Create touchless wrapper to handle gesture functionality
mTouchlessA3DWrapper = new TouchlessA3DWrapper(new TouchlessEventListener());
// Create helper for managing camera image rotation.
mImageRotationHelper = new ImageRotationHelper(this);
在oncreat中我们先把mTouchlessA3DWrapper对象先实例化。

private class TouchlessEventListener implements TouchlessA3DWrapper.TouchlessEventListener {
@Override
public void openHandFound() {
// Dispatch UI updates to UI thread
runOnUiThread(new Runnable() {
@Override
public void run() {
mPoseView.showOpenHand();
}
});
}
@Override
public void closedHandFound() {
// Dispatch UI updates to UI thread
runOnUiThread(new Runnable() {
@Override
public void run() {
mPoseView.showClosedHand();
}
});
}
@Override
public void pinchFound() {
// Dispatch UI updates to UI thread
runOnUiThread(new Runnable() {
@Override
public void run() {
mPoseView.showPinch();
}
});
}
@Override
public void thumbsUpFound() {
// Dispatch UI updates to UI thread
runOnUiThread(new Runnable() {
@Override
public void run() {
mPoseView.showThumbsUp();
}
});
}
@Override
public void poseLost() {
// Dispatch UI updates to UI thread
runOnUiThread(new Runnable() {
@Override
public void run() {
mPoseView.hideHand();
}
});
}
@Override
public void onError(final Exception e) {
Log.e(LOG_TAG, "TouchlessEventListener.onError: ", e);
// Dispatch event to main queue to update UI
runOnUiThread(new Runnable() {
@Override
public void run() {
Toast.makeText(TouchlessWorldActivity.this,
"Error reported from touchless engine. See logs for more info.",
Toast.LENGTH_LONG).show();
}
});
}
}
PoseView是我们自定的view用于显示手势识别成功后显示相应的图片。

ＣameraWrapper这个类当中主要是封装我们一些操作Camera的一些方法和数据回调。

private class ImageAvailableListener implements ImageReader.OnImageAvailableListener {
@Override
public void onImageAvailable(ImageReader imageReader) {
Image image = imageReader.acquireLatestImage();
if (image != null) {
int imageWidth = image.getWidth();
int imageHeight = image.getHeight();
//Get Y-plane of the YUV_420_888 image.
Image.Plane yPlane = image.getPlanes()[0];
//Copy plane to a new byte array, skipping row stride.
byte[] bytes = copyPlaneDataToPackedByteArray(yPlane, imageWidth, imageHeight);
//Convert timestamp to milliseconds.
long timestampMilliseconds = (long)(image.getTimestamp() / 1e6f);
if(mCameraEventListener != null) {
mCameraEventListener.onFrame(bytes, image.getWidth(), image.getHeight(), timestampMilliseconds);//回调数据给Ａｃｔｉｖｉｔｙ！
}
// Return image to image reader for reuse.
image.close();
}
}
private byte[] copyPlaneDataToPackedByteArray(Image.Plane yPlane, int imageWidth, int imageHeight) {
// Create destination buffer
byte[] bytes = new byte[imageWidth * imageHeight];
ByteBuffer buffer = yPlane.getBuffer();
int strideSkip = yPlane.getRowStride() - imageWidth;
// For every row of destination image
for (int row = 0; buffer.hasRemaining(); row += imageWidth) {
// Copy bytes to destination
buffer.get(bytes, row, imageWidth);
// On last row we mus make sure we have room for the stride skip
if(buffer.hasRemaining()) {
// Skip stride
buffer.position(buffer.position() + strideSkip);
}
}
return bytes;
}
}
TouchlessA3DWrapper这个类主要是封装了一些手势识别的操作！