Android : Detect movement of eyes using sensor at real time

Question

I am preparing one android application in which I have to detect to movement of eyes. Somehow I am able to achieve the above thing on images but I want this on live eyes.

I am not able to understand that if we can use the proximity sensor to detect the eyes. Just like smartStay feature.

Please suggest the ideas to implement the same.

Answer 1

We can use the front camera to detect the eyes and eyes blink. Use the Vision api for detecting the eyes.

Code for eye tracking:

public class FaceTracker extends Tracker<Face> {

private static final float PROB_THRESHOLD = 0.7f;
private static final String TAG = FaceTracker.class.getSimpleName();
private boolean leftClosed;
private boolean rightClosed;

@Override
public void onUpdate(Detector.Detections<Face> detections, Face face) {
    if (leftClosed && face.getIsLeftEyeOpenProbability() > PROB_THRESHOLD) {
        leftClosed = false;
    } else if (!leftClosed &&  face.getIsLeftEyeOpenProbability() < PROB_THRESHOLD){
        leftClosed = true;
    }
    if (rightClosed && face.getIsRightEyeOpenProbability() > PROB_THRESHOLD) {
        rightClosed = false;
    } else if (!rightClosed && face.getIsRightEyeOpenProbability() < PROB_THRESHOLD) {
        rightClosed = true;
    }

    if (leftClosed && !rightClosed) {
        EventBus.getDefault().post(new LeftEyeClosedEvent());
    } else if (rightClosed && !leftClosed) {
        EventBus.getDefault().post(new RightEyeClosedEvent());
    } else if (!leftClosed && !rightClosed) {
        EventBus.getDefault().post(new NeutralFaceEvent());
    }
}
}


//method to call the FaceTracker 
 private void createCameraResources() {
    Context context = getApplicationContext();

    // create and setup the face detector
    mFaceDetector = new FaceDetector.Builder(context)
            .setProminentFaceOnly(true) // optimize for single, relatively large face
            .setTrackingEnabled(true) // enable face tracking
            .setClassificationType(/* eyes open and smile */ FaceDetector.ALL_CLASSIFICATIONS)
            .setMode(FaceDetector.FAST_MODE) // for one face this is OK
            .build();

    // now that we've got a detector, create a processor pipeline to receive the detection
    // results
    mFaceDetector.setProcessor(new LargestFaceFocusingProcessor(mFaceDetector, new FaceTracker()));

    // operational...?
    if (!mFaceDetector.isOperational()) {
        Log.w(TAG, "createCameraResources: detector NOT operational");
    } else {
        Log.d(TAG, "createCameraResources: detector operational");
    }

    // Create camera source that will capture video frames
    // Use the front camera
    mCameraSource = new CameraSource.Builder(this, mFaceDetector)
            .setRequestedPreviewSize(640, 480)
            .setFacing(CameraSource.CAMERA_FACING_FRONT)
            .setRequestedFps(30f)
            .build();
}