Search code examples
javaopengllwjgl

Computing Mouse Position to 3d Space - OpenGL


I'm trying to create a ray to that translates my mouse coordinates to 3d world coordinates.

Cx = Mx / screenWidth * 2 - 1
Cy = -( My / screenHeight * 2 - 1 )

vNear = InverseViewProjectionMatrix * ( Cx, Cy, -1, 1 )
VFar = InverseViewProjectionMatrix * ( Cx, Cy, 1, 1 )

vNear /= vNear.w
vFar /= vFar.w

After testing the ray's vFar always appears to come from the same general direction

It seems like I need to add the camera perspective as I would expect vFar to always be behind my camera.

I'm not entirely sure how that should be added in. Here's my test code.

public void mouseToWorldCordinates(Window window,Camera camera, Vector2d mousePosition){
    float normalised_x = (float)((mousePosition.x / (window.getWidth()*2)) -1);
    float normalised_y = -(float)((mousePosition.y / (window.getHeight()*2)) -1);

    Vector4f mouse = new Vector4f(normalised_x,normalised_y,-1,1);

    Matrix4f projectionMatrix = new Matrix4f(transformation.getProjectionMatrix()).invert();
    Matrix4f mouse4f = new Matrix4f(mouse,new Vector4f(),new Vector4f(),new Vector4f());
    Matrix4f vNear4f = projectionMatrix.mul(mouse4f);
    Vector4f vNear = new Vector4f();
    vNear4f.getColumn(0,vNear);

    mouse.z = 1f;

    projectionMatrix = new Matrix4f(transformation.getProjectionMatrix()).invert();
    mouse4f = new Matrix4f(mouse,new Vector4f(),new Vector4f(),new Vector4f());
    Matrix4f vFar4f = projectionMatrix.mul(mouse4f);
    Vector4f vFar = new Vector4f();
    vFar4f.getColumn(0,vFar);

    vNear.div(vNear.w);
    vFar.div(vFar.w);

    lines[0] = vNear.x;
    lines[1] = vNear.y;
    lines[2] = vNear.z;

    lines[3] = vFar.x;
    lines[4] = vFar.y;
    lines[5] = vFar.z;

}

Solution

  • The computation of normalised_x and normalised_y is wrong. Normalized device coordinates are in range [-1.0, 1.0]:

    float normalised_x = 2.0f * (float)mousePosition.x / (float)window.getWidth() - 1.0f;
    float normalised_y = 1.0f - 2.0f * (float)mousePosition.y / (float)window.getHeight();