Nj `dZddlmZddlZddlZddlmZddlZdZ dZ dZ dZ d Z Gd d Zy) uGaze / face-direction detector using MediaPipe Face Mesh + iris tracking. Runs the webcam in a daemon background thread and exposes a single method: is_looking() -> bool Returns True when Ahmed's face appears directed at the camera (or when no face is detected — defaulting to "assume he's talking to Jarvis"). Returns False only when a face IS detected but the gaze is clearly directed away from the camera. Design constraints - CPU-light: processes every Nth frame only (SAMPLE_EVERY = 5, ~6 fps at 30 fps input) and runs at half resolution by default. - Camera unavailable: silently no-ops; is_looking() always returns True. - Thread-safe: the flag is a plain bool protected by threading.Lock. - No GUI windows are opened (headless OpenCV). Gaze estimation approach (no iris model required) Face Mesh gives 478 landmarks including the iris centres (landmarks 468 and 473 for left / right eye respectively) and the corners of each eye. We project the iris centre relative to the eye-corner span to get a normalised horizontal offset in [-1, 1]. Values outside a threshold mean the person is looking left/right. We also check the vertical tilt of the nose bridge vs eye line to catch strong downward or upward gaze. The thresholds are deliberately loose: the intent is to ignore Ahmed only when he is clearly staring at a second screen or looking down at his phone — not to react to small natural eye movements during conversation. ) annotationsN)Optionalg333333?g?iihcfeZdZdZd d dZd dZd dZddZeddZ d dZ d dZ e dd Z y ) GazeDetectorzContinuously sample the webcam and track whether the user is facing it. Usage:: gd = GazeDetector() gd.start() ... if gd.is_looking(): process_speech(text) ... gd.stop() c|||_d|_tj|_d|_d|_d|_y)NTF) _camera_index_looking threadingLock_lock_running_thread _available)self camera_indexs A/Users/ahmed/devFolder/Ultron/claude-voice/voice/gaze_detector.py__init__zGazeDetector.__init__Cs4) ^^%  37 c|j|jjryd|_tj|j dd|_|jj y)z5Start the background detection thread (non-blocking).NTz gaze-detector)targetnamedaemon)ris_aliverr Thread_runstartrs rrzGazeDetector.startOsT << # (=(=(?   ''99?4   rcd|_y)z%Signal the background thread to stop.FN)rrs rstopzGazeDetector.stopYs  rc^|j5|jcdddS#1swYyxYw)z8Return True if the user appears to be facing the camera.N)r r rs r is_lookingzGazeDetector.is_looking]s ZZ==ZZs #,c|jS)z-True once the camera was successfully opened.)rrs r availablezGazeDetector.availablebsrc |jy#t$rG}td|d|j5d|_dddn#1swYnxYwYd}~yYd}~yd}~wwxYw)Nz$ [gaze-detector] fatal error: z2; gaze check disabled (defaulting to looking=True)T) _run_inner Exceptionprintr r )rexcs rrzGazeDetector._runksZ % OO  % 8@EE F $  %s* A#AA AA AA#cV ddl}ddl}|jj }|j |j}|js tdyd|_ td|jdddd d }d} |jr|j\}} |stjd 8|dz }|tzdk7rJ|j!| t"t$f} |j'| |j(} |j+| } | j,s|j.5d|_ddd| j,dj2} |j5| }|j.5||_ddd|jr|j7|j9td y#t$r}td|dYd}~yd}~wwxYw#1swYxYw#1swYtxYw#|j7|j9td wxYw) Nrz% [gaze-detector] import error: z,; install mediapipe + opencv-python-headlessuH [gaze-detector] camera unavailable — defaulting to looking=TrueTu= [gaze-detector] camera opened — iris tracking activeF?)static_image_mode max_num_facesrefine_landmarksmin_detection_confidencemin_tracking_confidenceg?z [gaze-detector] stopped)cv2 mediapipe ImportErrorr( solutions face_mesh VideoCapturer isOpenedrFaceMeshrreadtimesleep _SAMPLE_EVERYresize _PROC_WIDTH _PROC_HEIGHTcvtColor COLOR_BGR2RGBprocessmulti_face_landmarksr r landmark_classify_gazecloserelease)rr2mpr) mp_face_meshcapr6 frame_idxretframesmallrgbresultslmlookings rr&zGazeDetector._run_innerts   " ||-- t112||~ / 0  MN ))#!%($' *   4-- XXZ UJJsOQ },1 5; *EFll5#*;*;<#++C033(, $11!4==--b1ZZ$+DM 3--8 OO  KKM 2 3q  9#??? @  Z$  Z OO  KKM 2 3sTF>B+G;-G#5?G;4G/<G;> G GG #G,(G;/G84G;;-H(cNdfd }|d}|d}|d}tjj||z }|dkDr|d|dz |z dz }nd}|d }|d }|d } tjj||z } | dkDr| d|dz | z dz } nd} t|| zd z } |dd |d d zd z } |d d }|dd }|dd }||z }|dkDr || z |z }nd}| tk}|t k}|xr|S)aReturn True if the face landmarks indicate the user is looking at the camera (or at least not clearly looking away). Landmark indices (MediaPipe Face Mesh with refine_landmarks=True): 33 left eye outer corner 133 left eye inner corner 362 right eye inner corner 263 right eye outer corner 468 left iris centre 473 right iris centre 1 nose tip 152 chin 10 forehead centre cd|}tj|j|jgS)N)nparrayxy)idxrR landmarkss rptz'GazeDetector._classify_gaze..pts'3B88RTT244L) )r!igư>rr,gijiig@r+ )rZint)rVlinalgnormabs_HORIZONTAL_THRESH_VERTICAL_THRESH)r[r\ left_outer left_inner left_iris left_span left_offset right_inner right_outer right_iris right_span right_offseth_offset eye_mid_y nose_tip_ychin_y forehead_y face_heightv_ratiolooking_horizontallylooking_verticallys` rrFzGazeDetector._classify_gazesh" * f g g iinnZ*%<= t $Q<*Q-79DsJKKg g g iinn[;%>?  &qMKN:jH3NLL l2c9:"vay2c71:-4 eAh gajfQi z)  !I-rsF>#    z;z;r