Smart Navigation Assistant

• Claudia is about to start a road trip and initiates the interactive capabilities of the infotainment system. This procedure can be done “offline” as she gets inside the car and calls the virtual assistant of the car (HRMN), before starting the engine.  Claudia is identified and authenticated (KL) when she sits on the driver’s side. At that point the eye gaze tracking module (TOB), the expression-monitoring module (NV), and the hand-tracking module (SKS) activate, load her specific configurations (UC1) and start tracking her. She tells to the assistant the destination of her journey and the virtual assistant is ready to go. The journey starts. During the journey, it could be possible that:
  • Claudia has a doubtful / worried / lost expression: The driver facing sensors track the driver’s facial expressions and eye movements to understand their underlying emotions. Specifically, the eye-tracking module (TOB) and the expression-monitoring module (NV) will report to the Central Unit (HRMN IVI system). From doubtful or puzzled expressions, the system can infer that the driver might need further or more detailed navigation instructions and help in order to reach her destination. The FANCI system will communicate this level of alarm to the virtual assistant (HRMN) which will trigger the navigation system to give more detailed vocal driving instructions. For example, it could be useful for the driver to have: a) more accurate locations of road intersections, b) more accurate numbers of kilometres to the next turn, c) suggested vehicle speed.
  • Claudia has a confident expression: The system keeps direction to a minimum, so not to interrupt the driver’s music and to let her enjoy the ride.
• Directions only when the driver missed a sign: In another case, Claudia can specify the final destination but choose that the navigation system will not provide full turn by turn directions.. In this case the system monitors the driver’s eye gaze and the direction signs posted on the road, (leveraging an outward facing sensor), and provides direction instructions to the driver only when she fails to look at a relevant sign.