Lost your password?

Smart Navigation Assistant

  • Claudia is about to start a road trip and initiates the interactive capabilities of the infotainment system. This procedure can be done “offline” as she gets inside the car and calls the virtual assistant of the car (HRMN), before starting the engine.  Claudia is identified and authenticated (KL) when she sits on the driver’s side. At that point the eye gaze tracking module (TOB), the expression-monitoring module (NV), and the hand-tracking module (SKS) activate, load her specific configurations (UC1) and start tracking her. She tells to the assistant the destination of her journey and the virtual assistant is ready to go. The journey starts. During the journey, it could be possible that:
    • Claudia has a doubtful / worried / lost expression: The driver facing sensors track the driver’s facial expressions and eye movements to understand their underlying emotions. Specifically, the eye-tracking module (TOB) and the expression-monitoring module (NV) will report to the Central Unit (HRMN IVI system). From doubtful or puzzled expressions, the system can infer that the driver might need further or more detailed navigation instructions and help in order to reach her destination. The FANCI system will communicate this level of alarm to the virtual assistant (HRMN) which will trigger the navigation system to give more detailed vocal driving instructions. For example, it could be useful for the driver to have: a) more accurate locations of road intersections, b) more accurate numbers of kilometres to the next turn, c) suggested vehicle speed.
    • Claudia has a confident expression: The system keeps direction to a minimum, so not to interrupt the driver’s music and to let her enjoy the ride.
  • Directions only when the driver missed a sign: In another case, Claudia can specify the final destination but choose that the navigation system will not provide full turn by turn directions.. In this case the system monitors the driver’s eye gaze and the direction signs posted on the road, (leveraging an outward facing sensor), and provides direction instructions to the driver only when she fails to look at a relevant sign.

Technology used

  • Emotion Tracking

  • Hand Gesture

  • Eye Gaze

  • Infotainment System

News & Events

find all you need to know about FANCI

Upcoming events

Mailing list

Sign up to our mailing list to receive regular updates from the FANCI project.

European Union

Horizon 2020 Innovation Framework Programme

The FANCI project is funded by the European Commission’s Horizon 2020 framework programme for research and innovation. Horizon 2020 flagship initiative aimed at securing Europe's global competitiveness. By coupling research and innovation, Horizon 2020 is helping to achieve this with its emphasis on excellent science, industrial leadership and tackling societal challenges.

European Union