References

Visual grounding

Using the source input as ground truth will help trust the system and makes it easy to interpret its process and what might have gone wrong.

A screenshot of a pricing table or spreadsheet. The main focus is a highlighted cell displaying the amount "€ 35,00". This same amount is also shown in a separate box or label within the image. The surrounding cells contain various other monetary amounts ranging from around €27 to €165. Based on the layout and formatting, this seems to be a financial or pricing-related document.
Human needs

When checking data, I want to be able to see how the system arrived at its answer, so I can trust the data and identify any potential errors in the process.

Considerations
  • AI Transparency and Explainability: Make AI systems transparent and understandable by explaining how and why decisions are made.
  • Multimodal Context: In this example we used the context of an image of a receipt, but it can also include other modalities, such as audio.
Explore Further

More of the Witlist

Proactive agents

Proactive agents can autonomously initiate conversations and actions based on previous interactions and context providing timely and relevant assistance.

Semantic ranking

Embedding models can rank content along virtually any dimension. This capability provides significant value by enabling users to explore and analyze the embeddings to create a spectrum of any features.

Generative context menus

Based on your selection and situation, context menus can help you discover actions and access them quickly.

Incentivize giving feedback

Presenting multiple outputs helps users explore and identify their preferences and provides valuable insights into their choices, even enabling user feedback for model improvement.

Quick or detailed feedback

Empower users to make decisions and give feedback quickly or engage more deeply when needed in natural language.

Cross-tab assistance

A smart browser assistant that understands the context of your open tabs to offer relevant suggestions and actions, enhancing productivity through transparency and control.