Skip to main content

2023.12.13

· One min read
Leon Meier
Leon Meier
Head of Product

Introduction​

On December 13, we introduced three new features: the Visual Description Matching Method for selecting diverse visual elements, Targeted Annotations for precise debugging, and Precision Text Matching for flexible text matching.

Overview​

  1. Visual Description Matching Method

    • Documentation: Matching Feature
    • This feature introduces the matching()method, allowing users to identify and interact with UI elements based solely on textual descriptions.
    • Enhances the flexibility of automated interactions with dynamic UIs.

  2. Targeted Annotations

    • Documentation: Annotate DetectedElements
    • Introduces an AnnotationRequest parameter in the annotate() method, allowing users to annotate specific elements retrieved from user interfaces by the get() method.
    • Simplifies debugging of UI element selection.

  3. Precision Text Matching

    • Documentation: Adjustable Similarity Score
    • Introduces an optional similarity_score parameter for the .withText() method.
    • Improves script resilience and minimizes mismatches in text-based automation.