askui

Tell us how we could make the product more useful for you.

Bugfix or Feature request

Give feedback on how we can improve our product.

Feature request

Tell us how we could make the product more useful for you.

Hello!I am using the annotate feature and it writes a HTML report from the annotations. I am trying to use the JSON/list that you use to create the HTML for my app. So if there is a way y'all can add a variable to the function call where I could just receive that and not have to go through any HTML to JSON stuff? So this would give me a data structure where I have a json/list of all of the annotations with their respective attributes. This would be INSANELY helpful! :) Thanks,Anish

URGENT: Simple Annotate Update

Adding more helpful logs with status updates throughout the run of the test. For more transparency during debugging.

📠 Better Logging

Detect tables, select rows, columns and single cells. For easier handling of tabular data in your test cases.

🥢 Table Detection

Perform an action once while recording yourself, then reuse that path however as often you want. For more joy while creating and managing tests.

💾 Test Recorder

Eliminating the need to learn automation syntax, by unlocking the power of the most notorious and powerful language model.

GPT-3 for askui input

Look after your test cases by managing them from the cloud. For more accessibility and effectiveness on the go.

🕴️ No Code Automation Platform

Integration with the largest testing platform

BrowserStack Integration

<ul><li>Support all BrowserStack devices</li><li>Register access in askui</li><li>Connect to device</li><li>Control device</li></ul>

DeviceFarm Support

Ability to detect custom elements even faster

Improved Custom Elements

Python as additional programming language is supported

Python Support

Video recorder

Better and more accurate prediction of icons

💪 Icon Classifier Stability

Experience a streamlined class set, that makes it easier to automate your UI and much higher precision.

🏫 Streamlined Element Class Set

🥏 Model versioning

Get notified when an automation run is complete

🔔 Notification Integration

Launch local apps directly from your askui project and quickly switch between contexts. For easier navigation in your automation workflows.

🚀 App Launcher

Enjoy fast response times (at least compared to other AI models). For more development velocity.

🏎️ Need for (inference) Speed

Manage your automation projects from anywhere using synchronized workspaces. For more accessibility from anywhere.

🔂 Sync between IDE and cloud

Android is supported for execution

Android Support

Users are able to create, edit and schedule test cases using a GUI

Low-code frontend

<ul><li>Users can record tests</li><li>Recorder is able to generate code</li></ul>

Screen Recorder

There are no options for these keys on Windows 10 (in my case) at the moment. It would be useful so I can simulate them for my tests.

Insert/Caps lock key for presskey

<pre><code class="language-typescript"> await aui.click().text().withText('No').exec();
</code></pre>The above command produced below.. i was trying to click the No button<img src="https://bucket1.featurebase.app/1678608588265.png">

Showing all the code to end user at error is not good

It says - text: ConurmBut actual text - text: ConfirmRefer snap. <img src="https://bucket1.featurebase.app/1678543164172.jpeg">

For disabled button it's recognising with wrong text

Refer to image:<img src="https://bucket1.featurebase.app/1678491414507.png"> Minor issue since I can click off to the side and it would still close it.

Featurebase query - 'Edit profile' modal has no X close button

Currently, there is no way to filter by my own feature requests.<img src="https://bucket1.featurebase.app/1678491345360.png">

Featurebase feature request: Filter by 'My feature requests'

Scenario: I run the same tests over and over under afterEach(), this results in many annotations. I do this so I can save myself dev time. If I had to do annotateInteractively all the time, it would take me longer to do what I want to do. Problem: Even though the filenames are timestamped, the contents of the file could be the same. In other words, the same screen with the same annotations could potentially be generated (unless the askui's AI is inconsistent in detection). Solution: If there was a way to de-duplicate annotations, that would help. It's not a big issue right now but saves me deleting files manually.

Annotations - option to only export html file for annotations if unique

<img src="https://bucket1.featurebase.app/1678490457041.png">Is this out of date? <a target="_blank" rel="noopener noreferrer nofollow" class="text-indigo-500 dark:text-indigo-300 cursor-pointer" href="https://docs.askui.com/docs/general/Troubleshooting/windows#askui-ui-controller">https://docs.askui.com/docs/general/Troubleshooting/windows#askui-ui-controller</a>. <code>UiController.stop()</code> does not exist in version 0.7.2 when I type it into VS Code. I'm on Windows 10 64 bit if it matters.

UIController.stop - is it deprecated?

await <a target="_blank" rel="noopener noreferrer nofollow" class="text-indigo-500 dark:text-indigo-300 cursor-pointer" href="http://aui.click">aui.click</a>().text().withExactText("Account 2").exec();This step is not clicking on "Account 2", it was not able to recognise number "2" Discussed &amp; shown the issue to Adrian over call <img src="https://bucket1.featurebase.app/1678459319673.jpeg">

not able to recognise number "2"

This element was recognised as icon = ellipsis-vSo i wrote the below code.. when i tried to use it again.. it could not recognize..This inconsistent behavior can lead to problems<pre><code class="language-typescript"> await aui.click().icon().withText('ellipsis-v').exec();
</code></pre><img src="https://bucket1.featurebase.app/1678456740553.png">

Annotation reads an elements once and next time it does not read the same

LongDistance is read as lonadistance by annotation command g is read as a, this will cause the test case to fail if g is read as a<img src="https://bucket1.featurebase.app/1678454584883.png">

Wrong text is being read by annotation g is read as a

Stronger predictions across multiple sessions

🕰️ Improve prediction quality and consistency across time (OD)

Get more accurate results, when using relational filters

🐟 Intuitive sorting direction

Visual aid for everyone who loves looking at bounding boxes

🖼️ Multicolor bounding boxes

Detect the layout of any UI for even simpler automation scripts

🎑 Layout Detection

🎨 ChromeOS support

Input natural language and convert it directly into an automation

🧠 Text to automation input

Receive automation reports directly where you analyse them. For a more consolidated toolset.

🔍 Reporting API

Let automations run in the background, while you’re out doing other things. Use schedules for more effective use of your time.

🕐 Automation Scheduler

Optimized UI controller for Windows environment for better performance during pipeline execution.

🪟 Windows Optimizations

Navigate through the user portal with ease. For a more intuitive user experience.

🍫 Navigation Bar

Use third-party solutions with askui’s powerful AI automation capabilities. For more creative opportunities.

🏦 Integration Platform

Scrape all of the detectable information from the screen to use in other parts of your app. Optimal for gathering data.

🤲 Get Element Data

Exclude elements from your inference results, so that you can get to the stuff you really want. For more control over your data apps automations.

🔛 Conditions and Grouping for NOT() Method

It’s just a facelift, but it makes the whole experience more fun. Make yourself at home

🪄 User Portal Redesign

Don’t rely on response times from our support team. Enjoy full access to all of askui’s development resources.

⬆️ Self-service Sign-up

Follow our expert guide to reach your value moment faster. For more confidence with askui’s toolset.

🏂 Onboarding Flow

Detect when the screen has settled to remove visual bugs during assembly. For a more intelligent testing experience.