Forums before death by AOL, social media and spammers... "We can't have nice things"
|    comp.mobile.android    |    Discussion about Android-based devices    |    236,147 messages    |
[   << oldest   |   < older   |   list   |   newer >   |   newest >>   ]
|    Message 234,780 of 236,147    |
|    NewsKrawler to NewsKrawler    |
|    Re: Does your Android Copilot app have a    |
|    18 Nov 25 16:23:40    |
      From: newskrawl@krawl.org              On Tue, 18 Nov 2025 07:58:19 -0000 (UTC), NewsKrawler wrote:              > only Whisper Keyboard (which       > doesn't rely on Android's RecognitionService at all) worked on the first       > tap with Copilot (without being logged into Microsoft).              When you press the mic button on your default keyboard while you're in       Copilot, does it work the first time, every time?              Of the integrated on-IME ASR's I tested, SendRight crashed every time so I       moved to the other IMEs that run automatic speech recognition inside the       input method process to insert text via the IME API.              Transcribo worked slightly differently than Whisper C++ in that Transcribo       doesn't require holding down the microphone button to convert speech to       text offline. You still have to tap its mic button though, even after I set       Transcribo to recognize speech automatically (so I have to work that minor       issue out later).              What's happening is that when a tap is performed in any app's text field,       Android hands focus to an IME. That IME pulled up is whatever keyboard is       set to the default (or the last-used, in the case of Whisper/Transcribo       settings). The problem with Copilot is the next step.              When you press the mic button on the delegation ASR's such as       AnysoftKeyboard, FlorisBoard, GBoard, Google Voice typing, HeliBoard,       OpenBoard, Samsung Keyboard, etc., the IME starts the platform recognizer       (either by SpeechRecognizer.startListening or by launching a       RecognitionService/voice-typing intent) which takes exclusive mic access       and runs ASR locally (or on the cloud if enabled).              The Android system recognizer posts results back to on the       Speechrecognizer.Listener (or intent) which the IME forwards to       InputConnection.commitText.              At this point, any app, including Copilot must still have a valid       InputConnection and focus at the time the IME forwards the text. That the       the step which seems to be failing since I can see flashes at times as the       ASR tries to communicate with the Copilot text focus and fails more often       than not.              Whisper C++ and Transcribo (and Sayboard when set up as an integrated       on-IME ASR) run ASR inside the IME pricess and call       Inputconnection.commitText directly, eliminating intermediate handoffs by       inserting text synchronously from the IME itself.              Of the three working on-IME ASRs, I'm leaning toward Transcribo but what I       need to test is accuracy (where Sayboard with the small English model is       the worst) and speed (where Whisper.cpp seems to be slow, and anything else       that might matter which I'll learn during testing, such as all of them seem       to be a bit flaky with Copilot).              Still, I need to know from someone who can run a quick test of Copilot.       1. Install Copilot on Android       2. Do not log into a Microsoft Account       3. Do not press the Copilot microphone button              If you do press the Copilot mic button, it "appears" to work without       needing an account but it's crippleware as it only works for a short time.       Then it requires the account for the Copilot mic button to work.              When you press the mic button on your default keyboard while you're in       Copilot, does it work the first time, every time?              --- SoupGate-Win32 v1.05        * Origin: you cannot sedate... all the things you hate (1:229/2)    |
[   << oldest   |   < older   |   list   |   newer >   |   newest >>   ]
(c) 1994, bbs@darkrealms.ca