AIMP Forum

English pages => Plugins / Addons => Topic started by: rime on January 16, 2017, 20:18:28

Title: Voice Control plugin
Post by: rime on January 16, 2017, 20:18:28
Voice Control plugin for AIMP
Control the player with voice commands.
Author: Damian Woroch. (http://r1me.pl)
Currently a closed source plugin, but there is a huge chance i will make it open if there is interest in it.

Download version 0.1 (early public test):
- ZIP package (http://r1me.pl/sites/default/files/2017-01/aimp_VoiceControl_0.1.zip) (copy manually to Plugins folder)
or
- Installer (http://r1me.pl/sites/default/files/2017-01/aimp_VoiceControl_0.1.exe)

Demonstration: https://youtu.be/YXZEN4cSjHk

In current version US English is the only available language, with commands:
Command is proceeded with a prefix. As default the prefix is "ok AIMP", it must be spoken before the command.
Plugin does NOT require Internet connection because voice recognition works locally.

Known issues:
- Prefix keyword sensitivity depends on input audio parameters and can cause false or no detection
If you get no detection, lower your microphone boost. If you get too much detection, go to Plugins\aimp_VoiceControl\Data\English\prefix.kws and modify /1e-24/ to /1e-18/ or even lower. After that change, save the file and reopen AIMP.
- Longer AIMP startup due to recognizer initialization
- If there is an application running in full screen mode, OSD can cause switching back to desktop
- Occasional plugin finalization crash

To-do:
- More languages support f.e. german, russian, french
- Adjustable prefix accuracy threshold to reduce false detection
- Custom step size for volume up/down and seek commands
- Selectable input audio device
- Play notification sound once prefix was recognized and plugin is ready to listen for commands (optional)
- More commands ? Any suggestions ?
Title: Re: Voice Control plugin
Post by: Soolo on January 16, 2017, 20:46:27
wow great
Title: Re: Voice Control plugin
Post by: Zhenya on January 16, 2017, 21:23:35
I got a memory leak after closing AIMP:

(https://habrastorage.org/files/6fd/4fe/fd5/6fd4fefd5b0047089314b514a4e50612)

On this build with debugger:

https://yadi.sk/d/KzfMxT_l382YTQ
Title: Re: Voice Control plugin
Post by: rime on January 16, 2017, 22:56:05
Thanks, i forgot to release GUI elements from the settings dialog, weirdly they have owner set to the form and should be released automatically. I fixed this leak already.
Title: Re: Voice Control plugin
Post by: Zhenya on January 16, 2017, 23:39:23
I fixed this leak already.
Ok, it seems that now there is no leak.

Why do you need a separate installer of the plugin?
Title: Re: Voice Control plugin
Post by: rime on January 17, 2017, 01:04:58
This installer works in "no uninstaller" mode, there is nothing left over in system, it basically checks if AIMP is running and copies plugin files and recognition data. I also made it as installer because another languages can be distributed this way in future. It is also preferred by unexperienced users to double click and press few Next buttons if compared to manually copying files. But i can make zip package also available.
Title: Re: Voice Control plugin
Post by: Zhenya on January 17, 2017, 01:25:04
But i can make zip package also available.
It would be good.

In AIMP v4.12 added this:

Quote
General: support of easy-to-install technology for add-ons packages in *.zip / *.aimppack formats

Using the package installing is much easier than via separate installer - just drag and drop zip-file to AIMP main window.
For example, I made the package (https://yadi.sk/d/ickAI8De39LGcS) of this plugin.

But in public 1880 build there is the bug with incorrect package installing which have multiple dll-files. This is fixed in the 1880 build from the link above.