mirror of
https://github.com/aidygus/LinVAM.git
synced 2024-11-23 01:08:06 +11:00
Merge pull request #3 from smirgol/master
Fixes & implementation of playing audio files. See changes.md for det…
This commit is contained in:
Aidan Gustard
GitHub
commit
a229683c57
3
.gitignore
vendored
3
.gitignore
vendored
@ -127,5 +127,8 @@ dmypy.json
|
||||
# Pyre type checker
|
||||
.pyre/
|
||||
|
||||
# Ignore voicepack files
|
||||
voicepacks/*
|
||||
|
||||
# End of https://www.gitignore.io/api/python
|
||||
|
||||
|
||||
33
README.md
33
README.md
@ -1,5 +1,6 @@
|
||||
# LinVAM
|
||||
Linux Voice Activated Macro
|
||||
|
||||
## Status
|
||||
This project is currently a work-in-progress and is minimally functional only for english.
|
||||
|
||||
@ -10,6 +11,7 @@ Known bugs and planned additions
|
||||
- Remember last loaded profile and load on start
|
||||
- Log window showing spoken words the V2T recognises with ability to right click and assign voice command and actions to current profile
|
||||
- Support for joysticks and gaming devices
|
||||
|
||||
## Requirements
|
||||
- python3
|
||||
- PyQt5
|
||||
@ -17,20 +19,33 @@ Known bugs and planned additions
|
||||
- pyaudio
|
||||
- pocketsphinx
|
||||
- swig3.0
|
||||
|
||||
## Optional requirements
|
||||
- xdotool
|
||||
- ffplay (part of ffmpeg, usually already installed)
|
||||
- HCS voicepacks
|
||||
|
||||
## Install
|
||||
- $ pip3 install PyQt5
|
||||
- $ pip3 install python3-xlib
|
||||
- $ pip3 install pyaudio
|
||||
- $ pip3 install pocketsphinx
|
||||
- $ sudo apt-get install swig3.0
|
||||
- $ (optional) sudo apt install xdotool
|
||||
- $ (optional) sudo apt install ffmpeg
|
||||
- $ sudo ln -s /usr/bin/swig3.0 /usr/bin/swig
|
||||
- $ git clone https://github.com/aidygus/LinVAM.git
|
||||
|
||||
## Usage
|
||||
This script must be run with root privilege because it must hook and simulate input devices such as keyboard, mouse etc.
|
||||
- $ cd LinVAM
|
||||
- $ xhost +
|
||||
- $ sudo ./main.py
|
||||
|
||||
As an alternative, if you use the X window manager and have xdotool installed, you can run the script like this:
|
||||
- $ cd LinVAM
|
||||
- $ ./main.py -noroot
|
||||
|
||||
### Profiles
|
||||
Multiple profiles are supported. To create a new profile for a specific task/game click new and the main profile editor window will be displayed
|
||||
|
||||
@ -46,3 +61,21 @@ You can also assign mouse movements and system commands if you require (eg openi
|
||||
|
||||
### Threshold
|
||||
As a rough guide use a value of 10 for each syllable of a word then tweak it down for better accuracy.
|
||||
|
||||
### Output audio
|
||||
In the Command Edit Dialog, chose 'Other' and then 'Play sound'. Pick the sound you would like to play.
|
||||
For this to work you need to copy any audio file you would like to use to the folder 'voicepacks'.
|
||||
You are required to create a subfolder to hold all your audio files (voicepack folder), then within that subfolder, create as many folders as you like to group your audio files (category folders).
|
||||
Place the audio file into these category folders or in any subfolder within a category folder.
|
||||
In theory any audio file should work, but tested only with MP3 files.
|
||||
|
||||
Example:
|
||||
/voicepacks/my voicepack/custom commands/hello.mp3
|
||||
/voicepacks/my voicepack/other/thank you.mp3
|
||||
|
||||
If you own a HCS voicepack, copy the whole voicepack folder (like 'hcspack', 'hcspack-eden', ...) to the 'voicepacks' folder, so it reads like this:
|
||||
/voicepacks/hcspack/...
|
||||
|
||||
### Improve voice recognition accuracy
|
||||
Please see this resource on how to train the acoustic model of pocketsphinx to match your voice:
|
||||
https://cmusphinx.github.io/wiki/tutorialadapt/
|
||||
66
changes.md
Normal file
66
changes.md
Normal file
@ -0,0 +1,66 @@
|
||||
# Changelog smirgol
|
||||
|
||||
### Issues:
|
||||
- (fixed) voice recognition autostarts, there is no way to disable it. the flag "self.m_listening" does nothing
|
||||
- (fixed) when profile is changed, the new commands will not be loaded, as the voice recognition is already running - by default with the Elite Dangerous settings. You cannot use any other profile.
|
||||
- (fixed) "When I say" commands need to be all lower case, otherwise it won't be recognized.
|
||||
|
||||
### Known/New Issues:
|
||||
- When using external speakers it will pick up a playing audio sample and might trigger commands. Use headphones! :)
|
||||
- On a Valve Index headset, the earphones, while being good, will feed the Index microphone causing troubles with the voice recognition.
|
||||
There's probably nothing that can be done about it, maybe some sort of audio filter could be introduced to cut off low-volume sounds?
|
||||
Lower voice audio for now to minimize the issue.
|
||||
- There sometimes is a window error in the console when clicking on a 'cancel' button, does not seem to do harm, but should fix that if possible.
|
||||
- Sometimes keypress signals are not recognized by game, this is the case with xdotool, don't know if this also happens with standard keyboard library.
|
||||
It seems to solve the issue if you at least once manually press any key while the game window is focused
|
||||
|
||||
### Added:
|
||||
- hacked profileexcutor to reload command list when changing it. it did not do that,
|
||||
so changing the profile had no effect at all.
|
||||
- hacked profileexecutor to somewhat make use of "Enable listening".
|
||||
It was an option without functionality at all until now.
|
||||
- created new directory 'voicepacks', copy HCS voicepacks here
|
||||
- new command to play a sound
|
||||
- new gui to select sounds from voicepacks
|
||||
- created playsound class that reads voicepack files and plays audio files with ffplay
|
||||
- added alternate keypress handling using xdotool, which won't require root privileges.
|
||||
might not work for any key existing in profiles, as some need to be remapped. added some remappings to profileexecutor.py pressKey()
|
||||
- added basic command line argument reading to set some configs. right now there:
|
||||
-noroot - will enable xdotool usage for keypresses
|
||||
-xdowindowid <windowid> - will send keypresses to this window only, makes it more relyable when window is not focused for any reason
|
||||
- added auto-detection of Elite Dangerous client window id if -noroot is used and no -xdowindowid is supplied.
|
||||
for this to work, start this script AFTER the client is already running.
|
||||
- monkey-wrenched a volume slider to the main window
|
||||
- added confirmation dialog for removing a profile (!)
|
||||
- copy existing profile. added a copy button to the main menu
|
||||
- properly shutdown audio recording stream
|
||||
- updated gitignore to ignore audio files
|
||||
|
||||
### Dependencies
|
||||
- ffplay
|
||||
- xdotool (optional, won't need root privileges for keypresses)
|
||||
|
||||
Not sure about these, I had them installed already:
|
||||
- import subprocess
|
||||
- import shlex
|
||||
- import signal
|
||||
|
||||
### TODO
|
||||
- select multiple files (from same category) to play one of them randomly
|
||||
|
||||
### FUTURE IDEAS
|
||||
- remember settings and load on start (nice to have)
|
||||
- change key assignment logic to record a keypress / buttonpress combo
|
||||
- will definitely break existing profiles, as we need to record keycodes and stuff
|
||||
- maybe add a state machine like voice attack does
|
||||
- look into reading log files from elite dangerous to trigger certain actions.
|
||||
this would be a very game specific addition though...
|
||||
- make connection to a specific voice pack more loose, so you can easily change the voice pack,
|
||||
without re-editing all the commands. maybe even a different voice pack for certain actions,
|
||||
like in voice attack (crewmen)
|
||||
- reorganize main window to hold more settings and a log window for displaying actions
|
||||
- look into other text2speech engines
|
||||
i gave julius-speech a quick try. its pretty easy to setup and looks promising, but it
|
||||
also has its problems with detecting some "exotic" words. as not being a native
|
||||
english speaker, my pronounciation is not the best sometimes, which doesn't help. :)
|
||||
- look into make recognized words using regex expressions
|
||||
@ -5,6 +5,7 @@ from ui_commandeditwnd import Ui_CommandEditDialog
|
||||
from keyactioneditwnd import KeyActionEditWnd
|
||||
from mouseactioneditwnd import MouseActionEditWnd
|
||||
from pauseactioneditwnd import PauseActionEditWnd
|
||||
from soundactioneditwnd import SoundActionEditWnd
|
||||
import json
|
||||
|
||||
class CommandEditWnd(QDialog):
|
||||
@ -12,6 +13,7 @@ class CommandEditWnd(QDialog):
|
||||
super().__init__(p_parent)
|
||||
self.ui = Ui_CommandEditDialog()
|
||||
self.ui.setupUi(self)
|
||||
self.m_parent = p_parent
|
||||
|
||||
self.ui.deleteBut.clicked.connect(self.slotDelete)
|
||||
self.ui.ok.clicked.connect(self.slotOK)
|
||||
@ -27,6 +29,7 @@ class CommandEditWnd(QDialog):
|
||||
w_otherMenu = QMenu()
|
||||
w_otherMenu.addAction('Stop Another Command', self.slotStopAnotherCommand)
|
||||
w_otherMenu.addAction('Execute Another Command', self.slotDoAnotherCommand)
|
||||
w_otherMenu.addAction('Play Sound', self.slotNewSoundEdit)
|
||||
self.ui.otherBut.setMenu(w_otherMenu)
|
||||
|
||||
self.m_command = {}
|
||||
@ -73,6 +76,14 @@ class CommandEditWnd(QDialog):
|
||||
w_commandDoAction['command name'] = text
|
||||
self.addAction(w_commandDoAction)
|
||||
|
||||
def slotDoPlaySound(self):
|
||||
text, okPressed = QInputDialog.getItem(self, "Set sound to play", "Enter sound file:", list(self.m_parent.m_parent.m_sound.m_sounds), 0, False)
|
||||
if okPressed and text != '':
|
||||
w_commandDoAction = {}
|
||||
w_commandDoAction['name'] = 'command play sound'
|
||||
w_commandDoAction['command name'] = text
|
||||
self.addAction(w_commandDoAction)
|
||||
|
||||
def slotNewKeyEdit(self):
|
||||
w_keyEditWnd = KeyActionEditWnd(None, self)
|
||||
if w_keyEditWnd.exec() == QDialog.Accepted:
|
||||
@ -88,6 +99,11 @@ class CommandEditWnd(QDialog):
|
||||
if w_pauseEditWnd.exec() == QDialog.Accepted:
|
||||
self.addAction(w_pauseEditWnd.m_pauseAction)
|
||||
|
||||
def slotNewSoundEdit(self):
|
||||
w_soundEditWnd = SoundActionEditWnd(self.m_parent.m_parent.m_sound, None, self)
|
||||
if w_soundEditWnd.exec() == QDialog.Accepted:
|
||||
self.addAction(w_soundEditWnd.m_soundAction)
|
||||
|
||||
def slotActionUp(self):
|
||||
currentIndex = self.ui.actionsListWidget.currentRow()
|
||||
currentItem = self.ui.actionsListWidget.takeItem(currentIndex);
|
||||
@ -132,6 +148,10 @@ class CommandEditWnd(QDialog):
|
||||
if okPressed and text != '':
|
||||
w_action['command name'] = text
|
||||
w_jsonAction = json.dumps(w_action)
|
||||
elif w_action['name'] == 'play sound':
|
||||
w_soundEditWnd = SoundActionEditWnd(self.m_parent.m_parent.m_sound, w_action, self)
|
||||
if w_soundEditWnd.exec() == QDialog.Accepted:
|
||||
w_jsonAction = json.dumps(w_soundEditWnd.m_soundAction)
|
||||
|
||||
w_item.setText(w_jsonAction)
|
||||
w_item.setData(Qt.UserRole, w_jsonAction)
|
||||
|
||||
82
main.py
82
main.py
@ -1,4 +1,4 @@
|
||||
#!/usr/bin/env python3
|
||||
#!/usr/bin/python3
|
||||
from PyQt5.QtCore import *
|
||||
from PyQt5.QtGui import *
|
||||
from PyQt5.QtWidgets import *
|
||||
@ -11,21 +11,32 @@ import pickle
|
||||
import signal
|
||||
import os
|
||||
import shutil
|
||||
import subprocess
|
||||
import shlex
|
||||
from soundfiles import SoundFiles
|
||||
|
||||
class MainWnd(QWidget):
|
||||
def __init__(self, p_parent = None):
|
||||
super().__init__(p_parent)
|
||||
|
||||
self.ui = Ui_MainWidget()
|
||||
self.ui.setupUi(self)
|
||||
self.m_profileExecutor = ProfileExecutor()
|
||||
self.handleArgs()
|
||||
self.m_sound = SoundFiles()
|
||||
self.m_profileExecutor = ProfileExecutor(None, self)
|
||||
|
||||
if not os.geteuid() == 0 and not self.m_config['noroot'] == 1:
|
||||
print("\033[93m\nWARNING: no root privileges, unable to send key strokes to the system.\nConsider running this as root.\nFor that you might need to install some python modules for the root user. \n\033[0m")
|
||||
|
||||
self.ui.profileCbx.currentIndexChanged.connect(self.slotProfileChanged)
|
||||
self.ui.addBut.clicked.connect(self.slotAddNewProfile)
|
||||
self.ui.editBut.clicked.connect(self.slotEditProfile)
|
||||
self.ui.copyBut.clicked.connect(self.slotCopyProfile)
|
||||
self.ui.removeBut.clicked.connect(self.slotRemoveProfile)
|
||||
self.ui.listeningChk.stateChanged.connect(self.slotListeningEnabled)
|
||||
self.ui.ok.clicked.connect(self.slotOK)
|
||||
self.ui.cancel.clicked.connect(self.slotCancel)
|
||||
self.ui.sliderVolume.valueChanged.connect(lambda: self.m_sound.setVolume(self.ui.sliderVolume.value()))
|
||||
signal.signal(signal.SIGINT, signal.SIG_DFL)
|
||||
|
||||
if self.loadFromDatabase() > 0 :
|
||||
@ -34,7 +45,8 @@ class MainWnd(QWidget):
|
||||
if w_jsonProfile != None:
|
||||
self.m_activeProfile = json.loads(w_jsonProfile)
|
||||
self.m_profileExecutor.setProfile(self.m_activeProfile)
|
||||
self.m_profileExecutor.start()
|
||||
#self.m_profileExecutor.start()
|
||||
|
||||
|
||||
def saveToDatabase(self):
|
||||
w_profiles = []
|
||||
@ -228,7 +240,25 @@ class MainWnd(QWidget):
|
||||
w_jsonProfile = json.dumps(w_profile)
|
||||
self.ui.profileCbx.setItemData(w_idx, w_jsonProfile)
|
||||
|
||||
def slotCopyProfile(self):
|
||||
text, okPressed = QInputDialog.getText(self, "Copy profile", "Enter new profile name:", QLineEdit.Normal, "")
|
||||
if okPressed and text != '':
|
||||
# todo: check if name not already in use
|
||||
w_idx = self.ui.profileCbx.currentIndex()
|
||||
w_jsonProfile = self.ui.profileCbx.itemData(w_idx)
|
||||
w_profile = json.loads(w_jsonProfile)
|
||||
w_profile_copy = w_profile
|
||||
w_profile_copy['name'] = text
|
||||
self.ui.profileCbx.addItem(w_profile_copy['name'])
|
||||
w_jsonProfile = json.dumps(w_profile_copy)
|
||||
self.ui.profileCbx.setItemData(self.ui.profileCbx.count()-1, w_jsonProfile)
|
||||
|
||||
def slotRemoveProfile(self):
|
||||
|
||||
buttonReply = QMessageBox.question(self, 'Remove Profile', "Do you really want to delete this profile?", QMessageBox.No | QMessageBox.Yes, QMessageBox.No)
|
||||
if buttonReply == QMessageBox.No:
|
||||
return
|
||||
|
||||
w_curIdx = self.ui.profileCbx.currentIndex()
|
||||
if w_curIdx >= 0:
|
||||
self.ui.profileCbx.removeItem(w_curIdx)
|
||||
@ -247,14 +277,56 @@ class MainWnd(QWidget):
|
||||
|
||||
def slotOK(self):
|
||||
self.saveToDatabase()
|
||||
self.m_profileExecutor.stop()
|
||||
self.m_profileExecutor.shutdown()
|
||||
self.close()
|
||||
|
||||
def slotCancel(self):
|
||||
self.m_profileExecutor.stop()
|
||||
self.m_profileExecutor.shutdown()
|
||||
self.close()
|
||||
exit()
|
||||
|
||||
def handleArgs(self):
|
||||
self.m_config = {
|
||||
'noroot' : 0,
|
||||
'xdowindowid' : None
|
||||
}
|
||||
|
||||
if len(sys.argv) == 1:
|
||||
return
|
||||
|
||||
for i in range(1,len(sys.argv)):
|
||||
if sys.argv[i] == '-noroot':
|
||||
self.m_config['noroot'] = 1
|
||||
elif sys.argv[i] == '-xdowindowid' and (i+1 < len(sys.argv)):
|
||||
self.m_config['xdowindowid'] = sys.argv[i+1]
|
||||
i = i+1
|
||||
|
||||
# try to help: if -noroot is supplied, but no xdowindowid, try to determine the id
|
||||
# Elite Dangerous only
|
||||
try:
|
||||
args = shlex.split('xdotool search --name "\(CLIENT\)"')
|
||||
window_id = str(subprocess.check_output(args))
|
||||
window_id = window_id.replace('b\'', '')
|
||||
window_id = window_id.replace('\\n\'','')
|
||||
except subprocess.CalledProcessError:
|
||||
window_id = None
|
||||
pass
|
||||
|
||||
if not window_id == None:
|
||||
# check if it's really the Client we want
|
||||
try:
|
||||
window_name = subprocess.check_output(['xdotool', 'getwindowname', str(window_id)])
|
||||
except subprocess.CalledProcessError:
|
||||
window_name = None
|
||||
pass
|
||||
if not window_name == None:
|
||||
if not str(window_name).find('Elite - Dangerous') == -1:
|
||||
print("Window ID: ", str(window_id), ", window name: ", window_name)
|
||||
print("Auto-detected window id of ED Client: ", window_id)
|
||||
self.m_config['xdowindowid'] = window_id
|
||||
|
||||
|
||||
|
||||
if __name__ == "__main__":
|
||||
app = QApplication(sys.argv)
|
||||
mainWnd = MainWnd()
|
||||
|
||||
100
mainwnd.ui
100
mainwnd.ui
@ -25,7 +25,7 @@
|
||||
<property name="verticalSpacing">
|
||||
<number>20</number>
|
||||
</property>
|
||||
<item row="1" column="0">
|
||||
<item row="2" column="0">
|
||||
<layout class="QHBoxLayout" name="horizontalLayout_2">
|
||||
<property name="spacing">
|
||||
<number>20</number>
|
||||
@ -38,7 +38,7 @@
|
||||
</widget>
|
||||
</item>
|
||||
<item>
|
||||
<spacer name="horizontalSpacer">
|
||||
<spacer name="horizontalSpacer_2">
|
||||
<property name="orientation">
|
||||
<enum>Qt::Horizontal</enum>
|
||||
</property>
|
||||
@ -50,6 +50,57 @@
|
||||
</property>
|
||||
</spacer>
|
||||
</item>
|
||||
<item>
|
||||
<widget class="QGroupBox" name="groupBox">
|
||||
<property name="minimumSize">
|
||||
<size>
|
||||
<width>200</width>
|
||||
<height>0</height>
|
||||
</size>
|
||||
</property>
|
||||
<property name="title">
|
||||
<string>Voice Volume</string>
|
||||
</property>
|
||||
<property name="alignment">
|
||||
<set>Qt::AlignCenter</set>
|
||||
</property>
|
||||
<widget class="QSlider" name="sliderVolume">
|
||||
<property name="geometry">
|
||||
<rect>
|
||||
<x>10</x>
|
||||
<y>20</y>
|
||||
<width>181</width>
|
||||
<height>21</height>
|
||||
</rect>
|
||||
</property>
|
||||
<property name="toolTip">
|
||||
<string>Change voice volume</string>
|
||||
</property>
|
||||
<property name="maximum">
|
||||
<number>100</number>
|
||||
</property>
|
||||
<property name="value">
|
||||
<number>100</number>
|
||||
</property>
|
||||
<property name="orientation">
|
||||
<enum>Qt::Horizontal</enum>
|
||||
</property>
|
||||
</widget>
|
||||
</widget>
|
||||
</item>
|
||||
<item>
|
||||
<spacer name="horizontalSpacer">
|
||||
<property name="orientation">
|
||||
<enum>Qt::Horizontal</enum>
|
||||
</property>
|
||||
<property name="sizeHint" stdset="0">
|
||||
<size>
|
||||
<width>20</width>
|
||||
<height>20</height>
|
||||
</size>
|
||||
</property>
|
||||
</spacer>
|
||||
</item>
|
||||
<item>
|
||||
<widget class="QPushButton" name="ok">
|
||||
<property name="minimumSize">
|
||||
@ -78,13 +129,19 @@
|
||||
</item>
|
||||
</layout>
|
||||
</item>
|
||||
<item row="0" column="0">
|
||||
<item row="1" column="0">
|
||||
<layout class="QHBoxLayout" name="horizontalLayout">
|
||||
<property name="spacing">
|
||||
<number>20</number>
|
||||
</property>
|
||||
<item>
|
||||
<widget class="QLabel" name="label">
|
||||
<property name="sizePolicy">
|
||||
<sizepolicy hsizetype="Fixed" vsizetype="Preferred">
|
||||
<horstretch>0</horstretch>
|
||||
<verstretch>0</verstretch>
|
||||
</sizepolicy>
|
||||
</property>
|
||||
<property name="minimumSize">
|
||||
<size>
|
||||
<width>60</width>
|
||||
@ -100,7 +157,7 @@
|
||||
<widget class="QComboBox" name="profileCbx">
|
||||
<property name="minimumSize">
|
||||
<size>
|
||||
<width>250</width>
|
||||
<width>300</width>
|
||||
<height>0</height>
|
||||
</size>
|
||||
</property>
|
||||
@ -110,7 +167,7 @@
|
||||
<widget class="QPushButton" name="addBut">
|
||||
<property name="minimumSize">
|
||||
<size>
|
||||
<width>130</width>
|
||||
<width>75</width>
|
||||
<height>0</height>
|
||||
</size>
|
||||
</property>
|
||||
@ -123,7 +180,7 @@
|
||||
<widget class="QPushButton" name="editBut">
|
||||
<property name="minimumSize">
|
||||
<size>
|
||||
<width>130</width>
|
||||
<width>75</width>
|
||||
<height>0</height>
|
||||
</size>
|
||||
</property>
|
||||
@ -132,11 +189,27 @@
|
||||
</property>
|
||||
</widget>
|
||||
</item>
|
||||
<item>
|
||||
<widget class="QPushButton" name="copyBut">
|
||||
<property name="minimumSize">
|
||||
<size>
|
||||
<width>75</width>
|
||||
<height>0</height>
|
||||
</size>
|
||||
</property>
|
||||
<property name="toolTip">
|
||||
<string>Copy currently selected profile</string>
|
||||
</property>
|
||||
<property name="text">
|
||||
<string>Copy</string>
|
||||
</property>
|
||||
</widget>
|
||||
</item>
|
||||
<item>
|
||||
<widget class="QPushButton" name="removeBut">
|
||||
<property name="minimumSize">
|
||||
<size>
|
||||
<width>130</width>
|
||||
<width>75</width>
|
||||
<height>0</height>
|
||||
</size>
|
||||
</property>
|
||||
@ -145,19 +218,6 @@
|
||||
</property>
|
||||
</widget>
|
||||
</item>
|
||||
<item>
|
||||
<spacer name="horizontalSpacer_3">
|
||||
<property name="orientation">
|
||||
<enum>Qt::Horizontal</enum>
|
||||
</property>
|
||||
<property name="sizeHint" stdset="0">
|
||||
<size>
|
||||
<width>40</width>
|
||||
<height>20</height>
|
||||
</size>
|
||||
</property>
|
||||
</spacer>
|
||||
</item>
|
||||
</layout>
|
||||
</item>
|
||||
</layout>
|
||||
|
||||
@ -13,6 +13,7 @@ class ProfileEditWnd(QDialog):
|
||||
self.ui = Ui_ProfileEditDialog()
|
||||
self.ui.setupUi(self)
|
||||
self.m_profile = {}
|
||||
self.m_parent = p_parent
|
||||
|
||||
self.ui.cmdTable.setHorizontalHeaderLabels(('Spoken command', 'Actions'))
|
||||
self.ui.cmdTable.setSelectionBehavior(QAbstractItemView.SelectRows)
|
||||
|
||||
@ -4,31 +4,44 @@ import time
|
||||
import threading
|
||||
import os, pyaudio
|
||||
import shutil
|
||||
import re
|
||||
from pocketsphinx.pocketsphinx import *
|
||||
from sphinxbase.sphinxbase import *
|
||||
from soundfiles import SoundFiles
|
||||
|
||||
|
||||
class ProfileExecutor(threading.Thread):
|
||||
mouse = Controller()
|
||||
|
||||
def __init__(self, p_profile = None):
|
||||
threading.Thread.__init__(self)
|
||||
def __init__(self, p_profile = None, p_parent = None):
|
||||
# threading.Thread.__init__(self)
|
||||
|
||||
# does nothing?
|
||||
self.setProfile(p_profile)
|
||||
self.m_stop = False
|
||||
self.m_listening = True
|
||||
self.m_listening = False
|
||||
self.m_cmdThreads = {}
|
||||
|
||||
self.m_config = Decoder.default_config()
|
||||
self.m_config.set_string('-hmm', os.path.join('model', 'en-us/en-us'))
|
||||
self.m_config.set_string('-dict', os.path.join('model', 'en-us/cmudict-en-us.dict'))
|
||||
self.m_config.set_string('-kws', 'command.list')
|
||||
# you usually don't want all this info stuff as a regular user. it just covers up init messages
|
||||
self.m_config.set_string('-logfn', '/dev/null')
|
||||
|
||||
p = pyaudio.PyAudio()
|
||||
self.m_stream = p.open(format=pyaudio.paInt16, channels=1, rate=16000, input=True)
|
||||
self.m_stream.start_stream()
|
||||
self.m_pyaudio = pyaudio.PyAudio()
|
||||
self.m_stream = self.m_pyaudio.open(format=pyaudio.paInt16, channels=1, rate=16000, input=True)
|
||||
|
||||
# Process audio chunk by chunk. On keyword detected perform action and restart search
|
||||
self.m_decoder = Decoder(self.m_config)
|
||||
|
||||
self.m_thread = False
|
||||
|
||||
self.p_parent = p_parent
|
||||
if not self.p_parent == None:
|
||||
self.m_sound = self.p_parent.m_sound
|
||||
|
||||
|
||||
def getSettingsPath(self, setting):
|
||||
home = os.path.expanduser("~") + '/.linvam/'
|
||||
if not os.path.exists(home):
|
||||
@ -39,25 +52,46 @@ class ProfileExecutor(threading.Thread):
|
||||
return home + setting
|
||||
|
||||
def setProfile(self, p_profile):
|
||||
#print("setProfile")
|
||||
self.m_profile = p_profile
|
||||
if self.m_profile == None:
|
||||
return
|
||||
|
||||
#print ("writing command list")
|
||||
w_commandWordFile = open(self.getSettingsPath('command.list'), 'w')
|
||||
w_commands = self.m_profile['commands']
|
||||
i = 0
|
||||
for w_command in w_commands:
|
||||
if i != 0:
|
||||
w_commandWordFile.write('\n')
|
||||
w_commandWordFile.write(w_command['name'] + ' /1e-%d/' % w_command['threshold'])
|
||||
w_commandWordFile.write(w_command['name'].lower() + ' /1e-%d/' % w_command['threshold'])
|
||||
i = i + 1
|
||||
w_commandWordFile.close()
|
||||
self.m_config.set_string('-kws', self.getSettingsPath('command.list'))
|
||||
# load new command list into decoder and restart it
|
||||
if self.m_listening == True:
|
||||
self.stop()
|
||||
self.m_stream.start_stream()
|
||||
# a self.m_decoder.reinit(self.config) will segfault?
|
||||
self.m_decoder = Decoder(self.m_config)
|
||||
self.m_stop = False
|
||||
self.m_thread = threading.Thread(target=self.doListen, args=())
|
||||
self.m_thread.start()
|
||||
else:
|
||||
self.m_decoder.reinit(self.m_config)
|
||||
|
||||
def setEnableListening(self, p_enable):
|
||||
if self.m_listening == False and p_enable == True:
|
||||
self.m_stream.start_stream()
|
||||
self.m_listening = p_enable
|
||||
self.m_stop = False
|
||||
self.m_thread = threading.Thread(target=self.doListen, args=())
|
||||
self.m_thread.start()
|
||||
elif self.m_listening == True and p_enable == False:
|
||||
self.stop()
|
||||
|
||||
def run(self):
|
||||
def doListen(self):
|
||||
print("Detection started")
|
||||
self.m_listening = True
|
||||
self.m_decoder.start_utt()
|
||||
while self.m_stop != True:
|
||||
buf = self.m_stream.read(1024)
|
||||
@ -65,8 +99,14 @@ class ProfileExecutor(threading.Thread):
|
||||
self.m_decoder.process_raw(buf, False, False)
|
||||
|
||||
if self.m_decoder.hyp() != None:
|
||||
# print([(seg.word, seg.prob, seg.start_frame, seg.end_frame) for seg in decoder.seg()])
|
||||
# print("Detected keyword, restarting search")
|
||||
#print([(seg.word, seg.prob, seg.start_frame, seg.end_frame) for seg in self.m_decoder.seg()])
|
||||
#print("Detected keyword, restarting search")
|
||||
|
||||
# hack :)
|
||||
for seg in self.m_decoder.seg():
|
||||
print("Detected: ",seg.word)
|
||||
break
|
||||
|
||||
#
|
||||
# Here you run the code you want based on keyword
|
||||
#
|
||||
@ -76,9 +116,21 @@ class ProfileExecutor(threading.Thread):
|
||||
self.m_decoder.end_utt()
|
||||
self.m_decoder.start_utt()
|
||||
|
||||
# def run(self):
|
||||
|
||||
def stop(self):
|
||||
if self.m_listening == True:
|
||||
self.m_stop = True
|
||||
threading.Thread.join(self)
|
||||
self.m_listening = False
|
||||
self.m_decoder.end_utt()
|
||||
self.m_thread.join()
|
||||
self.m_stream.stop_stream()
|
||||
|
||||
def shutdown(self):
|
||||
self.stop()
|
||||
self.m_stream.close()
|
||||
self.m_pyaudio.terminate()
|
||||
|
||||
|
||||
def doAction(self, p_action):
|
||||
# {'name': 'key action', 'key': 'left', 'type': 0}
|
||||
@ -91,20 +143,14 @@ class ProfileExecutor(threading.Thread):
|
||||
if w_actionName == 'key action':
|
||||
w_key = p_action['key']
|
||||
w_type = p_action['type']
|
||||
if w_type == 1:
|
||||
keyboard.press(w_key)
|
||||
print("pressed key: ", w_key)
|
||||
elif w_type == 0:
|
||||
keyboard.release(w_key)
|
||||
print("released key: ", w_key)
|
||||
elif w_type == 10:
|
||||
keyboard.press(w_key)
|
||||
keyboard.release(w_key)
|
||||
print("pressed and released key: ", w_key)
|
||||
self.pressKey(w_key, w_type)
|
||||
elif w_actionName == 'pause action':
|
||||
print("Sleep ", p_action['time'])
|
||||
time.sleep(p_action['time'])
|
||||
elif w_actionName == 'command stop action':
|
||||
self.stopCommand(p_action['command name'])
|
||||
elif w_actionName == 'command play sound' or w_actionName == 'play sound':
|
||||
self.playSound(p_action)
|
||||
elif w_actionName == 'mouse move action':
|
||||
if p_action['absolute']:
|
||||
ProfileExecutor.mouse.position([p_action['x'], p_action['y']])
|
||||
@ -167,7 +213,7 @@ class ProfileExecutor(threading.Thread):
|
||||
w_commands = self.m_profile['commands']
|
||||
flag = False
|
||||
for w_command in w_commands:
|
||||
if w_command['name'] == p_cmdName:
|
||||
if w_command['name'].lower() == p_cmdName:
|
||||
flag = True
|
||||
break
|
||||
if flag == False:
|
||||
@ -195,3 +241,66 @@ class ProfileExecutor(threading.Thread):
|
||||
if p_cmdName in self.m_cmdThreads.keys():
|
||||
self.m_cmdThreads[p_cmdName].stop()
|
||||
del self.m_cmdThreads[p_cmdName]
|
||||
|
||||
def playSound(self, p_cmdName):
|
||||
sound_file = './voicepacks/' + p_cmdName['pack'] + '/' + p_cmdName['cat'] + '/' + p_cmdName['file']
|
||||
self.m_sound.play(sound_file)
|
||||
|
||||
|
||||
def pressKey(self, w_key, w_type):
|
||||
if self.p_parent.m_config['noroot'] == 1:
|
||||
# xdotool has a different key mapping. translate old existing mappings of special keys
|
||||
# use this to find key name: xev -event keyboard
|
||||
w_key = re.sub('left ctrl', 'Control_L', w_key, flags=re.IGNORECASE)
|
||||
w_key = re.sub('right ctrl', 'Control_R', w_key, flags=re.IGNORECASE)
|
||||
w_key = re.sub('left shift', 'Shift_L', w_key, flags=re.IGNORECASE)
|
||||
w_key = re.sub('right shift', 'Shift_R', w_key, flags=re.IGNORECASE)
|
||||
w_key = re.sub('left alt', 'Alt_L', w_key, flags=re.IGNORECASE)
|
||||
w_key = re.sub('right alt', 'Alt_R', w_key, flags=re.IGNORECASE)
|
||||
w_key = re.sub('left windows', 'Super_L', w_key, flags=re.IGNORECASE)
|
||||
w_key = re.sub('right windows', 'Super_R', w_key, flags=re.IGNORECASE)
|
||||
w_key = re.sub('tab', 'Tab', w_key, flags=re.IGNORECASE)
|
||||
w_key = re.sub('esc', 'Escape', w_key, flags=re.IGNORECASE)
|
||||
|
||||
w_key = re.sub('left', 'Left', w_key, flags=re.IGNORECASE)
|
||||
w_key = re.sub('right', 'Right', w_key, flags=re.IGNORECASE)
|
||||
w_key = re.sub('up', 'Up', w_key, flags=re.IGNORECASE)
|
||||
w_key = re.sub('down', 'Down', w_key, flags=re.IGNORECASE)
|
||||
|
||||
w_key = re.sub('ins$', 'Insert', w_key, flags=re.IGNORECASE)
|
||||
w_key = re.sub('del$', 'Delete', w_key, flags=re.IGNORECASE)
|
||||
w_key = re.sub('home', 'Home', w_key, flags=re.IGNORECASE)
|
||||
w_key = re.sub('end', 'End', w_key, flags=re.IGNORECASE)
|
||||
w_key = re.sub('Page\s?up', 'Prior', w_key, flags=re.IGNORECASE)
|
||||
w_key = re.sub('Page\s?down', 'Next', w_key, flags=re.IGNORECASE)
|
||||
w_key = re.sub('return', 'Return', w_key, flags=re.IGNORECASE)
|
||||
w_key = re.sub('enter', 'Return', w_key, flags=re.IGNORECASE)
|
||||
w_key = re.sub('backspace', 'BackSpace', w_key, flags=re.IGNORECASE)
|
||||
|
||||
w_key = w_key.replace('insert', 'Insert')
|
||||
w_key = w_key.replace('delete', 'Delete')
|
||||
|
||||
window_cmd = ""
|
||||
if not self.p_parent.m_config['xdowindowid'] == None:
|
||||
window_cmd = " windowactivate --sync " + str(self.p_parent.m_config['xdowindowid'])
|
||||
|
||||
if w_type == 1:
|
||||
os.system('xdotool ' + window_cmd + ' keydown ' + str(w_key) )
|
||||
print("pressed key: ", w_key)
|
||||
elif w_type == 0:
|
||||
os.system('xdotool' + window_cmd + ' keyup ' + str(w_key))
|
||||
print("released key: ", w_key)
|
||||
elif w_type == 10:
|
||||
os.system('xdotool' + window_cmd + ' key ' + str(w_key))
|
||||
print("pressed and released key: ", w_key)
|
||||
else:
|
||||
if w_type == 1:
|
||||
keyboard.press(w_key)
|
||||
print("pressed key: ", w_key)
|
||||
elif w_type == 0:
|
||||
keyboard.release(w_key)
|
||||
print("released key: ", w_key)
|
||||
elif w_type == 10:
|
||||
keyboard.press(w_key)
|
||||
keyboard.release(w_key)
|
||||
print("pressed and released key: ", w_key)
|
||||
164
soundactioneditwnd.py
Normal file
164
soundactioneditwnd.py
Normal file
@ -0,0 +1,164 @@
|
||||
from PyQt5.QtCore import *
|
||||
from PyQt5.QtGui import *
|
||||
from PyQt5.QtWidgets import *
|
||||
import re
|
||||
import os
|
||||
from ui_soundactioneditwnd import Ui_SoundSelect
|
||||
|
||||
class SoundActionEditWnd(QDialog):
|
||||
def __init__(self, p_sounds, p_soundAction = None, p_parent = None):
|
||||
super().__init__(p_parent)
|
||||
self.ui = Ui_SoundSelect()
|
||||
self.ui.setupUi(self)
|
||||
|
||||
if p_sounds == None:
|
||||
return
|
||||
|
||||
self.p_sounds = p_sounds
|
||||
self.selectedVoicepack = False
|
||||
self.selectedCategory = False
|
||||
self.selectedFile = False
|
||||
|
||||
self.ui.buttonOkay.clicked.connect(self.slotOK)
|
||||
self.ui.buttonCancel.clicked.connect(super().reject)
|
||||
self.ui.buttonPlaySound.clicked.connect(self.playSound)
|
||||
self.ui.buttonStopSound.clicked.connect(self.stopSound)
|
||||
self.ui.buttonOkay.setEnabled(False)
|
||||
|
||||
# restore stuff when editing
|
||||
if not p_soundAction == None:
|
||||
self.selectedVoicepack = p_soundAction['pack']
|
||||
self.selectedCategory = p_soundAction['cat']
|
||||
self.selectedFile = p_soundAction['file']
|
||||
self.ui.buttonOkay.setEnabled(True)
|
||||
|
||||
self.listVoicepacks_model = QStandardItemModel()
|
||||
self.ui.listVoicepacks.setModel(self.listVoicepacks_model)
|
||||
self.ui.listVoicepacks.clicked.connect(self.onVoicepackSelect)
|
||||
|
||||
self.listCategories_model = QStandardItemModel()
|
||||
self.ui.listCategories.setModel(self.listCategories_model)
|
||||
self.ui.listCategories.clicked.connect(self.onCategorySelect)
|
||||
|
||||
self.listFiles_model = QStandardItemModel()
|
||||
self.ui.listFiles.setModel(self.listFiles_model)
|
||||
self.ui.listFiles.clicked.connect(self.onFileSelect)
|
||||
self.ui.listFiles.doubleClicked.connect(self.selectAndPlay)
|
||||
|
||||
s = sorted(p_sounds.m_sounds)
|
||||
for v in s:
|
||||
item = QStandardItem(v)
|
||||
self.listVoicepacks_model.appendRow(item)
|
||||
|
||||
self.ui.filterCategories.textChanged.connect(self.populateCategories)
|
||||
self.ui.filterFiles.textChanged.connect(self.populateFiles)
|
||||
|
||||
|
||||
self.populateCategories(False)
|
||||
self.populateFiles(False)
|
||||
|
||||
# when editing, select old entries
|
||||
if not self.selectedVoicepack == False:
|
||||
item = self.listVoicepacks_model.findItems(self.selectedVoicepack)
|
||||
if len(item) > 0:
|
||||
index = self.listVoicepacks_model.indexFromItem(item[0])
|
||||
self.ui.listVoicepacks.setCurrentIndex(index)
|
||||
|
||||
if not self.selectedCategory == False:
|
||||
item = self.listCategories_model.findItems(self.selectedCategory)
|
||||
if len(item) > 0:
|
||||
index = self.listCategories_model.indexFromItem(item[0])
|
||||
self.ui.listCategories.setCurrentIndex(index)
|
||||
|
||||
if not self.selectedFile == False:
|
||||
item = self.listFiles_model.findItems(self.selectedFile)
|
||||
if len(item) > 0:
|
||||
index = self.listFiles_model.indexFromItem(item[0])
|
||||
self.ui.listFiles.setCurrentIndex(index)
|
||||
|
||||
|
||||
|
||||
|
||||
def slotOK(self):
|
||||
self.m_soundAction = {'name': 'play sound', 'pack': self.selectedVoicepack, 'cat' : self.selectedCategory, 'file' : self.selectedFile}
|
||||
super().accept()
|
||||
|
||||
def slotCancel(self):
|
||||
super().reject()
|
||||
|
||||
def onVoicepackSelect(self):
|
||||
index = self.ui.listVoicepacks.currentIndex()
|
||||
itemText = index.data()
|
||||
self.selectedVoicepack = itemText
|
||||
self.populateCategories()
|
||||
self.ui.buttonOkay.setEnabled(False)
|
||||
self.ui.buttonPlaySound.setEnabled(False)
|
||||
|
||||
def onCategorySelect(self):
|
||||
index = self.ui.listCategories.currentIndex()
|
||||
itemText = index.data()
|
||||
self.selectedCategory = itemText
|
||||
self.populateFiles()
|
||||
self.ui.buttonOkay.setEnabled(False)
|
||||
self.ui.buttonPlaySound.setEnabled(False)
|
||||
|
||||
|
||||
def onFileSelect(self):
|
||||
index = self.ui.listFiles.currentIndex()
|
||||
itemText = index.data()
|
||||
self.selectedFile = itemText
|
||||
self.ui.buttonOkay.setEnabled(True)
|
||||
self.ui.buttonPlaySound.setEnabled(True)
|
||||
|
||||
def selectAndPlay(self):
|
||||
self.onFileSelect()
|
||||
self.playSound()
|
||||
|
||||
def populateCategories(self, reset = True):
|
||||
if self.selectedVoicepack == False:
|
||||
return
|
||||
|
||||
if reset == True:
|
||||
self.listCategories_model.removeRows( 0, self.listCategories_model.rowCount() )
|
||||
self.listFiles_model.removeRows( 0, self.listFiles_model.rowCount() )
|
||||
self.selectedCategory = False
|
||||
self.selectedFile = False
|
||||
|
||||
filter_categories = self.ui.filterCategories.toPlainText()
|
||||
if len(filter_categories) == 0:
|
||||
filter_categories = None
|
||||
|
||||
s = sorted(self.p_sounds.m_sounds[self.selectedVoicepack])
|
||||
for v in s:
|
||||
if not filter_categories == None:
|
||||
if not re.search(filter_categories, v, re.IGNORECASE):
|
||||
continue
|
||||
item = QStandardItem(v)
|
||||
self.listCategories_model.appendRow(item)
|
||||
|
||||
def populateFiles(self, reset = True):
|
||||
if self.selectedVoicepack == False or self.selectedCategory == False:
|
||||
return
|
||||
|
||||
if reset == True:
|
||||
self.listFiles_model.removeRows( 0, self.listFiles_model.rowCount() )
|
||||
self.selectedFile = False
|
||||
|
||||
filter_files = self.ui.filterFiles.toPlainText()
|
||||
if len(filter_files) == 0:
|
||||
filter_files = None
|
||||
|
||||
s = sorted(self.p_sounds.m_sounds[self.selectedVoicepack][self.selectedCategory])
|
||||
for v in s:
|
||||
if not filter_files == None:
|
||||
if not re.search(filter_files, v, re.IGNORECASE):
|
||||
continue
|
||||
item = QStandardItem(v)
|
||||
self.listFiles_model.appendRow(item)
|
||||
|
||||
def playSound(self):
|
||||
sound_file = './voicepacks/' + self.selectedVoicepack + '/' + self.selectedCategory + '/' + self.selectedFile
|
||||
self.p_sounds.play(sound_file)
|
||||
|
||||
def stopSound(self):
|
||||
self.p_sounds.stop()
|
||||
241
soundactioneditwnd.ui
Normal file
241
soundactioneditwnd.ui
Normal file
@ -0,0 +1,241 @@
|
||||
<?xml version="1.0" encoding="UTF-8"?>
|
||||
<ui version="4.0">
|
||||
<class>SoundSelect</class>
|
||||
<widget class="QGroupBox" name="SoundSelect">
|
||||
<property name="geometry">
|
||||
<rect>
|
||||
<x>0</x>
|
||||
<y>0</y>
|
||||
<width>1119</width>
|
||||
<height>362</height>
|
||||
</rect>
|
||||
</property>
|
||||
<property name="windowTitle">
|
||||
<string>Sound selection</string>
|
||||
</property>
|
||||
<property name="locale">
|
||||
<locale language="English" country="UnitedStates"/>
|
||||
</property>
|
||||
<widget class="QLabel" name="labelVoicepacks">
|
||||
<property name="geometry">
|
||||
<rect>
|
||||
<x>10</x>
|
||||
<y>30</y>
|
||||
<width>111</width>
|
||||
<height>17</height>
|
||||
</rect>
|
||||
</property>
|
||||
<property name="locale">
|
||||
<locale language="English" country="UnitedStates"/>
|
||||
</property>
|
||||
<property name="text">
|
||||
<string>VoicePacks:</string>
|
||||
</property>
|
||||
</widget>
|
||||
<widget class="QLabel" name="labelCategories">
|
||||
<property name="geometry">
|
||||
<rect>
|
||||
<x>160</x>
|
||||
<y>30</y>
|
||||
<width>111</width>
|
||||
<height>17</height>
|
||||
</rect>
|
||||
</property>
|
||||
<property name="locale">
|
||||
<locale language="English" country="UnitedStates"/>
|
||||
</property>
|
||||
<property name="text">
|
||||
<string>Categories:</string>
|
||||
</property>
|
||||
</widget>
|
||||
<widget class="QListView" name="listFiles">
|
||||
<property name="geometry">
|
||||
<rect>
|
||||
<x>660</x>
|
||||
<y>90</y>
|
||||
<width>451</width>
|
||||
<height>231</height>
|
||||
</rect>
|
||||
</property>
|
||||
<property name="locale">
|
||||
<locale language="English" country="UnitedStates"/>
|
||||
</property>
|
||||
<property name="editTriggers">
|
||||
<set>QAbstractItemView::NoEditTriggers</set>
|
||||
</property>
|
||||
<property name="showDropIndicator" stdset="0">
|
||||
<bool>false</bool>
|
||||
</property>
|
||||
<property name="alternatingRowColors">
|
||||
<bool>true</bool>
|
||||
</property>
|
||||
</widget>
|
||||
<widget class="QListView" name="listCategories">
|
||||
<property name="enabled">
|
||||
<bool>true</bool>
|
||||
</property>
|
||||
<property name="geometry">
|
||||
<rect>
|
||||
<x>160</x>
|
||||
<y>90</y>
|
||||
<width>491</width>
|
||||
<height>231</height>
|
||||
</rect>
|
||||
</property>
|
||||
<property name="locale">
|
||||
<locale language="English" country="UnitedStates"/>
|
||||
</property>
|
||||
<property name="editTriggers">
|
||||
<set>QAbstractItemView::NoEditTriggers</set>
|
||||
</property>
|
||||
<property name="showDropIndicator" stdset="0">
|
||||
<bool>false</bool>
|
||||
</property>
|
||||
<property name="alternatingRowColors">
|
||||
<bool>true</bool>
|
||||
</property>
|
||||
</widget>
|
||||
<widget class="QListView" name="listVoicepacks">
|
||||
<property name="geometry">
|
||||
<rect>
|
||||
<x>10</x>
|
||||
<y>50</y>
|
||||
<width>141</width>
|
||||
<height>271</height>
|
||||
</rect>
|
||||
</property>
|
||||
<property name="locale">
|
||||
<locale language="English" country="UnitedStates"/>
|
||||
</property>
|
||||
<property name="editTriggers">
|
||||
<set>QAbstractItemView::NoEditTriggers</set>
|
||||
</property>
|
||||
<property name="showDropIndicator" stdset="0">
|
||||
<bool>false</bool>
|
||||
</property>
|
||||
<property name="alternatingRowColors">
|
||||
<bool>true</bool>
|
||||
</property>
|
||||
</widget>
|
||||
<widget class="QLabel" name="labelFiles">
|
||||
<property name="geometry">
|
||||
<rect>
|
||||
<x>660</x>
|
||||
<y>30</y>
|
||||
<width>111</width>
|
||||
<height>17</height>
|
||||
</rect>
|
||||
</property>
|
||||
<property name="locale">
|
||||
<locale language="English" country="UnitedStates"/>
|
||||
</property>
|
||||
<property name="text">
|
||||
<string>Voice files:</string>
|
||||
</property>
|
||||
</widget>
|
||||
<widget class="QPushButton" name="buttonOkay">
|
||||
<property name="enabled">
|
||||
<bool>true</bool>
|
||||
</property>
|
||||
<property name="geometry">
|
||||
<rect>
|
||||
<x>940</x>
|
||||
<y>330</y>
|
||||
<width>80</width>
|
||||
<height>25</height>
|
||||
</rect>
|
||||
</property>
|
||||
<property name="locale">
|
||||
<locale language="English" country="UnitedStates"/>
|
||||
</property>
|
||||
<property name="text">
|
||||
<string>Ok</string>
|
||||
</property>
|
||||
</widget>
|
||||
<widget class="QPushButton" name="buttonCancel">
|
||||
<property name="geometry">
|
||||
<rect>
|
||||
<x>1030</x>
|
||||
<y>330</y>
|
||||
<width>80</width>
|
||||
<height>25</height>
|
||||
</rect>
|
||||
</property>
|
||||
<property name="locale">
|
||||
<locale language="English" country="UnitedStates"/>
|
||||
</property>
|
||||
<property name="text">
|
||||
<string>Cancel</string>
|
||||
</property>
|
||||
</widget>
|
||||
<widget class="QPlainTextEdit" name="filterCategories">
|
||||
<property name="geometry">
|
||||
<rect>
|
||||
<x>160</x>
|
||||
<y>50</y>
|
||||
<width>491</width>
|
||||
<height>31</height>
|
||||
</rect>
|
||||
</property>
|
||||
<property name="toolTip">
|
||||
<string>Filter categories</string>
|
||||
</property>
|
||||
<property name="statusTip">
|
||||
<string>Filter</string>
|
||||
</property>
|
||||
</widget>
|
||||
<widget class="QPlainTextEdit" name="filterFiles">
|
||||
<property name="geometry">
|
||||
<rect>
|
||||
<x>660</x>
|
||||
<y>50</y>
|
||||
<width>451</width>
|
||||
<height>31</height>
|
||||
</rect>
|
||||
</property>
|
||||
<property name="toolTip">
|
||||
<string>Filter voice files</string>
|
||||
</property>
|
||||
<property name="statusTip">
|
||||
<string>Filter</string>
|
||||
</property>
|
||||
<property name="plainText">
|
||||
<string/>
|
||||
</property>
|
||||
</widget>
|
||||
<widget class="QPushButton" name="buttonPlaySound">
|
||||
<property name="geometry">
|
||||
<rect>
|
||||
<x>410</x>
|
||||
<y>330</y>
|
||||
<width>80</width>
|
||||
<height>25</height>
|
||||
</rect>
|
||||
</property>
|
||||
<property name="toolTip">
|
||||
<string/>
|
||||
</property>
|
||||
<property name="text">
|
||||
<string>Play Sound</string>
|
||||
</property>
|
||||
</widget>
|
||||
<widget class="QPushButton" name="buttonStopSound">
|
||||
<property name="geometry">
|
||||
<rect>
|
||||
<x>500</x>
|
||||
<y>330</y>
|
||||
<width>80</width>
|
||||
<height>25</height>
|
||||
</rect>
|
||||
</property>
|
||||
<property name="toolTip">
|
||||
<string/>
|
||||
</property>
|
||||
<property name="text">
|
||||
<string>Stop Sound</string>
|
||||
</property>
|
||||
</widget>
|
||||
</widget>
|
||||
<resources/>
|
||||
<connections/>
|
||||
</ui>
|
||||
87
soundfiles.py
Normal file
87
soundfiles.py
Normal file
@ -0,0 +1,87 @@
|
||||
import time
|
||||
import threading
|
||||
import os
|
||||
import shutil
|
||||
from os import path
|
||||
import subprocess
|
||||
import shlex
|
||||
import signal
|
||||
|
||||
# I've tried a couple of libs that are capable of playing mp3:
|
||||
# pysound - offers no way to stop sounds. can't play files with whitespace in path
|
||||
# pygame - has problems with certain mp3 files from voice packs
|
||||
# mpg123 - does not offer volume control. need to be threaded as it's a system binary
|
||||
#
|
||||
# ffplay - need to be threaded as it's a system binary. i picked this one as it uses ffmpeg which
|
||||
# is an excellent tool and should be installed on any system already
|
||||
# I needed some process stuff to be able to stop an already playing sound (kill ffplay subprocess)
|
||||
|
||||
|
||||
class SoundFiles():
|
||||
def __init__(self):
|
||||
print("SoundFiles: init")
|
||||
self.m_sounds = {}
|
||||
self.scanSoundFiles()
|
||||
self.thread_play = False
|
||||
self.volume = 100
|
||||
|
||||
def scanSoundFiles(self):
|
||||
print("SoundFiles: scanning")
|
||||
if not path.exists('./voicepacks'):
|
||||
print("No folder 'voicepacks' found. Please create one and copy all your voicepacks in there.")
|
||||
return
|
||||
|
||||
for root, dirs, files in os.walk("./voicepacks"):
|
||||
for file in files:
|
||||
if file.endswith(".mp3"):
|
||||
# we expect a path like this:
|
||||
# voicepacks/VOICEPACKNAME/COMMANDGROUP/(FURTHER_OPTIONAL_FOLDERS/)FILE
|
||||
path_parts = root.split('/')
|
||||
|
||||
if len(path_parts) < 4:
|
||||
continue
|
||||
|
||||
if not path_parts[2] in self.m_sounds:
|
||||
self.m_sounds[path_parts[2]] = {}
|
||||
|
||||
category = path_parts[3]
|
||||
# there might be subfolders, so we have more than just 4 split results...
|
||||
# for the ease of my mind, we concat the voicepack subfolders to 1 category name
|
||||
# like voicepacks/hcspack/Characters/Astra/blah.mp3 will become:
|
||||
#
|
||||
# voicepack = hcspack
|
||||
# category = Characters/Astra
|
||||
# file = blah.mp4
|
||||
|
||||
if len(path_parts) > 4:
|
||||
for i in range(4, len(path_parts)):
|
||||
category = category + '/' + path_parts[i]
|
||||
|
||||
if not category in self.m_sounds[path_parts[2]]:
|
||||
self.m_sounds[path_parts[2]][category] = []
|
||||
|
||||
self.m_sounds[path_parts[2]][category].append(file)
|
||||
|
||||
def play(self, sound_file):
|
||||
if not os.path.isfile(sound_file):
|
||||
print("ERROR - Sound file not found: ", sound_file)
|
||||
return
|
||||
|
||||
self.stop()
|
||||
|
||||
# construct shell command. use shlex to split it up into valid args for Popen.
|
||||
cmd = "ffplay -nodisp -autoexit -loglevel quiet -volume " + str(self.volume) + " \"" + sound_file + "\"";
|
||||
args = shlex.split(cmd)
|
||||
self.thread_play = subprocess.Popen(args)
|
||||
|
||||
def stop(self):
|
||||
if not self.thread_play == False:
|
||||
# that aint no nice, but it's the only way i got the subprocess reliably killed.
|
||||
# self.thread_play.terminate() or kill() should do the trick, but it won't
|
||||
try:
|
||||
os.kill(self.thread_play.pid, signal.SIGKILL)
|
||||
except OSError:
|
||||
pass
|
||||
|
||||
def setVolume(self, volume):
|
||||
self.volume = volume;
|
||||
@ -2,10 +2,11 @@
|
||||
|
||||
# Form implementation generated from reading ui file 'mainwnd.ui'
|
||||
#
|
||||
# Created by: PyQt5 UI code generator 5.12.1
|
||||
# Created by: PyQt5 UI code generator 5.14.2
|
||||
#
|
||||
# WARNING! All changes made in this file will be lost!
|
||||
|
||||
|
||||
from PyQt5 import QtCore, QtGui, QtWidgets
|
||||
|
||||
|
||||
@ -28,6 +29,19 @@ class Ui_MainWidget(object):
|
||||
self.horizontalLayout_2.addWidget(self.listeningChk)
|
||||
spacerItem = QtWidgets.QSpacerItem(40, 20, QtWidgets.QSizePolicy.Expanding, QtWidgets.QSizePolicy.Minimum)
|
||||
self.horizontalLayout_2.addItem(spacerItem)
|
||||
self.groupBox = QtWidgets.QGroupBox(MainWidget)
|
||||
self.groupBox.setMinimumSize(QtCore.QSize(200, 42))
|
||||
self.groupBox.setAlignment(QtCore.Qt.AlignCenter)
|
||||
self.groupBox.setObjectName("groupBox")
|
||||
self.sliderVolume = QtWidgets.QSlider(self.groupBox)
|
||||
self.sliderVolume.setGeometry(QtCore.QRect(10, 20, 181, 21))
|
||||
self.sliderVolume.setMaximum(100)
|
||||
self.sliderVolume.setProperty("value", 100)
|
||||
self.sliderVolume.setOrientation(QtCore.Qt.Horizontal)
|
||||
self.sliderVolume.setObjectName("sliderVolume")
|
||||
self.horizontalLayout_2.addWidget(self.groupBox)
|
||||
spacerItem1 = QtWidgets.QSpacerItem(20, 20, QtWidgets.QSizePolicy.Expanding, QtWidgets.QSizePolicy.Minimum)
|
||||
self.horizontalLayout_2.addItem(spacerItem1)
|
||||
self.ok = QtWidgets.QPushButton(MainWidget)
|
||||
self.ok.setMinimumSize(QtCore.QSize(130, 0))
|
||||
self.ok.setObjectName("ok")
|
||||
@ -36,33 +50,40 @@ class Ui_MainWidget(object):
|
||||
self.cancel.setMinimumSize(QtCore.QSize(130, 0))
|
||||
self.cancel.setObjectName("cancel")
|
||||
self.horizontalLayout_2.addWidget(self.cancel)
|
||||
self.gridLayout_2.addLayout(self.horizontalLayout_2, 1, 0, 1, 1)
|
||||
self.gridLayout_2.addLayout(self.horizontalLayout_2, 2, 0, 1, 1)
|
||||
self.horizontalLayout = QtWidgets.QHBoxLayout()
|
||||
self.horizontalLayout.setSpacing(20)
|
||||
self.horizontalLayout.setObjectName("horizontalLayout")
|
||||
self.label = QtWidgets.QLabel(MainWidget)
|
||||
sizePolicy = QtWidgets.QSizePolicy(QtWidgets.QSizePolicy.Fixed, QtWidgets.QSizePolicy.Preferred)
|
||||
sizePolicy.setHorizontalStretch(0)
|
||||
sizePolicy.setVerticalStretch(0)
|
||||
sizePolicy.setHeightForWidth(self.label.sizePolicy().hasHeightForWidth())
|
||||
self.label.setSizePolicy(sizePolicy)
|
||||
self.label.setMinimumSize(QtCore.QSize(60, 0))
|
||||
self.label.setObjectName("label")
|
||||
self.horizontalLayout.addWidget(self.label)
|
||||
self.profileCbx = QtWidgets.QComboBox(MainWidget)
|
||||
self.profileCbx.setMinimumSize(QtCore.QSize(250, 0))
|
||||
self.profileCbx.setMinimumSize(QtCore.QSize(300, 0))
|
||||
self.profileCbx.setObjectName("profileCbx")
|
||||
self.horizontalLayout.addWidget(self.profileCbx)
|
||||
self.addBut = QtWidgets.QPushButton(MainWidget)
|
||||
self.addBut.setMinimumSize(QtCore.QSize(130, 0))
|
||||
self.addBut.setMinimumSize(QtCore.QSize(75, 0))
|
||||
self.addBut.setObjectName("addBut")
|
||||
self.horizontalLayout.addWidget(self.addBut)
|
||||
self.editBut = QtWidgets.QPushButton(MainWidget)
|
||||
self.editBut.setMinimumSize(QtCore.QSize(130, 0))
|
||||
self.editBut.setMinimumSize(QtCore.QSize(75, 0))
|
||||
self.editBut.setObjectName("editBut")
|
||||
self.horizontalLayout.addWidget(self.editBut)
|
||||
self.copyBut = QtWidgets.QPushButton(MainWidget)
|
||||
self.copyBut.setMinimumSize(QtCore.QSize(75, 0))
|
||||
self.copyBut.setObjectName("copyBut")
|
||||
self.horizontalLayout.addWidget(self.copyBut)
|
||||
self.removeBut = QtWidgets.QPushButton(MainWidget)
|
||||
self.removeBut.setMinimumSize(QtCore.QSize(130, 0))
|
||||
self.removeBut.setMinimumSize(QtCore.QSize(75, 0))
|
||||
self.removeBut.setObjectName("removeBut")
|
||||
self.horizontalLayout.addWidget(self.removeBut)
|
||||
spacerItem1 = QtWidgets.QSpacerItem(40, 20, QtWidgets.QSizePolicy.Expanding, QtWidgets.QSizePolicy.Minimum)
|
||||
self.horizontalLayout.addItem(spacerItem1)
|
||||
self.gridLayout_2.addLayout(self.horizontalLayout, 0, 0, 1, 1)
|
||||
self.gridLayout_2.addLayout(self.horizontalLayout, 1, 0, 1, 1)
|
||||
|
||||
self.retranslateUi(MainWidget)
|
||||
QtCore.QMetaObject.connectSlotsByName(MainWidget)
|
||||
@ -71,21 +92,13 @@ class Ui_MainWidget(object):
|
||||
_translate = QtCore.QCoreApplication.translate
|
||||
MainWidget.setWindowTitle(_translate("MainWidget", "LinVAM"))
|
||||
self.listeningChk.setText(_translate("MainWidget", "Enable Listening"))
|
||||
self.groupBox.setTitle(_translate("MainWidget", "Voice Volume"))
|
||||
self.sliderVolume.setToolTip(_translate("MainWidget", "Change voice volume"))
|
||||
self.ok.setText(_translate("MainWidget", "OK"))
|
||||
self.cancel.setText(_translate("MainWidget", "Cancel"))
|
||||
self.label.setText(_translate("MainWidget", "Profile:"))
|
||||
self.addBut.setText(_translate("MainWidget", "Add"))
|
||||
self.editBut.setText(_translate("MainWidget", "Edit"))
|
||||
self.copyBut.setToolTip(_translate("MainWidget", "Copy currently selected profile"))
|
||||
self.copyBut.setText(_translate("MainWidget", "Copy"))
|
||||
self.removeBut.setText(_translate("MainWidget", "Remove"))
|
||||
|
||||
|
||||
|
||||
|
||||
if __name__ == "__main__":
|
||||
import sys
|
||||
app = QtWidgets.QApplication(sys.argv)
|
||||
MainWidget = QtWidgets.QWidget()
|
||||
ui = Ui_MainWidget()
|
||||
ui.setupUi(MainWidget)
|
||||
MainWidget.show()
|
||||
sys.exit(app.exec_())
|
||||
|
||||
93
ui_soundactioneditwnd.py
Normal file
93
ui_soundactioneditwnd.py
Normal file
@ -0,0 +1,93 @@
|
||||
# -*- coding: utf-8 -*-
|
||||
|
||||
# Form implementation generated from reading ui file 'soundactioneditwnd.ui'
|
||||
#
|
||||
# Created by: PyQt5 UI code generator 5.14.2
|
||||
#
|
||||
# WARNING! All changes made in this file will be lost!
|
||||
|
||||
|
||||
from PyQt5 import QtCore, QtGui, QtWidgets
|
||||
|
||||
|
||||
class Ui_SoundSelect(object):
|
||||
def setupUi(self, SoundSelect):
|
||||
SoundSelect.setObjectName("SoundSelect")
|
||||
SoundSelect.resize(1119, 362)
|
||||
SoundSelect.setLocale(QtCore.QLocale(QtCore.QLocale.English, QtCore.QLocale.UnitedStates))
|
||||
self.labelVoicepacks = QtWidgets.QLabel(SoundSelect)
|
||||
self.labelVoicepacks.setGeometry(QtCore.QRect(10, 30, 111, 17))
|
||||
self.labelVoicepacks.setLocale(QtCore.QLocale(QtCore.QLocale.English, QtCore.QLocale.UnitedStates))
|
||||
self.labelVoicepacks.setObjectName("labelVoicepacks")
|
||||
self.labelCategories = QtWidgets.QLabel(SoundSelect)
|
||||
self.labelCategories.setGeometry(QtCore.QRect(160, 30, 111, 17))
|
||||
self.labelCategories.setLocale(QtCore.QLocale(QtCore.QLocale.English, QtCore.QLocale.UnitedStates))
|
||||
self.labelCategories.setObjectName("labelCategories")
|
||||
self.listFiles = QtWidgets.QListView(SoundSelect)
|
||||
self.listFiles.setGeometry(QtCore.QRect(660, 90, 451, 231))
|
||||
self.listFiles.setLocale(QtCore.QLocale(QtCore.QLocale.English, QtCore.QLocale.UnitedStates))
|
||||
self.listFiles.setEditTriggers(QtWidgets.QAbstractItemView.NoEditTriggers)
|
||||
self.listFiles.setProperty("showDropIndicator", False)
|
||||
self.listFiles.setAlternatingRowColors(True)
|
||||
self.listFiles.setObjectName("listFiles")
|
||||
self.listCategories = QtWidgets.QListView(SoundSelect)
|
||||
self.listCategories.setEnabled(True)
|
||||
self.listCategories.setGeometry(QtCore.QRect(160, 90, 491, 231))
|
||||
self.listCategories.setLocale(QtCore.QLocale(QtCore.QLocale.English, QtCore.QLocale.UnitedStates))
|
||||
self.listCategories.setEditTriggers(QtWidgets.QAbstractItemView.NoEditTriggers)
|
||||
self.listCategories.setProperty("showDropIndicator", False)
|
||||
self.listCategories.setAlternatingRowColors(True)
|
||||
self.listCategories.setObjectName("listCategories")
|
||||
self.listVoicepacks = QtWidgets.QListView(SoundSelect)
|
||||
self.listVoicepacks.setGeometry(QtCore.QRect(10, 50, 141, 271))
|
||||
self.listVoicepacks.setLocale(QtCore.QLocale(QtCore.QLocale.English, QtCore.QLocale.UnitedStates))
|
||||
self.listVoicepacks.setEditTriggers(QtWidgets.QAbstractItemView.NoEditTriggers)
|
||||
self.listVoicepacks.setProperty("showDropIndicator", False)
|
||||
self.listVoicepacks.setAlternatingRowColors(True)
|
||||
self.listVoicepacks.setObjectName("listVoicepacks")
|
||||
self.labelFiles = QtWidgets.QLabel(SoundSelect)
|
||||
self.labelFiles.setGeometry(QtCore.QRect(660, 30, 111, 17))
|
||||
self.labelFiles.setLocale(QtCore.QLocale(QtCore.QLocale.English, QtCore.QLocale.UnitedStates))
|
||||
self.labelFiles.setObjectName("labelFiles")
|
||||
self.buttonOkay = QtWidgets.QPushButton(SoundSelect)
|
||||
self.buttonOkay.setEnabled(True)
|
||||
self.buttonOkay.setGeometry(QtCore.QRect(940, 330, 80, 25))
|
||||
self.buttonOkay.setLocale(QtCore.QLocale(QtCore.QLocale.English, QtCore.QLocale.UnitedStates))
|
||||
self.buttonOkay.setObjectName("buttonOkay")
|
||||
self.buttonCancel = QtWidgets.QPushButton(SoundSelect)
|
||||
self.buttonCancel.setGeometry(QtCore.QRect(1030, 330, 80, 25))
|
||||
self.buttonCancel.setLocale(QtCore.QLocale(QtCore.QLocale.English, QtCore.QLocale.UnitedStates))
|
||||
self.buttonCancel.setObjectName("buttonCancel")
|
||||
self.filterCategories = QtWidgets.QPlainTextEdit(SoundSelect)
|
||||
self.filterCategories.setGeometry(QtCore.QRect(160, 50, 491, 31))
|
||||
self.filterCategories.setObjectName("filterCategories")
|
||||
self.filterFiles = QtWidgets.QPlainTextEdit(SoundSelect)
|
||||
self.filterFiles.setGeometry(QtCore.QRect(660, 50, 451, 31))
|
||||
self.filterFiles.setPlainText("")
|
||||
self.filterFiles.setObjectName("filterFiles")
|
||||
self.buttonPlaySound = QtWidgets.QPushButton(SoundSelect)
|
||||
self.buttonPlaySound.setGeometry(QtCore.QRect(410, 330, 80, 25))
|
||||
self.buttonPlaySound.setToolTip("")
|
||||
self.buttonPlaySound.setObjectName("buttonPlaySound")
|
||||
self.buttonStopSound = QtWidgets.QPushButton(SoundSelect)
|
||||
self.buttonStopSound.setGeometry(QtCore.QRect(500, 330, 80, 25))
|
||||
self.buttonStopSound.setToolTip("")
|
||||
self.buttonStopSound.setObjectName("buttonStopSound")
|
||||
|
||||
self.retranslateUi(SoundSelect)
|
||||
QtCore.QMetaObject.connectSlotsByName(SoundSelect)
|
||||
|
||||
def retranslateUi(self, SoundSelect):
|
||||
_translate = QtCore.QCoreApplication.translate
|
||||
SoundSelect.setWindowTitle(_translate("SoundSelect", "Sound selection"))
|
||||
self.labelVoicepacks.setText(_translate("SoundSelect", "VoicePacks:"))
|
||||
self.labelCategories.setText(_translate("SoundSelect", "Categories:"))
|
||||
self.labelFiles.setText(_translate("SoundSelect", "Voice files:"))
|
||||
self.buttonOkay.setText(_translate("SoundSelect", "Ok"))
|
||||
self.buttonCancel.setText(_translate("SoundSelect", "Cancel"))
|
||||
self.filterCategories.setToolTip(_translate("SoundSelect", "Filter categories"))
|
||||
self.filterCategories.setStatusTip(_translate("SoundSelect", "Filter"))
|
||||
self.filterFiles.setToolTip(_translate("SoundSelect", "Filter voice files"))
|
||||
self.filterFiles.setStatusTip(_translate("SoundSelect", "Filter"))
|
||||
self.buttonPlaySound.setText(_translate("SoundSelect", "Play Sound"))
|
||||
self.buttonStopSound.setText(_translate("SoundSelect", "Stop Sound"))
|
||||
Loading…
Reference in New Issue
Block a user