Development state:

Current Features

Currently I'm testing all the apps on my Redmi 12 Pro with MIUI 14 with server running on my Windows 11 laptop. Also implemented dummy sensor for testing client on windows with randomly generated signal. Could improve it by pre-recording some actual accelerometer reading and replaying them in a loop in the future for easier testability.

Haven't yet build it for IOS but have plans to do so when i solve the signal filtering issues in current version.

Calibration App

Guides the user throguh 7-step accelerometer calibration process. Currently need to manually copy the calibration data from the app into client/calibration.json file.

Mouse Server App

Features: - Handles movement and click commands from the client app. - plots the received movement commands in real time using basic matplotlib animation (not efficient but suffices for debugging purposes) - loads settings from json file.

Bugs: - Disconnecting and terminating server is not handled in a clean way.

Mouse Client APK

With the help of Kalman Filter the movements became much better. There is still a lot of room to fine-tune the parameter, but I suppose will have to clean up the code first to make it easier.

There is an issue that the signal appears to deteriorate the longer the app is running. Will need to review the filter and app state and perhaps change how its reset.

Build Instructions

On Windows

Prerequisites

1. WSL2 configured and running.
2. Python3 and Pip installed within WSL2 system.

Dependencies

sudo apt update
sudo apt install -y \
    python3 \
    python3-pip \
    git \
    zip \
    unzip \
    openjdk-17-jdk \
    python3-pip \
    autoconf \
    libtool \
    pkg-config \
    zlib1g-dev \
    libncurses5-dev \
    libncursesw5-dev \
    libtinfo5 \
    cmake \
    libffi-dev \
    libssl-dev \
    dos2unix

pip3 install --user --upgrade buildozer
pip3 install --user --upgrade Cython==0.29.33 virtualenv

Clone Repository

git clone https://github.com/buyuk-dev/imouse.git
cd imouse

Build Project

make all

Required if you get an error indicating something like: bash\r file not found

dos2unix .buildozer/android/platform/build-arm64-v8a_armeabi-v7a/dists/imouse/gradlew

Build speed

First time build with buildozer will take a long time, depending on the spec of the maching its being build on it may take upwards of 30 min. This is when buildozer downloads and compiles dependencies like numpy etc. After the first builds the dependencies will be saved in the build/.buildozer/ subdirectory. Using make clean will not remove this directory, in order to ensure the future builds are as fast as possible. To maintain fast build speed keep this directory and/or create a backup in case it will accidentally get deleted.

References

1. Implementing Positioning Algorithms Using Accelerometers by Kurt Seifert and Oscar Camacho
2. StackOverflow thread about accelerometer calibration
3. Clinometer App SourceCode
4. Build Kivy Apps On Android Official Quickstart Guide
5. Plyer Documentation
6. How To Build And Package Kivy Android Application Using Github Actions Workflow
7. Buildozer.spec reference
8. Kalman Filter Explained Simply