04.07.26:

Dette nettstedet er under utarbeidelse og vil endres fortløpende. Derfor vil det til tider være noe rot, innhold som mangler og noen linker som ikke fungerer som de skal

Background

øyestyring.no

Background

Norsk

About the project

øyestyring.no is a non-profit, non-commercial project run by Eyvind Bogstrand, with artificial intelligence (AI) supporting the development work. Several AI models have been used in the project, including DeepSeek, Gemini, Kimi, ChatGPT and Claude – for programming, language modelling and drafting content. Collaboration with additional developers is being explored, and contributors will be presented on these pages as agreements are put in place.

The project has three main goals, and this page describes the background for each of them: the development of an eye-controlled spelling app for mobile devices, the apps made freely available on the website, and øyestyring.no as an information and training resource.

1. The øyestyring.no website

The website is the project’s home base. It presents all information about the project: background, status, documentation and the apps developed along the way. All content is free and openly available, with no advertising and no login required. The ambition is that the site should serve as a resource for users, families, professionals and anyone interested in eye pointing as a communication method.

2. The spelling app for mobile devices

The main track of the project is the development of an eye-controlled spelling app for mobile phones and tablets. The app is controlled with the eyes via the device’s front camera and reads aloud what is written using built-in text-to-speech (TTS) in Norwegian.

The background for the project is a well-documented challenge: for people who cannot use their hands, text input is extremely time-consuming. The need for augmentative and alternative communication (AAC) is substantial. The World Health Organization and UNICEF estimate that more than 2.5 billion people globally need at least one assistive product, and that nearly one billion people today are denied access to the products they need. In many low-income countries, access to assistive products is as low as three per cent, compared to around 90 per cent in high-income countries (World Health Organization [WHO] & United Nations Children’s Fund [UNICEF], 2022).

For communication aids specifically, the estimated number of people who could benefit from AAC is substantial: international overviews based on Beukelman and Light (2020) put the figure at just under 100 million people worldwide. What these figures have in common is that the need is great, while access to dedicated and costly communication technology remains limited, particularly outside the wealthiest countries.

An eye-controlled spelling app on an ordinary mobile phone or tablet requires no special equipment beyond the device most people already own. This is the premise of the project: if the app can be made good enough, it can significantly lower the threshold for eye pointing as a communication method.

The technical solution is designed with fast eye pointing in mind. The app is built with the Flutter framework and currently runs on Android and in the browser; an iPhone release requires access to a Mac for building. A central design choice is two-step letter selection: the user first chooses between five letter fields, then between the five letters in the chosen field. This gives 25 letters in two glances, and six fixed control buttons and five shortcut letters reduce the number of glances needed to write ordinary Norwegian words. The letters A, G, M, T and Å are also selected by long press (holding the gaze), because of their position in the field. Otherwise, the user’s gaze would have to land twice in the same spot in a row. A language model with around 9,000 Norwegian words, statistical prediction of the next letter and automatic word completion will help increase writing speed further. The long-term goal is that a trained user should be able to approach 60–80 per cent of normal speaking speed.

The project also has a practical dimension related to accessibility: because the solution is built on ordinary consumer electronics and open code, it can in principle be used and further developed anywhere, including in countries where specialised equipment is unavailable.

3. The apps on the website

«Stavetavla» (the spelling board)

This is an early iteration of the project’s main track: an app for AAC users. It is an HTML script that runs on the website. You can use your eye-controlled device to try it, or use it to type text and have what you want to say read aloud – also in plenary situations (for example meetings, lectures and any other setting). It also has a built-in button for copying text, so that it can be pasted into other applications.

«Opplæringsapp» (the training app)

This app and «Litt mindre teit app» are essentially the same app. However, in the latter I have added an image of the analogue board to make it easier for beginners to connect the app to the principle of using the board. The buttons flash, and sentences and words are selected from a small set.

«To av appene i prosjektet» (two of the project’s apps)

Mirroreyes and Partnermirroreyes – prototypes.

These show the principles and the connection between the side of the board seen by the board user and the side seen by the communication partner. These early versions have no prediction built in. We can see that both the placement of the letters and the placement of the fields are mirrored.

«Litt mindre teit app» («a slightly less silly app»)

As described above, this app is the same as «Opplæringsapp» in principle. It also opens in full screen and is closed with the back key or ESC.

4. øyestyring.no as a training resource

The third main track is to make the website a training resource for the use of eye-pointing boards – both the analogue, paper-based boards and the digital solutions. Here you will find exercises, guidance and information aimed at users, families and professionals. The target group is everyone who wants to learn eye pointing as a communication method, whether you use a printout of a paper board, a tablet app, or the spelling app for mobile currently under development.

As part of this track, the site also links to national professional resources, including Statped’s guidance material on assessing eye control for communication.

Test checklist for the Spelling Board

Thank you for testing! Tick whatever applies – your ticks are inserted automatically into the feedback box below, where you can also write freely. There are no right or wrong answers – all observations are useful.

What are you testing on?

1. Getting started

2. Spelling

3. Suggestions while you type

4. «✨ Complete the sentence» (AI suggestions)

5. Read aloud and copy

6. Precision and eye control (only if you use eye control)

7. Screen and layout

8. Finally

Feel free to write freely in the message box below: What worked best? What worked worst? One thing you would change first?

Feedback

Are you testing the apps, or do you have input for the project? Please write a short message – it is sent directly to the project.

References

  • Beukelman, D. R., & Light, J. C. (2020). Augmentative and alternative communication: Supporting children and adults with complex communication needs (5th ed.). Paul H. Brookes Publishing Co.
  • World Health Organization, & United Nations Children’s Fund. (2022). Global report on assistive technology. World Health Organization. https://www.who.int/publications/i/item/9789240049451