Mohawk Language XR

What makes your solution innovative?

Dominant societies expect instant access to every bit and byte of data from the past, present, and future to be defined, categorized and stamped with non-Indigenous values. As we decolonize, how do we teach and learn Kakwitene language in a way that can minimize colonial values placed in our language? Using Oculus Rift and Oculus Go, MoniGarr–a small tech company located in the Akwesasne Indian Reservation–develops XR and VR experiences for Indigenous language revival and retention projects. Using Onkwehonwehneha techniques, we created a series of Kakwitene prototypes for Endangered Language Revival and Retention Research projects in Akwesasne called Kakwitene VR.

In this project, we use tactics from Onkwehonwehneha Ancient Intelligence, going back to long before settlers and colonizers arrived and began their attempts to remove Indigenous languages and dialects. Ancient Intelligence (A.I.) teaches through stories, words, and phrases that come from our Onkwehonwe homelands. We want Kakwitene VR to promote friendly, respectful communications with Indigenous languages as a foundation of learning and practicing Respect for All of Creation. I believe that communicating with languages and dialects our ancestors speak in our own homelands is a healthy way to heal, to overcome negative bias, and share a strong respectful message to All of Creation about each of our identities, values, and connections to our ancestors and homelands since time immemorial.

This paper tracks the effectiveness of Endangered Language Learning through VR, observing how participants learn new Kanien’kéha words. To us, “effective” aims to increase memory retention, the speed of learning, and each learners’ confidence to speak Kanien’kéha outside of the VR experience in the physical world. But Kakwitene VR has no intention of assimilating Indigenous dialects into non-Indigenous definitions and languages. It will not translate over to world-views and experiences that are foreign to the specific Indigenous dialect presented. The base communications in Kakwitene VR includes audio and visuals that are experienced without providing non-Indigenous cultural interpretations and literal translations.

Through observing and documenting three brief VR sessions with our Kakwitene VR prototype, we saw new language learners speaking confidently within VR sessions of 3 to 7 minutes per session. In particular, with the hope that our Onkwehonwehneha tactics, our source code, and software templates can be re-used by anyone working on similar projects to empower their own communities to maintain their own Indigenous languages and Ancient Intelligences.

Ancient Intelligence and Artificial Intelligence

Enter Kakwitene VR as a “baby learner.” By removing dominant societies’ English, French, Colonial influences, such as definitions, text, values, and expectations, we begin to explore the VR experience freely, to look, see, move, think for ourselves without anyone suggesting or telling them what is expected. Each participant creates their own unique experience that is tailored for their own interests, life experiences, abilities, and goals. We come into a virtual environment and experience dimension where we can soak in sounds and visuals created with Onkwehonwehneha A.I. Not Artificial Intelligence, as might be expected through colonial values.

I have noticed since I was a child that my colonial peers put high value on Artificial Intelligence that is judged and measured based on colonial standards that typically define intelligence as another being’s ability to look, mimic and behave the same as colonial society. Their A.I. typically pretends to be a human with goals of convincing and tricking everyone to believe the machine and software is a human being.

Ancient Intelligence has taught me that we, as humans, are not the echelon of existence nor are we the center of existence. I see no reason for apologies or shame to exist as a human, or a rock, the wind, an insect, dust, water; to be whatever it is we come into existence as is just as meaningful.

When I make software, machines, robots, or chatbots, I do not have a goal of shaping them to convince everyone they are human, nor do I strive for them to be human beings.  Much of what I create comes from my dreams and the natural world influencing my thought processes, work schedules and project plans. If a snow storm makes it impossible to communicate with my team, I pay attention to what is going on in the Natural World and adapt our project based on the strength of the messages we receive. If a project is slowed down, stopped or moving much faster than the original plans, I adapt our project based on those organic natural occurrences, too. Switching my workflow to pay more attention to what is going on in the Natural World has helped my team produce more effective solutions that actually Respect All of Creation.

These goals, projects, and this kind of workflow are all part of Onkwehonwehneha A.I., which is the most relevant phrase to describe the projects I’ve been working on for more than 25 years in the tech industry. English speakers roughly translate the phrase to mean “Native person’s way of doing stuff” and “Native person’s Artificial Intelligence.” But that’s not what it is. As an individual, I am Onkwehonwe and in the process of decolonizing myself, so I roughly translate the phrase to refer to ‘Respect for All of Creation’ as one of the core values learned from Ancient Intelligence. As a company, MoniGarr.com is in this process, too.

Onkwehonwehneha Communications

Kakwitene VR is a bright summer garden environment inspired by Iroquois Woodlands Raised Beadwork. Our prototypes put visitors into an interactive experience that fully immerses them with Kanien’kéha dialect audio and visuals.  Players can fly around, fly into, and touch 3D objects to hear Kanien’kéha dialects. The prototype features colorful pollen spheres on the ground and hidden inside flowers that speak the Kanien’kéha colors. The Oculus Rift version also includes Kanien’kéha Voice Recognition Commands to change the colors inside the VR experience.

Flowers and leaves inside the Kakwitene VR Prototype.

This is one of many projects that are part of MoniGarr’s overall Endangered Language Revival work. Crucially, MoniGarr.com is researching how our Kakwitene VR prototypes can increase a user’s confidence to recognize and speak the featured Indigenous language as a key indicator of success. One of the biggest hurdles to learning and retaining any information is an individual’s belief in their own capabilities. One of the well-known tactics that Indian Residential Schools used to kill off Indigenous Language Dialects was to remove children’s safety, confidence and abilities to communicate with each other and their families. Confidence, in our research, is measured by each individual’s choice to speak out loud, to speak clearly without anyone asking them to do so, and without anyone suggesting or hinting that they do so.

To accomplish this, we observed several research groups. The first group that participated in our research was a small group of five individuals from and currently living in Akwesasne Indian Reservation. Our participants’ ages ranged from 49 to 73. Three identify as women and one identifies as a man. All participants have previously studied Kanien’kéha for more than 40 years through classroom reading, writing, speaking, random rare speaking with family and friends, all with many breaks in between instances of language use.

Kakwitene VR (level one) provided 5 basic Kanien’kéha colors to hear when flying into colored pollen spheres inside a woodland garden setting filled with many colors. These research sessions were conducted on an Oculus Go and then an Oculus Rift. Oculus Go is a mid level VR device best used for sitting and watching films passively or with very little interaction using only one available hand held controller. The Oculus Rift is a high end VR device that allows for standing and more movement. Each research participant was presented with a survey via a Google document. MoniGarr logged if they recognized the written and spoken Kanien’kéha colors (following the Mohawk Language Standardization Guidelines) both before and after each session inside Kakwitene VR. In following the Mohawk Language Standardization Guidelines, we do not promote placing values of what is “right,” “wrong,” or “better” on specific spellings and pronunciations: that practice does not respect the fluent first language speakers that exist since long before the new standardization guidelines were created for English and French first language speakers.

First Kakwitene VR Experience: Oculus Go

Zero research participants attempted to speak Kanien’kéha out loud in the first session. All offered to continue helping to verify the Kanien’kéha pronunciations were “correct” without prompting. I observed that each research participant was very uncomfortable and even agitated the first few seconds they entered the VR experience as they tried to figure out how to use the VR controller to navigate.

But when they felt comfortable using the hand controller to navigate, each research subject became happy, amused and even laughing while they flew around the Kakwitene VR environment. They each chose to spend a minimum of 5 minutes in the experience to look around, search for colored pollen spheres, and to listen to each color many times. Each participant stated they enjoyed the Kakwitene VR experience because it was interesting and unlike anything they had ever seen before. They appreciated hearing Kanien’kéha in VR and shared hopeful stories about being able to communicate better with their families and friends.

Second Kakwitene VR Experience: Oculus Go

To begin the second session, all participants recognized about half of the Kanien’kéha colors written on the intake survey. Two research participants enjoyed discussing how different dialects sound from each other and how to recognize different dialects. But one participant questioned the “correctness” of the pronunciations and became angry about the idea the pronunciation might be a dialect she was not expecting. It’s important to note that the Mohawk Language Standardization Guidelines are relatively new, from the mid 1990s, and some fluent speakers choose to not follow, acknowledge nor appreciate it, whereas many who are non-fluent appreciate it because it helps them to learn when they are coming from a dominantly English or French first language speaking background.

Kanien’kéha has eastern, central and western dialects plus other varying accents. I remember hearing certain families and individuals with very distinct speaking accents in specific areas of Akwesasne: Snye accent, FrogTown accent, The Island accent, and each community has their distinct accents in specific areas of their communities. The Frogtown accent I heard in the 1970s is rarely heard today and attempting to spell or pronounce it is an extreme challenge today. English phonetics, phonemes and voice recognition foundations do not exist for all the Kanien’kéha dialect sounds, creating technical difficulties during software architecture and development work. These issues have a very strong influence on our decision to not push what English and French speakers call “proper” spelling, writing and pronunciations based on dominant societies’ current expectations and rules.

Third Kakwitene VR Experience: Oculus Rift

For our third session, one research subject went into Kakwitene VR on Oculus Rift) that includes two hand controllers and allows standing. She chose to sit because she has knee injuries. She appeared to enjoy Kakwitene VR and chose to stay inside for 15 minutes and would have stayed inside longer without the constraints of a research experience. I observed that she enjoyed the experience and was a noticeably confident speaker during this session. She flew around and into every color pollen sphere she could find and verbally repeated everything she heard over and over again–very clearly and with strong confidence.

Findings: Kakwitene VR increases Confidence to Speak and Recognize Indigenous Language?

Based on our initial sessions, it appears the Kakwitene VR experience helped to dramatically increase each research participant’s confidence to speak out loud without being asked nor being provided with any suggestions to do so. Each participant strongly believed they were not “good,” “experienced” or “knowledgeable” enough to speak out loud during the first research session. During the  second and subsequent sessions, each participant strongly believed they were knowledgeable, good, experienced enough and were confident to speak loud and clear without being asked to. The dramatic change was fast and very noticeable. MoniGarr was very careful to not make suggestions nor provide any clues about what this research project is looking at regarding the research participants’ behavior, beliefs and actions with their own Indigenous language dialects.

For example, the participant in session three who stayed in the VR experience the longest indicated that she believed she is a “slow learner” or unable to learn during past sessions. It’s been observed that this is a common belief in Akwesasne with language revivalists that have failed with retaining their dialects in the past and have to keep repeating basic language classes with traditional reading, writing and memorization for 40 years or longer. But with this new VR method, she appeared much more confident in her abilities to learn and speak.

Kakwitene VR visuals were drawn with Tilt Brush and the research subjects all commented on how it reminded them of the doodles that many people draw as children in Akwesasne – especially when learning how to make beadwork designs or sewing Kanien’kéhake regalia. Those that are fortunate to hike and play in the Adirondack forests recognize the connection between woodlands, Kanien’kéhake beadwork designs, regalia, the Natural World during the spring season in Kanien’kéhake homelands and Kakwitene VR. All of those visuals in the mind, from the Natural World brings Kakwitene VR experience around full circle to what one might see in their mind when hearing someone say ’Kakwitene’ pronounced ’gah gwih deh neh.’

A close-up of a purple flower inside the game, created with Tilt Brush to resemble early-learning level beadwork designs or sketches.

The next phase of research hopes to bring in more experienced researchers to help remove potential personal biases from this Indigenous language revival and retention research project. Being the developer of Kakwitene VR solution can set up MoniGarr.com with strong conscious and unconscious biases to want this research to show specific results. Future activities have a goal of removing bias as much as possible, so that future language revival and retention projects using XR technologies (virtual reality, augmented reality, spatial computing) can be re-usable and help any community or individual working on Indigenous Language Revival and Retention projects.

References:

Brantford school a key tool in 150-year effort to assimilate First Nations children. (2015, August 9). The Hamilton Spectator.

Eshet, D. (2015). Stolen lives: The Indigenous peoples of Canada and the Indian residential schools. Facing History and Ourselves. Hanson, E. (n.d.). The residential school systems. indigenousfoundations.arts.ubc.ca.

Hobson, B.  (2020, February 24). Dance performance ‘The Mush Hole’ based on Canada’s oldest residential school. National News.

MoniGarr. (2019, January 4). Scientific Research about VR benefits. MoniGarr.com.

MoniGarr. (2019, April 28). Kakwitene VR. MoniGarr.com.

MoniGarr. [Moni Garr]. (2019, May 8). Kanien’kéha Voice Commands Demo in Kakwitene VR [Video]. Youtube.

Copyright MoniGarr, monigarr@MoniGarr.com.  This is an Open Access article distributed under the terms of the Creative Commons Attribution Noncommercial 3.0 Unported License (http://creativecommons.org/lic...), permitting all non-commercial use, distribution, and reproduction in any medium, provided the original work is properly cited.

Other ways to get in touch:

https://www.LinkedIn.com/in/monigarr https://www.twitter.com/monigarr https://www.facebook.com/360monigarr https://poly.google.com/user/fStrUM5tkjB monigarr@MoniGarr.com

What are your impact goals for the next year and the next five years, and how will you achieve them?

Revive and Retain Kanien'keha (Mohawk Language Dialects).

XR solutions that are architected and designed with Onkwehonwehneha A.I. tactics are proving to increase memory retention and the speed to learn new topics (Kanien'keha speaking in this context).

Producing Mohawk Language XR content that is designed by, maintained by and approved by Kanien'kehake people - that can be accessed and licensed by industry standard requirements of maintream & non mainstream media in their own animations, films, stories, music, websites, software and more is a positive impact and real world action that not only stops the erasure of Kanien'kehake (people) but also respects Onkwehonwehneha world views of Respect for All. 

How are you measuring your progress toward your impact goals?

I document research results & stats in regards to individuals gaining & maintaining confidence to speak Kanien'keha out loud with friends, family and outside the home in the community. This indicates the viability of language revival, retention. Stopping linguicide and even reversing it the best we can today provides Kanien'kehake with access to opportunities and resources that were not available before having confidence, abilities to revive & retain Kanien'keha (Mohawk Language dialects).  Example: Is it always going to be true that Kanien'keha speakers are not welcome in tech industries and all industries in our own homelands / North America and worldwide?

Findings: Kakwitene VR increases Confidence to Speak and Recognize Indigenous Language?

Based on our initial sessions, it appears the Kakwitene VR experience helped to dramatically increase each research participant’s confidence to speak out loud without being asked nor being provided with any suggestions to do so.

Each participant strongly believed they were not “good,” “experienced” or “knowledgeable” enough to speak out loud during the first research session. During the  second and subsequent sessions, each participant strongly believed they were knowledgeable, good, experienced enough and were confident to speak loud and clear without being asked to. The dramatic change was fast and very noticeable. MoniGarr was very careful to not make suggestions nor provide any clues about what this research project is looking at regarding the research participants’ behavior, beliefs and actions with their own Indigenous language dialects.

For example, the participant in session three who stayed in the VR experience the longest indicated that she believed she is a “slow learner” or unable to learn during past sessions. It’s been observed that this is a common belief in Akwesasne with language revivalists that have failed with retaining their dialects in the past and have to keep repeating basic language classes with traditional reading, writing and memorization for 40 years or longer. But with this new VR method, she appeared much more confident in her abilities to learn and speak.

Kakwitene VR visuals were drawn with Tilt Brush and the research subjects all commented on how it reminded them of the doodles that many people draw as children in Akwesasne – especially when learning how to make beadwork designs or sewing Kanien’kéhake regalia. Those that are fortunate to hike and play in the Adirondack forests recognize the connection between woodlands, Kanien’kéhake beadwork designs, regalia, the Natural World during the spring season in Kanien’kéhake homelands and Kakwitene VR. All of those visuals in the mind, from the Natural World brings Kakwitene VR experience around full circle to what one might see in their mind when hearing someone say ’Kakwitene’ pronounced ’gah gwih deh neh.’

What is your theory of change?

In 2022, if I speak Kanien'keha when I leave or return from my home in the Akwesasne Indian Reservation: I risk being 'detained forever', labeled a criminal, forced into a back room with them and various other criminalization threats from the government workers that work as border guards around our Indian Reservation. Some of them view & treat our local people as sub human and behave abusive towards some of us when they hear us speaking Kanien'keha.

Some business owners, public service workers in every industry imagineable (medical, legal, retail...) also have very strong negative bias towards people that speak Kanien'keha. They refuse to provide access to services and often put Kanien'kehake into very dangerous situations where we are left begging for access to medical services; only to be left to die in emergency waiting rooms or wounded outside police stations.

What if society in the homelands of Kanienk'kehake (people) saw real life actions that show Kanien'kehake are human beings who's lives / views / beliefs / stories / languages / culture are also precious?   I imagine we would see and hear more Kanien'kehake speaking, appearing in all spaces and participating safely while being respected in all industries imaginable. 

Describe the core technology that powers your solution.

Onkwehonwehneha A.I. (Ancient Intelligence teaching Artificial Intelligence).

Pathways & Protocols: Nothing About Us without Us!

Meetings & Feedback with Communities (Indian Residential School Survivors, Elders, Adults, Youth, Parents) (Kanien'kehake, Onkwehonwe, Mohawk, Haudenosaunee, Onondaga, Oneida, Cayuga, Seneca, Tuscarora).

XR Production: virtual reality, augmented reality, 360 film, 3D content, spatial audio content, 3D animation, Motion Capture, Virtual Production...

Which of the following categories best describes your solution?

A new business model or process that relies on technology to be successful

Please select the technologies currently used in your solution:

• Ancestral Technology & Practices
• Artificial Intelligence / Machine Learning
• Audiovisual Media
• Crowd Sourced Service / Social Networks
• Internet of Things
• Software and Mobile Applications
• Virtual Reality / Augmented Reality

https://monigarr.com/2019/04/28/kakwitene-vr/

Which of the UN Sustainable Development Goals does your solution address?

• 3. Good Health and Well-being
• 8. Decent Work and Economic Growth
• 10. Reduced Inequalities
• 16. Peace, Justice, and Strong Institutions
• 17. Partnerships for the Goals

In which states do you currently operate?

• New York

In which states will you be operating within the next year?

• New York

What type of organization is your solution team?

For-profit, including B-Corp or similar models

How many people work on your solution team?

1 Founder full-time. Contractors as needed.

How long have you been working on your solution?

1996 to Present Date: 30+ Years

What is your approach to incorporating diversity, equity, and inclusivity into your work?

Onkwehonwehneha A.I. (Ancient Intelligence) from Kanien'keha worldviews, stories, life experiences.  I am Onkwehonwe, Kanien'kehake with extensive professional & life experience working with people from every background imaginable in tech industries worldwide.  For Mohawk Language XR projects, I hire contractors that are Native, Onkwehonwe, Kanien'kehake, Mohawk, Haudenosaunee, Onondaga, Oneida, Seneca, Cayuga, Tuscarora and / or from any of the Native communities world-wide. I also work with, hire and do business with non Natives on a daily basis.

What is your business model?

B2C, B2B, SAAS.

Do you primarily provide products or services directly to individuals, to other organizations, or to the government?

What is your plan for becoming financially sustainable?

Consistent sales that will support our team.  Sales from software stores (Oculus, SteamVR), content subscribers on our websites and social media platforms.

Share some examples of how your plan to achieve financial sustainability has been successful so far.

I work in tech industries and fund my projects / teamsof contractors when needed - with my personal earnings since the 1990s. 

I plan to provide access to Mohawk Language XR content from software stores, websites and social media platforms.