The Kavita Project
Create a prototype through the integration of modified versions of open source assistive technologies for Kavita, a student with spinal muscular atrophy (SMA) to make it easier for her to program by having a voice interface.
Thursday, April 2, 2020
Last week, the website with the experiment in which twenty programs were placed for each language (C, C++, Python) so participants could record the way they speak code, was finished by Sadia Nowrin. This website was tested and the experience was nice. It took an hour, just like how it was specified at the beginning of the survey. For now, this is the only new thing that was assigned since the last post.
Thursday, March 12, 2020
Hi,
During the last month two things have been done for the project.
These were:
-passing 15 program snippets from Java to Python
-adding 12 Python programs to Google Collab
-checking the Spanish translation on the consent form for the app that is being made
The work currently being done involves studying the modules of the Social/ Behavioral Research Course in order to be certified for when the interview period arrives. Additionally, working on translating the questionnaire on the app.
During the last month two things have been done for the project.
These were:
-passing 15 program snippets from Java to Python
-adding 12 Python programs to Google Collab
-checking the Spanish translation on the consent form for the app that is being made
The work currently being done involves studying the modules of the Social/ Behavioral Research Course in order to be certified for when the interview period arrives. Additionally, working on translating the questionnaire on the app.
Friday, November 6, 2015
Demo of Simon Codes at Assets 2015
Congratulations to everyone that had participated at the Kavita Lab with Simon Codes. Like Andrea Claudio said in her post, we went to Lisbon, Portugal to present a demo of Simon Codes and received the second Best Demo Award. I'm so happy for everyone and want to thanks our mentor Dra. Patricia Ordóñez.
Lisbon, Portugal! Oh, such a beautiful city! I am in love with Lisbon. But the conference was truly inspiring. This was my first participation at a conference at all. For the demo presentation, at first I was nervous but when I started to communicate with everybody it was an amazing feeling and a very satisfying experience.
Thank you for everything Andrea, Patti, Assets 2015, Lisbon and everybody!
Wednesday, November 4, 2015
ACM ASSETS 2015 Conference: Lisbon, Portugal
We went to Lisbon, Portugal to present the demo. We called it SIMON CODES. Having the opportunity to meet professionals in the industry and academia is unique and bolstering. Each time I explained the scope of SIMON CODES I felt a personal satisfaction that I was able to transmit, getting the people interested in the project. The papers presented were astonishing, and the projects were of high quality and mainly oriented to the computing and accessibility for people with disabilities.
Lisbon is a neat place with well-educated citizens and beautiful places to visit and enjoy. The morning run was our time to see the country, and we certainly took advantage of it.
Here is a link to the list of accepted demos for ASSETS 2015:
Friday, September 18, 2015
My First Week with the Kavita Project
First of all, I thank my predecessors and contemporaries in the project for all their work to date; and of course, Dr. Ordoñez for inviting me to contribute. Beyond a worthwhile endeavor in developing accessibility tools for programming, working with spoken interface software presents many opportunities for insight into how much more we can integrate computing into daily life.
Building on the progress of the past few years, I, along with Valerie and Andrea, have been configuring Simon to write code on behalf of us, instructed (mostly) by our voice. As we implement the recommendations of the previously administered survey, we're taking note of limitations as well as how to work around them in our effort to create something truly useful.
As well as using the previously set up Simon, I've been trying to get the program running in my computer - technical post to follow. I have run into some hurdles, but as these are worked around I'll learn more about Simon and a little about my computer as well.
This has been my first post, stay tuned for more.
Friday, August 28, 2015
Final Proposed Vocabulary and Grammar
A detailed survey was developed and administered with the purpose of gathering the
feedback from the programming community regarding alternative
options for the proposed vocabulary and grammar. The questions selected for the
survey represent an assortment of programming commands that
fall under each of the programming control flow structures: Sequential Structures; Decision or Conditional Structures, and
Looping or Repetitive Structures. The participants were students of Computer Science and Computer Engineering from the University of Puerto Rico and the Polytechnic University of Puerto Rico.
After performing a qualitative and quantitative analysis of the results obtained from the survey, which contains 10 questions (each one is a multiple choice featuring two or more possible verbalizations of the code and one write-in answer slot for alternative suggestions), a final version of the grammar and
vocabulary was proposed, and is presented in Table 1. It is expected to be embraced by the programming community.
The proposed voice command is written in bold, arial, and red, the
corresponding C++ code, as a consequence of the voice
command, in italics, bold, and black (this is the output produced
by the voice-recognition software in an editor), and variables and
literals presented in italics, and green.
Table 1: Final Proposed Vocabulary and Grammar
Programming structure
|
Voice commands
|
Variable definition
|
defining
integer variable
int ;
total
int total;
|
Standard output: literals
|
printing literal
cout << “ ”;
hello world
cout
<< “ hello world”;
|
Standard output: variables
|
printing
variable
cout << ;
total
cout << total;
|
Mathematical operations
|
printing
cout << ;
grouping
cout << () ;
total
adding 2
cout << ( total + 2 ) ;
moving
right, symbol frontslash 4
cout << ( total + 2 ) / 4 ;
|
Standard input
|
getting
input into variable total
cin >> total;
|
Modulus operations
|
total
modulus 3
total % 3
|
Relational operations
|
total
symbol greater than seven
total >
7
|
Logical operations
|
(statementA)
operating and
(statement) &&
negating
(statementB)
(statement) && !(statement)
|
Loops
|
inserting
for loop
for ( ; ; )
{
}
inserting
initiation (initializeExpression)
inserting
condition (conditionalExpression
inserting
modification (modifyExpression)
for ( initializeExpression; conditionalExpression;
modificationExpression)
{
}
entering
loop (statement(s))
for ( initializeExpression; conditionalExpression;
modificationExpression)
{
statement(s);
}
|
Conditionals
|
inserting
conditional
if()
{
}
inserting
condition total symbol greater than seven
if( total > 7)
{
}
printing
literal eight
if( total > 7)
{
cout << “8”;
}
else
printing literal six
if( total > 7)
{
cout << “8”;
}else
{
cout << “6”;
}
|
Tuesday, April 14, 2015
Prototype using for loop
Today, Jean K. and I finished implementing the vocabulary showed in an earlier post. We also made changes to the vocabulary by adding and eliminating some words, commands, sentences in Simon's Grammar module. During the implementation we create the commands necessary to create a program that would print the numbers from 0 to 9. Here is a video that we made showing the creation of this program.
Note: This video does not has sound because there was some technical difficulties when it was recorded.
Note: This video does not has sound because there was some technical difficulties when it was recorded.
Subscribe to:
Posts (Atom)