VideoKheti- Video Search for Low-Literate Users

VideoKheti (CHI’13, DEV’13) is a multimodal video search system for low-literate farmers that combines local language speech, graphics and touch interaction to help find and watch agriculture extension videos (of digitalGreen (opens in new tab)), in the farmer’s own language and dialect. We investigate if the complementarity of speech, graphics and touch lead to a better experience for low-literate and novice users? And if it is even worth the extra cost in engineering (to build automatic speech recognition) and bandwidth for sustained use? Among other things results from our usability studies show that speech works best where there is a long list of choices and selections comprise of short familiar words and expressions.