With the rapid development of speech recognition technologies being applied to smart home automation, people who are visually impaired are able to have promising lives at home comfortably. Recent studies [1-3] have shown that smart vocal interface at home can give a lot of assistance for people with visual impairment. They no longer need to rely on much assistance from other people in daily lives. This paper presents an ongoing framework design on a vocal interface control system for smart home automation. The system prototype is built from Jasper, an open source platform on a Raspberry Pi. The goal is to design a low-cost ubiquitous system for people with visual impairment to use voice commands accomplishing daily control tasks at home.