Conversational Desktop Concept based on SUSI.AI

[meets2tarun]

A new Meilix desktop concept based on deep conversational features integration.

Right now Linux Desktops do not provide conversational features as Windows or Mac OS X. Susi.Desktop adds those features to LXQt and possibly other Linux desktops. Minimum achievement of the project would be feature parity with the current device specific options of competitors and the provision of deep desktop integration and having a solid well-designed platform to make it become the best conversational desktop solution.

Recommended and required skills would be familiarity with the current Meilix code base and its build process, installation and hacking of Susi.AI components, deep insights into Linux desktop messaging standards, your ability to collaborate in teams using agile infrastructure, github and issue trackers, attention to details and quality of code, familiarity with the Fossasia coding standards.

fossasia/meilix#241

• SUSI.AI Desktop would be a FOSSASIA repository of its own that builds a Debian package using Travis CI.
• Meilix build script is modified to download and install the latest Susi.Desktop debian package.
• SUSI Desktop integrates with the desktop using Linux standard desktop messaging or desktop specific features. The Desktop it has to work with is LXQT as a proof of concept (but later extensible for KDE and others).
• SUSI.AI Desktop interacts with Susi.AI server component for all other queries.
• SUSI.AI Desktop provides local desktop functionality in par with Siri feature set, using local machine specific resources and knowledge and integrates with the desktop in a similar way as Microsoft Cortana into Windows.
• SUSI.AI Skills invoking device specific features like "Start Firefox", "Change my screen settings" are more important than anything that would be solved on the Susi.AI server side. It is not required to implement generic skills on the Susi.AI server side.
• Meilix is the reference platform for Susi.Desktop but not required. It should integrate seemingless with a LXQT desktop by installation of the package.
• Tests are provided.

Competitors available commands:

• Cortana https://www.windowscentral.com/comprehensive-list-cortana-voice-commands-windows-10-0
• Siri https://www.cnet.com/how-to/the-complete-list-of-siri-commands/

Prerequisite Knowledge/Programming languages

Linux Packaging, Python, C++, Shell

Possible Mentors

Norbert Preining, Andre Rebentisch, Harsh Lathwal, Tarun Kumar

[ssirowa]

@meets2tarun, I'm a Computer Science and Engineering Student at Indian Institute of Technology. I would like to work on this during GSoC. Can you help me get started.

[tabesin]

@ssirowa Cool, please develop your concept using the https://docs.google.com/document/d/1E4kNgrOSw64R2IAG45JSIgQL9Yxia-mG2dqlRcrUo-U/edit# guidelines and join the https://gitter.im/fossasia/meilix channel.

[abishekvashok]

Hey quick info, theres a PPA in meilix already to host such packages as these

[supreet11agrawal]

Hello @meets2tarun . I am quite interested in this idea. Can you please tell me about the work done in this area as I would like to take it further.

[supreet11agrawal]

@abishekvashok can u help?

[abishekvashok]

Please see the meilix repository

[ableabhinav]

Hi there! I am interested in doing this particular project. I would really like to do a project under SUSI, and this idea aligns with my interests. I had asked/discussed some things related to this project on the susi_linux gitter channel, and would like to add the same things here too:

1. The main goal of the project is developing a debian package SUSI;
2. That has deep desktop integration with a Linux Desktop;
3. Has features similar to competitors (lets consider Cortana);
4. And also integrates well with a desktop environment.

To do this project I need to have knowledge about: (Please Point me to additional reading if needed):

1. How SUSI.AI works - Client and Server Side
2. How Linux Message Passing works
3. How can I implement features of Cortana (+ Device features : "Open File Manager" + "Start Firefox")

Additionally, I found out about this open-source AI that might be useful: https://openassistant.org/

Please point me to additional things I might need to look into to do this project 😃

[d80ep08th]

Okay so I ended up here following the rabbit hole. Are there any updates on this ?