Simesta AI is an innovative learning assistant application that harnesses the power of AI to create personalized learning experiences for users. It interacts with the user and determines the way they learn best and teaches them "ANY" course of their choice based on that learning method.
Presentation Slide: https://drive.google.com/file/d/1gamxJNKA5Jsjba6GpgWVW2zHp3YIMnpY/view?usp=sharing
Application Demo: https://youtu.be/SCLDU8HcGEk
This Organisation contains the all code for the Simesta application.
- Personalized Learning Paths: Users can input a course title (and optionally specify topics, and any relevant file ) and TrueLearn generates a tailored learning journey with both textual and video content.
- Text Generation: The application leverages the Gemini Pro model to create comprehensive textual learning materials.
- Image Generation: Using the Imagen model, TrueLearn provides visual aids in the form of images based on the learning content.
- Video Integration: By utilizing the YouTube API, TrueLearn incorporates relevant videos into the learning path.
- Secure Authentication: User access is protected through Google OAuth2 authorization and token-based authentication using JWT.
- Backend Framework: Python, FastAPI, Express, TypeScript
- Frontend Framework: TypeScript, React Native, Next.js
- AI Models:
- Text Generation: Gemini Pro, GPT-4o
- Image Generation: Imagen, Dall-e
- External API: YouTube Data API
- Authentication: Google OAuth2, JWT
- Role: Software Engineer (Mobile and Backend)
- Actions:
- Built the entire agentic server in python to create courses and answer question from natural language.
- Build socket server to power chat messaging
- Implemented speech to text logic using Azure Speech service to enable voice commands from the frontend.
- Role: Machine Learning engineer
- Actions:
- Prompt engineering to determine user's learning methods. To work on: LLM to provide course content.
-
Role: Software Engineer (Backend)
-
Actions:
- Implemented the creation of Topic Lectures which involves the use of a generative ai model to generate an array of lectures associated with a Topic.
- Worked on populating each lectures with lecture contents sufficient to help a user understand a topic by creating a set of idea content, image description(to explain the ideas better) and Quizzes as well.
- Role: Program Manager
- Actions:
- Oversaw team activities.
- Scheduled team meetings and monitored the progress of each member.
- Ensured team is up to date with all necessary information regarding the buildathon.
- Assisted in research and data gathering for the development of the team's project.
- role: Lead Engineer
- actions:
- Did the authentication of users
- Worked on the user module and its services
- Implemented the database setup with Prisma
- Had an oversight of the operation of the backend
- Role: Backend Engineer
- Implemented functions for creating courses based on input (titles, topics, and files) from users.
- Worked on the functions for retrieving courses from the database.
- Transferred and improved code from controllers to services during structural code changes.
- Interface from user signin and register
- Chat Interface to display communication with socket server to determine learning method
- Interface to create course(add subtopics and files)
- Interface to view created course content and learn
- Technologies: React Native Expo, Redux Toolkit, Socket client
git clone https://github.com/simesta-ai/repo-name
cd truelearnnpm installnpm run start:dev