📍 Product Introduction

Eternal Tales: 멀티모달 AI 챗봇과의 대화를 통한 펫로스 극복 서비스

Eternal Tails is a service that helps people who experience loss by leaving their pets they have spent together as family members to experience and remember their precious daily lives with their pets again, and eventually to help their pets recover to a healthy daily life.

이터널 테일즈 는 가족 구성원으로서 함께 지낸 반려동물을 먼저 떠나보내면서 상실감을 경험하는 이들을 위해, 반려동물과 함께했던 소중한 일상을 다시금 경험 및 추억하고, 최종적으로는 이후 반려인이 다시 건강한 일상으로 회복할 수 있도록 보조하는 역할을 수행하는 서비스입니다.

📍 My contribution

AI Modelling ( Multi-modal Chatbot )

1. Task

Real-time Text and Image generation corresponding to user's message

2. Model

2.1. Text Generation: OpenAI GPT (Chat) API

• Making a chatting agent with user's pet information (user giving when joining the app).

2.2. Image Generation: Dreambooth Fast Stable Diffusion

• Using pre-training checkpoint: runwayml/stable-diffusion-v1-5
• Finetuning a model with user's 5 pet photos (user giving when joining the app).

3. Dataset (Demo Examples)

Dreambooth(kind of sd finetuning method) makes it possible to finetune the model with only a few images. Therefore, we do not use a large dataset. We only use data of 5 images for finetuning. Finetuning takes about 30 minutes. The finetuning outputs(ckpts) are as follows.

강아지 양파

1. Checkpoint: dhdbsrlw/pet-onion
2. Finetuning Images
(*src: Instagram @pom_onion)

강아지 제로

1. Checkpoint: dhdbsrlw/pet-zero
2. Finetuning Images
(*src: Google)

강아지 몽자

1. Checkpoint: dhdbsrlw/pet-monga
2. Finetuning Images
(*src: Instagram @mongja0408)

4. Generation Output

More generation outputs can be accessed in here !

---

(Last Update: 2024/02/10)
Contact: dhdbsrlw@korea.ac.kr