HackStack

Project Info

EchoTales

Devpost

Inspiration

The inspiration behind EchoTales came from a desire to create a truly engaging and nurturing reading experience for children. We wanted to combine the magic of storytelling with the power of AI to make stories not only more interactive but also emotionally supportive. We aim to create a comforting, personalized environment that adapts to each child’s unique reactions, fostering a love for reading and emotional growth.

What it does

EchoTales allows users to not only hear the story, but also interact with it aswell, through talking to the characters, creating voices for their favorite characters, and even jump to their favorite parts of a story. Dynamic Character Voices EchoTales uses AI to simulate character voices that change in tone, pitch, and emotion based on the story's plot and context. As the narrative progresses, characters express a range of emotions, making the story more vivid and engaging for children. This feature allows the app to deliver an immersive experience, bringing characters to life and capturing the child’s imagination. Dynamic Character Voices EchoTales uses AI to simulate character voices that change in tone, pitch, and emotion based on the story's plot and context. As the narrative progresses, characters express a range of emotions, making the story more vivid and engaging for children. This feature allows the app to deliver an immersive experience, bringing characters to life and capturing the child’s imagination. Voice Cloning EchoTales includes a voice cloning option, enabling parents or friends to narrate stories in familiar voices. This feature uses LMNT’s technology to create realistic voice replicas, making bedtime stories more comforting and personal. By hearing the voices of loved ones, children can feel more connected to the story, which helps create a sense of security and warmth during storytelling sessions. Voice Cloning EchoTales includes a voice cloning option, enabling parents or friends to narrate stories in familiar voices. This feature uses LMNT’s technology to create realistic voice replicas, making bedtime stories more comforting and personal. By hearing the voices of loved ones, children can feel more connected to the story, which helps create a sense of security and warmth during storytelling sessions. Interaction with Characters, Change Pace of Story Users are allowed to interact with the characters in the story, whether its figuring out the current events of the story, understanding the characters thought's behind their actions, also talking to the narrator aswell, and asking the narrator to jump to a certain section of the text. Interaction with Characters, Change Pace of Story Users are allowed to interact with the characters in the story, whether its figuring out the current events of the story, understanding the characters thought's behind their actions, also talking to the narrator aswell, and asking the narrator to jump to a certain section of the text.

How we built it

We developed EchoTales using TypeScript and React Native for the front end, ensuring a responsive and intuitive user interface for young users. The backend integrates LMNT for voice cloning and Hume AI for voice to voice interaction and narration, enabling dynamic voice adjustments and personalized audio interactions. This combination of technologies allows for a seamless, adaptive audiobook experience tailored to each child's emotional response.

Challenges we ran into

One challenge was figuring out how to allow multiple voices to be applied. For instance, if Character A is saying a dialogue, Character B would now have a dialogue after, but would require a different voice model to use. This was fixed through determining the total number of characters in a story so the creation of base voices will be dont at the beginning.

Accomplishments we're proud of

We're very proud of being able to apply applications that we are new to into our idea! And of course, being able to work as a team and planning the overall workflow in an effective manner.

What we learned

We learned a lot of new tools throughout this project and exploring how to integrate various API's such as Hume AI and LMNT.

What's next

We plan on adding an emotion sense technology that can determine the reactions of the reader throughout the story. The idea would be to integrate Hume AI’s emotion-sensing technology to detect children’s facial expressions during storytelling. If the system detects confusion, disinterest, or drowsiness, EchoTales can adjust the pacing, tone, or level of detail in real time. For example, if a child looks confused, the app pauses and offers a simpler explanation, while signs of drowsiness prompt a slower, more soothing narration. This adaptive feature ensures that the child remains engaged and receives appropriate emotional support throughout the story.

Analysis

Compare with all teams

View

Metric

Figures cover GitHub contributors during the hackathon window. A co-authored commit counts in full for each author, so per-member totals add up to more than the whole-team figures.

Technology

Found in codeClaimed only
  • JavaScriptIn code
  • PythonIn code
  • ReactIn code
  • TypeScriptIn code

4 of 4 appear in the indexed code.

AI coding agents

No AI coding agent signals were found in this repository.

Detected from committed agent config files and commit authorship. Absence of a signal is not proof an agent was unused.

Codebase size

Source size

32 KB

Source files

23

Counts recognized source files only; vendored directories, binaries and lockfiles are excluded, so this is smaller than the repository on disk.

0 stars