AI Reading Reasearch Tool
Summary
Goal
Improve the experience of our target users—researchers—using DeepTutor, an AI-powered research reading tool.
What did I do
Discover users' needs
Design
Solely designed DeepTutor Desktop from 0 to 1.
Implement
Vibe code the frontend UI
Outcomes
Problem Discovery
Low conversion rate
only
5%
Low retention rate
7-day retention rate is only
12%
To improve users' experience, we interviewed 24 users, collected 120+ surveys, and use fake door questionnaires to discover users' pain points:


Survey

User Interview Result

Fake Door Questionnaire
Through the research, we discovered that 95% of users have used AI to assist reading, but their biggest pain point is that:


We've decided the direction of product: integrating DeepTutor AI agent with Zotero, the most commonly used paper reader among researchers.
Deciding Information Architecture
How might we combine an AI feature with a mature product?

We first decide where the DeepTutor AI agent should go in Zotero, which already have three panels and is already information heavy.
I analyzed the use cases of Zotero's left and right panel, and see the influence of not able to use the panel and DeepTutor simultaneously. It turns out that placing DeepTutor in the right panel has less negative influence.

Then, I use quick sketch to test several layouts, and view it with engineers and product managers.

We didn't choose this one because open four panels simultaneously is overwhelming.

This version is also passed, because putting DeepTutor in the second half of the right panel also looks very crowded.

I didn't chose this version because the overlapped DeepTutor panel may distract some information and interaction in the right and middle panel.

We chose this layout as the final version, where DeepTutor replace the entire right panel

Here is the final layout: Users can toggle between DeepTutor and the right panel by clicking on the DeepTutor icon.
Refining User Experience
How might we ensure good experience on entire journey?

Refining User Experience: Easy Entry
How might we simplify the start conversation steps?
Beta Version Problem: Start Conversations and Add Contexts is Complicated
Drag
Search
Solution: Simply Starting a Conversation
Solution: Simply Adding Context
Solution 1
Auto-add

Solution 2
Slash Command
As shown here, user type a slash, then, choose “add current paper as context,” hit enter, and the paper is instantly added.

Error rate

Learning curve

Time

Conclusion
Result
~5s
to
<1s
Beta Version: Users Dropoff While Generating Answers
Beta version testing shows that 28% of users leave the product before the first answer is generated. This is because:
The average generation time is 60 to 90 second, significantly longer than the waiting time users are comfortable with.
There is no clear progress indicator, and users cannot do any other actions while the answer is generating.
No progress indicator
Unable to take other actions while an answer is generating
Solution 1: Divide Generation Steps into Sub-steps
In the beta version, the answer is displayed only after the entire response, including citations and follow-up questions, has finished generating, resulting in wait times longer than users are comfortable with.
Show the entire answer
Show answer text
Show citation
Show follow-up questions
Solution 2: Clearer Indicator and User Control
I also add a clear progress indicator and give users more control while generating by
Clear progress indicator
Result
28%
4%
Refining User Experience: Trusted Output
How might we let users believe the answers are trustworthy ?
Our target users, researchers, has mentioned that, they really care about accuracy when reading papers, and biggest concern of using other AI tools is that AI hallucinate the answer. It also bother them because they cannot find where the answer come from, which bring them trouble since they want to quote something from original paper.


To meet their needs, I want to make sure that users can see the evidence of the answers. I design citation marks in the answer, so users can click on the citation to highlight where the answer comes from in the middle panel.
Result
77%
Redesigning User Interface
How might we design better interfaces?
Alongside iterating on the user experience, I continuously refined the interface as we evolved from beta to the final product. I focused on 2 aspects, showing information more effeciently and refining the aesthetic and consistency.

How might we show information more effective?
Beta version

large margin → less effective information shown
Final version

Smaller margin → more effective information shown
Beta version

What question I just asked???
Easy to lose track of the question asked
Final version

Question fixed on the top → can always refer to the question
Beta version

Session history page and conversation page is seperated, creating additional frictions.
Final version

Change session history as a pop-up in the conversational page, reducing the needs of switching back and forth.
How might we improve UI's aesthetic and consistency?
Beta version

The top tool bar of right panel is inconsistent with the middle and the left panel.
Final version

Make the right panel top tool bar visually consistent with the left and middle panels.
Implementation
How might we collaborate with the engineers and increase implementation efficiency?
Besides the design, I also participated in the implementation process. Since we want to launch the product from scratch in only three months, its important to keep the implementation progress fast.
Collaboration

I was in charge of reviewing the engineers' implementation and make sure it aligns with design. To ensure smooth collaboration, I also build a notion doc to track and prioritize bugs, assign bugs to the engineers, and track the process of fixing the bugs.
Detail-oriented vibe coding

I also use Cursor and Codex plugin to do vibe coding, solving some front-end UI/UX issues instead of rolling all issue to the engineer team. This way, the engineer team can focus on the more important bugs.

















