The idea is good - but the solution doesn't work for me
I'm a content creator and I do psychology vulgarisation.
I have a lot of worksheets, pdfs and books I need to be using - A LOT.
To prepare my videos and courses, I need to be able to explore this material FAST.
The problem: AFFORAI, even with the most advanced models, is entirely hallucinating.
For example, I ask "what are the protocols for procrastination given in the PDF" - I take the PDF, and the answer given by the AI is just NOT from the source, even when I ask specifically to take only in the book or when I try to craft a complete and specific prompt.
NotebookLM vs Afforai, "Sum up the content of chapter 3"
NotebookLM : Nails it
Afforai : Gives a random general summary of the ideas presented in the book - which, ChatpGPT without Afforai can already do.
So, well...
Maybe I'm just not the right target for this, and it's really just for researchers and paper-finding/sorting đ¤ˇđťââď¸
---
EDIT 06/12/2024 : Response to Alec.
I edit as a response to the owner's feedback.
Well, I understand that sometimes there can be some misunderstanding, but Afforai is pretty straightforward in that matter, while the UX is not super ergonomic, it's quite easy to figure out how to link the specific material I want to use Research Assistant with.
Well, after thorough tests, different prompts and approaches and reading the content you shared, I'm sorry to confirm that I have way better results with NotebookLM and even with ChatGPT.
Like, in my case OpenAI's GPT-4o does a better job at telling me the content of a book without material than Afforai with the book as an Epub or PDF.
What's most surprising to me, considering your value proposition, is that, in my tests, it was never able to quote exact chunks. And it was unable to pinpoint a specific chapter. (Where NotebookLM can)
So, I'm sorry, your response doesn't seem to be of good faith here by just questioning my ability to catch the most basic feature of the app and by saying that the main actors are also struggling when you use the models of these companies as a base, and for some reason, the results are still less accurate.
____
Second Edit 09/12/2024
Ok, gave it another chance and thought, "Well, it could still get better, let's see how it does with research sourcing, I could definitely use some of this to back my videos and enhance credibility.
For that, I was using Consensus.app - Google Scholars and CoPapers.
Well...
For some fact-checking as straight-forward as "Are there proofs of an existing comorbidity between High IQ and ADHD" - like, the literature exist, and the answer is pretty straight forward...
Believe it or not, the output was just a ChatGPT bullshit (worse with Sonnet 3.5) with an hyperlinked source at the end of the paragraph, here are the sources, it is simply unbelievable :
Brown, M. B. (2014). The Politics of Science before Scientism. Isis, 105, 164â166.
Best, E. (1982). Recent Foreign New Testament Literature. The Expository Times, 94, 75â80.
NO LINK Whatsoever with the topic!! đ¤Ł
So, yep, you can't say I didn't try, but that's a refund for me.
Alec_Afforai
Dec 3, 2024Hi there, thank you for writing your review on your experience with Afforai. Comments like this is how we improve the product for our users.
On that note though, I'd like to provide some thoughts if I understood you correctly.
With Document Retrieval mode in the Afforai Research Assistant, you can link multiple of your papers, pdfs, docs in your Afforai Library to serve as a knowledge base to help the Al generate the answers. And give visual data sources and citations where the Al got the information from. This Al mode would actually read the content of the files you connected to give you your sources-backed answers.
Did you by any chance forgot to connect your document to the AI assisant via the Document Retrieval mode? Because that's how you would the Afforai Research Assistant to dig into your PDFs. If you didn't connect your files to the AI then it would obviously not be able to give the answer you are looking for.
Check out our User Guide below. I'm confident it will be helpful to you:
https://help.afforai.com/en/articles/8478714-afforai-comprehensive-user-guide-with-videos
Regarding AI hallucination, it is something we are constantly working on and we have put a lot of information in the User Guide on how to reduce hallucination on the user side. Keep in mind, AI and LLMs have inherent limitations, that even billion dollar companies are working on to improve, including Microsoft, Google, OpenAI, etc. So, we do our best and do what we can in Afforai.