PenPilot AI Reviews

I really wanted to love this product, but I couldn't.

No matter how hard I tried, the AI never created a complete blog.

I reached the point of correctly creating the outline, but when it came time to deliver the complete article, it only gave me the title.

I wrote to support a few days ago with no response.

I have no choice but to request a refund.

I already use other, general-purpose AIs (like Voila and ChatGPT). But I still glad to come across PenPilot, since – on paper – it seemed like a highly specialized, customizable writing assistant with a huge potential. So, I purchased the top tier immediately.

But when I started playing around with it, it became painfully clear that it still has a long way to go before it can become a useful tool in our arsenal. Here are some of the most frustrating issues I've come across:

1) Personas & instructions get ignored repeatedly – I've created a writing persona, gave detailed instructions regarding the style & format of the output, and provided an example. Despite all this, the output created by the AI felt boring, average – soulless, even – and NOTHING like what the persona I created might suggest. Same thing happened when I asked the AI to rewrite an article it created: it disregarded ALL my instructions, and just cranked out another version. Oh and my instructions regarding the approximate word count? There was a 35% difference!

2) The AI itself is slow – I know AI tools don't always respond to requests immediately, but I had to wait 10+ minutes for a rewrite... I mean, c'mon, it can't be THIS slow!

3) "Unable to process requests" – this error message (or something similar) has popped up multiple times throughout the ~90 minute testing session I had with the tool. It's possible that this was just a temporary glitch and I just chose a bad time to test PenPilot. But even if that is, in fact, the case, it was still frustrating.

4) Knowledge base feels unintuitive – in theory, a knowledge base sounds amazing! And it is, IF the AI can take full use of it. Unfortunately, that was not my experience with PenPilot. For one, once you create a category in the knowledge base, you can't delete it (or at least I couldn't figure out how to delete it). This means that if you accidentally create a duplicate category, you'll always be left guessing which one is the "real" one. Secondly, it seems the AI only uses ~80% of the knowledge base for the content it creates. I uploaded a single (!!!) 8-page pdf into my knowledge base, and the AI still left out key information from the article (despite me specifically telling it to include that information when I prompted it to rewrite the originally generated version).

5) The AI doesn't adjust & adapt: it doesn't seem to adapt to your style in real time. Now, this might be wishful thinking, but I'd like the AI to learn from each and every conversation I have with it; from each and every edit I make in the generated content; from each and every interaction – it needs to learn & adapt, otherwise it will always be stuck on the same – average – level. Currently, it doesn't seem like the AI is learning from ANY interaction. It just does the same thing over and over again with marginal changes – despite specific instructions, a detailed persona, and lots of manual editing.

6) It might be good in English, but it's pretty bad in other (smaller) languages. AI capabilities will always be behind in smaller languages – I know that. But when creating an article with PenPilot in another language, I was met with several weird sentence structures, grammatical errors, and even a few typos (!!!). Now, I get the weird sentence structures... I might even be understanding towards a few grammatical errors every now-and-then... But typos?! Seriously?

7) I don't get the SEO settings... It might just be me, but the current information under the SEO tab is too little to inform changes that need to be made to the article. Additionally, I though that once I gave it a primary keyword, the AI would automatically suggest modifications to achieve a better SEO-value. Clearly, I was wrong.

8) When I click "Rewrite content" (readability; plagarism; proofreading), it says the maximum character count for a prompt is 10,000 characters. Now, either don't offer the option to rewrite my article; of if you do, then make sure it works! Because now, I clicked on it only to discover that – apparently – I can't use this feature for long-form articles.

9) The tool has too much "noise". Look, not everyone will agree with me, but I was looking for a specialized writing assistant to help me craft better content, faster. Nothing else. I don't need image generation built in – I have other tools for that. I don't need a to-do list – I have other, specialized tools for that too. And if it's not going to help the AI create higher ranking content, then I don't need an SEO-checker either – again, I have far more capable, purpose-built tools for that too. I'd rather have PenPilot do one thing – and do it very, VERY well – than do multiple things at a mediocre level.

To summarize: the concept of PenPilot is great. And if they take my – and some other users' – feedback seriously, I believe it has the potential to turn into an irreplaceable writing assistant. But at the moment, it's just not there yet – far from it, actually.

I have used a handful of AI writing tools, and they all have their limitations. PenPilot AI is no different. It is, however, the best I've used because it allows you to upload knowledge bases. This is huge for steering the content of your writing. The more they expand this feature, the better the experience will be, especially for longer-form writing.

The personas have significant potential if they can add learning or expand the customizations you can make with them. The writing can get repetitive. For some reason, it had a run of (while writing casual, friendly, humorous) saying 'gather round' multiple times in an article and/or in back-to-back articles. It's not a phrase I would use once, let alone multiple times. Perhaps a way to block specific phrases/words for a particular persona would be helpful in this regard. If it learns what phrases you delete from your writing, that may help as well.

The outlines can be moved, tweaked, expanded, and streamlined before the AI takes off on the writing. It would be nice to be able to undo changes here. It was a user error, but I accidentally deleted a set of headings in the outline and was too trigger-happy. As a result, I accidentally deleted one additional heading beyond my original intent.

One of the reasons I've deleted so many headlines is that the AI-generated outlines tend to have too many. This results in short paragraphs with large headings in the output. Obviously, that is why you can delete headlines. With further development here, the long format will continue to improve.

The review processes are also a great touch. It offers 'Readability' that is tied to the age of your target audience. This tweaks how often you use 'big words' and complex thoughts. It has a 'Plagiarism' review, which I think is critical for any AI writing software (although not all have it). The last review is 'Proofread', which focuses on basic grammar and fundamentals essential for AI writing software.

I know I listed a lot of 'room for growth' items, but I genuinely believe this is a winner of a product. I look forward to seeing how they grow the AI.

I tested PenPilot AI with the new URL import and persona features I suggested, and the team actually added this very quickly. The import worked well, even pulling in a copy with images. The editor itself is easy to use, and I like having readability checks and plagiarism highlights built in. The reference documents make sense for adding context, and the plagiarism fix works smoothly.

That said, I was hoping it could automate plagiarism fixes directly from a shared URL and handle the full article rewrite through chat, instead of running the process step by step. This is something I can already do with my customised GPT setup, so I was expecting similar convenience here.

The bigger gap is with personas. It isn’t clearly explained or demonstrated how my active persona actually impacts the document output. In chat, responses seemed to reflect the persona’s tone and style, but once I switched to the editor, I couldn’t see the same influence. This inconsistency makes it hard to know when or where the persona is applied, which limits its usefulness.

On the plus side, support has been quick and responsive, which gives me confidence improvements will come.

Overall, PenPilot shows promise as an all-in-one writing tool, but personas need clearer and more consistent integration across chat, editor, and one-click fixes to fully deliver on the “human-like writing” promise with support of file upload for my own writing style and tone.