f388df0d968c418c8fdfd206ee6b5606Q: I need the Claude 3 family of models for their longer context windows.
According to Antrophic, the context window for Claude Pro is 200k+ tokens (~350 pages of text). My prompt is short and simple, 1-2 sentences; basically to *rewrite/rephrase* a medical textbook (very technical, thousand pages) in simpler English. I am considering to use Sonnet or Opus through MERLIN, instead of thru Antrophic directly. I saw one of your team's reply mentioned that MERLIN is LESS suited for 'long-form' writing, so I want to ask what would you recommend about my use case? Whether MERLIN offers more (for my specific purpose) than what I would get from a regular Antrophic subscription? THANKS
Pratyush_Merlin
Jun 19, 2024A: Given feedback from community, we are planning to add a pay-as-you-go option without context window limitations that can allow for long form writing. This would be a zero-margin upgrade, that means that while you will pay for the API bills as a BYOK, Merlin won't take additional charges on top.
Regular Antrophic susbcriptions also can't offer larged context than 200k+ tokens. What we are planning to do is to let you add as much tokens as required so that you can chat with entire books and docs in one go.
Until we launch that, Gemini can be a better alternative for you that Claude. Given it has 1M token limit.
How long is the context window for CLAUDE? I figure that I could split up the textbook into sections and rewrite it in multiple Merlin sessions. Would you suggest uploading several PDFs? Or manually copy and pasting the text into your context window?
Typo: *How long is the context window for *MERLIN? not Claude. And do I get a warning when I exceed the context window for that particular LLM setting chosen on my MERLIN interface?
Yes, I too really do need the Anthropic / Claude API integration for many applications the Claude is way better than Open AI models. Please can you give this new feature priority please