Q: Will more websites be supported going forward for review/comment scraping?
Or is the tool able to be customised for each individual site?
Am interested in using this to scrape forum posts for comments and run sentiment analysis on those comments. But each forum is structured differently with its own nuances.
Beybin_KimolaCognitive
May 15, 2024A: Hi John! Let me explain why we need to go and add mediums one by one, first:
- Most of the scraper tools have the problem of getting content because the scraper can't know which texts to get in a page, as there are too many of them. That is why, we are focused to go one by one and add main stream channels first. So when we support a medium, the extension knows where the reviews are and how to get it. After that, we might dive into forums. So keep connecting with us with your comments 🤩
To help you with that, I might have another solution. We often try other scrapers and write articles on how to use them. Here is one of the scrapers we like: https://kimola.com/cognitive/resources/how-to-generate-an-nlp-dataset-from-any-internet-source
When you have an .xls file, you're ready to drag & drop it to Cognitive dashboard to analyze content.
Also, I'd love to know which forums they are. Can you shoot me an e-mail with the forums list? beybin@kimola.com we have a very curious team 😇
Thank you for submitting! To keep our community as helpful as possible, we moderate all comments and reviews.
Hi John! Let me explain why we need to go and add mediums one by one, first:
- Most of the scraper tools have the problem of getting content because the scraper can't know which texts to get in a page, as there are too many of them. That is why, we are focused to go one by one and add main stream channels first. So when we support a medium, the extension knows where the reviews are and how to get it. After that, we might dive into forums. So keep connecting with us with your comments 🤩
To help you with that, I might have another solution. We often try other scrapers and write articles on how to use them. Here is one of the scrapers we like: https://kimola.com/cognitive/resources/how-to-generate-an-nlp-dataset-from-any-internet-source
When you have an .xls file, you're ready to drag & drop it to Cognitive dashboard to analyze content.
Also, I'd love to know which forums they are. Can you shoot me an e-mail with the forums list? beybin@kimola.com we have a very curious team 😇
jxhnHey Beybin thanks for such a helpful response. That is indeed an issue I've faced when using various web scraping tools for data extraction, and normally have to spend abit of time cleaning up the data before it is usable. Surprisingly enough, the Instant Data Scraper that you referred me to actually works perfectly for what I've been trying to do, with the least amount of cleaning required! Won't be much work to get the xls file ready to drop into the dashboard. This has very likely tipped me over the edge to grab a couple of codes and try out Kimola. Thanks again!
John, thank you for the positive vibes :) I'm looking forward to hear your honest reviews :)
Let me know if you need anything else, here is me: beybin@kimola.com
Hi John,
I've great news! We have increased our limits up to a MILLION! Starting from 100K, our limits are 10X higher now!
We love the Sumo-lings community, I hope this move shows our passion to become a lovemark! 🤩