Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

There are multiple internal tools I use at work (JIRA, our ticketing system, our code review tool) that won't work because of this issue.

In the meantime, I've written Tampermonkey scripts that will scrape and embedd multiple pages all hack-like, but at least I get a good CSV of the data I need.

To me, the value in this tool is the user interface for creating the scrape logic. If this ran as an embeddable JS app, that you could place inside any page and utilize local storage, you could scrape these dynamic sites by viewing the page first, and still get all of the cool gadetry provided by this tool.

In essence, the value of this tool could be built as a bookmarklet. THAT SIR - I would use every, single, day.



Great idea on the bookmarklet. I could see a tool for building custom readers with clippings from various sites. Say I want to organize JavaScript array patterns and ideas. Throw in a way to clip parts of my PDF books into this "reader" and you have an amazing product worth millions.


Can you explain this more, how do you see this being operated? See a pdf, clip it, create your own reader with your own clips?


Why would scrape JIRA when they have a perfectly workable API?


While their APIs are nice, they require separate permissions and having access to them isn't always a given depending on the company that runs/owns the Jira instance.


This. I also would rather just grab it in the browser instead of having to run a server or something else.


how would a bookmarklet be able to crawl & scrape a website?


You can have javascript code as a bookmarklet


yes I know that but how would you make it crawl links in your browser?




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: