Yasemin Alpay Posted March 13 Share Posted March 13 Hi, I am using TIBCO StreamBase application. I want to work on a project where I will need the live currency price data from a website instantly. Is it possible to do webscrapping on StreamBase? Thank you in advanced. Link to comment Share on other sites More sharing options...
Glenn Hoskins Posted March 13 Share Posted March 13 Hi Yasemin, yes, theoretically that should be possible. You will need to use the HTTP Client operator to read the contents of the web page. If the page requires authentication then that's going to make things more complicated, but there are options for passing auth parameters through in the request. This will then need to be setup to poll on a sensible interval. The hard part will be parsing the contents of the page, and there won't be any out of the box way to do that. Often pages aren't even well-formed XHTML/XML so parsing using that operator might not be possible. So it's likely going to need a fair bit of custom processing to get the information you need. Link to comment Share on other sites More sharing options...
Eddie Galvez Posted March 14 Share Posted March 14 Try to identify if that live currency price data is available from a proper data feed of sorts - for example, https://fixer.io/ (note: we do not test, support or endorse that particular example), and using either a built-in adapter or a custom adapter, you would have a better more resilient application. Link to comment Share on other sites More sharing options...
evelynwilson Posted July 3 Share Posted July 3 On 3/13/2024 at 12:00 PM, Yasemin Alpay said: Hi, I am using TIBCO StreamBase application. I want to work on a project where I will need the live currency price data from a website instantly. Is it possible to do webscrapping on StreamBase? Thank you in advanced. Hello, Yes, you can implement web scraping using various approaches. One effective method involves using the HTTP Client Adapter to fetch live data from websites. Link to comment Share on other sites More sharing options...
Recommended Posts
Create an account or sign in to comment
You need to be a member in order to leave a comment
Create an account
Sign up for a new account in our community. It's easy!
Register a new accountSign in
Already have an account? Sign in here.
Sign In Now