Accessing Data from SFTP or API with Spotfire

[Andrew McGowan]

Is there a way to access data directly from an SFTP or from a REST API in Spotfire? 

[Tejas Devadkar]

Hi Andrew,

 

Connecting directly to a REST / SOAP API or loading JSON data into an analysis file is not a feature available in Spotfire as of now. There are already a few enhancement requests submitted for that feature to be added, see the Spotfire Ideas Portal and vote for it.

Support JSON data
https://ideas.spotfire.com/ideas/TS-I-5837

Add "HTTP request" as a source for data tables 
https://ideas.spotfire.com/ideas/TS-I-5838

Better support of web services
https://ideas.spotfire.com/ideas/SPF-I-5061


However, there are some workarounds:
1. Use Data Virtualization (DV), 
2. ADS - Spotfire Advanced Data Services (which is basically DV, for Spotfire use ONLY) for a relatively low cost which will unlock access to virtually any data source.

DV is definitely the most secure and scalable option. These are a separate products/services. ADS, (DV) has support for consuming data through REST in a best-supported way.  You may get in touch with the Spotfire Account Manager for further information on this if this can solve your use case.

You may also raise a Support ticket with DV for more information on this.


Although you may try to make use of Spotfire Data Functions (Python/TERR) as a workaround to bring in data from a Web Service/ REST API's / JSON/XML files but that will require some sort of development efforts.
https://docs.tibco.com/pub/sfire-analyst/latest/doc/html/en-US/TIB_sfire-analyst_UsersGuide/index.htm#t=df%2Fdf_what_are_data_functions.htm&rhsearch=Data%20Function&rhsyns=%20


Some Additional ways,

You may also develop your own custom extension (custom data source) that suits your needs. For this, you may need to involve your C# developers or  you may contact your Spotfire Account Manager / Account Executive to discuss ways to involve professional assistance, partners or you may contact your Sales representative. 

Some other ways that I can think of are using 3rd party data pipelines. There are some other data pipelines as well, SO ideally you can import data from JSON ->> Data Pipelines -->> any Database (e.g SQL Server, oracle, etc) -->> Spotfire.  You can then connect to that end database from Spotfire and access your JSON data.

I could find some information on the Internet.  
https://pipes.datavirtuality.com/connectors/visualize/flat-file-xml-csv-json-etc/tibco-spotfire/
https://panoply.io/integrations/json/tibco-spotfire/

Thanks.

 

Edited September 13 by Tejas Devadkar

[Andrew McGowan]

Thanks Tejas! Can you provide more detail on how ADS can be used? Is there a recent implementation guidance documentation anywhere on integrating ADS and Spotfire? The most recent documentation I can find on the topic is over 5 years old. Specifically, is there any documentation for the implementation of using ADS to load data from an SFTP into Spotfire?

Thanks! 

[David Boot-Olazabal]

Hi Andrew,

Advanced Data Services (ADS) or TIBCO® Data Virtualization (TDV) is data virtualization software that lets you integrate data quickly and cost effectively. With ADS/TDV, you can build and manage virtualized views and data services that access, transform, and deliver the data your business requires to accelerate revenue, reduce costs, lessen risk, and improve compliance. ADS/TDV is:

•

Fast and Economical – Integrate data reliably at a fraction of the time, cost, and rigidity of physical warehousing and ETL. Evolve rapidly when requirements change.

•

Immediate – Deliver data as needed, using advanced performance optimization algorithms and fine-grained security.

•

Business-friendly – Transform native IT structures and syntax into easy-to-understand, IT-curated data sets sharable through a self-service business directory.

•

Wide-ranging – Access data from distributed data sources including traditional enterprise, big data, cloud, and IoT. Use it across myriad analytics, self-service, business intelligence and transactional applications.

•

Enterprise Grade – Support multiple lines of business, hundreds of projects and thousands of users.

Since ADS is the same product as DV (only to be used to pass data trough to Spotfire), you can find the relevant information here: https://docs.tibco.com/products/tibco-data-virtualization and the docs themselves here: https://docs.tibco.com/products/tibco-data-virtualization-8-8-0.

Not really sure what kind of information you look for related to SFTP, but let us know once you have more insights in how ADS could help you out.

Kind regards,

David