Jump to content
  • Spotfire 7.11 brings highly requested improvements in data wrangling, cross tables, tables and maps, and it also makes the life of the Spotfire Administrator easier through improvements in scheduled updates and management of multiple Sites.

    Spotfire 7.11 brings highly requested improvements in data wrangling, cross tables, tables and maps, and it also makes the life of the Spotfire Administrator easier through improvements in scheduled updates and management of multiple Sites. Developers and application builders will enjoy the upgraded IronPython engine that now supports the latest (2.7.7) IronPython version.

    In addition to the new features, Spotfire 7.11 has been designated as a Long Term Support (LTS) version.  LTS versions are typically supported for up to 36 months from release. For LTS versions, defect corrections will typically be delivered as hotfixes or service packs while for regular releases they will be delivered in subsequent releases.

    Back to the What's New in Spotfire landing page.

    Visual Analytics

    Calculate the subtotals and grand totals in cross tables based on the aggregated values displayed in the cells

    It is now possible to configure the cross table to calculate subtotals and grand totals based on the aggregated values visualized in the table, as an option to calculating it using the underlying row level data. This is useful, for example, when you want to visualize the sum of the absolute values of the categories displayed in the table.

    CrossTables.thumb.png.cef2706a9a6c8f5d178afbd2bde9a825.png

    In the screenshot above, you can see the Properties dialog where you can select, for each column, whether to calculate the subtotal and grand total on the underlying row values, or as the sum of the values displayed in the cross table cells. This is useful, for example, when one wants to compare the sum of absolute values in the subtotals.

    Conditional color of the text in tables and cross tables

    It is now possible to color the text in tables and cross tables through color rules, as an alternative to coloring the cell background. This provides more freedom in the visual expression of the tables.

    2CrossTables.png.0fedb35216ea41f60d8cddce5ac979e1.png

    Search and zoom to a location

    You can now search for a geographic location on the map and quickly zoom in to its geographic area. When you start typing a location name, Spotfire suggests locations you can select to zoom to on the map.
     

    Switch data table now keeps the visualization configuration

    Visualizations will now keep their configuration when switching to another data table, provided that the new and the old data table include the same columns. This saves time when switching back and forth between identical tables. 

    Data wrangling

    Replace Data source

    As a Spotfire user, you are used to working with multiple data sources mashed together, to provide more answers from your data. With this release of Spotfire, you can easily replace one of those data sources with another data source, without compromising the data wrangling and data mashup you have done.

    Example: Going from test to production

    The picture below shows the source view in an analysis file. Three data sources are used and mashed together using Insert Columns (joins).

    The first data source is a linked data table containing sales sample data, stored in a local Spotfire Binary Data Format file (SalesOrderDetailSample.sbdf).

    By working with an alternative and local data source you can develop an analysis file without access to the production data source. This is convenient, for example, when working off-site, or, when you have work in progress that you do not want to introduce in your production environment (for performance reasons or for other reasons).

    Once you are ready to switch to the production data source, you can access the new replace data source feature from the data source menu in the source view:

    3SourceView.thumb.png.5505a49727c6953c98958b812af70b55.png

    The picture below shows the new Replace Data Source dialog. In this example, we select to switch to the corresponding data table in Microsoft SQL Server.

    4ReplaceDataSource.thumb.png.e54607efb7a16c1487f31320566840fe.png

    In the image below, the sample data source has been replaced. The data source type is now a data connection instead of an sbdf file.
     

    5SampleDataSource.thumb.png.2328ac24166126aed11167f778709496.png

    Add transformation to existing data source

    In addition to the capability to replace data sources, this release of Spotfire also enables you to add data transformations to existing data sources. Previously, data transformations could only be added when creating a new data source or when editing data transformations already part of the data source.

    There are certain situations when it's beneficial to attach transformations to data sources. The benefits are based on the fact that Spotfire doesn't save the original data in the analysis file, only the transformed result.

    Let's assume you prefer to store a copy of your data in your analysis file for it to be available offline and for you to be able to decide when a reload is needed. Let's also assume that you are loading 200M rows into Spotfire, and then defines an pivot data transformation to reduce the size of the data table. Having the pivot data transformation as part of the data source will only store the pivoted result table and discard the 200M original rows. This dramatically reduces the size of the analysis file. If the transformation was performed as a separate step, the original 200M rows would be stored.

    This will also reduce the loading time when opening the analysis, since the pivoted table is already available. If the transformation was performed as a separate step, the pivot operation would have had to be performed as part of loading the analysis file.

    Custom data transformations may also benefit from being performed as part of the data source.

    The image below shows the new access point to insert a transformation on a data source.

    6Newaccesspoint.thumb.png.ade3e2a6aacdf4adcc0a5664d7a67bfa.png

    Edit replace value transformations

    It is now possible to edit replaced values without creating additional transformation steps within the analysis. This means that you can go back and modify previously added replacement operations, if they are no longer applicable. By editing already created operations, you can avoid having a large number of transformations for replacing the same value over time, and make the analysis cleaner.

    The image below shows the entry point for editing two replace specific value transformations. Click the Edit button to open the new edit dialog.

    7EditDialogue.thumb.png.33690e9a15866f49513214cc4bd15eb0.png
    The image below shows the new edit dialog for Replace Specific Value:
     

    8EditDialog.thumb.png.c9301d146a35cd01845f12101c90dcc4.png

    Since we have replaced a specific value we have defined both a new value and a primary key column (PermitNumber). You can add more key columns and you can replace the currently used key column and/or value in the dialog.

    You can also insert a new replace value transformation (using the new Replace Value and Replace Specific Value dialogs) into an existing transformation group by clicking Insert in the Edit Transformations dialog:

    9EditTransformation.png.779bc1cf495e6ab3669f9331fb405ce2.png
     

    10Edittransformation.png.e9fcc106f72dc9d84118c9deb0ba84d9.png

    11ReplaceSpecificvalue.png.eabed09ba914a94709f8291752e7a311.png

    12ReplaceSpecificvalue.thumb.png.1f5a9df4f30e8569f5bfba6696d85a9b.png

    Edit relational data connection data sources from the source view

    Previously, Spotfire users had source view access to make quick changes to data connection configurations. This made it possible to add and remove tables and columns, add or modify custom queries, modify prompts, change column names and other settings that are part of data connections.

    With this release, it is just as easy to make changes to the data source used by the data connection. The data source holds information regarding source IP, authentication method, time-outs and database, which are all easy to modify now.

    For example, it has never been as easy to move from a test database to a production database. With a few clicks from the source view, you can now point the data source to another database, maybe even to a database with another type of authentication method. If different table names are used in the databases, for example, 'dbo.test.transaction' in the test database and 'dbo.prod.transaction' in the production database, Spotfire highlights these differences in the data connection and makes it easy to select the corresponding table in the production database.

    The image below shows a data connection data source being displayed in the source view. Click on the settings button (the gear icon) on the data source node to edit the data connection.

    13SalesorderDetail.thumb.png.c70b929b46ad62c33b0ead329af7a1cb.png
    The image below shows the Views in Connection dialog reached from the settings button (the gear icon). From here, you can enable full editing of the data connection by clicking the button in the lower left corner of the dialog.

    14SalesorderDetail.thumb.png.ccdc8217efbfa2464254f48caa4497d3.png

    The image below shows the new Edit Data Source Settings button. This is a new feature in 7.11 and provides a shortcut to editing your data source.

    15SalesOrderDetail.thumb.png.8f98d8b3e47fec76a9732cc9d61dc781.png

    The image below shows the Microsoft SQL Server Connection dialog which contains the settings for the connection data source. From here, it is easy to, for example, switch from a test to production server or database. You can also switch authentication method.

    16SQLServer.png.0ded62265e8a6733939fb4be5538ff04.png

    Data Access

    Option to query SAP BW directly towards the SAP BAPI API

    The SAP BW connector now has the option to query SAP BW using the native SAP BAPI API without going through the ODBO API used until today. If you choose to enable the BAPI API integration you can expect a boost in performance and more detailed messages from SAP BW should something go wrong. If you choose not to enable the BAPI API, the SAP BW connector will use the ODBO API as before.

    We are convinced that the BAPI API will provide a better user experience and allow us to develop new features over time. We have therefore decided to deprecate support for the ODBO API in a future Spotfire release. However, both APIs will be available for a period of time, to allow you to upgrade your SAP BW client driver installation to the BAPI API at your own pace.

    The image below shows the title of the SAP BW Connection dialog, where it is indicated that the SAP BAPI API is being used.

    17SAPBWConnection.png.51e46d00513c463e6a5e1bfadc26e5a5.png

    Load more than one million SAP BW data cells

    Note: This feature becomes available when you have enabled the SAP BW's BAPI API on Spotfire clients and servers. Please see the "Option to query SAP BW directly towards the SAP BAPI API" feature above for more details.

    SAP BW limits the number of non-empty cells that can be retrieved in metadata and in result data sets. This limit is configurable in SAP BW, and common limits are between 500k and 1M non-empty cells. By leveraging the SAP BW BAPI API, Spotfire is no longer dependent on this limitation and allows you to analyze more data than set by the limit. This means that you can connect to BEx queries representing more data, and thus extending the number of use cases you can implement with Spotfire.

    Only Spotfire administrators can enable this capability in the Spotfire platform.

    Specify SAP BW operation timeout

    It is common for SAP BW BEx queries to represent very large amounts of data. This means that Spotfire data import queries towards BEx queries sometimes need some extra time to complete. You can now increase the default 10 minute timeout as part of the SAP BW data connection. This allows you to import and analyze larger data volumes without queries timing out before your data is available.

    The images below show the SAP BW Connection dialog. Click the new Advanced tab to reach the operation timeout setting.

    18SAPBWConnection(ODBO).png.93cbc5ece3b426e43656ec4551c453fa.png

    Increased SAP HANA function support

    Spotfire's SAP HANA connector now supports the following additional functions: 

    Median

    Stddev_Pop

    Stddev_Samp

    Var_Pop

    Var_Samp

    Bitcount

    Months_Between

    Years_Between

    The image below shows a few of the new functions in Spotfire's Custom Expression user interface. Note that the details for how to use these functions are documented by SAP and are subject to change over time.

    19STDFunction.png.0cbc6a8328124dbfd664f44e51a7a348.png

    Support for new thrift transport modes in Apache Spark SQL

    Spotfire's connector for Apache Spark SQL now supports the thrift transport modes Binary, SASL and HTTP. Having the TLS security settings on the first page and turned on by default for new connections makes it quicker to configure your data connections in a secure way, for example, to Databricks data sources.

    20ApacheSpark.thumb.png.481187530a8c8da53149e3b360fbb8d2.png

    Support for Teradata 16

    The Teradata connector and Information Services now support Teradata 16.

    The images below show the different tabs available in the updated Teradata Connection dialog.


    21TeradataConnection.png.8377e3efa71fd381ae7bd6e4e42fb225.png

    22TeradataConnection.png.6a94ea1e2aa9a42e7be5030a44be9076.png

    23TeradataConnection.png.11148b65ac0576e9e663f4ee9dd9df65.png

    Spotfire Cloud access to data from TIBCO Spotfire Data Catalog in Spotfire Cloud Business Author and Consumer

    Analysis files opened in Spotfire Cloud Business Author and Consumer can now load data directly from publically available TIBCO Spotfire Data Catalogs.

    Analysis files are authored in Spotfire Analyst, saved to the Spotfire Cloud Library and are instantly available for Business Author and Consumer users.

    As a Business Author and Consumer user, you will receive fresh data when the analysis is opened. You can manually refresh data from individual data sources in the source view of Spotfire Business Author.

    The image below shows the library browser of the Spotfire Cloud web client.

    24LibraryBrowser.thumb.png.0e489a1b6c0395af5026639ea815e0e2.png


    User Feedback

    Recommended Comments

    There are no comments to display.


×
×
  • Create New...